[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:21:28.686092 17568 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.40.62:33765
I20260709 12:21:28.687868 17568 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:21:28.689054 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:28.706099 17574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.706198 17575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:28.707489 17577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:28.708195 17568 server_base.cc:1061] running on GCE node
I20260709 12:21:29.916917 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:29.917213 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:29.917513 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599689917464 us; error 0 us; skew 500 ppm
I20260709 12:21:29.918524 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:29.924599 17568 webserver.cc:533] Webserver started at http://127.17.40.62:42117/ using document root <none> and password file <none>
I20260709 12:21:29.925635 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:29.925902 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:29.926498 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:29.933046 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/master-0-root/instance:
uuid: "af4887041edd4be1b71190e98e088038"
format_stamp: "Formatted at 2026-07-09 12:21:29 on dist-test-slave-tjfs"
I20260709 12:21:29.942152 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:21:29.948222 17583 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:29.949829 17568 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:21:29.950276 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/master-0-root
uuid: "af4887041edd4be1b71190e98e088038"
format_stamp: "Formatted at 2026-07-09 12:21:29 on dist-test-slave-tjfs"
I20260709 12:21:29.950766 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:30.020744 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:30.022606 17568 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:21:30.023169 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:30.101992 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.62:33765
I20260709 12:21:30.102064 17634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.62:33765 every 8 connection(s)
I20260709 12:21:30.110697 17635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.134689 17635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038: Bootstrap starting.
I20260709 12:21:30.141247 17635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.143388 17635 log.cc:826] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038: Log is configured to *not* fsync() on all Append() calls
I20260709 12:21:30.148577 17635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038: No bootstrap required, opened a new log
I20260709 12:21:30.170099 17635 raft_consensus.cc:359] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4887041edd4be1b71190e98e088038" member_type: VOTER }
I20260709 12:21:30.170804 17635 raft_consensus.cc:385] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.171087 17635 raft_consensus.cc:740] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4887041edd4be1b71190e98e088038, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.172081 17635 consensus_queue.cc:260] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4887041edd4be1b71190e98e088038" member_type: VOTER }
I20260709 12:21:30.172679 17635 raft_consensus.cc:399] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:30.173014 17635 raft_consensus.cc:493] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:30.173381 17635 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.177878 17635 raft_consensus.cc:515] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4887041edd4be1b71190e98e088038" member_type: VOTER }
I20260709 12:21:30.178805 17635 leader_election.cc:304] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af4887041edd4be1b71190e98e088038; no voters: 
I20260709 12:21:30.180691 17635 leader_election.cc:290] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:30.181233 17638 raft_consensus.cc:2804] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.184190 17638 raft_consensus.cc:697] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 1 LEADER]: Becoming Leader. State: Replica: af4887041edd4be1b71190e98e088038, State: Running, Role: LEADER
I20260709 12:21:30.185247 17638 consensus_queue.cc:237] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4887041edd4be1b71190e98e088038" member_type: VOTER }
I20260709 12:21:30.186333 17635 sys_catalog.cc:565] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:30.200969 17639 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af4887041edd4be1b71190e98e088038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4887041edd4be1b71190e98e088038" member_type: VOTER } }
I20260709 12:21:30.201386 17640 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af4887041edd4be1b71190e98e088038. Latest consensus state: current_term: 1 leader_uuid: "af4887041edd4be1b71190e98e088038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4887041edd4be1b71190e98e088038" member_type: VOTER } }
I20260709 12:21:30.202127 17639 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:30.202318 17640 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:30.206125 17647 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:30.220345 17647 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:30.223096 17568 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:30.241508 17647 catalog_manager.cc:1383] Generated new cluster ID: f3152de60f1c4be881d27c39f471bc4c
I20260709 12:21:30.241884 17647 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:30.278576 17647 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:30.280915 17647 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:30.299567 17647 catalog_manager.cc:6070] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038: Generated new TSK 0
I20260709 12:21:30.300710 17647 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:30.355031 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:30.364917 17657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:30.366221 17658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:30.370535 17568 server_base.cc:1061] running on GCE node
W20260709 12:21:30.370865 17660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:30.372058 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:30.372364 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:30.372582 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599690372564 us; error 0 us; skew 500 ppm
I20260709 12:21:30.373466 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:30.378139 17568 webserver.cc:533] Webserver started at http://127.17.40.1:34575/ using document root <none> and password file <none>
I20260709 12:21:30.379001 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:30.379284 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:30.379657 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:30.381323 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-0-root/instance:
uuid: "e35f84c8056d49bda99c1a5bae7d2679"
format_stamp: "Formatted at 2026-07-09 12:21:30 on dist-test-slave-tjfs"
I20260709 12:21:30.389021 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:21:30.394809 17665 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.395866 17568 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:21:30.396275 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "e35f84c8056d49bda99c1a5bae7d2679"
format_stamp: "Formatted at 2026-07-09 12:21:30 on dist-test-slave-tjfs"
I20260709 12:21:30.396697 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:30.418994 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:30.420881 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:30.423866 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:30.430024 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:30.430429 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.430822 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:30.431052 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.544327 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:36481
I20260709 12:21:30.544487 17727 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:36481 every 8 connection(s)
I20260709 12:21:30.552742 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:30.563761 17732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:30.565876 17733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:30.574596 17568 server_base.cc:1061] running on GCE node
W20260709 12:21:30.575090 17735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:30.576330 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:30.576690 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:30.576924 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599690576899 us; error 0 us; skew 500 ppm
I20260709 12:21:30.577674 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:30.581899 17568 webserver.cc:533] Webserver started at http://127.17.40.2:37875/ using document root <none> and password file <none>
I20260709 12:21:30.582728 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:30.583036 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:30.583421 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:30.584836 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-1-root/instance:
uuid: "2a96610b2690477ba2a3f2f7186a097e"
format_stamp: "Formatted at 2026-07-09 12:21:30 on dist-test-slave-tjfs"
I20260709 12:21:30.585413 17728 heartbeater.cc:344] Connected to a master server at 127.17.40.62:33765
I20260709 12:21:30.585964 17728 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:30.587479 17728 heartbeater.cc:507] Master 127.17.40.62:33765 requested a full tablet report, sending...
I20260709 12:21:30.591791 17600 ts_manager.cc:194] Registered new tserver with Master: e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481)
I20260709 12:21:30.593448 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.004s
I20260709 12:21:30.595315 17600 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51360
I20260709 12:21:30.598861 17740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.600039 17568 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:21:30.600397 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-1-root
uuid: "2a96610b2690477ba2a3f2f7186a097e"
format_stamp: "Formatted at 2026-07-09 12:21:30 on dist-test-slave-tjfs"
I20260709 12:21:30.600807 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:30.620326 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:30.621815 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:30.624204 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:30.627656 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:30.627930 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.628217 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:30.628409 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.734408 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.2:44519
I20260709 12:21:30.734560 17802 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.2:44519 every 8 connection(s)
I20260709 12:21:30.741489 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:30.753234 17806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:30.757021 17807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:30.757911 17803 heartbeater.cc:344] Connected to a master server at 127.17.40.62:33765
I20260709 12:21:30.758468 17803 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:30.759816 17803 heartbeater.cc:507] Master 127.17.40.62:33765 requested a full tablet report, sending...
I20260709 12:21:30.763355 17600 ts_manager.cc:194] Registered new tserver with Master: 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:30.765373 17600 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51370
W20260709 12:21:30.765826 17809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:30.769512 17568 server_base.cc:1061] running on GCE node
I20260709 12:21:30.770642 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:30.770888 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:30.771096 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599690771073 us; error 0 us; skew 500 ppm
I20260709 12:21:30.771699 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:30.774878 17568 webserver.cc:533] Webserver started at http://127.17.40.3:43497/ using document root <none> and password file <none>
I20260709 12:21:30.775445 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:30.775674 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:30.775990 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:30.777122 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-2-root/instance:
uuid: "edade32f911b4eafb025543e30817b0c"
format_stamp: "Formatted at 2026-07-09 12:21:30 on dist-test-slave-tjfs"
I20260709 12:21:30.782500 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:21:30.786517 17814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.787477 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:30.787832 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-2-root
uuid: "edade32f911b4eafb025543e30817b0c"
format_stamp: "Formatted at 2026-07-09 12:21:30 on dist-test-slave-tjfs"
I20260709 12:21:30.788173 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599688508335-17568-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:30.823356 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:30.824704 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:30.826304 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:30.828512 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:30.828766 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.829020 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:30.829206 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:30.937279 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.3:34419
I20260709 12:21:30.937465 17876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.3:34419 every 8 connection(s)
I20260709 12:21:30.958266 17877 heartbeater.cc:344] Connected to a master server at 127.17.40.62:33765
I20260709 12:21:30.958794 17877 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:30.959715 17877 heartbeater.cc:507] Master 127.17.40.62:33765 requested a full tablet report, sending...
I20260709 12:21:30.962076 17600 ts_manager.cc:194] Registered new tserver with Master: edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:30.962821 17568 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020012756s
I20260709 12:21:30.963966 17600 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51378
I20260709 12:21:31.022742 17600 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51390:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:31.026791 17600 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:31.137648 17842 tablet_service.cc:1511] Processing CreateTablet for tablet 8be31e8908d94753915421aa61e4064f (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:31.151095 17841 tablet_service.cc:1511] Processing CreateTablet for tablet 703f83feacac4d6eb53045d6b494fb04 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:31.154317 17842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8be31e8908d94753915421aa61e4064f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.150148 17839 tablet_service.cc:1511] Processing CreateTablet for tablet 10536ff303d440aa828e5200507989c4 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:31.154961 17837 tablet_service.cc:1511] Processing CreateTablet for tablet 0782b29c294943ba99ebaf5ffb57dca5 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:31.149708 17840 tablet_service.cc:1511] Processing CreateTablet for tablet e7a4e502cd9e41e89db84bbbf8707840 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:31.149708 17838 tablet_service.cc:1511] Processing CreateTablet for tablet 8517c95cc00f4e3883d586915b1bf873 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:31.158528 17836 tablet_service.cc:1511] Processing CreateTablet for tablet 89cb7d865af442b7a5164492a4c382cf (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:31.159302 17841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703f83feacac4d6eb53045d6b494fb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.162734 17840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a4e502cd9e41e89db84bbbf8707840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.166838 17839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10536ff303d440aa828e5200507989c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.169250 17837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0782b29c294943ba99ebaf5ffb57dca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.169152 17835 tablet_service.cc:1511] Processing CreateTablet for tablet 44c9a2becaa0413096cba58b92ec9702 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:31.178637 17836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89cb7d865af442b7a5164492a4c382cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.188664 17835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c9a2becaa0413096cba58b92ec9702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.203114 17692 tablet_service.cc:1511] Processing CreateTablet for tablet 703f83feacac4d6eb53045d6b494fb04 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:31.201434 17838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8517c95cc00f4e3883d586915b1bf873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.200618 17690 tablet_service.cc:1511] Processing CreateTablet for tablet 10536ff303d440aa828e5200507989c4 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:31.200693 17693 tablet_service.cc:1511] Processing CreateTablet for tablet 8be31e8908d94753915421aa61e4064f (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:31.225282 17692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703f83feacac4d6eb53045d6b494fb04. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:31.225401 17648 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:31.228190 17693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8be31e8908d94753915421aa61e4064f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.229979 17690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10536ff303d440aa828e5200507989c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.236816 17767 tablet_service.cc:1511] Processing CreateTablet for tablet 703f83feacac4d6eb53045d6b494fb04 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:31.240515 17688 tablet_service.cc:1511] Processing CreateTablet for tablet 0782b29c294943ba99ebaf5ffb57dca5 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:31.244875 17834 tablet_service.cc:1511] Processing CreateTablet for tablet 5281784b0bab461a8635c66333e01cfd (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:31.246938 17834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5281784b0bab461a8635c66333e01cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.250660 17767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703f83feacac4d6eb53045d6b494fb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.233721 17689 tablet_service.cc:1511] Processing CreateTablet for tablet 8517c95cc00f4e3883d586915b1bf873 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:31.254536 17689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8517c95cc00f4e3883d586915b1bf873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.243852 17768 tablet_service.cc:1511] Processing CreateTablet for tablet 8be31e8908d94753915421aa61e4064f (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:31.231973 17691 tablet_service.cc:1511] Processing CreateTablet for tablet e7a4e502cd9e41e89db84bbbf8707840 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:31.258960 17768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8be31e8908d94753915421aa61e4064f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.261852 17688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0782b29c294943ba99ebaf5ffb57dca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.265514 17691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a4e502cd9e41e89db84bbbf8707840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.284893 17766 tablet_service.cc:1511] Processing CreateTablet for tablet e7a4e502cd9e41e89db84bbbf8707840 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:31.287803 17765 tablet_service.cc:1511] Processing CreateTablet for tablet 10536ff303d440aa828e5200507989c4 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:31.285032 17764 tablet_service.cc:1511] Processing CreateTablet for tablet 8517c95cc00f4e3883d586915b1bf873 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:31.290139 17766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a4e502cd9e41e89db84bbbf8707840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.290741 17687 tablet_service.cc:1511] Processing CreateTablet for tablet 89cb7d865af442b7a5164492a4c382cf (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:31.292174 17687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89cb7d865af442b7a5164492a4c382cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.294922 17765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10536ff303d440aa828e5200507989c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.299072 17764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8517c95cc00f4e3883d586915b1bf873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.312268 17686 tablet_service.cc:1511] Processing CreateTablet for tablet 44c9a2becaa0413096cba58b92ec9702 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:31.321050 17685 tablet_service.cc:1511] Processing CreateTablet for tablet 5281784b0bab461a8635c66333e01cfd (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:31.343489 17895 tablet_bootstrap.cc:492] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:31.341364 17686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c9a2becaa0413096cba58b92ec9702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.375396 17763 tablet_service.cc:1511] Processing CreateTablet for tablet 0782b29c294943ba99ebaf5ffb57dca5 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:31.377652 17763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0782b29c294943ba99ebaf5ffb57dca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.394905 17685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5281784b0bab461a8635c66333e01cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.392278 17762 tablet_service.cc:1511] Processing CreateTablet for tablet 89cb7d865af442b7a5164492a4c382cf (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:31.405646 17761 tablet_service.cc:1511] Processing CreateTablet for tablet 44c9a2becaa0413096cba58b92ec9702 (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:31.408751 17760 tablet_service.cc:1511] Processing CreateTablet for tablet 5281784b0bab461a8635c66333e01cfd (DEFAULT_TABLE table=test-workload [id=98fc06d25d0d41369dc8eda1fcb5bd56]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:31.411919 17761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c9a2becaa0413096cba58b92ec9702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.418895 17762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89cb7d865af442b7a5164492a4c382cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.422307 17760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5281784b0bab461a8635c66333e01cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.501271 17895 tablet_bootstrap.cc:654] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.557854 17897 tablet_bootstrap.cc:492] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:31.563668 17896 tablet_bootstrap.cc:492] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:31.603256 17728 heartbeater.cc:499] Master 127.17.40.62:33765 was elected leader, sending a full tablet report...
I20260709 12:21:31.617228 17895 tablet_bootstrap.cc:492] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:31.628356 17896 tablet_bootstrap.cc:654] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.625741 17895 ts_tablet_manager.cc:1403] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.285s	user 0.002s	sys 0.040s
I20260709 12:21:31.653584 17897 tablet_bootstrap.cc:654] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.661288 17895 raft_consensus.cc:359] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.662519 17895 raft_consensus.cc:385] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.662950 17895 raft_consensus.cc:740] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.664163 17895 consensus_queue.cc:260] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.665031 17896 tablet_bootstrap.cc:492] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:31.666188 17896 ts_tablet_manager.cc:1403] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.123s	user 0.008s	sys 0.013s
I20260709 12:21:31.668004 17897 tablet_bootstrap.cc:492] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:31.668479 17897 ts_tablet_manager.cc:1403] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.008s
I20260709 12:21:31.669399 17896 raft_consensus.cc:359] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.670238 17896 raft_consensus.cc:385] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.670589 17896 raft_consensus.cc:740] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.671908 17877 heartbeater.cc:499] Master 127.17.40.62:33765 was elected leader, sending a full tablet report...
I20260709 12:21:31.672024 17896 consensus_queue.cc:260] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.672672 17895 ts_tablet_manager.cc:1434] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.008s
I20260709 12:21:31.672075 17897 raft_consensus.cc:359] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.673053 17897 raft_consensus.cc:385] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.673362 17897 raft_consensus.cc:740] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.673782 17895 tablet_bootstrap.cc:492] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:31.674310 17897 consensus_queue.cc:260] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.681579 17897 ts_tablet_manager.cc:1434] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:21:31.681998 17895 tablet_bootstrap.cc:654] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.683370 17803 heartbeater.cc:499] Master 127.17.40.62:33765 was elected leader, sending a full tablet report...
I20260709 12:21:31.684321 17896 ts_tablet_manager.cc:1434] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 12:21:31.685361 17896 tablet_bootstrap.cc:492] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:31.688843 17897 tablet_bootstrap.cc:492] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:31.692998 17896 tablet_bootstrap.cc:654] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.694550 17895 tablet_bootstrap.cc:492] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:31.695204 17895 ts_tablet_manager.cc:1403] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.002s
W20260709 12:21:31.699955 17878 tablet.cc:2406] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:31.703500 17895 raft_consensus.cc:359] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:31.704294 17895 raft_consensus.cc:385] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.704684 17897 tablet_bootstrap.cc:654] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.704649 17895 raft_consensus.cc:740] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.705534 17895 consensus_queue.cc:260] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:31.709709 17895 ts_tablet_manager.cc:1434] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:21:31.710912 17895 tablet_bootstrap.cc:492] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:31.711016 17896 tablet_bootstrap.cc:492] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:31.718885 17896 ts_tablet_manager.cc:1403] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.011s
I20260709 12:21:31.719280 17895 tablet_bootstrap.cc:654] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.722285 17896 raft_consensus.cc:359] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.723390 17896 raft_consensus.cc:385] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.723793 17896 raft_consensus.cc:740] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.724911 17896 consensus_queue.cc:260] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.728905 17897 tablet_bootstrap.cc:492] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:31.729457 17897 ts_tablet_manager.cc:1403] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.001s
I20260709 12:21:31.732612 17897 raft_consensus.cc:359] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.733342 17897 raft_consensus.cc:385] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.733603 17897 raft_consensus.cc:740] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.734458 17897 consensus_queue.cc:260] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.736299 17896 ts_tablet_manager.cc:1434] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:21:31.737345 17896 tablet_bootstrap.cc:492] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:31.744025 17897 ts_tablet_manager.cc:1434] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:21:31.745267 17897 tablet_bootstrap.cc:492] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:31.752913 17896 tablet_bootstrap.cc:654] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.759477 17897 tablet_bootstrap.cc:654] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.772135 17896 tablet_bootstrap.cc:492] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:31.772727 17896 ts_tablet_manager.cc:1403] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.003s
I20260709 12:21:31.774147 17895 tablet_bootstrap.cc:492] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:31.774446 17897 tablet_bootstrap.cc:492] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:31.774856 17895 ts_tablet_manager.cc:1403] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.011s
I20260709 12:21:31.774953 17897 ts_tablet_manager.cc:1403] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.003s
I20260709 12:21:31.775960 17896 raft_consensus.cc:359] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.776747 17896 raft_consensus.cc:385] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.777076 17896 raft_consensus.cc:740] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.778028 17896 consensus_queue.cc:260] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.778441 17895 raft_consensus.cc:359] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.780902 17896 ts_tablet_manager.cc:1434] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:31.780977 17895 raft_consensus.cc:385] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.781481 17895 raft_consensus.cc:740] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.782080 17896 tablet_bootstrap.cc:492] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:31.782367 17895 consensus_queue.cc:260] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.785151 17895 ts_tablet_manager.cc:1434] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:21:31.787086 17895 tablet_bootstrap.cc:492] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:31.778698 17897 raft_consensus.cc:359] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.793089 17897 raft_consensus.cc:385] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.793473 17897 raft_consensus.cc:740] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.794570 17896 tablet_bootstrap.cc:654] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.794242 17897 consensus_queue.cc:260] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.796643 17897 ts_tablet_manager.cc:1434] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.003s
I20260709 12:21:31.799669 17895 tablet_bootstrap.cc:654] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.799876 17897 tablet_bootstrap.cc:492] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:31.808645 17897 tablet_bootstrap.cc:654] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.809681 17902 raft_consensus.cc:493] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.810418 17902 raft_consensus.cc:515] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.820060 17895 tablet_bootstrap.cc:492] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:31.820681 17895 ts_tablet_manager.cc:1403] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.010s
I20260709 12:21:31.824872 17902 leader_election.cc:290] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:31.829531 17895 raft_consensus.cc:359] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.830332 17895 raft_consensus.cc:385] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.830677 17895 raft_consensus.cc:740] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.831439 17895 consensus_queue.cc:260] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.833680 17895 ts_tablet_manager.cc:1434] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:31.834748 17895 tablet_bootstrap.cc:492] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:31.850754 17901 raft_consensus.cc:493] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.851356 17901 raft_consensus.cc:515] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.867976 17901 leader_election.cc:290] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:31.884277 17895 tablet_bootstrap.cc:654] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.906731 17896 tablet_bootstrap.cc:492] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:31.907470 17896 ts_tablet_manager.cc:1403] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.126s	user 0.026s	sys 0.042s
I20260709 12:21:31.916126 17896 raft_consensus.cc:359] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.918102 17896 raft_consensus.cc:385] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.918470 17896 raft_consensus.cc:740] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.919582 17897 tablet_bootstrap.cc:492] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:31.919198 17896 consensus_queue.cc:260] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.920116 17897 ts_tablet_manager.cc:1403] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.120s	user 0.021s	sys 0.029s
I20260709 12:21:31.932041 17901 raft_consensus.cc:493] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.934652 17896 ts_tablet_manager.cc:1434] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:21:31.934530 17901 raft_consensus.cc:515] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:31.936108 17896 tablet_bootstrap.cc:492] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:31.960330 17901 leader_election.cc:290] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:31.962221 17903 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.963292 17901 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.964776 17902 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.963639 17903 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.964926 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:31.965833 17902 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.965417 17901 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.969313 17902 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
W20260709 12:21:31.970007 17667 leader_election.cc:343] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:31.975374 17901 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:31.975811 17903 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:31.977028 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:31.977306 17897 raft_consensus.cc:359] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:31.978906 17897 raft_consensus.cc:385] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:31.979261 17897 raft_consensus.cc:740] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:31.991406 17895 tablet_bootstrap.cc:492] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:31.992178 17895 ts_tablet_manager.cc:1403] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.158s	user 0.018s	sys 0.005s
I20260709 12:21:32.003789 17896 tablet_bootstrap.cc:654] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:31.990880 17897 consensus_queue.cc:260] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.006297 17897 ts_tablet_manager.cc:1434] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.075s	user 0.015s	sys 0.000s
I20260709 12:21:32.012920 17897 tablet_bootstrap.cc:492] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:32.006556 17895 raft_consensus.cc:359] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
W20260709 12:21:32.020292 17667 leader_election.cc:343] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.019577 17895 raft_consensus.cc:385] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.021483 17895 raft_consensus.cc:740] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.025271 17895 consensus_queue.cc:260] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.028573 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.029598 17778 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 0.
I20260709 12:21:32.037421 17895 ts_tablet_manager.cc:1434] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 12:21:32.036468 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.042702 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.048739 17895 tablet_bootstrap.cc:492] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:32.047171 17903 raft_consensus.cc:493] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.051808 17903 raft_consensus.cc:515] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.051483 17703 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 0.
I20260709 12:21:32.050585 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.062021 17816 leader_election.cc:304] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.064332 17901 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.063127 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.065019 17901 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.066578 17777 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 0.
I20260709 12:21:32.069703 17901 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.065876 17903 leader_election.cc:290] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.062341 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
W20260709 12:21:32.072357 17815 leader_election.cc:343] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.072304 17901 raft_consensus.cc:2804] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.075377 17901 raft_consensus.cc:493] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.077250 17901 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:32.080170 17815 leader_election.cc:343] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.080415 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.085301 17702 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 0.
I20260709 12:21:32.093191 17815 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
W20260709 12:21:32.093730 17816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:44519, user_credentials={real_user=slave}} blocked reactor thread for 50482.5us
I20260709 12:21:32.096494 17852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.096891 17902 raft_consensus.cc:493] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.101722 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.098462 17902 raft_consensus.cc:515] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.096949 17851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
W20260709 12:21:32.101245 17816 leader_election.cc:343] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.111758 17896 tablet_bootstrap.cc:492] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:32.107123 17927 raft_consensus.cc:2804] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.112336 17816 leader_election.cc:304] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edade32f911b4eafb025543e30817b0c; no voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:32.121357 17851 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 0.
I20260709 12:21:32.123296 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.126883 17849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.127157 17850 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 0.
I20260709 12:21:32.127226 17896 ts_tablet_manager.cc:1403] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.191s	user 0.018s	sys 0.028s
I20260709 12:21:32.129257 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.129667 17902 leader_election.cc:290] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.129953 17777 raft_consensus.cc:2468] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 0.
I20260709 12:21:32.124562 17927 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:32.133042 17742 leader_election.cc:343] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edade32f911b4eafb025543e30817b0c (127.17.40.3:34419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.134017 17897 tablet_bootstrap.cc:654] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.131769 17927 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.134333 17849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.133872 17901 raft_consensus.cc:515] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.137485 17895 tablet_bootstrap.cc:654] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.135020 17816 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:32.136986 17667 leader_election.cc:304] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:32.137720 17742 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.140152 17928 raft_consensus.cc:2749] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.142325 17852 raft_consensus.cc:2393] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e35f84c8056d49bda99c1a5bae7d2679 in current term 1: Already voted for candidate edade32f911b4eafb025543e30817b0c in this term.
I20260709 12:21:32.142268 17903 raft_consensus.cc:2804] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.142755 17903 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.143170 17903 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:32.143505 17667 leader_election.cc:343] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edade32f911b4eafb025543e30817b0c (127.17.40.3:34419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.141645 17902 raft_consensus.cc:2804] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.143630 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.145555 17902 raft_consensus.cc:493] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.146294 17902 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.142710 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.144698 17928 raft_consensus.cc:2804] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:32.149927 17741 leader_election.cc:343] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:32.150231 17816 leader_election.cc:343] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.149861 17896 raft_consensus.cc:359] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.149480 17928 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.151522 17896 raft_consensus.cc:385] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.151902 17928 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.151935 17896 raft_consensus.cc:740] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.157783 17901 leader_election.cc:290] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.157692 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:32.158524 17702 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.159252 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:32.160048 17777 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.159078 17896 consensus_queue.cc:260] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.163110 17903 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.190557 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
W20260709 12:21:32.195016 17741 leader_election.cc:343] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.196338 17849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:32.198104 17903 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.201100 17895 tablet_bootstrap.cc:492] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:32.200809 17777 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:32.203280 17895 ts_tablet_manager.cc:1403] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.009s
I20260709 12:21:32.204720 17816 leader_election.cc:304] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.205821 17897 tablet_bootstrap.cc:492] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:32.205190 17702 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:32.206166 17901 raft_consensus.cc:2804] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.207288 17901 raft_consensus.cc:697] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:32.207686 17896 ts_tablet_manager.cc:1434] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.008s
I20260709 12:21:32.206353 17897 ts_tablet_manager.cc:1403] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.196s	user 0.023s	sys 0.027s
I20260709 12:21:32.206655 17927 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.208180 17901 consensus_queue.cc:237] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.212558 17896 tablet_bootstrap.cc:492] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:32.215008 17897 raft_consensus.cc:359] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:32.215827 17897 raft_consensus.cc:385] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.216156 17897 raft_consensus.cc:740] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.218080 17929 raft_consensus.cc:493] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.218909 17897 consensus_queue.cc:260] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:32.218858 17929 raft_consensus.cc:515] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.221343 17928 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.221527 17902 raft_consensus.cc:515] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.226915 17701 raft_consensus.cc:2393] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a96610b2690477ba2a3f2f7186a097e in current term 1: Already voted for candidate e35f84c8056d49bda99c1a5bae7d2679 in this term.
I20260709 12:21:32.227248 17897 ts_tablet_manager.cc:1434] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:21:32.230628 17849 raft_consensus.cc:2393] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a96610b2690477ba2a3f2f7186a097e in current term 1: Already voted for candidate edade32f911b4eafb025543e30817b0c in this term.
W20260709 12:21:32.232863 17648 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:32.233745 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.234846 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.235476 17928 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.235473 17929 leader_election.cc:290] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.238152 17702 raft_consensus.cc:2468] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 0.
I20260709 12:21:32.239640 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:32.239497 17897 tablet_bootstrap.cc:492] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:32.239704 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:32.241451 17778 raft_consensus.cc:2393] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edade32f911b4eafb025543e30817b0c in current term 1: Already voted for candidate 2a96610b2690477ba2a3f2f7186a097e in this term.
I20260709 12:21:32.238385 17895 raft_consensus.cc:359] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.242668 17902 leader_election.cc:290] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.243934 17895 raft_consensus.cc:385] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:32.243702 17816 leader_election.cc:343] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.244853 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:32.246583 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:32.245810 17895 raft_consensus.cc:740] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.248000 17777 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.249918 17896 tablet_bootstrap.cc:654] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.252616 17895 consensus_queue.cc:260] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.254859 17850 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.259994 17895 ts_tablet_manager.cc:1434] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.053s	user 0.015s	sys 0.002s
I20260709 12:21:32.262967 17895 tablet_bootstrap.cc:492] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:32.263489 17903 raft_consensus.cc:493] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.264569 17903 raft_consensus.cc:515] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.272836 17903 leader_election.cc:290] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.273614 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.273212 17667 leader_election.cc:304] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679; no voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c
I20260709 12:21:32.275409 17902 raft_consensus.cc:2749] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.276261 17852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.278301 17815 leader_election.cc:304] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:32.279351 17928 raft_consensus.cc:2804] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.279729 17928 raft_consensus.cc:493] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:32.279754 17815 leader_election.cc:343] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.280187 17928 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.280514 17895 tablet_bootstrap.cc:654] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.280340 17815 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edade32f911b4eafb025543e30817b0c; no voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:32.285176 17777 raft_consensus.cc:2468] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 1.
I20260709 12:21:32.285252 17741 leader_election.cc:304] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e; no voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c
I20260709 12:21:32.286213 17903 raft_consensus.cc:2749] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:32.286690 17741 leader_election.cc:343] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.290478 17895 tablet_bootstrap.cc:492] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:32.291041 17895 ts_tablet_manager.cc:1403] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 12:21:32.291623 17742 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e; no voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c
W20260709 12:21:32.292969 17742 leader_election.cc:343] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edade32f911b4eafb025543e30817b0c (127.17.40.3:34419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.293438 17742 leader_election.cc:304] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e; no voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c
I20260709 12:21:32.294296 17903 raft_consensus.cc:2749] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.295198 17667 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:32.296094 17902 raft_consensus.cc:2804] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.296499 17902 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.296989 17902 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.295239 17929 raft_consensus.cc:2749] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.297183 17850 raft_consensus.cc:2468] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 1.
I20260709 12:21:32.295055 17936 raft_consensus.cc:2749] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.300580 17896 tablet_bootstrap.cc:492] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:32.301090 17896 ts_tablet_manager.cc:1403] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.012s
I20260709 12:21:32.296517 17667 leader_election.cc:304] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:32.303364 17932 raft_consensus.cc:2804] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.304826 17902 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.305557 17896 raft_consensus.cc:359] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.306159 17896 raft_consensus.cc:385] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.306485 17896 raft_consensus.cc:740] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.306936 17902 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.296556 17895 raft_consensus.cc:359] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.309522 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:32.308020 17932 raft_consensus.cc:697] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
W20260709 12:21:32.321592 17667 leader_election.cc:343] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.321158 17932 consensus_queue.cc:237] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.317163 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:32.322806 17850 raft_consensus.cc:2393] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e35f84c8056d49bda99c1a5bae7d2679 in current term 1: Already voted for candidate edade32f911b4eafb025543e30817b0c in this term.
I20260709 12:21:32.312533 17600 catalog_manager.cc:5697] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 0 to 1, leader changed from <none> to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 1 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.307341 17896 consensus_queue.cc:260] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.308990 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:32.326660 17703 raft_consensus.cc:2393] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edade32f911b4eafb025543e30817b0c in current term 1: Already voted for candidate e35f84c8056d49bda99c1a5bae7d2679 in this term.
I20260709 12:21:32.327490 17896 ts_tablet_manager.cc:1434] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.008s
I20260709 12:21:32.328502 17896 tablet_bootstrap.cc:492] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:32.329499 17928 raft_consensus.cc:515] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.307876 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:32.307507 17895 raft_consensus.cc:385] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.309170 17927 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.324385 17667 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679; no voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c
I20260709 12:21:32.330847 17895 raft_consensus.cc:740] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
W20260709 12:21:32.331672 17816 leader_election.cc:343] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.331835 17902 raft_consensus.cc:2749] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.331689 17895 consensus_queue.cc:260] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.332333 17816 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edade32f911b4eafb025543e30817b0c; no voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:32.279057 17897 tablet_bootstrap.cc:654] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.335150 17929 raft_consensus.cc:2749] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.335577 17895 ts_tablet_manager.cc:1434] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.007s
I20260709 12:21:32.336668 17895 tablet_bootstrap.cc:492] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:32.337936 17896 tablet_bootstrap.cc:654] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.341773 17936 raft_consensus.cc:493] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.342468 17936 raft_consensus.cc:515] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:32.342947 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:32.343891 17703 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.344659 17895 tablet_bootstrap.cc:654] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.346493 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.347249 17850 raft_consensus.cc:2468] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 0.
I20260709 12:21:32.348052 17936 leader_election.cc:290] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.349419 17742 leader_election.cc:304] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.350955 17936 raft_consensus.cc:2804] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.351428 17936 raft_consensus.cc:493] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.351780 17936 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.351902 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
W20260709 12:21:32.354451 17741 leader_election.cc:343] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.359858 17928 leader_election.cc:290] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.360127 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
W20260709 12:21:32.361640 17816 leader_election.cc:343] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.361799 17936 raft_consensus.cc:515] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:32.363086 17703 raft_consensus.cc:2468] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:32.364868 17815 leader_election.cc:304] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:32.365399 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
W20260709 12:21:32.367151 17741 leader_election.cc:343] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.367929 17928 raft_consensus.cc:2804] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.368587 17928 raft_consensus.cc:697] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:32.369833 17896 tablet_bootstrap.cc:492] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:32.370343 17896 ts_tablet_manager.cc:1403] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.023s
I20260709 12:21:32.369709 17928 consensus_queue.cc:237] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.373000 17896 raft_consensus.cc:359] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.373673 17896 raft_consensus.cc:385] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.374023 17896 raft_consensus.cc:740] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.374101 17895 tablet_bootstrap.cc:492] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:32.374835 17895 ts_tablet_manager.cc:1403] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.002s
I20260709 12:21:32.374962 17896 consensus_queue.cc:260] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.377676 17896 ts_tablet_manager.cc:1434] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:21:32.378144 17897 tablet_bootstrap.cc:492] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:32.378468 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:32.378806 17896 tablet_bootstrap.cc:492] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:32.379142 17850 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.379141 17895 raft_consensus.cc:359] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.380177 17895 raft_consensus.cc:385] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.380592 17895 raft_consensus.cc:740] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.381393 17895 consensus_queue.cc:260] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.378705 17897 ts_tablet_manager.cc:1403] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.004s
I20260709 12:21:32.384164 17895 ts_tablet_manager.cc:1434] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:21:32.385342 17895 tablet_bootstrap.cc:492] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c: Bootstrap starting.
I20260709 12:21:32.385604 17897 raft_consensus.cc:359] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.386384 17897 raft_consensus.cc:385] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.392421 17897 raft_consensus.cc:740] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.387702 17850 raft_consensus.cc:2468] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 1.
I20260709 12:21:32.387691 17936 leader_election.cc:290] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.391121 17932 raft_consensus.cc:493] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.393297 17932 raft_consensus.cc:515] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.393887 17742 leader_election.cc:304] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:32.391394 17895 tablet_bootstrap.cc:654] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.395288 17936 raft_consensus.cc:2804] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.395767 17932 leader_election.cc:290] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.395833 17936 raft_consensus.cc:697] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 1 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:32.386644 17896 tablet_bootstrap.cc:654] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.398012 17936 consensus_queue.cc:237] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:32.399616 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281784b0bab461a8635c66333e01cfd" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
W20260709 12:21:32.401098 17667 leader_election.cc:343] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edade32f911b4eafb025543e30817b0c (127.17.40.3:34419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.401748 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281784b0bab461a8635c66333e01cfd" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.402146 17897 consensus_queue.cc:260] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
W20260709 12:21:32.405045 17667 leader_election.cc:343] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.405563 17667 leader_election.cc:304] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679; no voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c
I20260709 12:21:32.406962 17932 raft_consensus.cc:2749] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.407007 17897 ts_tablet_manager.cc:1434] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:21:32.420684 17897 tablet_bootstrap.cc:492] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:32.424072 17597 catalog_manager.cc:5697] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 0 to 1, leader changed from <none> to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:32.430006 17599 catalog_manager.cc:5697] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 1 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.436847 17895 tablet_bootstrap.cc:492] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c: No bootstrap required, opened a new log
I20260709 12:21:32.437397 17895 ts_tablet_manager.cc:1403] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.012s
I20260709 12:21:32.438231 17897 tablet_bootstrap.cc:654] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.438375 17896 tablet_bootstrap.cc:492] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:32.438884 17896 ts_tablet_manager.cc:1403] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.018s
I20260709 12:21:32.441962 17896 raft_consensus.cc:359] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:32.443009 17896 raft_consensus.cc:385] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.443387 17896 raft_consensus.cc:740] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.444279 17896 consensus_queue.cc:260] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:32.447564 17896 ts_tablet_manager.cc:1434] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:32.448962 17896 tablet_bootstrap.cc:492] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679: Bootstrap starting.
I20260709 12:21:32.455425 17600 catalog_manager.cc:5697] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 0 to 1, leader changed from <none> to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 1 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.457129 17896 tablet_bootstrap.cc:654] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.458861 17895 raft_consensus.cc:359] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.463438 17928 raft_consensus.cc:493] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.461282 17897 tablet_bootstrap.cc:492] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:32.464357 17897 ts_tablet_manager.cc:1403] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.015s
I20260709 12:21:32.464071 17928 raft_consensus.cc:515] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.471469 17928 leader_election.cc:290] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.472126 17897 raft_consensus.cc:359] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.463627 17895 raft_consensus.cc:385] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.473114 17897 raft_consensus.cc:385] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.473430 17895 raft_consensus.cc:740] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.473650 17897 raft_consensus.cc:740] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.474611 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.474486 17895 consensus_queue.cc:260] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.475323 17777 raft_consensus.cc:2468] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 0.
I20260709 12:21:32.474866 17897 consensus_queue.cc:260] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.476737 17816 leader_election.cc:304] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.473694 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.477952 17895 ts_tablet_manager.cc:1434] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
W20260709 12:21:32.479368 17815 leader_election.cc:343] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:32.480789 17928 raft_consensus.cc:2804] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.481344 17928 raft_consensus.cc:493] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.481817 17928 raft_consensus.cc:3060] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.485451 17897 ts_tablet_manager.cc:1434] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:21:32.486922 17897 tablet_bootstrap.cc:492] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:32.490912 17932 raft_consensus.cc:493] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.491770 17932 raft_consensus.cc:515] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.494807 17897 tablet_bootstrap.cc:654] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.498004 17932 leader_election.cc:290] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.498256 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.499126 17850 raft_consensus.cc:2468] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 0.
I20260709 12:21:32.499663 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.500634 17777 raft_consensus.cc:2468] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 0.
I20260709 12:21:32.502842 17667 leader_election.cc:304] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:32.513286 17897 tablet_bootstrap.cc:492] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:32.513942 17897 ts_tablet_manager.cc:1403] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.009s
I20260709 12:21:32.516691 17932 raft_consensus.cc:2804] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.516970 17897 raft_consensus.cc:359] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.518534 17897 raft_consensus.cc:385] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.518924 17897 raft_consensus.cc:740] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.519747 17897 consensus_queue.cc:260] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.517339 17932 raft_consensus.cc:493] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.520699 17932 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.524459 17928 raft_consensus.cc:515] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.527590 17897 ts_tablet_manager.cc:1434] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:21:32.532466 17897 tablet_bootstrap.cc:492] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e: Bootstrap starting.
I20260709 12:21:32.530903 17932 raft_consensus.cc:515] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.539788 17897 tablet_bootstrap.cc:654] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:32.540100 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:32.540745 17777 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.541726 17896 tablet_bootstrap.cc:492] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679: No bootstrap required, opened a new log
I20260709 12:21:32.542814 17896 ts_tablet_manager.cc:1403] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679: Time spent bootstrapping tablet: real 0.094s	user 0.036s	sys 0.035s
I20260709 12:21:32.542145 17928 leader_election.cc:290] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.546964 17896 raft_consensus.cc:359] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.547821 17896 raft_consensus.cc:385] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.548184 17896 raft_consensus.cc:740] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.549083 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:32.551612 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:32.552423 17778 raft_consensus.cc:3060] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.555440 17932 leader_election.cc:290] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.549031 17896 consensus_queue.cc:260] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.556907 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:32.557600 17850 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.557761 17896 ts_tablet_manager.cc:1434] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:21:32.561203 17703 raft_consensus.cc:3060] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.561756 17897 tablet_bootstrap.cc:492] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e: No bootstrap required, opened a new log
I20260709 12:21:32.562271 17897 ts_tablet_manager.cc:1403] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.006s
I20260709 12:21:32.560129 17778 raft_consensus.cc:2468] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:32.563974 17816 leader_election.cc:304] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.564972 17928 raft_consensus.cc:2804] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.565270 17897 raft_consensus.cc:359] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.565537 17928 raft_consensus.cc:697] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:32.570381 17936 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.571308 17897 raft_consensus.cc:385] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:32.571745 17897 raft_consensus.cc:740] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Initialized, Role: FOLLOWER
I20260709 12:21:32.571667 17936 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.572072 17928 consensus_queue.cc:237] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.572664 17897 consensus_queue.cc:260] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.574999 17897 ts_tablet_manager.cc:1434] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.007s
I20260709 12:21:32.575878 17851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.576774 17851 raft_consensus.cc:2393] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a96610b2690477ba2a3f2f7186a097e in current term 1: Already voted for candidate edade32f911b4eafb025543e30817b0c in this term.
I20260709 12:21:32.578472 17936 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.578773 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.579617 17701 raft_consensus.cc:2393] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a96610b2690477ba2a3f2f7186a097e in current term 1: Already voted for candidate e35f84c8056d49bda99c1a5bae7d2679 in this term.
I20260709 12:21:32.581970 17741 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e; no voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c
I20260709 12:21:32.585039 17596 catalog_manager.cc:5697] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 0 to 1, leader changed from <none> to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 1 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.590646 17936 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.598809 17936 raft_consensus.cc:2749] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.565506 17850 raft_consensus.cc:2468] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 1.
I20260709 12:21:32.600314 17703 raft_consensus.cc:2468] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:32.600855 17777 raft_consensus.cc:2468] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 1.
I20260709 12:21:32.602293 17667 leader_election.cc:304] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.603888 17932 raft_consensus.cc:2804] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.604406 17932 raft_consensus.cc:697] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:32.605188 17932 consensus_queue.cc:237] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.615015 17596 catalog_manager.cc:5697] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 0 to 1, leader changed from <none> to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:32.638854 17932 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.639451 17932 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.641824 17932 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.643288 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.643193 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.644157 17850 raft_consensus.cc:2393] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e35f84c8056d49bda99c1a5bae7d2679 in current term 1: Already voted for candidate edade32f911b4eafb025543e30817b0c in this term.
I20260709 12:21:32.644164 17777 raft_consensus.cc:2393] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e35f84c8056d49bda99c1a5bae7d2679 in current term 1: Already voted for candidate 2a96610b2690477ba2a3f2f7186a097e in this term.
I20260709 12:21:32.645730 17667 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679; no voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c
I20260709 12:21:32.646529 17932 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.652930 17932 raft_consensus.cc:2749] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.730528 17927 consensus_queue.cc:1048] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.731408 17928 consensus_queue.cc:1048] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.772994 17932 consensus_queue.cc:1048] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.791988 17902 consensus_queue.cc:1048] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.817166 17703 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.823545 17936 consensus_queue.cc:1048] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.835269 17936 consensus_queue.cc:1048] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.851130 17965 raft_consensus.cc:493] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.851686 17965 raft_consensus.cc:515] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.853998 17965 leader_election.cc:290] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:32.854803 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.855706 17703 raft_consensus.cc:2393] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a96610b2690477ba2a3f2f7186a097e in current term 1: Already voted for candidate edade32f911b4eafb025543e30817b0c in this term.
I20260709 12:21:32.856758 17851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:32.858173 17742 leader_election.cc:304] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e; no voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c
I20260709 12:21:32.859392 17965 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.867134 17965 raft_consensus.cc:2749] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:32.941888 17928 consensus_queue.cc:1048] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.954634 17927 consensus_queue.cc:1048] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:32.958809 17927 raft_consensus.cc:493] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.959339 17927 raft_consensus.cc:515] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.962671 17927 leader_election.cc:290] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.966820 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281784b0bab461a8635c66333e01cfd" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:32.967947 17778 raft_consensus.cc:2468] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 0.
I20260709 12:21:32.966796 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281784b0bab461a8635c66333e01cfd" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:32.969486 17816 leader_election.cc:304] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.969715 17703 raft_consensus.cc:2468] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 0.
I20260709 12:21:32.970517 17927 raft_consensus.cc:2804] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:32.970914 17927 raft_consensus.cc:493] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.971240 17927 raft_consensus.cc:3060] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.980362 17927 raft_consensus.cc:515] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:32.983283 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281784b0bab461a8635c66333e01cfd" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:32.983939 17927 leader_election.cc:290] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:32.984117 17703 raft_consensus.cc:3060] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.983494 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281784b0bab461a8635c66333e01cfd" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:32.984829 17777 raft_consensus.cc:3060] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:32.991966 17777 raft_consensus.cc:2468] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:32.991966 17703 raft_consensus.cc:2468] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:32.993580 17816 leader_election.cc:304] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:32.994603 17927 raft_consensus.cc:2804] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:32.995297 17927 raft_consensus.cc:697] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:32.996201 17927 consensus_queue.cc:237] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:33.000979 17902 consensus_queue.cc:1048] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:33.009116 17596 catalog_manager.cc:5697] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 0 to 1, leader changed from <none> to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 1 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:33.011301 17962 consensus_queue.cc:1048] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:33.092149 17927 consensus_queue.cc:1048] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:33.103794 17928 consensus_queue.cc:1048] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:33.236315 17648 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:33.569868 17928 consensus_queue.cc:1048] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:33.581926 17927 consensus_queue.cc:1048] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.088574 17928 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.089108 17928 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.091040 17928 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:34.091820 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:34.092064 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:34.092422 17703 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:34.092671 17777 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 1.
I20260709 12:21:34.093667 17815 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:34.094453 17928 raft_consensus.cc:2804] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:34.094806 17928 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.095088 17928 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.099967 17928 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.101732 17928 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 2 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:34.102980 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:34.102998 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:34.103750 17703 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.103828 17777 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.111760 17703 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 2.
I20260709 12:21:34.112260 17777 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 2.
I20260709 12:21:34.113298 17815 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:34.114082 17928 raft_consensus.cc:2804] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:34.114570 17928 raft_consensus.cc:697] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 2 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:34.115213 17928 consensus_queue.cc:237] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.123199 17596 catalog_manager.cc:5697] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 0 to 2, leader changed from <none> to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 2 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:34.239416 17648 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:34.337791 17965 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.338460 17965 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.340492 17965 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:34.341429 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:34.341722 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:34.342067 17703 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 1.
I20260709 12:21:34.342376 17850 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 1.
I20260709 12:21:34.343343 17741 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:34.344197 17965 raft_consensus.cc:2804] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:34.344583 17965 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.344842 17965 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.349877 17965 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.351784 17965 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:34.352680 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:34.352809 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:34.353312 17703 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.353412 17850 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.359277 17850 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 2.
I20260709 12:21:34.359529 17703 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 2.
I20260709 12:21:34.360750 17742 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:34.361593 17965 raft_consensus.cc:2804] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:34.363065 17965 raft_consensus.cc:697] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:34.363888 17965 consensus_queue.cc:237] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.372944 17596 catalog_manager.cc:5697] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 0 to 2, leader changed from <none> to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 2 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.532831 17703 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:34.534679 17929 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.545554 17777 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:34.548118 17929 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.601236 17777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8be31e8908d94753915421aa61e4064f"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
mode: GRACEFUL
new_leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:34760
I20260709 12:21:34.601848 17777 raft_consensus.cc:606] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 1 LEADER]: Received request to transfer leadership to TS e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:34.616691 17850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
mode: GRACEFUL
new_leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:32880
I20260709 12:21:34.617285 17850 raft_consensus.cc:606] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Received request to transfer leadership to TS e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:34.622478 17777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
mode: GRACEFUL
new_leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:34760
I20260709 12:21:34.623029 17777 raft_consensus.cc:606] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Received request to transfer leadership to TS e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:34.628736 17850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10536ff303d440aa828e5200507989c4"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
mode: GRACEFUL
new_leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:32880
I20260709 12:21:34.629295 17850 raft_consensus.cc:606] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Received request to transfer leadership to TS e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:34.643035 17703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:52978
I20260709 12:21:34.643620 17703 raft_consensus.cc:606] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:34.648919 17703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:52978
I20260709 12:21:34.649477 17703 raft_consensus.cc:606] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:34.654322 17850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 12:21:34.654947 17850 raft_consensus.cc:606] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 2 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:34.660336 17850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 12:21:34.660889 17850 raft_consensus.cc:606] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:34.710451 17929 raft_consensus.cc:993] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c: : Instructing follower e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:34.710949 17928 raft_consensus.cc:1081] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Signalling peer e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:34.712656 17703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:52958
I20260709 12:21:34.713227 17703 raft_consensus.cc:493] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:34.713598 17703 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.718225 17703 raft_consensus.cc:515] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.719941 17703 leader_election.cc:290] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 2 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:34.720952 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:34.721249 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:34.721637 17777 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.721805 17850 raft_consensus.cc:3055] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:34.722183 17850 raft_consensus.cc:740] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:34.723084 17850 consensus_queue.cc:260] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.724556 17850 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.728820 17777 raft_consensus.cc:2468] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 2.
I20260709 12:21:34.730171 17667 leader_election.cc:304] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:34.731036 17937 raft_consensus.cc:2804] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:34.731324 17850 raft_consensus.cc:2468] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 2.
I20260709 12:21:34.732566 17937 raft_consensus.cc:697] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:34.733404 17937 consensus_queue.cc:237] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.740425 17600 catalog_manager.cc:5697] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 1 to 2, leader changed from edade32f911b4eafb025543e30817b0c (127.17.40.3) to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.790601 17850 raft_consensus.cc:1275] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:34.791929 17965 consensus_queue.cc:1048] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.801769 17703 raft_consensus.cc:1275] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:34.803560 17981 consensus_queue.cc:1048] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.813061 17965 raft_consensus.cc:993] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e: : Instructing follower e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:34.813586 17981 raft_consensus.cc:1081] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Signalling peer e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:34.815357 17703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:52970
I20260709 12:21:34.815888 17703 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:34.816210 17703 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.820996 17703 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.822906 17703 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 3 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:34.824014 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:34.824337 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:34.824671 17777 raft_consensus.cc:3055] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:34.824957 17850 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.825052 17777 raft_consensus.cc:740] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:34.826023 17777 consensus_queue.cc:260] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.827396 17777 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.830607 17850 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 3.
I20260709 12:21:34.831743 17667 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:34.832571 17937 raft_consensus.cc:2804] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:34.832897 17777 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 3.
I20260709 12:21:34.833016 17937 raft_consensus.cc:697] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:34.833976 17937 consensus_queue.cc:237] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.840440 17596 catalog_manager.cc:5697] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 2 to 3, leader changed from 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2) to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.845348 17929 raft_consensus.cc:993] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c: : Instructing follower e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:34.845834 17928 raft_consensus.cc:1081] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Signalling peer e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:34.848057 17703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10536ff303d440aa828e5200507989c4"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:52958
I20260709 12:21:34.848667 17703 raft_consensus.cc:493] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:34.849078 17703 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.853991 17703 raft_consensus.cc:515] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.855895 17703 leader_election.cc:290] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 2 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:34.856806 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:34.857106 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:34.857394 17777 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.857671 17850 raft_consensus.cc:3055] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:34.858014 17850 raft_consensus.cc:740] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:34.858777 17850 consensus_queue.cc:260] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.859745 17850 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.862989 17777 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 2.
I20260709 12:21:34.864182 17667 leader_election.cc:304] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:34.865048 17937 raft_consensus.cc:2804] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:34.865521 17937 raft_consensus.cc:697] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:34.865473 17850 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 2.
I20260709 12:21:34.866652 17937 consensus_queue.cc:237] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.875946 17596 catalog_manager.cc:5697] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 1 to 2, leader changed from edade32f911b4eafb025543e30817b0c (127.17.40.3) to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.885079 17992 raft_consensus.cc:993] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:34.885577 17937 raft_consensus.cc:1081] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:34.887171 17777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:34.887699 17777 raft_consensus.cc:493] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:34.888000 17777 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.894083 17777 raft_consensus.cc:515] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.895854 17777 leader_election.cc:290] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:34.896842 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:34.896921 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:34.897455 17703 raft_consensus.cc:3055] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:34.897545 17850 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.897881 17703 raft_consensus.cc:740] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:34.898778 17703 consensus_queue.cc:260] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.899766 17703 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.903086 17850 raft_consensus.cc:2468] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 2.
I20260709 12:21:34.904217 17742 leader_election.cc:304] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:34.904987 17981 raft_consensus.cc:2804] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:34.905270 17703 raft_consensus.cc:2468] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 2.
I20260709 12:21:34.905417 17981 raft_consensus.cc:697] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:34.906270 17981 consensus_queue.cc:237] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.913630 17596 catalog_manager.cc:5697] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 1 to 2, leader changed from e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 2 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.961856 17992 raft_consensus.cc:993] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:34.962324 17937 raft_consensus.cc:1081] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:34.963994 17777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:34.964479 17777 raft_consensus.cc:493] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:34.964753 17777 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.969552 17777 raft_consensus.cc:515] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.971061 17777 leader_election.cc:290] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:34.972103 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:34.972240 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:34.972638 17703 raft_consensus.cc:3055] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:34.972817 17850 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.973091 17703 raft_consensus.cc:740] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:34.973753 17703 consensus_queue.cc:260] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.974668 17703 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.978658 17850 raft_consensus.cc:2468] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 2.
I20260709 12:21:34.979115 17703 raft_consensus.cc:2468] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 2.
I20260709 12:21:34.979938 17742 leader_election.cc:304] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:34.980805 17981 raft_consensus.cc:2804] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:34.981271 17981 raft_consensus.cc:697] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:34.982152 17981 consensus_queue.cc:237] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:34.989590 17596 catalog_manager.cc:5697] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 1 to 2, leader changed from e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 2 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.006209 17965 raft_consensus.cc:993] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e: : Instructing follower e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:35.006795 17981 raft_consensus.cc:1081] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 1 LEADER]: Signalling peer e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:35.008386 17703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8be31e8908d94753915421aa61e4064f"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:52970
I20260709 12:21:35.008824 17703 raft_consensus.cc:493] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:35.009054 17703 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.013288 17703 raft_consensus.cc:515] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:35.014863 17703 leader_election.cc:290] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 2 election: Requested vote from peers edade32f911b4eafb025543e30817b0c (127.17.40.3:34419), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:35.015995 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:35.016067 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:35.016702 17850 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.016781 17777 raft_consensus.cc:3055] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:35.017203 17777 raft_consensus.cc:740] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:35.017926 17777 consensus_queue.cc:260] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:35.018842 17777 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.022346 17850 raft_consensus.cc:2468] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 2.
I20260709 12:21:35.023015 17777 raft_consensus.cc:2468] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 2.
I20260709 12:21:35.023737 17667 leader_election.cc:304] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:35.024473 17937 raft_consensus.cc:2804] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:35.024946 17937 raft_consensus.cc:697] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:35.025738 17937 consensus_queue.cc:237] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:35.032445 17596 catalog_manager.cc:5697] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 1 to 2, leader changed from 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2) to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.135725 17928 raft_consensus.cc:993] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:35.136152 17929 raft_consensus.cc:1081] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:35.137691 17777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34748
I20260709 12:21:35.138206 17777 raft_consensus.cc:493] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:35.138520 17777 raft_consensus.cc:3060] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.142798 17777 raft_consensus.cc:515] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:35.144304 17777 leader_election.cc:290] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:35.145304 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:35.145387 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c9a2becaa0413096cba58b92ec9702" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:35.145823 17703 raft_consensus.cc:3060] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.145929 17850 raft_consensus.cc:3055] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:35.146279 17850 raft_consensus.cc:740] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:35.146997 17850 consensus_queue.cc:260] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:35.147925 17850 raft_consensus.cc:3060] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.150259 17703 raft_consensus.cc:2468] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 2.
I20260709 12:21:35.151448 17741 leader_election.cc:304] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:35.152268 17981 raft_consensus.cc:2804] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:35.152683 17981 raft_consensus.cc:697] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:35.153189 17850 raft_consensus.cc:2468] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 2.
I20260709 12:21:35.153479 17981 consensus_queue.cc:237] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:35.161569 17928 raft_consensus.cc:993] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:35.161182 17596 catalog_manager.cc:5697] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 1 to 2, leader changed from edade32f911b4eafb025543e30817b0c (127.17.40.3) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 2 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.162096 18002 raft_consensus.cc:1081] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 2 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:35.163849 17777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34748
I20260709 12:21:35.164415 17777 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:35.164759 17777 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.170104 17777 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:35.172122 17777 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 3 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:35.172680 17778 raft_consensus.cc:1275] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.172776 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:35.173398 17703 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.173796 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:35.174360 17850 raft_consensus.cc:3055] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.174216 17937 consensus_queue.cc:1048] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.174829 17850 raft_consensus.cc:740] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:35.175710 17850 consensus_queue.cc:260] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:35.176991 17850 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.179387 17703 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 3.
I20260709 12:21:35.180503 17741 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:35.181291 17981 raft_consensus.cc:2804] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:35.181753 17981 raft_consensus.cc:697] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:35.182621 17981 consensus_queue.cc:237] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:35.186630 17851 raft_consensus.cc:1275] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.188290 17992 consensus_queue.cc:1048] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.197661 17850 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 3.
I20260709 12:21:35.198484 17596 catalog_manager.cc:5697] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 2 to 3, leader changed from edade32f911b4eafb025543e30817b0c (127.17.40.3) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 3 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.297755 17850 raft_consensus.cc:1275] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.299090 17981 consensus_queue.cc:1048] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.309156 17703 raft_consensus.cc:1275] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.311374 17981 consensus_queue.cc:1048] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.372610 17850 raft_consensus.cc:1275] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:35.372702 17778 raft_consensus.cc:1275] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:35.374096 18004 consensus_queue.cc:1048] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.374828 17992 consensus_queue.cc:1048] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.395368 17850 raft_consensus.cc:1275] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.396741 17965 consensus_queue.cc:1048] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.407065 17703 raft_consensus.cc:1275] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.408493 17965 consensus_queue.cc:1048] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:35.435709 17850 raft_consensus.cc:1275] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.437124 17992 consensus_queue.cc:1048] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.446026 17778 raft_consensus.cc:1275] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.447971 18004 consensus_queue.cc:1048] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.452903 17850 raft_consensus.cc:1275] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.454378 18004 consensus_queue.cc:1048] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.465744 17778 raft_consensus.cc:1275] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.467746 17992 consensus_queue.cc:1048] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.548380 17850 raft_consensus.cc:1275] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.549734 17965 consensus_queue.cc:1048] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.559306 17703 raft_consensus.cc:1275] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.561465 18007 consensus_queue.cc:1048] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.742141 17850 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:35.743570 18007 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.752491 17703 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:35.754952 17981 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:37.698035 17568 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:21:37.698940 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:37.724426 17703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
mode: GRACEFUL
new_leader_uuid: "edade32f911b4eafb025543e30817b0c"
 from {username='slave'} at 127.0.0.1:40452
I20260709 12:21:37.725268 17703 raft_consensus.cc:606] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Received request to transfer leadership to TS edade32f911b4eafb025543e30817b0c
I20260709 12:21:37.740000 17777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
mode: GRACEFUL
new_leader_uuid: "edade32f911b4eafb025543e30817b0c"
 from {username='slave'} at 127.0.0.1:46300
I20260709 12:21:37.740581 17777 raft_consensus.cc:606] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Received request to transfer leadership to TS edade32f911b4eafb025543e30817b0c
I20260709 12:21:37.741876 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:37.742498 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:37.933774 17981 raft_consensus.cc:993] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e: : Instructing follower edade32f911b4eafb025543e30817b0c to start an election
I20260709 12:21:37.934240 18024 raft_consensus.cc:1081] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Signalling peer edade32f911b4eafb025543e30817b0c to start an election
I20260709 12:21:37.936069 17850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
 from {username='slave'} at 127.0.0.1:32868
I20260709 12:21:37.936640 17850 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:37.936939 17850 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:37.941282 17850 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:37.943259 17850 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 4 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:37.944152 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:37.944419 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:37.944717 17703 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:37.945071 17777 raft_consensus.cc:3055] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:37.945364 17777 raft_consensus.cc:740] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:37.946075 17777 consensus_queue.cc:260] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:37.947120 17777 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:37.949481 17703 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 4.
I20260709 12:21:37.950843 17815 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:37.951679 18002 raft_consensus.cc:2804] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:37.952167 17777 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 4.
I20260709 12:21:37.953154 18002 raft_consensus.cc:697] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 4 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:37.954020 18002 consensus_queue.cc:237] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:37.961390 17600 catalog_manager.cc:5697] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 3 to 4, leader changed from 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2) to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 4 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.013952 17992 raft_consensus.cc:993] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679: : Instructing follower edade32f911b4eafb025543e30817b0c to start an election
I20260709 12:21:38.014503 18031 raft_consensus.cc:1081] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Signalling peer edade32f911b4eafb025543e30817b0c to start an election
I20260709 12:21:38.016350 17850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
 from {username='slave'} at 127.0.0.1:32858
I20260709 12:21:38.016837 17850 raft_consensus.cc:493] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:38.017102 17850 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.021859 17850 raft_consensus.cc:515] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:38.023591 17850 leader_election.cc:290] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 3 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:38.024655 17703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:38.024995 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:38.025244 17703 raft_consensus.cc:3055] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:38.025579 17777 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.025607 17703 raft_consensus.cc:740] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:38.026625 17703 consensus_queue.cc:260] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:38.027747 17703 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.031177 17777 raft_consensus.cc:2468] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 3.
I20260709 12:21:38.032546 17816 leader_election.cc:304] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:38.033381 18002 raft_consensus.cc:2804] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:38.034008 18002 raft_consensus.cc:697] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 3 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:38.034153 17703 raft_consensus.cc:2468] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 3.
I20260709 12:21:38.034999 18002 consensus_queue.cc:237] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:38.043001 17600 catalog_manager.cc:5697] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 2 to 3, leader changed from e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1) to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 3 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.376407 17777 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:38.377781 18002 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:38.388113 17703 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:38.389747 18035 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:38.473032 17777 raft_consensus.cc:1275] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:38.474422 18035 consensus_queue.cc:1048] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:38.483505 17703 raft_consensus.cc:1275] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:38.486073 18035 consensus_queue.cc:1048] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:38.744093 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:38.750504 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:38.750988 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:39.752146 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:39.758100 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:39.758615 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:40.759781 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:40.764986 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:40.765391 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:41.810827 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:41.968315 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:41.985150 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:42.672344 17631 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 17571
W20260709 12:21:42.697068 17631 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 17634
I20260709 12:21:42.718125 18047 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e35f84c8056d49bda99c1a5bae7d2679)
I20260709 12:21:42.726836 18047 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:42.719863 18046 raft_consensus.cc:493] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edade32f911b4eafb025543e30817b0c)
I20260709 12:21:42.743484 18046 raft_consensus.cc:515] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:42.746749 18046 leader_election.cc:290] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
W20260709 12:21:42.749277 17631 debug-util.cc:398] Leaking SignalData structure 0x7b080009cca0 after lost signal to thread 17727
I20260709 12:21:42.749171 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:42.754276 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edade32f911b4eafb025543e30817b0c" is_pre_election: true
I20260709 12:21:42.755923 17742 leader_election.cc:304] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e; no voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c
W20260709 12:21:42.756610 17631 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0ca0 after lost signal to thread 17802
W20260709 12:21:42.757566 17631 debug-util.cc:398] Leaking SignalData structure 0x7b080018e8c0 after lost signal to thread 17876
I20260709 12:21:42.757721 18046 raft_consensus.cc:2749] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:42.758591 18047 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:42.761013 17778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a96610b2690477ba2a3f2f7186a097e" is_pre_election: true
I20260709 12:21:42.764604 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679" is_pre_election: true
I20260709 12:21:42.766821 17815 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edade32f911b4eafb025543e30817b0c; no voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:42.767820 18049 raft_consensus.cc:2749] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:43.134140 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:43.140264 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:43.140772 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:44.141829 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:44.147325 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:44.147804 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:45.148789 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:45.154578 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:45.155058 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:46.156013 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:46.161567 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:46.162053 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:47.163097 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:47.168188 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:47.168697 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:48.201031 17568 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:21:48.206569 17701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8be31e8908d94753915421aa61e4064f"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:52978
I20260709 12:21:48.207281 17701 raft_consensus.cc:606] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:48.213195 17850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 12:21:48.213707 17850 raft_consensus.cc:606] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 3 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:48.219096 17701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:52978
I20260709 12:21:48.219732 17701 raft_consensus.cc:606] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:48.225698 17701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10536ff303d440aa828e5200507989c4"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:52978
I20260709 12:21:48.226305 17701 raft_consensus.cc:606] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:48.238863 17850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
mode: GRACEFUL
new_leader_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 12:21:48.239441 17850 raft_consensus.cc:606] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 4 LEADER]: Received request to transfer leadership to TS 2a96610b2690477ba2a3f2f7186a097e
I20260709 12:21:48.267221 18056 raft_consensus.cc:993] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.267701 18054 raft_consensus.cc:1081] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.269249 17778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8be31e8908d94753915421aa61e4064f"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:48.269873 17778 raft_consensus.cc:493] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.270274 17778 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.276471 17778 raft_consensus.cc:515] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:48.279489 17778 leader_election.cc:290] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 3 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:48.280748 17851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:48.280252 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:48.281400 17851 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.281662 17701 raft_consensus.cc:3055] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:48.282007 17701 raft_consensus.cc:740] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:48.282975 17701 consensus_queue.cc:260] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:48.284390 17701 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.289422 17851 raft_consensus.cc:2468] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 3.
I20260709 12:21:48.291009 17742 leader_election.cc:304] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:48.291916 18046 raft_consensus.cc:2804] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:48.291791 17701 raft_consensus.cc:2468] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 3.
I20260709 12:21:48.293185 18046 raft_consensus.cc:697] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:48.294103 18046 consensus_queue.cc:237] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:48.303596 17600 catalog_manager.cc:5697] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 2 to 3, leader changed from e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 3 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:48.364347 18063 raft_consensus.cc:993] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.365094 18053 raft_consensus.cc:1081] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 3 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.367007 17778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34748
I20260709 12:21:48.367481 17778 raft_consensus.cc:493] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.367734 17778 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.369256 18063 raft_consensus.cc:993] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.369766 18053 raft_consensus.cc:1081] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 4 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.371558 17777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34748
I20260709 12:21:48.372077 17777 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.372387 17777 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.372888 17778 raft_consensus.cc:515] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.374716 17778 leader_election.cc:290] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 4 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:48.375690 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:48.375805 17851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703f83feacac4d6eb53045d6b494fb04" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:48.376467 17701 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.376482 17851 raft_consensus.cc:3055] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:48.377024 17851 raft_consensus.cc:740] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:48.377944 17851 consensus_queue.cc:260] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.379106 17851 raft_consensus.cc:3060] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.379468 17777 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.381754 17777 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 5 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:48.382756 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:48.383420 17702 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.383987 17701 raft_consensus.cc:2468] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 4.
I20260709 12:21:48.385964 17851 raft_consensus.cc:2468] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 4.
I20260709 12:21:48.387130 17742 leader_election.cc:304] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:48.387806 17851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:48.387990 18046 raft_consensus.cc:2804] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:48.388594 17851 raft_consensus.cc:3055] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:48.388717 18046 raft_consensus.cc:697] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 4 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:48.389344 17851 raft_consensus.cc:740] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:48.389976 18046 consensus_queue.cc:237] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.390306 17851 consensus_queue.cc:260] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.391214 17702 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 5.
I20260709 12:21:48.391767 17851 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.392725 17741 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, e35f84c8056d49bda99c1a5bae7d2679; no voters: 
I20260709 12:21:48.393831 18057 raft_consensus.cc:2804] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:48.397872 18057 raft_consensus.cc:697] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 5 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:48.398799 17851 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 5.
I20260709 12:21:48.398911 18057 consensus_queue.cc:237] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.400081 17600 catalog_manager.cc:5697] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 3 to 4, leader changed from edade32f911b4eafb025543e30817b0c (127.17.40.3) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 4 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.414724 18056 raft_consensus.cc:993] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.415190 18054 raft_consensus.cc:1081] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.414511 17600 catalog_manager.cc:5697] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 4 to 5, leader changed from edade32f911b4eafb025543e30817b0c (127.17.40.3) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 5 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.416811 17777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:48.417387 17777 raft_consensus.cc:493] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.417670 17777 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.421986 17777 raft_consensus.cc:515] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.423796 17777 leader_election.cc:290] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 4 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:48.424621 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:48.424890 17851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a4e502cd9e41e89db84bbbf8707840" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:48.425206 17702 raft_consensus.cc:3055] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:48.425416 17851 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.425570 17702 raft_consensus.cc:740] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:48.426460 17702 consensus_queue.cc:260] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.427480 17702 raft_consensus.cc:3060] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.430778 17851 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 4.
I20260709 12:21:48.431985 17742 leader_election.cc:304] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:48.432734 18057 raft_consensus.cc:2804] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:48.432672 17702 raft_consensus.cc:2468] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 4.
I20260709 12:21:48.433318 18057 raft_consensus.cc:697] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 4 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:48.434121 18057 consensus_queue.cc:237] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.441298 17600 catalog_manager.cc:5697] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 3 to 4, leader changed from e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 4 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.730571 18056 raft_consensus.cc:993] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679: : Instructing follower 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.731055 18054 raft_consensus.cc:1081] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Signalling peer 2a96610b2690477ba2a3f2f7186a097e to start an election
I20260709 12:21:48.732725 17777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10536ff303d440aa828e5200507989c4"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
 from {username='slave'} at 127.0.0.1:34732
I20260709 12:21:48.733292 17777 raft_consensus.cc:493] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.733645 17777 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.738674 17777 raft_consensus.cc:515] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.740442 17777 leader_election.cc:290] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 3 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:48.741568 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:48.741644 17851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "2a96610b2690477ba2a3f2f7186a097e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:48.742251 17702 raft_consensus.cc:3055] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:48.742304 17851 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.742765 17702 raft_consensus.cc:740] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:48.744083 17702 consensus_queue.cc:260] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.745816 17702 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.751782 17851 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 3.
I20260709 12:21:48.771193 17742 leader_election.cc:304] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a96610b2690477ba2a3f2f7186a097e, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:48.773432 18057 raft_consensus.cc:2804] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:48.774626 18057 raft_consensus.cc:697] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Becoming Leader. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:48.776350 18057 consensus_queue.cc:237] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:48.786469 17851 raft_consensus.cc:1275] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:48.788743 17702 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a96610b2690477ba2a3f2f7186a097e in term 3.
I20260709 12:21:48.788904 18057 consensus_queue.cc:1048] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:48.795030 17596 catalog_manager.cc:5697] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e reported cstate change: term changed from 2 to 3, leader changed from e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1) to 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2). New cstate: current_term: 3 leader_uuid: "2a96610b2690477ba2a3f2f7186a097e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.820173 17702 raft_consensus.cc:1275] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:48.822233 18057 consensus_queue.cc:1048] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:48.874498 17851 raft_consensus.cc:1275] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:48.876227 18057 consensus_queue.cc:1048] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:48.886282 17702 raft_consensus.cc:1275] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:48.887948 18046 consensus_queue.cc:1048] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:48.908986 17851 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 5 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:48.910408 18046 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:48.920401 17702 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 5 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:48.921964 18057 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:48.971930 17851 raft_consensus.cc:1275] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:48.973397 18057 consensus_queue.cc:1048] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:48.985168 17702 raft_consensus.cc:1275] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:48.987109 18057 consensus_queue.cc:1048] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:49.323622 17702 raft_consensus.cc:1275] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:49.324976 18057 consensus_queue.cc:1048] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:49.336374 17851 raft_consensus.cc:1275] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Refusing update from remote peer 2a96610b2690477ba2a3f2f7186a097e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:49.337870 18057 consensus_queue.cc:1048] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:51.278985 17568 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:21:51.279807 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:51.287207 17777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
mode: GRACEFUL
new_leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:46300
I20260709 12:21:51.287904 17777 raft_consensus.cc:606] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Received request to transfer leadership to TS e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:51.290442 17777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10536ff303d440aa828e5200507989c4"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
mode: GRACEFUL
new_leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:46300
I20260709 12:21:51.290912 17777 raft_consensus.cc:606] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Received request to transfer leadership to TS e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:51.293061 17777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
mode: GRACEFUL
new_leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:46300
I20260709 12:21:51.293517 17777 raft_consensus.cc:606] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Received request to transfer leadership to TS e35f84c8056d49bda99c1a5bae7d2679
I20260709 12:21:51.295714 17777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
mode: GRACEFUL
new_leader_uuid: "edade32f911b4eafb025543e30817b0c"
 from {username='slave'} at 127.0.0.1:46300
I20260709 12:21:51.296172 17777 raft_consensus.cc:606] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 5 LEADER]: Received request to transfer leadership to TS edade32f911b4eafb025543e30817b0c
I20260709 12:21:51.298643 17777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8be31e8908d94753915421aa61e4064f"
dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
mode: GRACEFUL
new_leader_uuid: "edade32f911b4eafb025543e30817b0c"
 from {username='slave'} at 127.0.0.1:46300
I20260709 12:21:51.299146 17777 raft_consensus.cc:606] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Received request to transfer leadership to TS edade32f911b4eafb025543e30817b0c
I20260709 12:21:51.300263 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:51.300760 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:51.366973 18046 raft_consensus.cc:993] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e: : Instructing follower edade32f911b4eafb025543e30817b0c to start an election
I20260709 12:21:51.367473 18046 raft_consensus.cc:1081] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Signalling peer edade32f911b4eafb025543e30817b0c to start an election
I20260709 12:21:51.369041 17851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8be31e8908d94753915421aa61e4064f"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
 from {username='slave'} at 127.0.0.1:32868
I20260709 12:21:51.369582 17851 raft_consensus.cc:493] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:51.369894 17851 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.374981 17851 raft_consensus.cc:515] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:51.377444 17851 leader_election.cc:290] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 4 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:51.378345 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:51.378724 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8be31e8908d94753915421aa61e4064f" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:51.379081 17702 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.379307 17777 raft_consensus.cc:3055] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:51.379693 17777 raft_consensus.cc:740] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:51.380426 17777 consensus_queue.cc:260] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:51.381356 17777 raft_consensus.cc:3060] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.384783 17702 raft_consensus.cc:2468] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 4.
I20260709 12:21:51.386547 17815 leader_election.cc:304] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:51.386547 17777 raft_consensus.cc:2468] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 4.
I20260709 12:21:51.387410 18085 raft_consensus.cc:2804] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:51.387931 18085 raft_consensus.cc:697] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 4 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:51.388895 18085 consensus_queue.cc:237] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } }
I20260709 12:21:51.389953 18087 raft_consensus.cc:993] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e: : Instructing follower e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:51.390432 18046 raft_consensus.cc:1081] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Signalling peer e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:51.392006 17702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10536ff303d440aa828e5200507989c4"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:52970
I20260709 12:21:51.392556 17702 raft_consensus.cc:493] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:51.392976 17702 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.396771 17596 catalog_manager.cc:5697] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 3 to 4, leader changed from 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2) to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 4 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.400003 17702 raft_consensus.cc:515] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.403595 17702 leader_election.cc:290] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 4 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:51.403831 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:51.404444 17777 raft_consensus.cc:3055] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:51.404363 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10536ff303d440aa828e5200507989c4" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:51.404843 17777 raft_consensus.cc:740] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:51.405005 17850 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.405786 17777 consensus_queue.cc:260] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.406879 17777 raft_consensus.cc:3060] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.411831 17850 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 4.
I20260709 12:21:51.413203 17667 leader_election.cc:304] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:51.414516 17777 raft_consensus.cc:2468] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 4.
I20260709 12:21:51.415231 18093 raft_consensus.cc:2804] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:51.416700 18093 raft_consensus.cc:697] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:51.417568 18093 consensus_queue.cc:237] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.424595 17596 catalog_manager.cc:5697] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 3 to 4, leader changed from 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2) to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 4 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.505331 18087 raft_consensus.cc:993] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e: : Instructing follower e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:51.505779 18046 raft_consensus.cc:1081] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Signalling peer e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:51.507233 17702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:52970
I20260709 12:21:51.507743 17702 raft_consensus.cc:493] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:51.508067 17702 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.512982 17702 raft_consensus.cc:515] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.515249 17702 leader_election.cc:290] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 3 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:51.516223 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:51.516470 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0782b29c294943ba99ebaf5ffb57dca5" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:51.516812 17777 raft_consensus.cc:3055] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:51.517091 17850 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.517206 17777 raft_consensus.cc:740] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:51.518077 17777 consensus_queue.cc:260] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.519174 17777 raft_consensus.cc:3060] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.521971 17850 raft_consensus.cc:2468] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 3.
I20260709 12:21:51.523180 17667 leader_election.cc:304] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:51.523993 18093 raft_consensus.cc:2804] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:51.524066 17777 raft_consensus.cc:2468] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 3.
I20260709 12:21:51.524541 18093 raft_consensus.cc:697] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:51.525620 18093 consensus_queue.cc:237] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.533205 17596 catalog_manager.cc:5697] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 2 to 3, leader changed from 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2) to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.592096 18087 raft_consensus.cc:993] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e: : Instructing follower e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:51.592602 18046 raft_consensus.cc:1081] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Signalling peer e35f84c8056d49bda99c1a5bae7d2679 to start an election
I20260709 12:21:51.594230 17702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873"
dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
 from {username='slave'} at 127.0.0.1:52970
I20260709 12:21:51.594888 17702 raft_consensus.cc:493] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:51.595363 17702 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.600492 17702 raft_consensus.cc:515] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.602103 17702 leader_election.cc:290] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 3 election: Requested vote from peers 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519), edade32f911b4eafb025543e30817b0c (127.17.40.3:34419)
I20260709 12:21:51.603040 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:51.603281 17850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8517c95cc00f4e3883d586915b1bf873" candidate_uuid: "e35f84c8056d49bda99c1a5bae7d2679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edade32f911b4eafb025543e30817b0c"
I20260709 12:21:51.603663 17777 raft_consensus.cc:3055] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:51.603768 17850 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.604001 17777 raft_consensus.cc:740] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:51.604796 17777 consensus_queue.cc:260] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.606000 17777 raft_consensus.cc:3060] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.610553 17850 raft_consensus.cc:2468] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 3.
I20260709 12:21:51.611758 17667 leader_election.cc:304] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:51.612587 17777 raft_consensus.cc:2468] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35f84c8056d49bda99c1a5bae7d2679 in term 3.
I20260709 12:21:51.612584 18093 raft_consensus.cc:2804] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:51.613258 18093 raft_consensus.cc:697] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Becoming Leader. State: Replica: e35f84c8056d49bda99c1a5bae7d2679, State: Running, Role: LEADER
I20260709 12:21:51.614187 18093 consensus_queue.cc:237] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.620986 17596 catalog_manager.cc:5697] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 reported cstate change: term changed from 2 to 3, leader changed from 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2) to e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "e35f84c8056d49bda99c1a5bae7d2679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.648679 18087 raft_consensus.cc:993] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e: : Instructing follower edade32f911b4eafb025543e30817b0c to start an election
I20260709 12:21:51.649178 18046 raft_consensus.cc:1081] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 5 LEADER]: Signalling peer edade32f911b4eafb025543e30817b0c to start an election
I20260709 12:21:51.650761 17850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf"
dest_uuid: "edade32f911b4eafb025543e30817b0c"
 from {username='slave'} at 127.0.0.1:32868
I20260709 12:21:51.651270 17850 raft_consensus.cc:493] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:51.651558 17850 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.655972 17850 raft_consensus.cc:515] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.657640 17850 leader_election.cc:290] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 6 election: Requested vote from peers e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481), 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519)
I20260709 12:21:51.658740 17777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "2a96610b2690477ba2a3f2f7186a097e"
I20260709 12:21:51.658717 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cb7d865af442b7a5164492a4c382cf" candidate_uuid: "edade32f911b4eafb025543e30817b0c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e35f84c8056d49bda99c1a5bae7d2679"
I20260709 12:21:51.659528 17702 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.659521 17777 raft_consensus.cc:3055] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:51.660063 17777 raft_consensus.cc:740] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2a96610b2690477ba2a3f2f7186a097e, State: Running, Role: LEADER
I20260709 12:21:51.660828 17777 consensus_queue.cc:260] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.661978 17777 raft_consensus.cc:3060] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.666293 17702 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 6.
I20260709 12:21:51.667604 17815 leader_election.cc:304] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35f84c8056d49bda99c1a5bae7d2679, edade32f911b4eafb025543e30817b0c; no voters: 
I20260709 12:21:51.668076 17777 raft_consensus.cc:2468] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edade32f911b4eafb025543e30817b0c in term 6.
I20260709 12:21:51.668452 18085 raft_consensus.cc:2804] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:51.668987 18085 raft_consensus.cc:697] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 6 LEADER]: Becoming Leader. State: Replica: edade32f911b4eafb025543e30817b0c, State: Running, Role: LEADER
I20260709 12:21:51.669827 18085 consensus_queue.cc:237] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } }
I20260709 12:21:51.677294 17596 catalog_manager.cc:5697] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c reported cstate change: term changed from 5 to 6, leader changed from 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2) to edade32f911b4eafb025543e30817b0c (127.17.40.3). New cstate: current_term: 6 leader_uuid: "edade32f911b4eafb025543e30817b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.789192 17702 raft_consensus.cc:1275] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:51.790545 18085 consensus_queue.cc:1048] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:51.800683 17777 raft_consensus.cc:1275] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:51.802635 18086 consensus_queue.cc:1048] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:51.925450 17777 raft_consensus.cc:1275] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:51.927162 18093 consensus_queue.cc:1048] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:51.936187 17850 raft_consensus.cc:1275] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:51.939160 18094 consensus_queue.cc:1048] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:52.053244 17850 raft_consensus.cc:1275] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:52.054478 18094 consensus_queue.cc:1048] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:52.064877 17777 raft_consensus.cc:1275] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:52.066408 18093 consensus_queue.cc:1048] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:52.121331 17777 raft_consensus.cc:1275] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:52.122640 18093 consensus_queue.cc:1048] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:52.133363 17850 raft_consensus.cc:1275] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Refusing update from remote peer e35f84c8056d49bda99c1a5bae7d2679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:52.134976 18105 consensus_queue.cc:1048] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edade32f911b4eafb025543e30817b0c" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:52.136193 17777 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 6 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:52.137705 18086 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a96610b2690477ba2a3f2f7186a097e" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:52.149366 17702 raft_consensus.cc:1275] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 6 FOLLOWER]: Refusing update from remote peer edade32f911b4eafb025543e30817b0c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:52.150681 18086 consensus_queue.cc:1048] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35f84c8056d49bda99c1a5bae7d2679" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:52.302139 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.307458 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:52.307911 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:53.309139 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:53.314838 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:53.315306 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:54.316645 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:54.322471 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:54.323020 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:55.324229 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:55.329886 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:55.330360 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:56.331475 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:56.337373 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:56.337832 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:57.339016 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:57.344134 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:57.344570 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:58.345709 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:58.351023 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:58.351455 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:59.352792 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:59.359719 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:59.360195 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:00.361436 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:00.366478 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:00.366966 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:01.399309 17568 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:22:01.399899 17568 tablet_server.cc:179] TabletServer@127.17.40.1:0 shutting down...
I20260709 12:22:01.433012 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:01.433871 17568 tablet_replica.cc:333] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.434875 17568 raft_consensus.cc:2243] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.435632 17568 raft_consensus.cc:2272] T 44c9a2becaa0413096cba58b92ec9702 P e35f84c8056d49bda99c1a5bae7d2679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.438522 17568 tablet_replica.cc:333] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.439126 17568 raft_consensus.cc:2243] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.439630 17568 raft_consensus.cc:2272] T e7a4e502cd9e41e89db84bbbf8707840 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.441382 17568 tablet_replica.cc:333] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.441926 17568 raft_consensus.cc:2243] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.442435 17568 raft_consensus.cc:2272] T 8be31e8908d94753915421aa61e4064f P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.444221 17568 tablet_replica.cc:333] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.444782 17568 raft_consensus.cc:2243] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.445628 17568 raft_consensus.cc:2272] T 0782b29c294943ba99ebaf5ffb57dca5 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.447494 17568 tablet_replica.cc:333] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.448043 17568 raft_consensus.cc:2243] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.448500 17568 raft_consensus.cc:2272] T 703f83feacac4d6eb53045d6b494fb04 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.450191 17568 tablet_replica.cc:333] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.450784 17568 raft_consensus.cc:2243] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.451646 17568 raft_consensus.cc:2272] T 8517c95cc00f4e3883d586915b1bf873 P e35f84c8056d49bda99c1a5bae7d2679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.453538 17568 tablet_replica.cc:333] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.454057 17568 raft_consensus.cc:2243] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.454926 17568 raft_consensus.cc:2272] T 10536ff303d440aa828e5200507989c4 P e35f84c8056d49bda99c1a5bae7d2679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.456652 17568 tablet_replica.cc:333] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.457139 17568 raft_consensus.cc:2243] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.457545 17568 raft_consensus.cc:2272] T 5281784b0bab461a8635c66333e01cfd P e35f84c8056d49bda99c1a5bae7d2679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.459290 17568 tablet_replica.cc:333] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679: stopping tablet replica
I20260709 12:22:01.459748 17568 raft_consensus.cc:2243] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.460183 17568 raft_consensus.cc:2272] T 89cb7d865af442b7a5164492a4c382cf P e35f84c8056d49bda99c1a5bae7d2679 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.554015 17568 tablet_server.cc:196] TabletServer@127.17.40.1:0 shutdown complete.
W20260709 12:22:01.562125 17815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36481: connect: Connection refused (error 111)
W20260709 12:22:01.566696 17815 consensus_peers.cc:597] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c -> Peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Couldn't send request to peer e35f84c8056d49bda99c1a5bae7d2679. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:01.577920 17568 tablet_server.cc:179] TabletServer@127.17.40.2:0 shutting down...
W20260709 12:22:01.602165 17815 consensus_peers.cc:597] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c -> Peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Couldn't send request to peer e35f84c8056d49bda99c1a5bae7d2679. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:01.616477 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:01.617255 17568 tablet_replica.cc:333] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.617928 17568 raft_consensus.cc:2243] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.618886 17568 raft_consensus.cc:2272] T 703f83feacac4d6eb53045d6b494fb04 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.620786 17568 tablet_replica.cc:333] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.621325 17568 raft_consensus.cc:2243] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.621758 17568 raft_consensus.cc:2272] T 5281784b0bab461a8635c66333e01cfd P 2a96610b2690477ba2a3f2f7186a097e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.623612 17568 tablet_replica.cc:333] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.624150 17568 raft_consensus.cc:2243] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.624621 17568 raft_consensus.cc:2272] T 89cb7d865af442b7a5164492a4c382cf P 2a96610b2690477ba2a3f2f7186a097e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.626461 17568 tablet_replica.cc:333] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.627038 17568 raft_consensus.cc:2243] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.627563 17568 raft_consensus.cc:2272] T 10536ff303d440aa828e5200507989c4 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.629336 17568 tablet_replica.cc:333] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.629873 17568 raft_consensus.cc:2243] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.630306 17568 raft_consensus.cc:2272] T 0782b29c294943ba99ebaf5ffb57dca5 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.632148 17568 tablet_replica.cc:333] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.632720 17568 raft_consensus.cc:2243] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.633204 17568 raft_consensus.cc:2272] T 8be31e8908d94753915421aa61e4064f P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.635089 17568 tablet_replica.cc:333] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.635609 17568 raft_consensus.cc:2243] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.636444 17568 raft_consensus.cc:2272] T 44c9a2becaa0413096cba58b92ec9702 P 2a96610b2690477ba2a3f2f7186a097e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.638355 17568 tablet_replica.cc:333] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.638917 17568 raft_consensus.cc:2243] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.639799 17568 raft_consensus.cc:2272] T e7a4e502cd9e41e89db84bbbf8707840 P 2a96610b2690477ba2a3f2f7186a097e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.641527 17568 tablet_replica.cc:333] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e: stopping tablet replica
I20260709 12:22:01.642015 17568 raft_consensus.cc:2243] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.642501 17568 raft_consensus.cc:2272] T 8517c95cc00f4e3883d586915b1bf873 P 2a96610b2690477ba2a3f2f7186a097e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:01.650600 17815 consensus_peers.cc:597] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c -> Peer e35f84c8056d49bda99c1a5bae7d2679 (127.17.40.1:36481): Couldn't send request to peer e35f84c8056d49bda99c1a5bae7d2679. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:01.675155 17568 tablet_server.cc:196] TabletServer@127.17.40.2:0 shutdown complete.
I20260709 12:22:01.694593 17568 tablet_server.cc:179] TabletServer@127.17.40.3:0 shutting down...
W20260709 12:22:01.708968 17816 consensus_peers.cc:597] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c -> Peer 2a96610b2690477ba2a3f2f7186a097e (127.17.40.2:44519): Couldn't send request to peer 2a96610b2690477ba2a3f2f7186a097e. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:01.725919 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:01.726907 17568 tablet_replica.cc:333] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.727901 17568 raft_consensus.cc:2243] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.728744 17568 raft_consensus.cc:2272] T 8517c95cc00f4e3883d586915b1bf873 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.731298 17568 tablet_replica.cc:333] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.731887 17568 raft_consensus.cc:2243] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.732887 17568 raft_consensus.cc:2272] T 5281784b0bab461a8635c66333e01cfd P edade32f911b4eafb025543e30817b0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.735114 17568 tablet_replica.cc:333] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.735644 17568 raft_consensus.cc:2243] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.736603 17568 raft_consensus.cc:2272] T 89cb7d865af442b7a5164492a4c382cf P edade32f911b4eafb025543e30817b0c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.738699 17568 tablet_replica.cc:333] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.739482 17568 raft_consensus.cc:2243] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.740020 17568 raft_consensus.cc:2272] T 10536ff303d440aa828e5200507989c4 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.742141 17568 tablet_replica.cc:333] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.742739 17568 raft_consensus.cc:2243] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.743283 17568 raft_consensus.cc:2272] T 703f83feacac4d6eb53045d6b494fb04 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.745008 17568 tablet_replica.cc:333] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.745544 17568 raft_consensus.cc:2243] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.746014 17568 raft_consensus.cc:2272] T 0782b29c294943ba99ebaf5ffb57dca5 P edade32f911b4eafb025543e30817b0c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.747843 17568 tablet_replica.cc:333] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.748425 17568 raft_consensus.cc:2243] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.749248 17568 raft_consensus.cc:2272] T 8be31e8908d94753915421aa61e4064f P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.751221 17568 tablet_replica.cc:333] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.751726 17568 raft_consensus.cc:2243] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.752205 17568 raft_consensus.cc:2272] T 44c9a2becaa0413096cba58b92ec9702 P edade32f911b4eafb025543e30817b0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.753953 17568 tablet_replica.cc:333] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c: stopping tablet replica
I20260709 12:22:01.754549 17568 raft_consensus.cc:2243] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.755004 17568 raft_consensus.cc:2272] T e7a4e502cd9e41e89db84bbbf8707840 P edade32f911b4eafb025543e30817b0c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.784389 17568 tablet_server.cc:196] TabletServer@127.17.40.3:0 shutdown complete.
I20260709 12:22:01.803874 17568 master.cc:562] Master@127.17.40.62:33765 shutting down...
I20260709 12:22:01.964286 17568 raft_consensus.cc:2243] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.965186 17568 raft_consensus.cc:2272] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.965715 17568 tablet_replica.cc:333] T 00000000000000000000000000000000 P af4887041edd4be1b71190e98e088038: stopping tablet replica
I20260709 12:22:02.004348 17568 master.cc:584] Master@127.17.40.62:33765 shutdown complete.
2a96610b2690477ba2a3f2f7186a097e  4
e35f84c8056d49bda99c1a5bae7d2679  4
edade32f911b4eafb025543e30817b0c  1
2a96610b2690477ba2a3f2f7186a097e  3
e35f84c8056d49bda99c1a5bae7d2679  3
edade32f911b4eafb025543e30817b0c  3
2a96610b2690477ba2a3f2f7186a097e  8
e35f84c8056d49bda99c1a5bae7d2679  0
edade32f911b4eafb025543e30817b0c  1
2a96610b2690477ba2a3f2f7186a097e  3
e35f84c8056d49bda99c1a5bae7d2679  3
edade32f911b4eafb025543e30817b0c  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (33368 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:22:02.050748 17568 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.40.62:34663
I20260709 12:22:02.051908 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:02.058732 18125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.058905 18128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.059185 18126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:02.059404 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:02.060889 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:02.061138 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:02.061339 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599722061320 us; error 0 us; skew 500 ppm
I20260709 12:22:02.061892 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:02.064661 17568 webserver.cc:533] Webserver started at http://127.17.40.62:34823/ using document root <none> and password file <none>
I20260709 12:22:02.065249 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:02.065485 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:02.065789 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:02.067127 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/master-0-root/instance:
uuid: "75b1ee02f2484988b7893046064c2a54"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-tjfs"
I20260709 12:22:02.072026 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:02.075954 18133 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.076994 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:22:02.077308 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/master-0-root
uuid: "75b1ee02f2484988b7893046064c2a54"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-tjfs"
I20260709 12:22:02.077602 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:02.124320 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:02.125615 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:02.166978 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.62:34663
I20260709 12:22:02.167078 18184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.62:34663 every 8 connection(s)
I20260709 12:22:02.171253 18185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.182075 18185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54: Bootstrap starting.
I20260709 12:22:02.187103 18185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.191735 18185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54: No bootstrap required, opened a new log
I20260709 12:22:02.194154 18185 raft_consensus.cc:359] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75b1ee02f2484988b7893046064c2a54" member_type: VOTER }
I20260709 12:22:02.194720 18185 raft_consensus.cc:385] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.194993 18185 raft_consensus.cc:740] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75b1ee02f2484988b7893046064c2a54, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.195616 18185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75b1ee02f2484988b7893046064c2a54" member_type: VOTER }
I20260709 12:22:02.196153 18185 raft_consensus.cc:399] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:02.196373 18185 raft_consensus.cc:493] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:02.196707 18185 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.200966 18185 raft_consensus.cc:515] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75b1ee02f2484988b7893046064c2a54" member_type: VOTER }
I20260709 12:22:02.201568 18185 leader_election.cc:304] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75b1ee02f2484988b7893046064c2a54; no voters: 
I20260709 12:22:02.202827 18185 leader_election.cc:290] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:02.203191 18188 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:02.204583 18188 raft_consensus.cc:697] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 1 LEADER]: Becoming Leader. State: Replica: 75b1ee02f2484988b7893046064c2a54, State: Running, Role: LEADER
I20260709 12:22:02.205391 18188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75b1ee02f2484988b7893046064c2a54" member_type: VOTER }
I20260709 12:22:02.205973 18185 sys_catalog.cc:565] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:02.210721 18189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75b1ee02f2484988b7893046064c2a54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75b1ee02f2484988b7893046064c2a54" member_type: VOTER } }
I20260709 12:22:02.211436 18189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:02.212604 18190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75b1ee02f2484988b7893046064c2a54. Latest consensus state: current_term: 1 leader_uuid: "75b1ee02f2484988b7893046064c2a54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75b1ee02f2484988b7893046064c2a54" member_type: VOTER } }
I20260709 12:22:02.213219 18190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:02.217448 18196 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:02.222692 18196 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:02.224198 17568 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:02.232523 18196 catalog_manager.cc:1383] Generated new cluster ID: 8843aa621f054dc69f65ffc41278227e
I20260709 12:22:02.232857 18196 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:02.260864 18196 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:02.262173 18196 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:02.283596 18196 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54: Generated new TSK 0
I20260709 12:22:02.284231 18196 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:02.291671 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:02.298812 18206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.299440 18207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.300493 18209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:02.301321 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:02.302446 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:02.302681 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:02.302883 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599722302861 us; error 0 us; skew 500 ppm
I20260709 12:22:02.303463 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:02.306038 17568 webserver.cc:533] Webserver started at http://127.17.40.1:45475/ using document root <none> and password file <none>
I20260709 12:22:02.306649 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:02.306879 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:02.307202 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:02.308320 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-0-root/instance:
uuid: "f88b95a5ceb646018800dbe92210850d"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-tjfs"
I20260709 12:22:02.313338 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:02.317289 18214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.318320 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:22:02.318791 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "f88b95a5ceb646018800dbe92210850d"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-tjfs"
I20260709 12:22:02.319157 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:02.334646 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:02.336014 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:02.337543 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:02.340286 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:02.340497 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.340812 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:02.341003 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.385437 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:41809
I20260709 12:22:02.385551 18276 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:41809 every 8 connection(s)
I20260709 12:22:02.390808 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:02.398515 18281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.398806 18282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.402923 18284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:02.404031 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:02.404851 18277 heartbeater.cc:344] Connected to a master server at 127.17.40.62:34663
I20260709 12:22:02.405273 18277 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:02.405347 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:02.405642 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:02.405848 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599722405829 us; error 0 us; skew 500 ppm
I20260709 12:22:02.406247 18277 heartbeater.cc:507] Master 127.17.40.62:34663 requested a full tablet report, sending...
I20260709 12:22:02.406641 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:02.408996 18150 ts_manager.cc:194] Registered new tserver with Master: f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809)
I20260709 12:22:02.409704 17568 webserver.cc:533] Webserver started at http://127.17.40.2:46533/ using document root <none> and password file <none>
I20260709 12:22:02.410276 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:02.410542 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:02.410841 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:02.411288 18150 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53018
I20260709 12:22:02.412130 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-1-root/instance:
uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-tjfs"
I20260709 12:22:02.417620 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:02.421694 18289 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.422681 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:02.423019 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-1-root
uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-tjfs"
I20260709 12:22:02.423357 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:02.445760 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:02.447255 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:02.448889 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:02.451454 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:02.451738 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.452015 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:02.452208 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.497967 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.2:42635
I20260709 12:22:02.498097 18351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.2:42635 every 8 connection(s)
I20260709 12:22:02.503262 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:02.512301 18355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.514003 18356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.516836 18358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:02.517360 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:02.518920 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:02.519275 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:02.519487 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599722519464 us; error 0 us; skew 500 ppm
I20260709 12:22:02.519399 18352 heartbeater.cc:344] Connected to a master server at 127.17.40.62:34663
I20260709 12:22:02.520073 18352 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:02.520328 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:02.521101 18352 heartbeater.cc:507] Master 127.17.40.62:34663 requested a full tablet report, sending...
I20260709 12:22:02.523728 18150 ts_manager.cc:194] Registered new tserver with Master: 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:02.524241 17568 webserver.cc:533] Webserver started at http://127.17.40.3:37819/ using document root <none> and password file <none>
I20260709 12:22:02.524853 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:02.525089 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:02.525471 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:02.525629 18150 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53026
I20260709 12:22:02.527196 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-2-root/instance:
uuid: "744fcdd127974560aae6a7f2999e5166"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-tjfs"
I20260709 12:22:02.532996 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:02.537039 18363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.538095 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:22:02.538534 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-2-root
uuid: "744fcdd127974560aae6a7f2999e5166"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-tjfs"
I20260709 12:22:02.538872 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599688508335-17568-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:02.569590 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:02.571323 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:02.573122 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:02.575953 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:02.576172 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.576503 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:02.576678 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.619100 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.3:38435
I20260709 12:22:02.619216 18425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.3:38435 every 8 connection(s)
I20260709 12:22:02.634097 18426 heartbeater.cc:344] Connected to a master server at 127.17.40.62:34663
I20260709 12:22:02.634575 18426 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:02.635458 18426 heartbeater.cc:507] Master 127.17.40.62:34663 requested a full tablet report, sending...
I20260709 12:22:02.637665 18150 ts_manager.cc:194] Registered new tserver with Master: 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:02.638641 17568 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016240108s
I20260709 12:22:02.639271 18150 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53042
I20260709 12:22:02.667201 18150 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53046:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:02.670262 18150 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:02.745090 18316 tablet_service.cc:1511] Processing CreateTablet for tablet a82214cfdfe849dc8caac812719ae78b (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:02.745029 18317 tablet_service.cc:1511] Processing CreateTablet for tablet 7982bab4284f4024ad6a7632dfc95937 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:02.746994 18316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82214cfdfe849dc8caac812719ae78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.747869 18317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7982bab4284f4024ad6a7632dfc95937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.750712 18315 tablet_service.cc:1511] Processing CreateTablet for tablet 427281ea08c74002a7564dd8b90009b8 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:02.752295 18315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427281ea08c74002a7564dd8b90009b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.757331 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 7982bab4284f4024ad6a7632dfc95937 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:02.758948 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7982bab4284f4024ad6a7632dfc95937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.758491 18314 tablet_service.cc:1511] Processing CreateTablet for tablet ce7ede191db14217b487bea5d2dade5f (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:02.762162 18241 tablet_service.cc:1511] Processing CreateTablet for tablet a82214cfdfe849dc8caac812719ae78b (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:02.763368 18314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7ede191db14217b487bea5d2dade5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.763741 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82214cfdfe849dc8caac812719ae78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.765601 18240 tablet_service.cc:1511] Processing CreateTablet for tablet 427281ea08c74002a7564dd8b90009b8 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:02.767854 18239 tablet_service.cc:1511] Processing CreateTablet for tablet ce7ede191db14217b487bea5d2dade5f (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:02.768296 18313 tablet_service.cc:1511] Processing CreateTablet for tablet fef486087d6d4f1baf35dfdb287c7592 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:02.780103 18313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef486087d6d4f1baf35dfdb287c7592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.775365 18312 tablet_service.cc:1511] Processing CreateTablet for tablet b32a6791d97b4613bce2768d43fedb4a (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:02.782651 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427281ea08c74002a7564dd8b90009b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.783447 18312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32a6791d97b4613bce2768d43fedb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.776013 18237 tablet_service.cc:1511] Processing CreateTablet for tablet b32a6791d97b4613bce2768d43fedb4a (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:02.774266 18238 tablet_service.cc:1511] Processing CreateTablet for tablet fef486087d6d4f1baf35dfdb287c7592 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:02.796326 18235 tablet_service.cc:1511] Processing CreateTablet for tablet 11180684279749a39b4db71cf37e7452 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:02.798167 18236 tablet_service.cc:1511] Processing CreateTablet for tablet d6765f457c3644f19301f4f43cda14af (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:02.798475 18310 tablet_service.cc:1511] Processing CreateTablet for tablet 11180684279749a39b4db71cf37e7452 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:02.785421 18311 tablet_service.cc:1511] Processing CreateTablet for tablet d6765f457c3644f19301f4f43cda14af (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:02.800107 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32a6791d97b4613bce2768d43fedb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.800781 18310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11180684279749a39b4db71cf37e7452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.803236 18311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6765f457c3644f19301f4f43cda14af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.806581 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6765f457c3644f19301f4f43cda14af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.814771 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11180684279749a39b4db71cf37e7452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.818080 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7ede191db14217b487bea5d2dade5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.819842 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef486087d6d4f1baf35dfdb287c7592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.829114 18234 tablet_service.cc:1511] Processing CreateTablet for tablet c84be94ba4d6461e9f0f06abfbbbf439 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:02.831338 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84be94ba4d6461e9f0f06abfbbbf439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.831511 18309 tablet_service.cc:1511] Processing CreateTablet for tablet c84be94ba4d6461e9f0f06abfbbbf439 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:02.833215 18309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84be94ba4d6461e9f0f06abfbbbf439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.843225 18391 tablet_service.cc:1511] Processing CreateTablet for tablet 7982bab4284f4024ad6a7632dfc95937 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:02.844822 18391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7982bab4284f4024ad6a7632dfc95937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.845507 18389 tablet_service.cc:1511] Processing CreateTablet for tablet 427281ea08c74002a7564dd8b90009b8 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:02.847383 18389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427281ea08c74002a7564dd8b90009b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.847695 18390 tablet_service.cc:1511] Processing CreateTablet for tablet a82214cfdfe849dc8caac812719ae78b (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:02.849187 18390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82214cfdfe849dc8caac812719ae78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.851811 18388 tablet_service.cc:1511] Processing CreateTablet for tablet ce7ede191db14217b487bea5d2dade5f (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:02.853478 18388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7ede191db14217b487bea5d2dade5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.855782 18387 tablet_service.cc:1511] Processing CreateTablet for tablet fef486087d6d4f1baf35dfdb287c7592 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:02.857407 18387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef486087d6d4f1baf35dfdb287c7592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.863528 18384 tablet_service.cc:1511] Processing CreateTablet for tablet 11180684279749a39b4db71cf37e7452 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:02.865211 18384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11180684279749a39b4db71cf37e7452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.867352 18386 tablet_service.cc:1511] Processing CreateTablet for tablet b32a6791d97b4613bce2768d43fedb4a (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:02.868824 18386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32a6791d97b4613bce2768d43fedb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.873579 18441 tablet_bootstrap.cc:492] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:02.863457 18385 tablet_service.cc:1511] Processing CreateTablet for tablet d6765f457c3644f19301f4f43cda14af (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:02.879125 18385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6765f457c3644f19301f4f43cda14af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.915541 18441 tablet_bootstrap.cc:654] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.926851 18383 tablet_service.cc:1511] Processing CreateTablet for tablet c84be94ba4d6461e9f0f06abfbbbf439 (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:02.928972 18383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84be94ba4d6461e9f0f06abfbbbf439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.951972 18240 tablet_service.cc:1511] Processing CreateTablet for tablet 735976b1978a4810b080ff0e95abc16a (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:02.963603 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735976b1978a4810b080ff0e95abc16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.968760 18317 tablet_service.cc:1511] Processing CreateTablet for tablet 735976b1978a4810b080ff0e95abc16a (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:02.971771 18317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735976b1978a4810b080ff0e95abc16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.991096 18442 tablet_bootstrap.cc:492] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:02.997752 18442 tablet_bootstrap.cc:654] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.028019 18443 tablet_bootstrap.cc:492] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.030200 18388 tablet_service.cc:1511] Processing CreateTablet for tablet 735976b1978a4810b080ff0e95abc16a (DEFAULT_TABLE table=test-workload [id=6c2407ec29c54b27bd60f0704be213ef]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:03.032027 18388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735976b1978a4810b080ff0e95abc16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.033972 18443 tablet_bootstrap.cc:654] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.036867 18442 tablet_bootstrap.cc:492] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.037488 18442 ts_tablet_manager.cc:1403] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.014s
I20260709 12:22:03.041749 18442 raft_consensus.cc:359] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.042631 18442 raft_consensus.cc:385] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.042968 18442 raft_consensus.cc:740] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.044016 18442 consensus_queue.cc:260] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.053675 18441 tablet_bootstrap.cc:492] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.054217 18441 ts_tablet_manager.cc:1403] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.013s
I20260709 12:22:03.054973 18442 ts_tablet_manager.cc:1434] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:22:03.055797 18277 heartbeater.cc:499] Master 127.17.40.62:34663 was elected leader, sending a full tablet report...
I20260709 12:22:03.057447 18441 raft_consensus.cc:359] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.058617 18441 raft_consensus.cc:385] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.059010 18441 raft_consensus.cc:740] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.060066 18441 consensus_queue.cc:260] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.061504 18443 tablet_bootstrap.cc:492] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.062026 18443 ts_tablet_manager.cc:1403] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.008s
I20260709 12:22:03.063232 18442 tablet_bootstrap.cc:492] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.065373 18443 raft_consensus.cc:359] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.066330 18443 raft_consensus.cc:385] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.066675 18443 raft_consensus.cc:740] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.067560 18443 consensus_queue.cc:260] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.073616 18442 tablet_bootstrap.cc:654] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.075708 18352 heartbeater.cc:499] Master 127.17.40.62:34663 was elected leader, sending a full tablet report...
I20260709 12:22:03.076296 18441 ts_tablet_manager.cc:1434] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 12:22:03.077406 18441 tablet_bootstrap.cc:492] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.080888 18449 raft_consensus.cc:493] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.081451 18449 raft_consensus.cc:515] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.087098 18441 tablet_bootstrap.cc:654] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.087602 18443 ts_tablet_manager.cc:1434] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.008s
I20260709 12:22:03.088652 18426 heartbeater.cc:499] Master 127.17.40.62:34663 was elected leader, sending a full tablet report...
I20260709 12:22:03.098579 18443 tablet_bootstrap.cc:492] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.107376 18443 tablet_bootstrap.cc:654] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:03.123540 18427 tablet.cc:2406] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:03.139599 18449 leader_election.cc:290] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435), f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809)
I20260709 12:22:03.153939 18443 tablet_bootstrap.cc:492] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.154592 18443 ts_tablet_manager.cc:1403] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.029s
I20260709 12:22:03.164908 18442 tablet_bootstrap.cc:492] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.165515 18442 ts_tablet_manager.cc:1403] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.103s	user 0.042s	sys 0.045s
I20260709 12:22:03.166016 18443 raft_consensus.cc:359] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.166873 18443 raft_consensus.cc:385] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.167193 18443 raft_consensus.cc:740] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.168247 18443 consensus_queue.cc:260] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.168745 18442 raft_consensus.cc:359] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.169502 18442 raft_consensus.cc:385] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.169826 18442 raft_consensus.cc:740] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.171429 18441 tablet_bootstrap.cc:492] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.171063 18442 consensus_queue.cc:260] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.172125 18441 ts_tablet_manager.cc:1403] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.095s	user 0.043s	sys 0.040s
I20260709 12:22:03.175699 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7982bab4284f4024ad6a7632dfc95937" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.176523 18252 raft_consensus.cc:2468] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.177992 18443 ts_tablet_manager.cc:1434] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:22:03.178020 18292 leader_election.cc:304] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:03.173475 18442 ts_tablet_manager.cc:1434] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:22:03.179095 18449 raft_consensus.cc:2804] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.179643 18449 raft_consensus.cc:493] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.180012 18449 raft_consensus.cc:3060] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.182559 18401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7982bab4284f4024ad6a7632dfc95937" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.183334 18401 raft_consensus.cc:2468] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.184930 18443 tablet_bootstrap.cc:492] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.185189 18442 tablet_bootstrap.cc:492] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.186084 18441 raft_consensus.cc:359] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.186954 18441 raft_consensus.cc:385] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.187336 18441 raft_consensus.cc:740] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.188283 18441 consensus_queue.cc:260] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.188757 18449 raft_consensus.cc:515] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.191866 18401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7982bab4284f4024ad6a7632dfc95937" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:03.192548 18401 raft_consensus.cc:3060] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.193077 18441 ts_tablet_manager.cc:1434] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:22:03.194041 18442 tablet_bootstrap.cc:654] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.194041 18443 tablet_bootstrap.cc:654] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.194262 18441 tablet_bootstrap.cc:492] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.200474 18401 raft_consensus.cc:2468] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.201754 18441 tablet_bootstrap.cc:654] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.201997 18291 leader_election.cc:304] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:03.203112 18448 raft_consensus.cc:2804] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.206315 18443 tablet_bootstrap.cc:492] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.206319 18442 tablet_bootstrap.cc:492] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.212224 18443 ts_tablet_manager.cc:1403] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.009s
I20260709 12:22:03.212241 18442 ts_tablet_manager.cc:1403] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.014s
I20260709 12:22:03.215152 18441 tablet_bootstrap.cc:492] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.215866 18441 ts_tablet_manager.cc:1403] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.011s
I20260709 12:22:03.215758 18442 raft_consensus.cc:359] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.218338 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7982bab4284f4024ad6a7632dfc95937" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
W20260709 12:22:03.218760 18198 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:03.219010 18252 raft_consensus.cc:3060] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.216770 18442 raft_consensus.cc:385] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.219581 18442 raft_consensus.cc:740] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.219494 18441 raft_consensus.cc:359] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.220340 18441 raft_consensus.cc:385] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.220177 18443 raft_consensus.cc:359] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.220850 18441 raft_consensus.cc:740] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.221017 18443 raft_consensus.cc:385] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.221415 18443 raft_consensus.cc:740] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.221480 18442 consensus_queue.cc:260] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.221757 18441 consensus_queue.cc:260] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.222257 18443 consensus_queue.cc:260] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.224206 18449 leader_election.cc:290] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Requested vote from peers 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435), f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809)
I20260709 12:22:03.226212 18448 raft_consensus.cc:697] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:03.227363 18442 ts_tablet_manager.cc:1434] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:22:03.227166 18448 consensus_queue.cc:237] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:03.228677 18442 tablet_bootstrap.cc:492] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.229241 18450 raft_consensus.cc:493] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.229650 18252 raft_consensus.cc:2468] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.229754 18450 raft_consensus.cc:515] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.234826 18441 ts_tablet_manager.cc:1434] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.005s
I20260709 12:22:03.236398 18441 tablet_bootstrap.cc:492] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.240129 18442 tablet_bootstrap.cc:654] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.245297 18441 tablet_bootstrap.cc:654] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.246346 18450 leader_election.cc:290] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:03.251569 18149 catalog_manager.cc:5697] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 1 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.265005 18443 ts_tablet_manager.cc:1434] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:22:03.270866 18448 raft_consensus.cc:493] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.271685 18448 raft_consensus.cc:515] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.274276 18443 tablet_bootstrap.cc:492] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.276031 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.277072 18252 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.278878 18292 leader_election.cc:304] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:03.280316 18460 raft_consensus.cc:2804] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.280896 18460 raft_consensus.cc:493] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.281378 18460 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.287707 18448 leader_election.cc:290] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.294783 18460 raft_consensus.cc:515] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.296073 18401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.296839 18401 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.299135 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:03.300063 18252 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.311935 18252 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.312512 18460 leader_election.cc:290] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.313273 18292 leader_election.cc:304] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:03.314832 18460 raft_consensus.cc:2804] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.315786 18460 raft_consensus.cc:697] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:03.317667 18460 consensus_queue.cc:237] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.319566 18401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:03.320397 18401 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.342167 18442 tablet_bootstrap.cc:492] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.342965 18442 ts_tablet_manager.cc:1403] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.115s	user 0.032s	sys 0.035s
I20260709 12:22:03.348047 18442 raft_consensus.cc:359] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.349198 18442 raft_consensus.cc:385] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.349560 18442 raft_consensus.cc:740] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.350479 18442 consensus_queue.cc:260] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.353163 18442 ts_tablet_manager.cc:1434] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:03.376019 18401 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.382231 18441 tablet_bootstrap.cc:492] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.383037 18441 ts_tablet_manager.cc:1403] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.147s	user 0.040s	sys 0.036s
I20260709 12:22:03.384810 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82214cfdfe849dc8caac812719ae78b" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" is_pre_election: true
I20260709 12:22:03.385852 18327 raft_consensus.cc:2468] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 0.
I20260709 12:22:03.388164 18364 leader_election.cc:304] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:03.389456 18450 raft_consensus.cc:2804] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.389936 18450 raft_consensus.cc:493] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.390655 18450 raft_consensus.cc:3060] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.399411 18441 raft_consensus.cc:359] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.400092 18450 raft_consensus.cc:515] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.400599 18441 raft_consensus.cc:385] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.401080 18441 raft_consensus.cc:740] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.402158 18441 consensus_queue.cc:260] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.405009 18441 ts_tablet_manager.cc:1434] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 12:22:03.406123 18441 tablet_bootstrap.cc:492] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.406057 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82214cfdfe849dc8caac812719ae78b" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.354257 18442 tablet_bootstrap.cc:492] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.406257 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82214cfdfe849dc8caac812719ae78b" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:03.406880 18252 raft_consensus.cc:2468] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 0.
I20260709 12:22:03.411170 18450 leader_election.cc:290] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:03.412133 18443 tablet_bootstrap.cc:654] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.412501 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82214cfdfe849dc8caac812719ae78b" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:03.413125 18327 raft_consensus.cc:3060] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.421025 18443 tablet_bootstrap.cc:492] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.421332 18327 raft_consensus.cc:2468] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 1.
I20260709 12:22:03.421868 18443 ts_tablet_manager.cc:1403] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.148s	user 0.011s	sys 0.005s
I20260709 12:22:03.422840 18364 leader_election.cc:304] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: f88b95a5ceb646018800dbe92210850d
I20260709 12:22:03.424154 18450 raft_consensus.cc:2804] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.425658 18441 tablet_bootstrap.cc:654] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.425272 18443 raft_consensus.cc:359] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.426352 18443 raft_consensus.cc:385] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.426760 18443 raft_consensus.cc:740] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.427597 18443 consensus_queue.cc:260] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.428916 18442 tablet_bootstrap.cc:654] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.429351 18150 catalog_manager.cc:5697] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 1 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.444115 18450 raft_consensus.cc:697] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Becoming Leader. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:03.445554 18450 consensus_queue.cc:237] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.451462 18441 tablet_bootstrap.cc:492] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.452054 18441 ts_tablet_manager.cc:1403] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.008s
I20260709 12:22:03.455334 18441 raft_consensus.cc:359] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.456298 18441 raft_consensus.cc:385] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.456681 18441 raft_consensus.cc:740] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.457864 18441 consensus_queue.cc:260] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.459059 18443 ts_tablet_manager.cc:1434] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.037s	user 0.017s	sys 0.019s
I20260709 12:22:03.460204 18442 tablet_bootstrap.cc:492] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.460445 18443 tablet_bootstrap.cc:492] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.460728 18442 ts_tablet_manager.cc:1403] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.000s
I20260709 12:22:03.463996 18442 raft_consensus.cc:359] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.464861 18442 raft_consensus.cc:385] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.465186 18442 raft_consensus.cc:740] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.467760 18443 tablet_bootstrap.cc:654] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.469563 18441 ts_tablet_manager.cc:1434] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:22:03.471645 18150 catalog_manager.cc:5697] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 reported cstate change: term changed from 0 to 1, leader changed from <none> to 744fcdd127974560aae6a7f2999e5166 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "744fcdd127974560aae6a7f2999e5166" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.473392 18441 tablet_bootstrap.cc:492] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.473734 18443 tablet_bootstrap.cc:492] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.474262 18443 ts_tablet_manager.cc:1403] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:22:03.476903 18443 raft_consensus.cc:359] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.477546 18443 raft_consensus.cc:385] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.477749 18443 raft_consensus.cc:740] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.478381 18443 consensus_queue.cc:260] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.478710 18442 consensus_queue.cc:260] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.481133 18441 tablet_bootstrap.cc:654] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.481207 18442 ts_tablet_manager.cc:1434] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:22:03.482465 18442 tablet_bootstrap.cc:492] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.486485 18443 ts_tablet_manager.cc:1434] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:22:03.487769 18443 tablet_bootstrap.cc:492] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.489599 18442 tablet_bootstrap.cc:654] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.495855 18443 tablet_bootstrap.cc:654] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.496232 18441 tablet_bootstrap.cc:492] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.496833 18441 ts_tablet_manager.cc:1403] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 12:22:03.500327 18441 raft_consensus.cc:359] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.501158 18441 raft_consensus.cc:385] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.501461 18441 raft_consensus.cc:740] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.502169 18441 consensus_queue.cc:260] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.507023 18441 ts_tablet_manager.cc:1434] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:22:03.508373 18441 tablet_bootstrap.cc:492] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.515452 18442 tablet_bootstrap.cc:492] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.516243 18442 ts_tablet_manager.cc:1403] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.012s
I20260709 12:22:03.518458 18441 tablet_bootstrap.cc:654] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.522944 18442 raft_consensus.cc:359] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.523772 18442 raft_consensus.cc:385] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.524104 18442 raft_consensus.cc:740] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.524569 18443 tablet_bootstrap.cc:492] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.525108 18443 ts_tablet_manager.cc:1403] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.038s	user 0.033s	sys 0.002s
I20260709 12:22:03.524998 18442 consensus_queue.cc:260] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.527619 18442 ts_tablet_manager.cc:1434] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:22:03.528029 18441 tablet_bootstrap.cc:492] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.528542 18441 ts_tablet_manager.cc:1403] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 12:22:03.528694 18442 tablet_bootstrap.cc:492] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.528379 18443 raft_consensus.cc:359] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.529153 18443 raft_consensus.cc:385] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.529476 18443 raft_consensus.cc:740] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.530267 18443 consensus_queue.cc:260] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.532163 18441 raft_consensus.cc:359] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.532935 18441 raft_consensus.cc:385] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.533257 18441 raft_consensus.cc:740] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.534148 18441 consensus_queue.cc:260] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.535539 18443 ts_tablet_manager.cc:1434] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.007s
I20260709 12:22:03.536434 18442 tablet_bootstrap.cc:654] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.536656 18443 tablet_bootstrap.cc:492] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.536777 18441 ts_tablet_manager.cc:1434] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:22:03.537796 18441 tablet_bootstrap.cc:492] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.544780 18441 tablet_bootstrap.cc:654] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.546041 18443 tablet_bootstrap.cc:654] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.554512 18442 tablet_bootstrap.cc:492] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.555094 18442 ts_tablet_manager.cc:1403] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 12:22:03.555716 18443 tablet_bootstrap.cc:492] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.556265 18443 ts_tablet_manager.cc:1403] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 12:22:03.558323 18442 raft_consensus.cc:359] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.559217 18442 raft_consensus.cc:385] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.559556 18442 raft_consensus.cc:740] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.559435 18443 raft_consensus.cc:359] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.560920 18443 raft_consensus.cc:385] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.560484 18442 consensus_queue.cc:260] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.561264 18443 raft_consensus.cc:740] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.562207 18443 consensus_queue.cc:260] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.564841 18443 ts_tablet_manager.cc:1434] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:22:03.566023 18443 tablet_bootstrap.cc:492] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.570196 18442 ts_tablet_manager.cc:1434] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.005s
I20260709 12:22:03.570111 18446 raft_consensus.cc:493] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.570858 18446 raft_consensus.cc:515] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.571529 18442 tablet_bootstrap.cc:492] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.573884 18446 leader_election.cc:290] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.577560 18446 raft_consensus.cc:493] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.578423 18446 raft_consensus.cc:515] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.580634 18443 tablet_bootstrap.cc:654] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.588690 18442 tablet_bootstrap.cc:654] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.601155 18446 leader_election.cc:290] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.602514 18446 raft_consensus.cc:493] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.603855 18446 raft_consensus.cc:515] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.605837 18441 tablet_bootstrap.cc:492] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.606472 18441 ts_tablet_manager.cc:1403] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.069s	user 0.026s	sys 0.038s
I20260709 12:22:03.609299 18446 leader_election.cc:290] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.609773 18441 raft_consensus.cc:359] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.610529 18441 raft_consensus.cc:385] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.610816 18441 raft_consensus.cc:740] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.611472 18441 consensus_queue.cc:260] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.616649 18401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.617663 18401 raft_consensus.cc:2468] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 0.
I20260709 12:22:03.619241 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.621177 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.622164 18399 raft_consensus.cc:2468] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 0.
I20260709 12:22:03.623086 18216 leader_election.cc:304] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
W20260709 12:22:03.624133 18216 leader_election.cc:343] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.624356 18460 raft_consensus.cc:493] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.625226 18446 raft_consensus.cc:2804] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.624842 18460 raft_consensus.cc:515] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.619724 18441 ts_tablet_manager.cc:1434] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.004s
I20260709 12:22:03.625592 18446 raft_consensus.cc:493] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.625980 18446 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.626686 18441 tablet_bootstrap.cc:492] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.626873 18442 tablet_bootstrap.cc:492] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.627261 18460 leader_election.cc:290] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.627291 18442 ts_tablet_manager.cc:1403] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.030s
I20260709 12:22:03.629804 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.630369 18442 raft_consensus.cc:359] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.631079 18442 raft_consensus.cc:385] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.631395 18442 raft_consensus.cc:740] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
W20260709 12:22:03.631626 18291 leader_election.cc:343] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.632014 18443 tablet_bootstrap.cc:492] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.624929 18216 leader_election.cc:304] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:03.632064 18442 consensus_queue.cc:260] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.632745 18443 ts_tablet_manager.cc:1403] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.004s
I20260709 12:22:03.633564 18488 raft_consensus.cc:2804] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.634001 18488 raft_consensus.cc:493] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.634325 18488 raft_consensus.cc:3060] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.635587 18441 tablet_bootstrap.cc:654] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.635511 18443 raft_consensus.cc:359] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.636271 18443 raft_consensus.cc:385] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.636546 18443 raft_consensus.cc:740] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.637310 18443 consensus_queue.cc:260] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.641973 18443 ts_tablet_manager.cc:1434] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:22:03.643390 18443 tablet_bootstrap.cc:492] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.646533 18448 raft_consensus.cc:493] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.647082 18448 raft_consensus.cc:515] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.649371 18448 leader_election.cc:290] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.654932 18460 consensus_queue.cc:1048] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:03.659228 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.659904 18252 raft_consensus.cc:2468] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.661067 18292 leader_election.cc:304] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 744fcdd127974560aae6a7f2999e5166
I20260709 12:22:03.656287 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.662515 18399 raft_consensus.cc:2468] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.662467 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.664299 18291 leader_election.cc:304] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:03.665264 18448 raft_consensus.cc:2804] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.665695 18448 raft_consensus.cc:493] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.666083 18448 raft_consensus.cc:3060] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.668202 18446 raft_consensus.cc:515] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.669112 18460 raft_consensus.cc:2804] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.669584 18460 raft_consensus.cc:493] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.670594 18460 raft_consensus.cc:3060] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.674985 18488 raft_consensus.cc:515] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.677103 18252 raft_consensus.cc:2393] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in current term 1: Already voted for candidate f88b95a5ceb646018800dbe92210850d in this term.
I20260709 12:22:03.678783 18449 raft_consensus.cc:493] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.679308 18449 raft_consensus.cc:515] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.680562 18401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:03.681131 18401 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.681373 18449 leader_election.cc:290] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.683815 18398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32a6791d97b4613bce2768d43fedb4a" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.684836 18398 raft_consensus.cc:2468] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.686767 18291 leader_election.cc:304] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:03.687949 18449 raft_consensus.cc:2804] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.688391 18458 raft_consensus.cc:493] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.688495 18449 raft_consensus.cc:493] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.689073 18449 raft_consensus.cc:3060] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.688961 18458 raft_consensus.cc:515] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.690212 18401 raft_consensus.cc:2468] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 1.
I20260709 12:22:03.691355 18446 leader_election.cc:290] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.691859 18216 leader_election.cc:304] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:03.692967 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:03.691473 18458 leader_election.cc:290] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.694216 18399 raft_consensus.cc:3060] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.695818 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.698082 18251 raft_consensus.cc:2468] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.696139 18398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.699702 18398 raft_consensus.cc:2468] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.700456 18446 raft_consensus.cc:2804] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.701016 18446 raft_consensus.cc:697] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:03.696673 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32a6791d97b4613bce2768d43fedb4a" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.701164 18291 leader_election.cc:304] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:03.703660 18443 tablet_bootstrap.cc:654] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.706007 18458 raft_consensus.cc:2804] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.701972 18446 consensus_queue.cc:237] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.706606 18458 raft_consensus.cc:493] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.707158 18458 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.691655 18488 leader_election.cc:290] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.717845 18441 tablet_bootstrap.cc:492] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.723681 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" is_pre_election: true
I20260709 12:22:03.730427 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" is_pre_election: true
I20260709 12:22:03.732100 18441 ts_tablet_manager.cc:1403] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.106s	user 0.022s	sys 0.035s
I20260709 12:22:03.732316 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" is_pre_election: true
I20260709 12:22:03.733521 18325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:03.735035 18324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:03.736459 18448 raft_consensus.cc:515] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.741698 18449 raft_consensus.cc:515] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.743197 18327 raft_consensus.cc:2393] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f88b95a5ceb646018800dbe92210850d in current term 1: Already voted for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in this term.
I20260709 12:22:03.744611 18449 leader_election.cc:290] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.741891 18460 raft_consensus.cc:515] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.746853 18326 raft_consensus.cc:2393] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f88b95a5ceb646018800dbe92210850d in current term 1: Already voted for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in this term.
I20260709 12:22:03.746948 18442 ts_tablet_manager.cc:1434] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.119s	user 0.026s	sys 0.066s
I20260709 12:22:03.747219 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32a6791d97b4613bce2768d43fedb4a" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:03.748059 18442 tablet_bootstrap.cc:492] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.748222 18450 raft_consensus.cc:493] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.748617 18448 leader_election.cc:290] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
W20260709 12:22:03.735299 18292 leader_election.cc:343] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.748680 18450 raft_consensus.cc:515] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.750878 18401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:03.752656 18450 leader_election.cc:290] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
W20260709 12:22:03.753000 18291 leader_election.cc:343] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.754427 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" is_pre_election: true
I20260709 12:22:03.754948 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.755823 18252 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 0.
I20260709 12:22:03.757557 18442 tablet_bootstrap.cc:654] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.758054 18366 leader_election.cc:304] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:03.759501 18450 raft_consensus.cc:2804] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.760084 18450 raft_consensus.cc:493] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.740094 18494 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:22:03.762763 18450 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.747826 18400 raft_consensus.cc:3060] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.755133 18326 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 0.
I20260709 12:22:03.770714 18442 tablet_bootstrap.cc:492] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.771276 18442 ts_tablet_manager.cc:1403] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
W20260709 12:22:03.771766 18215 leader_election.cc:343] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:03.773582 18215 leader_election.cc:343] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.773660 18442 raft_consensus.cc:359] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.782430 18442 raft_consensus.cc:385] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.782780 18442 raft_consensus.cc:740] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.783769 18442 consensus_queue.cc:260] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.740110 18399 raft_consensus.cc:2468] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 1.
I20260709 12:22:03.777221 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32a6791d97b4613bce2768d43fedb4a" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:03.770681 18441 raft_consensus.cc:359] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.787511 18252 raft_consensus.cc:3060] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.787806 18441 raft_consensus.cc:385] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.788233 18441 raft_consensus.cc:740] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.789238 18441 consensus_queue.cc:260] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.780700 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:03.790627 18251 raft_consensus.cc:3060] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.776528 18458 raft_consensus.cc:515] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.788908 18150 catalog_manager.cc:5697] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 0 to 1, leader changed from <none> to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 1 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.797214 18441 ts_tablet_manager.cc:1434] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:22:03.778491 18215 leader_election.cc:304] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f88b95a5ceb646018800dbe92210850d; no voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae
I20260709 12:22:03.798671 18441 tablet_bootstrap.cc:492] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Bootstrap starting.
I20260709 12:22:03.805231 18251 raft_consensus.cc:2468] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.805877 18446 raft_consensus.cc:2749] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.807067 18442 ts_tablet_manager.cc:1434] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:22:03.808703 18442 tablet_bootstrap.cc:492] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d: Bootstrap starting.
I20260709 12:22:03.809337 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:03.810540 18250 raft_consensus.cc:2393] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in current term 1: Already voted for candidate f88b95a5ceb646018800dbe92210850d in this term.
I20260709 12:22:03.810643 18458 leader_election.cc:290] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.812336 18401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:03.813127 18401 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.781175 18443 tablet_bootstrap.cc:492] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.815395 18443 ts_tablet_manager.cc:1403] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.172s	user 0.019s	sys 0.017s
I20260709 12:22:03.815471 18216 leader_election.cc:304] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 9ba16ff1cc5845a49acf82e9bf6e16ae
I20260709 12:22:03.816012 18441 tablet_bootstrap.cc:654] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.816776 18446 raft_consensus.cc:2804] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.817407 18446 raft_consensus.cc:697] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:03.818487 18446 consensus_queue.cc:237] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.820797 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:03.821344 18442 tablet_bootstrap.cc:654] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.821573 18250 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.822926 18401 raft_consensus.cc:2468] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.825448 18291 leader_election.cc:304] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:03.827113 18448 raft_consensus.cc:2804] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.828469 18448 raft_consensus.cc:697] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:03.830104 18448 consensus_queue.cc:237] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.831600 18460 leader_election.cc:290] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.832828 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:03.836119 18399 raft_consensus.cc:2393] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in current term 1: Already voted for candidate f88b95a5ceb646018800dbe92210850d in this term.
I20260709 12:22:03.837422 18252 raft_consensus.cc:2468] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.839287 18292 leader_election.cc:304] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 744fcdd127974560aae6a7f2999e5166
I20260709 12:22:03.840651 18292 leader_election.cc:304] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d
I20260709 12:22:03.841539 18458 raft_consensus.cc:2804] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.842077 18458 raft_consensus.cc:697] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:03.843101 18458 consensus_queue.cc:237] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.846601 18449 raft_consensus.cc:2749] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.852485 18441 tablet_bootstrap.cc:492] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae: No bootstrap required, opened a new log
I20260709 12:22:03.853091 18443 raft_consensus.cc:359] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.853888 18443 raft_consensus.cc:385] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.853545 18441 ts_tablet_manager.cc:1403] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.015s
I20260709 12:22:03.855461 18250 raft_consensus.cc:2468] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.856969 18149 catalog_manager.cc:5697] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 0 to 1, leader changed from <none> to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 1 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.860507 18292 leader_election.cc:304] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:03.852272 18450 raft_consensus.cc:515] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.861754 18449 consensus_queue.cc:1048] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:03.862795 18460 raft_consensus.cc:2804] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.854233 18443 raft_consensus.cc:740] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.863344 18460 raft_consensus.cc:697] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:03.864281 18460 consensus_queue.cc:237] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.865963 18441 raft_consensus.cc:359] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.870963 18441 raft_consensus.cc:385] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.871448 18442 tablet_bootstrap.cc:492] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d: No bootstrap required, opened a new log
I20260709 12:22:03.871371 18441 raft_consensus.cc:740] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.871965 18442 ts_tablet_manager.cc:1403] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.004s
I20260709 12:22:03.872370 18441 consensus_queue.cc:260] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.874631 18441 ts_tablet_manager.cc:1434] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:22:03.867846 18400 raft_consensus.cc:2468] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:03.869904 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:03.875846 18326 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.864141 18443 consensus_queue.cc:260] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.884285 18443 ts_tablet_manager.cc:1434] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 12:22:03.874969 18442 raft_consensus.cc:359] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.884972 18442 raft_consensus.cc:385] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.885303 18442 raft_consensus.cc:740] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.885860 18443 tablet_bootstrap.cc:492] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166: Bootstrap starting.
I20260709 12:22:03.895046 18449 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:03.885633 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:03.886080 18442 consensus_queue.cc:260] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.870523 18450 leader_election.cc:290] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:03.897730 18442 ts_tablet_manager.cc:1434] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:22:03.898797 18251 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.892110 18326 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 1.
I20260709 12:22:03.906080 18364 leader_election.cc:304] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:03.907430 18450 raft_consensus.cc:2804] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.908013 18450 raft_consensus.cc:697] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Becoming Leader. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:03.910878 18443 tablet_bootstrap.cc:654] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.908933 18450 consensus_queue.cc:237] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.913892 18251 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 1.
I20260709 12:22:03.933156 18252 raft_consensus.cc:3060] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.939762 18150 catalog_manager.cc:5697] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 reported cstate change: term changed from 0 to 1, leader changed from <none> to 744fcdd127974560aae6a7f2999e5166 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "744fcdd127974560aae6a7f2999e5166" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.942567 18450 consensus_queue.cc:1048] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:03.956120 18450 consensus_queue.cc:1048] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:03.987581 18443 tablet_bootstrap.cc:492] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166: No bootstrap required, opened a new log
I20260709 12:22:03.988095 18443 ts_tablet_manager.cc:1403] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.034s
I20260709 12:22:03.990870 18443 raft_consensus.cc:359] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.991644 18443 raft_consensus.cc:385] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.991956 18443 raft_consensus.cc:740] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.991974 18448 raft_consensus.cc:493] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.992079 18148 catalog_manager.cc:5697] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 1 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.992851 18448 raft_consensus.cc:515] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.992887 18443 consensus_queue.cc:260] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:03.994277 18148 catalog_manager.cc:5697] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 1 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.995397 18443 ts_tablet_manager.cc:1434] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:03.995597 18448 leader_election.cc:290] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:03.996467 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735976b1978a4810b080ff0e95abc16a" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:03.997089 18252 raft_consensus.cc:2468] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.997327 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735976b1978a4810b080ff0e95abc16a" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:03.997990 18400 raft_consensus.cc:2468] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 0.
I20260709 12:22:03.998420 18292 leader_election.cc:304] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:03.999662 18448 raft_consensus.cc:2804] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:04.000065 18448 raft_consensus.cc:493] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.000413 18448 raft_consensus.cc:3060] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.009244 18448 raft_consensus.cc:515] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.012014 18448 leader_election.cc:290] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:04.014770 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735976b1978a4810b080ff0e95abc16a" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:04.015172 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735976b1978a4810b080ff0e95abc16a" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:04.015614 18252 raft_consensus.cc:3060] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.015903 18400 raft_consensus.cc:3060] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.017138 18150 catalog_manager.cc:5697] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 1 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.023644 18252 raft_consensus.cc:2468] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:04.023801 18400 raft_consensus.cc:2468] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 1.
I20260709 12:22:04.025077 18292 leader_election.cc:304] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:04.025929 18448 raft_consensus.cc:2804] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:04.026500 18448 raft_consensus.cc:697] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:04.028299 18448 consensus_queue.cc:237] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.039533 18149 catalog_manager.cc:5697] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 1 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.112366 18448 raft_consensus.cc:493] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.112916 18448 raft_consensus.cc:515] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.114722 18448 leader_election.cc:290] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:04.115799 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "744fcdd127974560aae6a7f2999e5166" is_pre_election: true
I20260709 12:22:04.115720 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:04.116671 18400 raft_consensus.cc:2393] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in current term 1: Already voted for candidate f88b95a5ceb646018800dbe92210850d in this term.
I20260709 12:22:04.117661 18291 leader_election.cc:304] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d
I20260709 12:22:04.118367 18448 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.123481 18448 raft_consensus.cc:2749] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:04.172715 18450 raft_consensus.cc:493] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.173322 18450 raft_consensus.cc:515] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.175057 18446 consensus_queue.cc:1048] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.176594 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88b95a5ceb646018800dbe92210850d" is_pre_election: true
I20260709 12:22:04.176956 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" is_pre_election: true
I20260709 12:22:04.177560 18252 raft_consensus.cc:2393] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 744fcdd127974560aae6a7f2999e5166 in current term 1: Already voted for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in this term.
I20260709 12:22:04.178903 18450 leader_election.cc:290] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:04.179981 18366 leader_election.cc:304] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166; no voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d
I20260709 12:22:04.181453 18450 raft_consensus.cc:3060] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.195228 18488 consensus_queue.cc:1048] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.192826 18450 raft_consensus.cc:2749] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:04.208027 18327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7982bab4284f4024ad6a7632dfc95937"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:33910
I20260709 12:22:04.208783 18327 raft_consensus.cc:606] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:04.225211 18400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a82214cfdfe849dc8caac812719ae78b"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:40450
I20260709 12:22:04.225844 18400 raft_consensus.cc:606] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:04.231740 18327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:33910
I20260709 12:22:04.232443 18327 raft_consensus.cc:606] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:04.238804 18327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:33910
I20260709 12:22:04.239347 18448 consensus_queue.cc:1048] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.239437 18327 raft_consensus.cc:606] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:04.242785 18488 consensus_queue.cc:1048] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.253698 18449 consensus_queue.cc:1048] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.263674 18446 consensus_queue.cc:1048] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.267539 18449 consensus_queue.cc:1048] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.273114 18398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11180684279749a39b4db71cf37e7452"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
mode: GRACEFUL
new_leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
 from {username='slave'} at 127.0.0.1:40450
I20260709 12:22:04.273806 18398 raft_consensus.cc:606] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Received request to transfer leadership to TS 9ba16ff1cc5845a49acf82e9bf6e16ae
I20260709 12:22:04.299798 18458 consensus_queue.cc:1048] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.308619 18458 consensus_queue.cc:1048] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.311255 18250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
mode: GRACEFUL
new_leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
 from {username='slave'} at 127.0.0.1:51742
I20260709 12:22:04.311946 18250 raft_consensus.cc:606] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Received request to transfer leadership to TS 9ba16ff1cc5845a49acf82e9bf6e16ae
I20260709 12:22:04.321517 18327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "735976b1978a4810b080ff0e95abc16a"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
mode: GRACEFUL
new_leader_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:33910
I20260709 12:22:04.322276 18327 raft_consensus.cc:606] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Received request to transfer leadership to TS 744fcdd127974560aae6a7f2999e5166
I20260709 12:22:04.326998 18449 raft_consensus.cc:993] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:04.327519 18449 raft_consensus.cc:1081] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:04.329435 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51720
I20260709 12:22:04.330147 18251 raft_consensus.cc:493] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.330626 18251 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.337396 18458 consensus_queue.cc:1048] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.342535 18251 raft_consensus.cc:515] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.345996 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:04.346760 18327 raft_consensus.cc:3055] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.347121 18327 raft_consensus.cc:740] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:04.347970 18327 consensus_queue.cc:260] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.349023 18327 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:04.350299 18458 consensus_queue.cc:1175] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "744fcdd127974560aae6a7f2999e5166" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:22:04.355119 18251 leader_election.cc:290] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:04.357249 18327 raft_consensus.cc:2468] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:04.357844 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:04.358506 18400 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.358583 18215 leader_election.cc:304] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:04.359519 18446 raft_consensus.cc:2804] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.359956 18446 raft_consensus.cc:697] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:04.360786 18446 consensus_queue.cc:237] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.364388 18400 raft_consensus.cc:2468] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:04.368526 18149 catalog_manager.cc:5697] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 1 to 2, leader changed from 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 2 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.421989 18448 raft_consensus.cc:993] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:04.422508 18458 raft_consensus.cc:1081] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:04.424190 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51720
I20260709 12:22:04.424831 18251 raft_consensus.cc:493] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.425230 18251 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.430114 18251 raft_consensus.cc:515] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.432587 18251 leader_election.cc:290] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:04.433151 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:04.433775 18327 raft_consensus.cc:3055] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.433878 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:04.434513 18400 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.434178 18327 raft_consensus.cc:740] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:04.435814 18458 raft_consensus.cc:993] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:04.436335 18449 raft_consensus.cc:1081] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:04.435806 18327 consensus_queue.cc:260] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.437343 18327 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.438328 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7982bab4284f4024ad6a7632dfc95937"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51720
I20260709 12:22:04.439011 18251 raft_consensus.cc:493] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.439397 18251 raft_consensus.cc:3060] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.442538 18400 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:04.443915 18216 leader_election.cc:304] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:04.444195 18327 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:04.444866 18446 raft_consensus.cc:2804] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.445389 18446 raft_consensus.cc:697] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:04.446190 18446 consensus_queue.cc:237] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.447160 18251 raft_consensus.cc:515] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:04.449129 18251 leader_election.cc:290] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:04.450021 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7982bab4284f4024ad6a7632dfc95937" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:04.450754 18327 raft_consensus.cc:3055] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.450855 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7982bab4284f4024ad6a7632dfc95937" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:04.451134 18327 raft_consensus.cc:740] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:04.451459 18400 raft_consensus.cc:3060] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.452057 18327 consensus_queue.cc:260] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:04.453116 18327 raft_consensus.cc:3060] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.453969 18149 catalog_manager.cc:5697] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 1 to 2, leader changed from 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 2 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.459154 18400 raft_consensus.cc:2468] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:04.459645 18327 raft_consensus.cc:2468] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:04.460456 18216 leader_election.cc:304] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:04.461380 18446 raft_consensus.cc:2804] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.461928 18446 raft_consensus.cc:697] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:04.462697 18446 consensus_queue.cc:237] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } }
I20260709 12:22:04.469420 18149 catalog_manager.cc:5697] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 1 to 2, leader changed from 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 2 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.494508 18473 raft_consensus.cc:993] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:04.495041 18450 raft_consensus.cc:1081] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:04.496817 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a82214cfdfe849dc8caac812719ae78b"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51736
I20260709 12:22:04.497339 18251 raft_consensus.cc:493] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.497655 18251 raft_consensus.cc:3060] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.502876 18251 raft_consensus.cc:515] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.504812 18251 leader_election.cc:290] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:04.506207 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82214cfdfe849dc8caac812719ae78b" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:04.506222 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82214cfdfe849dc8caac812719ae78b" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:04.506908 18400 raft_consensus.cc:3055] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.506938 18327 raft_consensus.cc:3060] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.507292 18400 raft_consensus.cc:740] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:04.508203 18400 consensus_queue.cc:260] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.509198 18400 raft_consensus.cc:3060] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.512657 18327 raft_consensus.cc:2468] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:04.514015 18215 leader_election.cc:304] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:04.514719 18400 raft_consensus.cc:2468] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:04.515012 18446 raft_consensus.cc:2804] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.515552 18446 raft_consensus.cc:697] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:04.516422 18446 consensus_queue.cc:237] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.523229 18473 consensus_queue.cc:1048] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.524049 18450 consensus_queue.cc:1048] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.523841 18149 catalog_manager.cc:5697] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 1 to 2, leader changed from 744fcdd127974560aae6a7f2999e5166 (127.17.40.3) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 2 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.538616 18450 raft_consensus.cc:993] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166: : Instructing follower 9ba16ff1cc5845a49acf82e9bf6e16ae to start an election
I20260709 12:22:04.539433 18473 raft_consensus.cc:1081] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Signalling peer 9ba16ff1cc5845a49acf82e9bf6e16ae to start an election
I20260709 12:22:04.550534 18327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11180684279749a39b4db71cf37e7452"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
 from {username='slave'} at 127.0.0.1:33896
I20260709 12:22:04.551342 18327 raft_consensus.cc:493] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.551859 18327 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.560067 18327 raft_consensus.cc:515] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.562233 18327 leader_election.cc:290] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 2 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:04.563093 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:04.563805 18251 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.565193 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:04.565893 18400 raft_consensus.cc:3055] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.566280 18400 raft_consensus.cc:740] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:04.567260 18400 consensus_queue.cc:260] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.568692 18400 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.570446 18458 consensus_queue.cc:1048] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.572608 18251 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 2.
I20260709 12:22:04.573578 18458 consensus_queue.cc:1048] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.576629 18292 leader_election.cc:304] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:04.578001 18458 raft_consensus.cc:2804] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.581050 18400 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 2.
I20260709 12:22:04.583731 18458 raft_consensus.cc:697] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:04.584681 18458 consensus_queue.cc:237] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.590448 18460 raft_consensus.cc:993] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae: : Instructing follower 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:04.591014 18448 raft_consensus.cc:1081] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Signalling peer 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:04.594045 18398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "735976b1978a4810b080ff0e95abc16a"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:40444
I20260709 12:22:04.595727 18398 raft_consensus.cc:493] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.596592 18398 raft_consensus.cc:3060] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.598757 18150 catalog_manager.cc:5697] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 1 to 2, leader changed from 744fcdd127974560aae6a7f2999e5166 (127.17.40.3) to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 2 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.603821 18398 raft_consensus.cc:515] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.609184 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735976b1978a4810b080ff0e95abc16a" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:04.609323 18398 leader_election.cc:290] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 2 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:04.609387 18327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735976b1978a4810b080ff0e95abc16a" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:04.609875 18252 raft_consensus.cc:3060] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.610142 18327 raft_consensus.cc:3055] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.611208 18327 raft_consensus.cc:740] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:04.612102 18327 consensus_queue.cc:260] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.613518 18327 raft_consensus.cc:3060] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.618065 18252 raft_consensus.cc:2468] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 2.
I20260709 12:22:04.619382 18366 leader_election.cc:304] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:04.620308 18473 raft_consensus.cc:2804] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.620858 18473 raft_consensus.cc:697] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 2 LEADER]: Becoming Leader. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:04.620939 18327 raft_consensus.cc:2468] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 2.
I20260709 12:22:04.621763 18473 consensus_queue.cc:237] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.629313 18149 catalog_manager.cc:5697] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 reported cstate change: term changed from 1 to 2, leader changed from 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2) to 744fcdd127974560aae6a7f2999e5166 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "744fcdd127974560aae6a7f2999e5166" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.647532 18446 raft_consensus.cc:993] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d: : Instructing follower 9ba16ff1cc5845a49acf82e9bf6e16ae to start an election
I20260709 12:22:04.648042 18488 raft_consensus.cc:1081] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Signalling peer 9ba16ff1cc5845a49acf82e9bf6e16ae to start an election
I20260709 12:22:04.649730 18327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
 from {username='slave'} at 127.0.0.1:33908
I20260709 12:22:04.650420 18327 raft_consensus.cc:493] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.650856 18327 raft_consensus.cc:3060] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.656193 18327 raft_consensus.cc:515] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.657979 18327 leader_election.cc:290] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 2 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:04.659157 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:04.659514 18398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84be94ba4d6461e9f0f06abfbbbf439" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:04.659754 18252 raft_consensus.cc:3055] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.660104 18252 raft_consensus.cc:740] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:04.660145 18398 raft_consensus.cc:3060] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.661011 18252 consensus_queue.cc:260] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.662497 18252 raft_consensus.cc:3060] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.665777 18398 raft_consensus.cc:2468] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 2.
I20260709 12:22:04.667047 18291 leader_election.cc:304] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:04.667814 18458 raft_consensus.cc:2804] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.668298 18458 raft_consensus.cc:697] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:04.669171 18252 raft_consensus.cc:2468] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 2.
I20260709 12:22:04.669090 18458 consensus_queue.cc:237] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:04.676301 18149 catalog_manager.cc:5697] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 1 to 2, leader changed from f88b95a5ceb646018800dbe92210850d (127.17.40.1) to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 2 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.757077 18398 raft_consensus.cc:1275] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.758497 18488 consensus_queue.cc:1048] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.766459 18327 raft_consensus.cc:1275] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.768019 18446 consensus_queue.cc:1048] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.848507 18327 raft_consensus.cc:1275] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.849921 18490 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.855906 18398 raft_consensus.cc:1275] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.857760 18490 consensus_queue.cc:1048] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.859216 18400 raft_consensus.cc:1275] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.861490 18488 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.877313 18327 raft_consensus.cc:1275] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.881224 18490 consensus_queue.cc:1048] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.976320 18327 raft_consensus.cc:1275] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.977960 18490 consensus_queue.cc:1048] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.986768 18400 raft_consensus.cc:1275] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.990310 18490 consensus_queue.cc:1048] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.072585 18400 raft_consensus.cc:1275] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Refusing update from remote peer 9ba16ff1cc5845a49acf82e9bf6e16ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.074189 18458 consensus_queue.cc:1048] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.082336 18252 raft_consensus.cc:1275] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Refusing update from remote peer 9ba16ff1cc5845a49acf82e9bf6e16ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.084592 18448 consensus_queue.cc:1048] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.087643 18327 raft_consensus.cc:1275] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.089720 18473 consensus_queue.cc:1048] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.099541 18252 raft_consensus.cc:1275] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.099920 18251 raft_consensus.cc:1275] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Refusing update from remote peer 9ba16ff1cc5845a49acf82e9bf6e16ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.102012 18450 consensus_queue.cc:1048] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.102281 18448 consensus_queue.cc:1048] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.114861 18400 raft_consensus.cc:1275] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Refusing update from remote peer 9ba16ff1cc5845a49acf82e9bf6e16ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.117997 18448 consensus_queue.cc:1048] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:07.361070 17568 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:22:07.361860 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:07.380084 18251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
mode: GRACEFUL
new_leader_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:51748
I20260709 12:22:07.380681 18251 raft_consensus.cc:606] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Received request to transfer leadership to TS 744fcdd127974560aae6a7f2999e5166
I20260709 12:22:07.383496 18251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
mode: GRACEFUL
new_leader_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:51748
I20260709 12:22:07.384058 18251 raft_consensus.cc:606] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Received request to transfer leadership to TS 744fcdd127974560aae6a7f2999e5166
I20260709 12:22:07.385262 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:07.385744 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:07.509706 18446 raft_consensus.cc:993] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d: : Instructing follower 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:07.510221 18539 raft_consensus.cc:1081] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Signalling peer 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:07.511873 18398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:40446
I20260709 12:22:07.512423 18398 raft_consensus.cc:493] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:07.512766 18398 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.518046 18398 raft_consensus.cc:515] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:07.519790 18398 leader_election.cc:290] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 2 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:07.520915 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:07.520995 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:07.521724 18251 raft_consensus.cc:3055] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:07.521870 18326 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.522123 18251 raft_consensus.cc:740] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:07.523222 18251 consensus_queue.cc:260] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:07.524618 18251 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.528534 18326 raft_consensus.cc:2468] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 2.
I20260709 12:22:07.529942 18364 leader_election.cc:304] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:07.530929 18473 raft_consensus.cc:2804] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:07.531035 18251 raft_consensus.cc:2468] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 2.
I20260709 12:22:07.532272 18473 raft_consensus.cc:697] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 2 LEADER]: Becoming Leader. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:07.533196 18473 consensus_queue.cc:237] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:07.540287 18149 catalog_manager.cc:5697] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 reported cstate change: term changed from 1 to 2, leader changed from f88b95a5ceb646018800dbe92210850d (127.17.40.1) to 744fcdd127974560aae6a7f2999e5166 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "744fcdd127974560aae6a7f2999e5166" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.677863 18446 raft_consensus.cc:993] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d: : Instructing follower 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:07.678464 18446 raft_consensus.cc:1081] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Signalling peer 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:07.680164 18398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:40446
I20260709 12:22:07.680740 18398 raft_consensus.cc:493] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:07.681159 18398 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.687625 18398 raft_consensus.cc:515] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:07.689386 18398 leader_election.cc:290] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 3 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:07.690523 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:07.690456 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:07.691203 18326 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.691262 18251 raft_consensus.cc:3055] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:07.691686 18251 raft_consensus.cc:740] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:07.692437 18251 consensus_queue.cc:260] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:07.693441 18251 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.696789 18326 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 3.
I20260709 12:22:07.698045 18364 leader_election.cc:304] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:07.698909 18473 raft_consensus.cc:2804] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:07.699414 18473 raft_consensus.cc:697] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 3 LEADER]: Becoming Leader. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:07.700405 18251 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 3.
I20260709 12:22:07.700304 18473 consensus_queue.cc:237] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:07.710211 18149 catalog_manager.cc:5697] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 reported cstate change: term changed from 2 to 3, leader changed from f88b95a5ceb646018800dbe92210850d (127.17.40.1) to 744fcdd127974560aae6a7f2999e5166 (127.17.40.3). New cstate: current_term: 3 leader_uuid: "744fcdd127974560aae6a7f2999e5166" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.912789 18326 raft_consensus.cc:1275] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.914023 18473 consensus_queue.cc:1048] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.923754 18251 raft_consensus.cc:1275] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.925909 18553 consensus_queue.cc:1048] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:08.373450 18251 raft_consensus.cc:1275] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:08.373694 18326 raft_consensus.cc:1275] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:08.376152 18560 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:08.378154 18560 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:22:08.411187 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:08.430982 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:08.431771 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:09.164958 18348 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd8a0 after lost signal to thread 17571
W20260709 12:22:09.166286 18348 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdf80 after lost signal to thread 18184
W20260709 12:22:09.167470 18348 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2440 after lost signal to thread 18276
W20260709 12:22:09.168671 18348 debug-util.cc:398] Leaking SignalData structure 0x7b080009b140 after lost signal to thread 18351
W20260709 12:22:09.169711 18348 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8140 after lost signal to thread 18425
I20260709 12:22:09.433584 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:09.447557 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:09.448378 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:10.449899 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:10.460085 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:10.460640 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:11.461880 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:11.469506 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:11.470068 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:12.740968 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:12.748510 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:12.749068 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:13.010593 18348 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6d20 after lost signal to thread 17571
W20260709 12:22:13.011397 18348 debug-util.cc:398] Leaking SignalData structure 0x7b0800088ec0 after lost signal to thread 18184
W20260709 12:22:13.012159 18348 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdb80 after lost signal to thread 18276
W20260709 12:22:13.012827 18348 debug-util.cc:398] Leaking SignalData structure 0x7b080010b7e0 after lost signal to thread 18351
W20260709 12:22:13.013485 18348 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3920 after lost signal to thread 18425
I20260709 12:22:13.750149 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:13.756907 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:13.757474 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:14.758718 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:14.764323 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:14.764819 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:15.765863 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:15.771729 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:15.772214 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:16.773308 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.779403 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:16.779901 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:17.820003 17568 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:22:17.832289 18399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:40450
I20260709 12:22:17.833094 18399 raft_consensus.cc:606] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 3 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:17.842605 18399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:40450
I20260709 12:22:17.843191 18399 raft_consensus.cc:606] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 2 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:17.848806 18324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b32a6791d97b4613bce2768d43fedb4a"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:33910
I20260709 12:22:17.849488 18324 raft_consensus.cc:606] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:17.855072 18324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:33910
I20260709 12:22:17.855674 18324 raft_consensus.cc:606] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:17.861105 18324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11180684279749a39b4db71cf37e7452"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
mode: GRACEFUL
new_leader_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:33910
I20260709 12:22:17.861660 18324 raft_consensus.cc:606] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 LEADER]: Received request to transfer leadership to TS f88b95a5ceb646018800dbe92210850d
I20260709 12:22:17.931839 18568 raft_consensus.cc:993] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:17.932330 18568 raft_consensus.cc:1081] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 2 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:17.933992 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51736
I20260709 12:22:17.934615 18251 raft_consensus.cc:493] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.934926 18251 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.940729 18251 raft_consensus.cc:515] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:17.942601 18251 leader_election.cc:290] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 3 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:17.943789 18324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:17.943858 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:17.944694 18324 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.944839 18399 raft_consensus.cc:3055] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:17.945261 18399 raft_consensus.cc:740] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:17.946271 18399 consensus_queue.cc:260] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:17.947539 18399 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.950598 18324 raft_consensus.cc:2468] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 3.
I20260709 12:22:17.952009 18215 leader_election.cc:304] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:17.953013 18571 raft_consensus.cc:2804] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.954169 18571 raft_consensus.cc:697] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:17.954382 18399 raft_consensus.cc:2468] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 3.
I20260709 12:22:17.955454 18571 consensus_queue.cc:237] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:17.966735 18150 catalog_manager.cc:5697] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 2 to 3, leader changed from 744fcdd127974560aae6a7f2999e5166 (127.17.40.3) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 3 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.975270 18574 raft_consensus.cc:993] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:17.975850 18568 raft_consensus.cc:1081] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 3 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:17.977981 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51736
I20260709 12:22:17.978673 18251 raft_consensus.cc:493] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.979099 18251 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.985045 18251 raft_consensus.cc:515] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:17.986570 18251 leader_election.cc:290] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 4 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:17.987478 18324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:17.987564 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:17.988159 18324 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.988255 18399 raft_consensus.cc:3055] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.988662 18399 raft_consensus.cc:740] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:17.989495 18399 consensus_queue.cc:260] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:17.990669 18399 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.993988 18324 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 4.
I20260709 12:22:17.995536 18215 leader_election.cc:304] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba16ff1cc5845a49acf82e9bf6e16ae, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:17.996881 18571 raft_consensus.cc:2804] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:17.997078 18399 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 4.
I20260709 12:22:17.997427 18571 raft_consensus.cc:697] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 4 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:17.998324 18571 consensus_queue.cc:237] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.006736 18150 catalog_manager.cc:5697] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 3 to 4, leader changed from 744fcdd127974560aae6a7f2999e5166 (127.17.40.3) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 4 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.076414 18572 raft_consensus.cc:993] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:18.076982 18582 raft_consensus.cc:1081] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:18.078828 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51720
I20260709 12:22:18.079464 18251 raft_consensus.cc:493] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.079825 18251 raft_consensus.cc:3060] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.085215 18251 raft_consensus.cc:515] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.086846 18251 leader_election.cc:290] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:18.087903 18324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:18.087929 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6765f457c3644f19301f4f43cda14af" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:18.088533 18324 raft_consensus.cc:3055] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:18.088567 18399 raft_consensus.cc:3060] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.088897 18324 raft_consensus.cc:740] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:18.089649 18324 consensus_queue.cc:260] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.090811 18324 raft_consensus.cc:3060] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.094164 18399 raft_consensus.cc:2468] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:18.095723 18216 leader_election.cc:304] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:18.096505 18324 raft_consensus.cc:2468] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:18.096539 18571 raft_consensus.cc:2804] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:18.097254 18571 raft_consensus.cc:697] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:18.098359 18571 consensus_queue.cc:237] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.106470 18150 catalog_manager.cc:5697] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 1 to 2, leader changed from 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 2 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.132509 18572 raft_consensus.cc:993] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:18.133024 18582 raft_consensus.cc:1081] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:18.134572 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b32a6791d97b4613bce2768d43fedb4a"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51720
I20260709 12:22:18.135054 18251 raft_consensus.cc:493] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.135340 18251 raft_consensus.cc:3060] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.139993 18251 raft_consensus.cc:515] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.141861 18251 leader_election.cc:290] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:18.142958 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32a6791d97b4613bce2768d43fedb4a" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:18.143313 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32a6791d97b4613bce2768d43fedb4a" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:18.143517 18399 raft_consensus.cc:3060] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.143980 18326 raft_consensus.cc:3055] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:18.144371 18326 raft_consensus.cc:740] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:18.145268 18326 consensus_queue.cc:260] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.146473 18326 raft_consensus.cc:3060] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.149251 18399 raft_consensus.cc:2468] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:18.150358 18216 leader_election.cc:304] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:18.151126 18571 raft_consensus.cc:2804] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:18.151549 18571 raft_consensus.cc:697] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:18.152441 18326 raft_consensus.cc:2468] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 2.
I20260709 12:22:18.152526 18571 consensus_queue.cc:237] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.159891 18150 catalog_manager.cc:5697] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 1 to 2, leader changed from 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 2 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.304494 18572 raft_consensus.cc:993] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae: : Instructing follower f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:18.304987 18582 raft_consensus.cc:1081] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 LEADER]: Signalling peer f88b95a5ceb646018800dbe92210850d to start an election
I20260709 12:22:18.306564 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11180684279749a39b4db71cf37e7452"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
 from {username='slave'} at 127.0.0.1:51720
I20260709 12:22:18.307065 18251 raft_consensus.cc:493] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.307338 18251 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.312036 18251 raft_consensus.cc:515] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.313699 18251 leader_election.cc:290] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 3 election: Requested vote from peers 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:18.314604 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:18.314716 18399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "f88b95a5ceb646018800dbe92210850d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:18.315363 18399 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.315361 18326 raft_consensus.cc:3055] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:18.315944 18326 raft_consensus.cc:740] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:18.316840 18326 consensus_queue.cc:260] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.318118 18326 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.323298 18399 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 3.
I20260709 12:22:18.324572 18216 leader_election.cc:304] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, f88b95a5ceb646018800dbe92210850d; no voters: 
I20260709 12:22:18.325403 18571 raft_consensus.cc:2804] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:18.325591 18326 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88b95a5ceb646018800dbe92210850d in term 3.
I20260709 12:22:18.325891 18571 raft_consensus.cc:697] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Becoming Leader. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:18.326942 18571 consensus_queue.cc:237] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:18.334574 18150 catalog_manager.cc:5697] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d reported cstate change: term changed from 2 to 3, leader changed from 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2) to f88b95a5ceb646018800dbe92210850d (127.17.40.1). New cstate: current_term: 3 leader_uuid: "f88b95a5ceb646018800dbe92210850d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.347023 18326 raft_consensus.cc:1275] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.348475 18571 consensus_queue.cc:1048] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.360391 18399 raft_consensus.cc:1275] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.362651 18575 consensus_queue.cc:1048] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:18.456061 18399 raft_consensus.cc:1275] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:18.457535 18575 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:18.468211 18326 raft_consensus.cc:1275] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:18.470577 18575 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:18.482200 18399 raft_consensus.cc:1275] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.483696 18571 consensus_queue.cc:1048] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.492849 18326 raft_consensus.cc:1275] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.494727 18588 consensus_queue.cc:1048] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:18.609776 18399 raft_consensus.cc:1275] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.611197 18588 consensus_queue.cc:1048] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.621281 18326 raft_consensus.cc:1275] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.623145 18590 consensus_queue.cc:1048] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:18.857441 18399 raft_consensus.cc:1275] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.858719 18590 consensus_queue.cc:1048] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.867668 18326 raft_consensus.cc:1275] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Refusing update from remote peer f88b95a5ceb646018800dbe92210850d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.869355 18571 consensus_queue.cc:1048] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:21.050573 17568 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:22:21.051474 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:21.061013 18251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11180684279749a39b4db71cf37e7452"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
mode: GRACEFUL
new_leader_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:51748
I20260709 12:22:21.061736 18251 raft_consensus.cc:606] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Received request to transfer leadership to TS 744fcdd127974560aae6a7f2999e5166
I20260709 12:22:21.064831 18251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
mode: GRACEFUL
new_leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
 from {username='slave'} at 127.0.0.1:51748
I20260709 12:22:21.065316 18251 raft_consensus.cc:606] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 4 LEADER]: Received request to transfer leadership to TS 9ba16ff1cc5845a49acf82e9bf6e16ae
I20260709 12:22:21.067760 18251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
mode: GRACEFUL
new_leader_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:51748
I20260709 12:22:21.068217 18251 raft_consensus.cc:606] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Received request to transfer leadership to TS 744fcdd127974560aae6a7f2999e5166
I20260709 12:22:21.070531 18251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592"
dest_uuid: "f88b95a5ceb646018800dbe92210850d"
mode: GRACEFUL
new_leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
 from {username='slave'} at 127.0.0.1:51748
I20260709 12:22:21.071015 18251 raft_consensus.cc:606] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Received request to transfer leadership to TS 9ba16ff1cc5845a49acf82e9bf6e16ae
I20260709 12:22:21.071936 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:21.072379 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:21.141641 18590 raft_consensus.cc:993] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d: : Instructing follower 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:21.142267 18604 raft_consensus.cc:1081] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Signalling peer 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:21.143985 18400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:40446
I20260709 12:22:21.144526 18400 raft_consensus.cc:493] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.144881 18400 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.150593 18400 raft_consensus.cc:515] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.152910 18400 leader_election.cc:290] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 3 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:21.153777 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:21.154330 18324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7ede191db14217b487bea5d2dade5f" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:21.154568 18251 raft_consensus.cc:3055] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:21.154933 18251 raft_consensus.cc:740] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:21.154994 18324 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.155795 18251 consensus_queue.cc:260] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.157055 18251 raft_consensus.cc:3060] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.160835 18324 raft_consensus.cc:2468] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 3.
I20260709 12:22:21.162276 18364 leader_election.cc:304] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:21.163053 18251 raft_consensus.cc:2468] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 3.
I20260709 12:22:21.163252 18568 raft_consensus.cc:2804] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:21.164399 18568 raft_consensus.cc:697] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 3 LEADER]: Becoming Leader. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:21.165198 18568 consensus_queue.cc:237] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.175884 18148 catalog_manager.cc:5697] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 reported cstate change: term changed from 2 to 3, leader changed from f88b95a5ceb646018800dbe92210850d (127.17.40.1) to 744fcdd127974560aae6a7f2999e5166 (127.17.40.3). New cstate: current_term: 3 leader_uuid: "744fcdd127974560aae6a7f2999e5166" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:21.285751 18590 raft_consensus.cc:993] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d: : Instructing follower 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:21.286237 18604 raft_consensus.cc:1081] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Signalling peer 744fcdd127974560aae6a7f2999e5166 to start an election
I20260709 12:22:21.287873 18400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11180684279749a39b4db71cf37e7452"
dest_uuid: "744fcdd127974560aae6a7f2999e5166"
 from {username='slave'} at 127.0.0.1:40446
I20260709 12:22:21.288359 18400 raft_consensus.cc:493] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.288597 18400 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.293351 18400 raft_consensus.cc:515] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.294934 18400 leader_election.cc:290] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 4 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635)
I20260709 12:22:21.295894 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:21.295981 18324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11180684279749a39b4db71cf37e7452" candidate_uuid: "744fcdd127974560aae6a7f2999e5166" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
I20260709 12:22:21.296406 18251 raft_consensus.cc:3055] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:21.296656 18324 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.296720 18251 raft_consensus.cc:740] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:21.297569 18251 consensus_queue.cc:260] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.298739 18251 raft_consensus.cc:3060] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.304468 18324 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 4.
I20260709 12:22:21.304706 18251 raft_consensus.cc:2468] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744fcdd127974560aae6a7f2999e5166 in term 4.
I20260709 12:22:21.305743 18364 leader_election.cc:304] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:21.306294 18590 raft_consensus.cc:993] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d: : Instructing follower 9ba16ff1cc5845a49acf82e9bf6e16ae to start an election
I20260709 12:22:21.306569 18568 raft_consensus.cc:2804] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:21.306815 18604 raft_consensus.cc:1081] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 4 LEADER]: Signalling peer 9ba16ff1cc5845a49acf82e9bf6e16ae to start an election
I20260709 12:22:21.307173 18568 raft_consensus.cc:697] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 4 LEADER]: Becoming Leader. State: Replica: 744fcdd127974560aae6a7f2999e5166, State: Running, Role: LEADER
I20260709 12:22:21.308147 18568 consensus_queue.cc:237] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.308667 18324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
 from {username='slave'} at 127.0.0.1:33908
I20260709 12:22:21.309270 18324 raft_consensus.cc:493] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.309677 18324 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.316990 18324 raft_consensus.cc:515] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.317960 18148 catalog_manager.cc:5697] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 reported cstate change: term changed from 3 to 4, leader changed from f88b95a5ceb646018800dbe92210850d (127.17.40.1) to 744fcdd127974560aae6a7f2999e5166 (127.17.40.3). New cstate: current_term: 4 leader_uuid: "744fcdd127974560aae6a7f2999e5166" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:21.320940 18324 leader_election.cc:290] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 5 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:21.321215 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:21.321506 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427281ea08c74002a7564dd8b90009b8" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:21.321875 18251 raft_consensus.cc:3055] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:21.322084 18400 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.322219 18251 raft_consensus.cc:740] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:21.323189 18251 consensus_queue.cc:260] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.324460 18251 raft_consensus.cc:3060] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.329465 18400 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 5.
I20260709 12:22:21.331007 18291 leader_election.cc:304] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:21.331894 18602 raft_consensus.cc:2804] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:21.331790 18251 raft_consensus.cc:2468] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 5.
I20260709 12:22:21.333439 18602 raft_consensus.cc:697] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 5 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:21.334364 18602 consensus_queue.cc:237] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.342734 18148 catalog_manager.cc:5697] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 4 to 5, leader changed from f88b95a5ceb646018800dbe92210850d (127.17.40.1) to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 5 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:21.350580 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2a00 after lost signal to thread 17571
W20260709 12:22:21.351622 18273 debug-util.cc:398] Leaking SignalData structure 0x7b0800198c00 after lost signal to thread 18184
W20260709 12:22:21.352530 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08000c05c0 after lost signal to thread 18276
W20260709 12:22:21.353379 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08001cc0e0 after lost signal to thread 18351
W20260709 12:22:21.354151 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08000dad80 after lost signal to thread 18425
I20260709 12:22:21.569670 18251 raft_consensus.cc:1275] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:21.571703 18590 raft_consensus.cc:993] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d: : Instructing follower 9ba16ff1cc5845a49acf82e9bf6e16ae to start an election
I20260709 12:22:21.571314 18568 consensus_queue.cc:1048] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:21.572239 18590 raft_consensus.cc:1081] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Signalling peer 9ba16ff1cc5845a49acf82e9bf6e16ae to start an election
I20260709 12:22:21.573904 18324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592"
dest_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae"
 from {username='slave'} at 127.0.0.1:33908
I20260709 12:22:21.574465 18324 raft_consensus.cc:493] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.574828 18324 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.583351 18324 raft_consensus.cc:515] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.585619 18324 leader_election.cc:290] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 4 election: Requested vote from peers f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809), 744fcdd127974560aae6a7f2999e5166 (127.17.40.3:38435)
I20260709 12:22:21.586105 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f88b95a5ceb646018800dbe92210850d"
I20260709 12:22:21.586872 18250 raft_consensus.cc:3055] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:21.587304 18250 raft_consensus.cc:740] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f88b95a5ceb646018800dbe92210850d, State: Running, Role: LEADER
I20260709 12:22:21.588352 18250 consensus_queue.cc:260] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.592659 18400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef486087d6d4f1baf35dfdb287c7592" candidate_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "744fcdd127974560aae6a7f2999e5166"
I20260709 12:22:21.593288 18400 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.590071 18250 raft_consensus.cc:3060] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.600814 18400 raft_consensus.cc:2468] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 4.
I20260709 12:22:21.602473 18291 leader_election.cc:304] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744fcdd127974560aae6a7f2999e5166, 9ba16ff1cc5845a49acf82e9bf6e16ae; no voters: 
I20260709 12:22:21.603616 18602 raft_consensus.cc:2804] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:21.604242 18602 raft_consensus.cc:697] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 LEADER]: Becoming Leader. State: Replica: 9ba16ff1cc5845a49acf82e9bf6e16ae, State: Running, Role: LEADER
I20260709 12:22:21.605334 18250 raft_consensus.cc:2468] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba16ff1cc5845a49acf82e9bf6e16ae in term 4.
I20260709 12:22:21.605463 18602 consensus_queue.cc:237] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } }
I20260709 12:22:21.618559 18324 raft_consensus.cc:1275] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:21.620565 18605 consensus_queue.cc:1048] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:21.624014 18148 catalog_manager.cc:5697] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae reported cstate change: term changed from 3 to 4, leader changed from f88b95a5ceb646018800dbe92210850d (127.17.40.1) to 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2). New cstate: current_term: 4 leader_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:21.705534 18324 raft_consensus.cc:1275] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.706941 18568 consensus_queue.cc:1048] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba16ff1cc5845a49acf82e9bf6e16ae" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.718359 18251 raft_consensus.cc:1275] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Refusing update from remote peer 744fcdd127974560aae6a7f2999e5166: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.720746 18605 consensus_queue.cc:1048] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.743242 18400 raft_consensus.cc:1275] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 5 FOLLOWER]: Refusing update from remote peer 9ba16ff1cc5845a49acf82e9bf6e16ae: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:21.745077 18602 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:21.762710 18251 raft_consensus.cc:1275] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 5 FOLLOWER]: Refusing update from remote peer 9ba16ff1cc5845a49acf82e9bf6e16ae: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:21.769273 18625 consensus_queue.cc:1048] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:22.039346 18251 raft_consensus.cc:1275] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Refusing update from remote peer 9ba16ff1cc5845a49acf82e9bf6e16ae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:22.040871 18612 consensus_queue.cc:1048] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88b95a5ceb646018800dbe92210850d" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:22.064821 18400 raft_consensus.cc:1275] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Refusing update from remote peer 9ba16ff1cc5845a49acf82e9bf6e16ae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:22.068174 18625 consensus_queue.cc:1048] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "744fcdd127974560aae6a7f2999e5166" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:22.073596 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:22.083288 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:22.083925 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:23.085065 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:23.091495 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:23.092002 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:24.093012 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:24.099104 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:24.099594 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:25.100596 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:25.106310 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:25.106891 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:26.107977 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.114075 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:26.114655 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:27.115716 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:27.121603 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:27.122105 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:28.123137 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:28.128643 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:28.129141 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.130363 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.137722 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:29.138242 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:30.139302 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.145512 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:30.146020 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:31.180303 17568 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:22:31.180847 17568 tablet_server.cc:179] TabletServer@127.17.40.1:0 shutting down...
W20260709 12:22:31.206614 18292 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 12:22:31.209940 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:31.210904 17568 tablet_replica.cc:333] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
W20260709 12:22:31.211781 18292 consensus_peers.cc:597] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae -> Peer f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809): Couldn't send request to peer f88b95a5ceb646018800dbe92210850d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.211789 17568 raft_consensus.cc:2243] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.212841 17568 raft_consensus.cc:2272] T 735976b1978a4810b080ff0e95abc16a P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.215214 17568 tablet_replica.cc:333] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.215817 17568 raft_consensus.cc:2243] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.216313 17568 raft_consensus.cc:2272] T 11180684279749a39b4db71cf37e7452 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.218277 17568 tablet_replica.cc:333] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.218914 17568 raft_consensus.cc:2243] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.219391 17568 raft_consensus.cc:2272] T fef486087d6d4f1baf35dfdb287c7592 P f88b95a5ceb646018800dbe92210850d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.221400 17568 tablet_replica.cc:333] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.222013 17568 raft_consensus.cc:2243] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.222571 17568 raft_consensus.cc:2272] T ce7ede191db14217b487bea5d2dade5f P f88b95a5ceb646018800dbe92210850d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.224509 17568 tablet_replica.cc:333] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.225085 17568 raft_consensus.cc:2243] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.225984 17568 raft_consensus.cc:2272] T b32a6791d97b4613bce2768d43fedb4a P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.227948 17568 tablet_replica.cc:333] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.228497 17568 raft_consensus.cc:2243] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.229350 17568 raft_consensus.cc:2272] T 7982bab4284f4024ad6a7632dfc95937 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.231551 17568 tablet_replica.cc:333] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.232182 17568 raft_consensus.cc:2243] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.233024 17568 raft_consensus.cc:2272] T d6765f457c3644f19301f4f43cda14af P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.234927 17568 tablet_replica.cc:333] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.235488 17568 raft_consensus.cc:2243] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.235993 17568 raft_consensus.cc:2272] T 427281ea08c74002a7564dd8b90009b8 P f88b95a5ceb646018800dbe92210850d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.238055 17568 tablet_replica.cc:333] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.238601 17568 raft_consensus.cc:2243] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.239051 17568 raft_consensus.cc:2272] T c84be94ba4d6461e9f0f06abfbbbf439 P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.240939 17568 tablet_replica.cc:333] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d: stopping tablet replica
I20260709 12:22:31.241426 17568 raft_consensus.cc:2243] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.242290 17568 raft_consensus.cc:2272] T a82214cfdfe849dc8caac812719ae78b P f88b95a5ceb646018800dbe92210850d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.260649 18366 consensus_peers.cc:597] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 -> Peer f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809): Couldn't send request to peer f88b95a5ceb646018800dbe92210850d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.283651 18366 consensus_peers.cc:597] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 -> Peer f88b95a5ceb646018800dbe92210850d (127.17.40.1:41809): Couldn't send request to peer f88b95a5ceb646018800dbe92210850d. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:41809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.295183 17568 tablet_server.cc:196] TabletServer@127.17.40.1:0 shutdown complete.
I20260709 12:22:31.318096 17568 tablet_server.cc:179] TabletServer@127.17.40.2:0 shutting down...
I20260709 12:22:31.348866 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:31.349710 17568 tablet_replica.cc:333] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.350507 17568 raft_consensus.cc:2243] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.350998 17568 raft_consensus.cc:2272] T 735976b1978a4810b080ff0e95abc16a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.352909 17568 tablet_replica.cc:333] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.353485 17568 raft_consensus.cc:2243] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.353994 17568 raft_consensus.cc:2272] T 11180684279749a39b4db71cf37e7452 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.356448 17568 tablet_replica.cc:333] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.357043 17568 raft_consensus.cc:2243] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.357971 17568 raft_consensus.cc:2272] T c84be94ba4d6461e9f0f06abfbbbf439 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.359418 18364 consensus_peers.cc:597] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 -> Peer 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635): Couldn't send request to peer 9ba16ff1cc5845a49acf82e9bf6e16ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.360671 17568 tablet_replica.cc:333] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.361296 17568 raft_consensus.cc:2243] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.361793 17568 raft_consensus.cc:2272] T a82214cfdfe849dc8caac812719ae78b P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.363734 17568 tablet_replica.cc:333] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.364293 17568 raft_consensus.cc:2243] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.365176 17568 raft_consensus.cc:2272] T fef486087d6d4f1baf35dfdb287c7592 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.367218 17568 tablet_replica.cc:333] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.367982 17568 raft_consensus.cc:2243] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.368559 17568 raft_consensus.cc:2272] T ce7ede191db14217b487bea5d2dade5f P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.371063 17568 tablet_replica.cc:333] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.371541 17568 raft_consensus.cc:2243] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.371954 17568 raft_consensus.cc:2272] T d6765f457c3644f19301f4f43cda14af P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.373788 17568 tablet_replica.cc:333] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.374240 17568 raft_consensus.cc:2243] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.374660 17568 raft_consensus.cc:2272] T b32a6791d97b4613bce2768d43fedb4a P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.376335 17568 tablet_replica.cc:333] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.376791 17568 raft_consensus.cc:2243] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.377519 17568 raft_consensus.cc:2272] T 427281ea08c74002a7564dd8b90009b8 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.379922 17568 tablet_replica.cc:333] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae: stopping tablet replica
I20260709 12:22:31.380407 17568 raft_consensus.cc:2243] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.380985 17568 raft_consensus.cc:2272] T 7982bab4284f4024ad6a7632dfc95937 P 9ba16ff1cc5845a49acf82e9bf6e16ae [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.382725 18364 consensus_peers.cc:597] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 -> Peer 9ba16ff1cc5845a49acf82e9bf6e16ae (127.17.40.2:42635): Couldn't send request to peer 9ba16ff1cc5845a49acf82e9bf6e16ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.434002 17568 tablet_server.cc:196] TabletServer@127.17.40.2:0 shutdown complete.
I20260709 12:22:31.456118 17568 tablet_server.cc:179] TabletServer@127.17.40.3:0 shutting down...
I20260709 12:22:31.484616 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:31.485387 17568 tablet_replica.cc:333] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.486081 17568 raft_consensus.cc:2243] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.487077 17568 raft_consensus.cc:2272] T 735976b1978a4810b080ff0e95abc16a P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.489097 17568 tablet_replica.cc:333] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.489670 17568 raft_consensus.cc:2243] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.490597 17568 raft_consensus.cc:2272] T 11180684279749a39b4db71cf37e7452 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.492578 17568 tablet_replica.cc:333] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.493135 17568 raft_consensus.cc:2243] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.493597 17568 raft_consensus.cc:2272] T c84be94ba4d6461e9f0f06abfbbbf439 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.495559 17568 tablet_replica.cc:333] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.496129 17568 raft_consensus.cc:2243] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.496601 17568 raft_consensus.cc:2272] T a82214cfdfe849dc8caac812719ae78b P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.498319 17568 tablet_replica.cc:333] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.498864 17568 raft_consensus.cc:2243] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.499289 17568 raft_consensus.cc:2272] T fef486087d6d4f1baf35dfdb287c7592 P 744fcdd127974560aae6a7f2999e5166 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.500977 17568 tablet_replica.cc:333] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.501472 17568 raft_consensus.cc:2243] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.502547 17568 raft_consensus.cc:2272] T ce7ede191db14217b487bea5d2dade5f P 744fcdd127974560aae6a7f2999e5166 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.504436 17568 tablet_replica.cc:333] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.504956 17568 raft_consensus.cc:2243] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.505399 17568 raft_consensus.cc:2272] T d6765f457c3644f19301f4f43cda14af P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.507388 17568 tablet_replica.cc:333] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.507885 17568 raft_consensus.cc:2243] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.508297 17568 raft_consensus.cc:2272] T b32a6791d97b4613bce2768d43fedb4a P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.510176 17568 tablet_replica.cc:333] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.510727 17568 raft_consensus.cc:2243] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.511154 17568 raft_consensus.cc:2272] T 427281ea08c74002a7564dd8b90009b8 P 744fcdd127974560aae6a7f2999e5166 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.512976 17568 tablet_replica.cc:333] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166: stopping tablet replica
I20260709 12:22:31.513412 17568 raft_consensus.cc:2243] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.514029 17568 raft_consensus.cc:2272] T 7982bab4284f4024ad6a7632dfc95937 P 744fcdd127974560aae6a7f2999e5166 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.543838 17568 tablet_server.cc:196] TabletServer@127.17.40.3:0 shutdown complete.
I20260709 12:22:31.566192 17568 master.cc:562] Master@127.17.40.62:34663 shutting down...
I20260709 12:22:31.592722 17568 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.593405 17568 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.593776 17568 tablet_replica.cc:333] T 00000000000000000000000000000000 P 75b1ee02f2484988b7893046064c2a54: stopping tablet replica
I20260709 12:22:31.614640 17568 master.cc:584] Master@127.17.40.62:34663 shutdown complete.
744fcdd127974560aae6a7f2999e5166  1
9ba16ff1cc5845a49acf82e9bf6e16ae  4
f88b95a5ceb646018800dbe92210850d  5
744fcdd127974560aae6a7f2999e5166  3
9ba16ff1cc5845a49acf82e9bf6e16ae  4
f88b95a5ceb646018800dbe92210850d  3
744fcdd127974560aae6a7f2999e5166  1
9ba16ff1cc5845a49acf82e9bf6e16ae  1
f88b95a5ceb646018800dbe92210850d  8
744fcdd127974560aae6a7f2999e5166  3
9ba16ff1cc5845a49acf82e9bf6e16ae  3
f88b95a5ceb646018800dbe92210850d  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29609 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:22:31.660243 17568 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.40.62:43633
I20260709 12:22:31.661551 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:31.668336 18646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:31.668502 18647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:31.669010 18649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:31.669884 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:31.671198 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:31.671418 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:31.671545 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599751671534 us; error 0 us; skew 500 ppm
I20260709 12:22:31.672096 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:31.674950 17568 webserver.cc:533] Webserver started at http://127.17.40.62:33857/ using document root <none> and password file <none>
I20260709 12:22:31.675473 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:31.675659 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:31.675935 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:31.677228 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/master-0-root/instance:
uuid: "bcc1b451ad6147bd802f7cd458a81a5c"
format_stamp: "Formatted at 2026-07-09 12:22:31 on dist-test-slave-tjfs"
I20260709 12:22:31.682610 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:22:31.686810 18654 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:31.687986 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:22:31.688289 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/master-0-root
uuid: "bcc1b451ad6147bd802f7cd458a81a5c"
format_stamp: "Formatted at 2026-07-09 12:22:31 on dist-test-slave-tjfs"
I20260709 12:22:31.688556 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:31.704793 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:31.706049 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:31.752108 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.62:43633
I20260709 12:22:31.752226 18705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.62:43633 every 8 connection(s)
I20260709 12:22:31.756544 18706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.768184 18706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Bootstrap starting.
I20260709 12:22:31.773636 18706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.778698 18706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: No bootstrap required, opened a new log
I20260709 12:22:31.781709 18706 raft_consensus.cc:359] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc1b451ad6147bd802f7cd458a81a5c" member_type: VOTER }
I20260709 12:22:31.782253 18706 raft_consensus.cc:385] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.782557 18706 raft_consensus.cc:740] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcc1b451ad6147bd802f7cd458a81a5c, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.783226 18706 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc1b451ad6147bd802f7cd458a81a5c" member_type: VOTER }
I20260709 12:22:31.783797 18706 raft_consensus.cc:399] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:31.784041 18706 raft_consensus.cc:493] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:31.784431 18706 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.789386 18706 raft_consensus.cc:515] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc1b451ad6147bd802f7cd458a81a5c" member_type: VOTER }
I20260709 12:22:31.790088 18706 leader_election.cc:304] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcc1b451ad6147bd802f7cd458a81a5c; no voters: 
I20260709 12:22:31.791496 18706 leader_election.cc:290] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:31.791930 18709 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.793411 18709 raft_consensus.cc:697] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 1 LEADER]: Becoming Leader. State: Replica: bcc1b451ad6147bd802f7cd458a81a5c, State: Running, Role: LEADER
I20260709 12:22:31.794212 18709 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc1b451ad6147bd802f7cd458a81a5c" member_type: VOTER }
I20260709 12:22:31.795202 18706 sys_catalog.cc:565] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:31.800233 18711 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcc1b451ad6147bd802f7cd458a81a5c. Latest consensus state: current_term: 1 leader_uuid: "bcc1b451ad6147bd802f7cd458a81a5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc1b451ad6147bd802f7cd458a81a5c" member_type: VOTER } }
I20260709 12:22:31.800414 18710 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcc1b451ad6147bd802f7cd458a81a5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc1b451ad6147bd802f7cd458a81a5c" member_type: VOTER } }
I20260709 12:22:31.801160 18711 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:31.801273 18710 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:31.807648 18716 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:31.816848 18716 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:31.818084 17568 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:31.827256 18716 catalog_manager.cc:1383] Generated new cluster ID: 8540b42ad89e4eb7a7d6183ca6251b50
I20260709 12:22:31.827580 18716 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:31.844031 18716 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:31.845424 18716 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:31.859063 18716 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Generated new TSK 0
I20260709 12:22:31.859715 18716 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:31.885006 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:31.891551 18727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:31.893054 18728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:31.895023 18730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:31.895162 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:31.896497 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:31.896782 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:31.896965 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599751896947 us; error 0 us; skew 500 ppm
I20260709 12:22:31.897531 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:31.900110 17568 webserver.cc:533] Webserver started at http://127.17.40.1:35041/ using document root <none> and password file <none>
I20260709 12:22:31.900660 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:31.900884 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:31.901170 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:31.902346 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/instance:
uuid: "1e2529a8cff04207bb1b07c108e16983"
format_stamp: "Formatted at 2026-07-09 12:22:31 on dist-test-slave-tjfs"
I20260709 12:22:31.907394 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:22:31.911103 18735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:31.911945 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:22:31.912274 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "1e2529a8cff04207bb1b07c108e16983"
format_stamp: "Formatted at 2026-07-09 12:22:31 on dist-test-slave-tjfs"
I20260709 12:22:31.912611 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:31.925935 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:31.927368 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:31.928933 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:31.931486 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:31.931742 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:31.932039 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:31.932255 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:31.975760 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:46365
I20260709 12:22:31.975873 18797 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:46365 every 8 connection(s)
I20260709 12:22:31.981082 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:31.989854 18802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:31.990092 18803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:31.992504 18805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:31.995512 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:31.997218 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:31.997453 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:31.997684 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599751997649 us; error 0 us; skew 500 ppm
I20260709 12:22:31.998267 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:32.000833 18798 heartbeater.cc:344] Connected to a master server at 127.17.40.62:43633
I20260709 12:22:32.001281 18798 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:32.001715 17568 webserver.cc:533] Webserver started at http://127.17.40.2:44285/ using document root <none> and password file <none>
I20260709 12:22:32.002131 18798 heartbeater.cc:507] Master 127.17.40.62:43633 requested a full tablet report, sending...
I20260709 12:22:32.002283 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:32.002615 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:32.002962 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:32.004330 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/instance:
uuid: "47b48b5c69f245b79ecb292eff89927f"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-tjfs"
I20260709 12:22:32.004727 18671 ts_manager.cc:194] Registered new tserver with Master: 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:22:32.006675 18671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47848
I20260709 12:22:32.009778 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:32.013679 18810 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.014976 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:32.015355 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root
uuid: "47b48b5c69f245b79ecb292eff89927f"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-tjfs"
I20260709 12:22:32.015661 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:32.038501 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:32.039855 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:32.041363 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:32.043831 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:32.044085 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.044341 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:32.044523 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.085938 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.2:36959
I20260709 12:22:32.086045 18872 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.2:36959 every 8 connection(s)
I20260709 12:22:32.091118 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:32.100539 18876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:32.103258 18877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:32.104456 18879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:32.106092 18873 heartbeater.cc:344] Connected to a master server at 127.17.40.62:43633
I20260709 12:22:32.106573 18873 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:32.106846 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:32.107622 18873 heartbeater.cc:507] Master 127.17.40.62:43633 requested a full tablet report, sending...
I20260709 12:22:32.108156 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:32.108466 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:32.108696 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599752108677 us; error 0 us; skew 500 ppm
I20260709 12:22:32.109473 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:32.110081 18671 ts_manager.cc:194] Registered new tserver with Master: 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:32.112212 18671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47856
I20260709 12:22:32.112695 17568 webserver.cc:533] Webserver started at http://127.17.40.3:33995/ using document root <none> and password file <none>
I20260709 12:22:32.113386 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:32.113673 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:32.114071 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:32.115609 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/instance:
uuid: "674d77fe8bcb4c768537ebae4be828bd"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-tjfs"
I20260709 12:22:32.121002 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:22:32.124982 18884 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.125805 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:32.126151 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root
uuid: "674d77fe8bcb4c768537ebae4be828bd"
format_stamp: "Formatted at 2026-07-09 12:22:32 on dist-test-slave-tjfs"
I20260709 12:22:32.126530 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:32.145403 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:32.146806 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:32.148452 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:32.150946 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:32.151156 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.151489 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:32.151638 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:32.193758 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.3:41535
I20260709 12:22:32.193890 18946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.3:41535 every 8 connection(s)
I20260709 12:22:32.208222 18947 heartbeater.cc:344] Connected to a master server at 127.17.40.62:43633
I20260709 12:22:32.208634 18947 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:32.209502 18947 heartbeater.cc:507] Master 127.17.40.62:43633 requested a full tablet report, sending...
I20260709 12:22:32.211607 18671 ts_manager.cc:194] Registered new tserver with Master: 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:32.211866 17568 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014890421s
I20260709 12:22:32.213078 18671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47866
I20260709 12:22:32.240712 18671 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47868:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:32.247583 18671 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:32.455595 18838 tablet_service.cc:1511] Processing CreateTablet for tablet bf32cd3655eb4943abc0cdbf54a32206 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:32.457257 18838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf32cd3655eb4943abc0cdbf54a32206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.463757 18762 tablet_service.cc:1511] Processing CreateTablet for tablet c6ce381c67cd4b4a8dc16ebe1f6527a0 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:32.465415 18762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ce381c67cd4b4a8dc16ebe1f6527a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.465946 18759 tablet_service.cc:1511] Processing CreateTablet for tablet ca478d842a8f406087ef2855fb0363a8 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:32.467518 18759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca478d842a8f406087ef2855fb0363a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.470177 18758 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:32.471113 18911 tablet_service.cc:1511] Processing CreateTablet for tablet c6ce381c67cd4b4a8dc16ebe1f6527a0 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:32.471838 18758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.471716 18760 tablet_service.cc:1511] Processing CreateTablet for tablet 91bf73a138f349e787495351ffd803b7 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:32.472227 18912 tablet_service.cc:1511] Processing CreateTablet for tablet bf32cd3655eb4943abc0cdbf54a32206 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:32.472644 18911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ce381c67cd4b4a8dc16ebe1f6527a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.473152 18760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bf73a138f349e787495351ffd803b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.473601 18912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf32cd3655eb4943abc0cdbf54a32206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.475806 18761 tablet_service.cc:1511] Processing CreateTablet for tablet 9b54e62a509d44c3ae8c3e6c013db104 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:32.477430 18761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b54e62a509d44c3ae8c3e6c013db104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.477118 18910 tablet_service.cc:1511] Processing CreateTablet for tablet 9b54e62a509d44c3ae8c3e6c013db104 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:32.478652 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b54e62a509d44c3ae8c3e6c013db104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.479488 18763 tablet_service.cc:1511] Processing CreateTablet for tablet bf32cd3655eb4943abc0cdbf54a32206 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:32.481103 18763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf32cd3655eb4943abc0cdbf54a32206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.482014 18909 tablet_service.cc:1511] Processing CreateTablet for tablet 91bf73a138f349e787495351ffd803b7 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:32.455595 18837 tablet_service.cc:1511] Processing CreateTablet for tablet c6ce381c67cd4b4a8dc16ebe1f6527a0 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:32.484072 18837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ce381c67cd4b4a8dc16ebe1f6527a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.484447 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bf73a138f349e787495351ffd803b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.488502 18908 tablet_service.cc:1511] Processing CreateTablet for tablet ca478d842a8f406087ef2855fb0363a8 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:32.493059 18908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca478d842a8f406087ef2855fb0363a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.494184 18907 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:32.496126 18907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.502311 18836 tablet_service.cc:1511] Processing CreateTablet for tablet 9b54e62a509d44c3ae8c3e6c013db104 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:32.503971 18836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b54e62a509d44c3ae8c3e6c013db104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.505908 18835 tablet_service.cc:1511] Processing CreateTablet for tablet 91bf73a138f349e787495351ffd803b7 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:32.507558 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bf73a138f349e787495351ffd803b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.509946 18834 tablet_service.cc:1511] Processing CreateTablet for tablet ca478d842a8f406087ef2855fb0363a8 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:32.511610 18834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca478d842a8f406087ef2855fb0363a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.514916 18833 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:32.516783 18833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.532753 18757 tablet_service.cc:1511] Processing CreateTablet for tablet d14b13acceee47439963d9c58e4b6d39 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:32.534781 18757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14b13acceee47439963d9c58e4b6d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.535431 18832 tablet_service.cc:1511] Processing CreateTablet for tablet d14b13acceee47439963d9c58e4b6d39 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:32.537371 18832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14b13acceee47439963d9c58e4b6d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.540485 18756 tablet_service.cc:1511] Processing CreateTablet for tablet 3dca728d7de8469d95dbe82b045bf65e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:32.540485 18906 tablet_service.cc:1511] Processing CreateTablet for tablet d14b13acceee47439963d9c58e4b6d39 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:32.542977 18831 tablet_service.cc:1511] Processing CreateTablet for tablet 3dca728d7de8469d95dbe82b045bf65e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:32.544374 18906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14b13acceee47439963d9c58e4b6d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.544616 18831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dca728d7de8469d95dbe82b045bf65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.546434 18756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dca728d7de8469d95dbe82b045bf65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.547852 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 0406e95e375e45c495fe295f541d7cd4 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:32.549741 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0406e95e375e45c495fe295f541d7cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.550796 18830 tablet_service.cc:1511] Processing CreateTablet for tablet 0406e95e375e45c495fe295f541d7cd4 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:32.552368 18905 tablet_service.cc:1511] Processing CreateTablet for tablet 3dca728d7de8469d95dbe82b045bf65e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:32.554250 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dca728d7de8469d95dbe82b045bf65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.557729 18904 tablet_service.cc:1511] Processing CreateTablet for tablet 0406e95e375e45c495fe295f541d7cd4 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:32.552356 18830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0406e95e375e45c495fe295f541d7cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.559324 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0406e95e375e45c495fe295f541d7cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.574693 18754 tablet_service.cc:1511] Processing CreateTablet for tablet 38d69daa256f430796196f10dfcaad2f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:32.576573 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d69daa256f430796196f10dfcaad2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.583858 18829 tablet_service.cc:1511] Processing CreateTablet for tablet 38d69daa256f430796196f10dfcaad2f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:32.586189 18829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d69daa256f430796196f10dfcaad2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.591877 18903 tablet_service.cc:1511] Processing CreateTablet for tablet 38d69daa256f430796196f10dfcaad2f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:32.594810 18903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d69daa256f430796196f10dfcaad2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.675675 18763 tablet_service.cc:1511] Processing CreateTablet for tablet 5f60880728ad4cb19bd4cb835996961f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:32.677448 18763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f60880728ad4cb19bd4cb835996961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.722775 18964 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:32.722826 18963 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:32.727634 18962 tablet_bootstrap.cc:492] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:32.729952 18963 tablet_bootstrap.cc:654] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.733004 18904 tablet_service.cc:1511] Processing CreateTablet for tablet 73828daf5c2b417fb99b9a563c19c850 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:32.733935 18909 tablet_service.cc:1511] Processing CreateTablet for tablet 5f60880728ad4cb19bd4cb835996961f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:32.734735 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73828daf5c2b417fb99b9a563c19c850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.735406 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f60880728ad4cb19bd4cb835996961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.736382 18835 tablet_service.cc:1511] Processing CreateTablet for tablet 5f60880728ad4cb19bd4cb835996961f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:32.737912 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f60880728ad4cb19bd4cb835996961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.741237 18837 tablet_service.cc:1511] Processing CreateTablet for tablet 7d92766f8c3c42b9aa8708c1d7d317c2 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:32.743007 18837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d92766f8c3c42b9aa8708c1d7d317c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.737526 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 73828daf5c2b417fb99b9a563c19c850 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:32.747419 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73828daf5c2b417fb99b9a563c19c850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.751096 18962 tablet_bootstrap.cc:654] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.746274 18964 tablet_bootstrap.cc:654] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.741197 18754 tablet_service.cc:1511] Processing CreateTablet for tablet 7d92766f8c3c42b9aa8708c1d7d317c2 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:32.756090 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d92766f8c3c42b9aa8708c1d7d317c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.762758 18832 tablet_service.cc:1511] Processing CreateTablet for tablet d6c1ae2a327b421383ffacb5d5831a0e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:32.764317 18832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c1ae2a327b421383ffacb5d5831a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.757022 18903 tablet_service.cc:1511] Processing CreateTablet for tablet 7d92766f8c3c42b9aa8708c1d7d317c2 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:32.765507 18903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d92766f8c3c42b9aa8708c1d7d317c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.760857 18962 tablet_bootstrap.cc:492] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:32.758442 18834 tablet_service.cc:1511] Processing CreateTablet for tablet 73828daf5c2b417fb99b9a563c19c850 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:32.775228 18962 ts_tablet_manager.cc:1403] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.048s	user 0.000s	sys 0.013s
I20260709 12:22:32.775727 18834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73828daf5c2b417fb99b9a563c19c850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.778129 18964 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:32.778913 18964 ts_tablet_manager.cc:1403] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.013s
I20260709 12:22:32.778816 18962 raft_consensus.cc:359] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.779832 18962 raft_consensus.cc:385] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.780230 18962 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.781284 18962 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.761451 18763 tablet_service.cc:1511] Processing CreateTablet for tablet d6c1ae2a327b421383ffacb5d5831a0e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:32.783818 18763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c1ae2a327b421383ffacb5d5831a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.785389 18963 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:32.785934 18963 ts_tablet_manager.cc:1403] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.011s
I20260709 12:22:32.789078 18963 raft_consensus.cc:359] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.789901 18963 raft_consensus.cc:385] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.790257 18963 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.791082 18963 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.794178 18909 tablet_service.cc:1511] Processing CreateTablet for tablet d6c1ae2a327b421383ffacb5d5831a0e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:32.793927 18964 raft_consensus.cc:359] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.795353 18964 raft_consensus.cc:385] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.795738 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c1ae2a327b421383ffacb5d5831a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.795786 18964 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.797267 18964 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.808881 18964 ts_tablet_manager.cc:1434] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.029s	user 0.016s	sys 0.001s
W20260709 12:22:32.809736 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:32.810041 18873 heartbeater.cc:499] Master 127.17.40.62:43633 was elected leader, sending a full tablet report...
I20260709 12:22:32.826617 18964 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:32.820652 18762 tablet_service.cc:1511] Processing CreateTablet for tablet 5c18545306c9477ba3e214f788705644 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:32.829311 18762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c18545306c9477ba3e214f788705644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.835310 18904 tablet_service.cc:1511] Processing CreateTablet for tablet 5c18545306c9477ba3e214f788705644 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:32.836215 18761 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd048e748d347889eab552ac02ed00f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:32.836831 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c18545306c9477ba3e214f788705644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.837584 18761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd048e748d347889eab552ac02ed00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.843986 18835 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd048e748d347889eab552ac02ed00f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:32.844483 18907 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd048e748d347889eab552ac02ed00f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:32.845633 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd048e748d347889eab552ac02ed00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.846019 18907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd048e748d347889eab552ac02ed00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.846269 18833 tablet_service.cc:1511] Processing CreateTablet for tablet 0e216d91bdc543ad8e4ba4e9346f7b3a (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:32.847043 18964 tablet_bootstrap.cc:654] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.847647 18833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e216d91bdc543ad8e4ba4e9346f7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.848565 18758 tablet_service.cc:1511] Processing CreateTablet for tablet 0e216d91bdc543ad8e4ba4e9346f7b3a (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:32.851547 18798 heartbeater.cc:499] Master 127.17.40.62:43633 was elected leader, sending a full tablet report...
I20260709 12:22:32.862156 18962 ts_tablet_manager.cc:1434] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.015s
I20260709 12:22:32.863561 18962 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:32.871680 18947 heartbeater.cc:499] Master 127.17.40.62:43633 was elected leader, sending a full tablet report...
I20260709 12:22:32.875178 18832 tablet_service.cc:1511] Processing CreateTablet for tablet 5c18545306c9477ba3e214f788705644 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:32.877388 18832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c18545306c9477ba3e214f788705644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.881552 18758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e216d91bdc543ad8e4ba4e9346f7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.891315 18963 ts_tablet_manager.cc:1434] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.105s	user 0.016s	sys 0.022s
I20260709 12:22:32.892645 18963 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:32.899148 18905 tablet_service.cc:1511] Processing CreateTablet for tablet 0e216d91bdc543ad8e4ba4e9346f7b3a (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:32.900686 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e216d91bdc543ad8e4ba4e9346f7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.900714 18837 tablet_service.cc:1511] Processing CreateTablet for tablet f5cbcb3f54b5453eaa89ac9bf8859e93 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:32.907987 18837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cbcb3f54b5453eaa89ac9bf8859e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.909490 18962 tablet_bootstrap.cc:654] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.918372 18910 tablet_service.cc:1511] Processing CreateTablet for tablet f5cbcb3f54b5453eaa89ac9bf8859e93 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:32.919828 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cbcb3f54b5453eaa89ac9bf8859e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.909511 18755 tablet_service.cc:1511] Processing CreateTablet for tablet f5cbcb3f54b5453eaa89ac9bf8859e93 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:32.925249 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cbcb3f54b5453eaa89ac9bf8859e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.948976 18963 tablet_bootstrap.cc:654] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.953266 18754 tablet_service.cc:1511] Processing CreateTablet for tablet 2054e631aee84e6d9d5435f9031fec9e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:32.967473 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2054e631aee84e6d9d5435f9031fec9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.959679 18962 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:32.969947 18962 ts_tablet_manager.cc:1403] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.004s
I20260709 12:22:32.970407 18833 tablet_service.cc:1511] Processing CreateTablet for tablet 2054e631aee84e6d9d5435f9031fec9e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:32.971837 18833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2054e631aee84e6d9d5435f9031fec9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.971623 18904 tablet_service.cc:1511] Processing CreateTablet for tablet 2054e631aee84e6d9d5435f9031fec9e (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:32.972975 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2054e631aee84e6d9d5435f9031fec9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.973232 18962 raft_consensus.cc:359] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.974000 18962 raft_consensus.cc:385] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.974311 18962 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.967729 18968 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.975201 18968 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.968888 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 20fd9926cbc04b9b9436afef7b0d1f6f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:32.957808 18964 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:32.978929 18964 ts_tablet_manager.cc:1403] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.002s
I20260709 12:22:32.979380 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fd9926cbc04b9b9436afef7b0d1f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.988880 18837 tablet_service.cc:1511] Processing CreateTablet for tablet 20fd9926cbc04b9b9436afef7b0d1f6f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:32.990437 18837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fd9926cbc04b9b9436afef7b0d1f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:32.994092 18835 tablet_service.cc:1511] Processing CreateTablet for tablet 99bb1352a2bd46e7bb08b8e1b6711fe1 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:32.996452 18962 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.983431 18964 raft_consensus.cc:359] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:32.984259 18968 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:33.001643 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bb1352a2bd46e7bb08b8e1b6711fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.006368 18964 raft_consensus.cc:385] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.009019 18962 ts_tablet_manager.cc:1434] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 12:22:33.011586 18758 tablet_service.cc:1511] Processing CreateTablet for tablet 99bb1352a2bd46e7bb08b8e1b6711fe1 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:33.015012 18758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bb1352a2bd46e7bb08b8e1b6711fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.016441 18963 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:33.017033 18963 ts_tablet_manager.cc:1403] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.125s	user 0.005s	sys 0.007s
I20260709 12:22:33.013357 18964 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.026525 18762 tablet_service.cc:1511] Processing CreateTablet for tablet a65d49b3134d46ba885c7513bd67571f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:33.029338 18762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a65d49b3134d46ba885c7513bd67571f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.027688 18964 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.065024 18910 tablet_service.cc:1511] Processing CreateTablet for tablet 99bb1352a2bd46e7bb08b8e1b6711fe1 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:33.065717 18964 ts_tablet_manager.cc:1434] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 12:22:33.066709 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bb1352a2bd46e7bb08b8e1b6711fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.066833 18964 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:33.068783 18962 tablet_bootstrap.cc:492] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:33.063410 18905 tablet_service.cc:1511] Processing CreateTablet for tablet 20fd9926cbc04b9b9436afef7b0d1f6f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:33.072425 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fd9926cbc04b9b9436afef7b0d1f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.077333 18962 tablet_bootstrap.cc:654] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.087436 18837 tablet_service.cc:1511] Processing CreateTablet for tablet a65d49b3134d46ba885c7513bd67571f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:33.088762 18837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a65d49b3134d46ba885c7513bd67571f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.063539 18963 raft_consensus.cc:359] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.112255 18963 raft_consensus.cc:385] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.115686 18907 tablet_service.cc:1511] Processing CreateTablet for tablet e9168ac06d4b4b11ac8272d328166702 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:33.116259 18963 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.118122 18963 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.113922 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:33.117178 18907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9168ac06d4b4b11ac8272d328166702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.128695 18773 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:33.130489 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:33.131546 18968 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.131237 18909 tablet_service.cc:1511] Processing CreateTablet for tablet bbadce60e960476289740ec2afd0a5c8 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:33.131958 18968 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.132308 18968 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.132692 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbadce60e960476289740ec2afd0a5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.118449 18761 tablet_service.cc:1511] Processing CreateTablet for tablet 910a21b48434464ba8cc8f1f36ba2346 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:33.113324 18833 tablet_service.cc:1511] Processing CreateTablet for tablet e9168ac06d4b4b11ac8272d328166702 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:33.135456 18761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910a21b48434464ba8cc8f1f36ba2346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.118973 18832 tablet_service.cc:1511] Processing CreateTablet for tablet 910a21b48434464ba8cc8f1f36ba2346 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:33.120195 18904 tablet_service.cc:1511] Processing CreateTablet for tablet a65d49b3134d46ba885c7513bd67571f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:33.124094 18903 tablet_service.cc:1511] Processing CreateTablet for tablet 910a21b48434464ba8cc8f1f36ba2346 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:33.137513 18903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910a21b48434464ba8cc8f1f36ba2346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.126746 18763 tablet_service.cc:1511] Processing CreateTablet for tablet bbadce60e960476289740ec2afd0a5c8 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:33.111184 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:33.140450 18763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbadce60e960476289740ec2afd0a5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.141211 18970 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:33.141479 18887 leader_election.cc:343] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.135499 18833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9168ac06d4b4b11ac8272d328166702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.141847 18970 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.142889 18832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910a21b48434464ba8cc8f1f36ba2346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.146883 18970 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:33.159691 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a65d49b3134d46ba885c7513bd67571f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.159505 18968 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.166767 18758 tablet_service.cc:1511] Processing CreateTablet for tablet b7d5f339cce949e5b5159e03d3d9f348 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:33.168329 18758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d5f339cce949e5b5159e03d3d9f348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.169929 18968 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:33.095820 18964 tablet_bootstrap.cc:654] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.116907 18754 tablet_service.cc:1511] Processing CreateTablet for tablet e9168ac06d4b4b11ac8272d328166702 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:33.180547 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9168ac06d4b4b11ac8272d328166702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.183562 18837 tablet_service.cc:1511] Processing CreateTablet for tablet bbadce60e960476289740ec2afd0a5c8 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:33.185598 18837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbadce60e960476289740ec2afd0a5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.207674 18963 ts_tablet_manager.cc:1434] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.190s	user 0.011s	sys 0.008s
I20260709 12:22:33.208933 18963 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:33.216617 18835 tablet_service.cc:1511] Processing CreateTablet for tablet b7d5f339cce949e5b5159e03d3d9f348 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:33.218179 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d5f339cce949e5b5159e03d3d9f348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.230728 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 4eda139ea8094bec9f34a061ca15f982 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:33.232414 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eda139ea8094bec9f34a061ca15f982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.231953 18834 tablet_service.cc:1511] Processing CreateTablet for tablet 4eda139ea8094bec9f34a061ca15f982 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:33.233618 18834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eda139ea8094bec9f34a061ca15f982. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:33.234879 18799 tablet.cc:2406] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:33.235016 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:33.235718 18773 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.258320 18963 tablet_bootstrap.cc:654] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.271512 18832 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcb82468fe454b951282d52761a6c3 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:33.273030 18832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcb82468fe454b951282d52761a6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.273236 18969 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.273716 18969 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.282611 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:33.283061 18969 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:33.302814 18963 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:33.303503 18963 ts_tablet_manager.cc:1403] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.002s
I20260709 12:22:33.304111 18833 tablet_service.cc:1511] Processing CreateTablet for tablet e8038db5456b47f5af9508f8dcb3883b (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:33.306108 18833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8038db5456b47f5af9508f8dcb3883b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.305676 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcb82468fe454b951282d52761a6c3 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:33.307377 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcb82468fe454b951282d52761a6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.307005 18761 tablet_service.cc:1511] Processing CreateTablet for tablet e8038db5456b47f5af9508f8dcb3883b (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:33.308571 18761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8038db5456b47f5af9508f8dcb3883b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.309331 18773 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:33.310778 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:33.311844 18982 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.312485 18982 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:33.313961 18909 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcb82468fe454b951282d52761a6c3 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:33.315485 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcb82468fe454b951282d52761a6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.316037 18962 tablet_bootstrap.cc:492] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:33.315717 18907 tablet_service.cc:1511] Processing CreateTablet for tablet 4eda139ea8094bec9f34a061ca15f982 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:33.316540 18962 ts_tablet_manager.cc:1403] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.248s	user 0.030s	sys 0.036s
I20260709 12:22:33.317523 18907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eda139ea8094bec9f34a061ca15f982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.313690 18982 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.323498 18903 tablet_service.cc:1511] Processing CreateTablet for tablet b7d5f339cce949e5b5159e03d3d9f348 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:33.323977 18962 raft_consensus.cc:359] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.324741 18962 raft_consensus.cc:385] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.324957 18903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d5f339cce949e5b5159e03d3d9f348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.335830 18963 raft_consensus.cc:359] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.336503 18964 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:33.336664 18963 raft_consensus.cc:385] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.337059 18964 ts_tablet_manager.cc:1403] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.270s	user 0.018s	sys 0.009s
I20260709 12:22:33.336992 18963 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.338022 18963 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.340374 18963 ts_tablet_manager.cc:1434] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:22:33.341463 18963 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:33.325074 18962 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.352797 18762 tablet_service.cc:1511] Processing CreateTablet for tablet 34d2d90d352e40cb8b6cde778d729c24 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:33.354236 18762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d2d90d352e40cb8b6cde778d729c24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:33.355387 18738 leader_election.cc:343] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.356325 18968 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.356818 18968 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.366132 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:33.366242 18968 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:33.366274 18829 tablet_service.cc:1511] Processing CreateTablet for tablet 34d2d90d352e40cb8b6cde778d729c24 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:33.367936 18829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d2d90d352e40cb8b6cde778d729c24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:33.367849 18886 leader_election.cc:343] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.390513 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:33.390591 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:33.392136 18969 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.393461 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:33.394157 18848 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:33.392653 18969 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:33.396880 18739 leader_election.cc:343] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.397164 18969 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:33.397022 18904 tablet_service.cc:1511] Processing CreateTablet for tablet e8038db5456b47f5af9508f8dcb3883b (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:33.397408 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:33.399052 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8038db5456b47f5af9508f8dcb3883b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.399271 18970 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.392661 18670 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.406955 18964 raft_consensus.cc:359] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.407784 18964 raft_consensus.cc:385] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.408092 18964 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.410775 18763 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccd682aee974b58818f7327974e2aa0 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:33.412232 18763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccd682aee974b58818f7327974e2aa0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:33.413393 18887 leader_election.cc:343] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.414577 18887 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:33.415479 18982 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.415889 18982 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.415725 18830 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccd682aee974b58818f7327974e2aa0 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:33.416249 18982 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.417191 18830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccd682aee974b58818f7327974e2aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.420073 18963 tablet_bootstrap.cc:654] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.373090 18962 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.424306 18962 ts_tablet_manager.cc:1434] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.000s
I20260709 12:22:33.426625 18964 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.439962 18968 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.440193 18962 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:33.440557 18968 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.442929 18968 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:33.444694 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:33.446112 18964 ts_tablet_manager.cc:1434] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
W20260709 12:22:33.446456 18886 leader_election.cc:343] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.450666 18834 tablet_service.cc:1511] Processing CreateTablet for tablet 94efc7ae4146469f94df524ec5b89c77 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:33.450754 18909 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccd682aee974b58818f7327974e2aa0 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:33.452175 18754 tablet_service.cc:1511] Processing CreateTablet for tablet 987becbef0a24ee6a5e0c3eb9a3384cc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:33.453398 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987becbef0a24ee6a5e0c3eb9a3384cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.452481 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccd682aee974b58818f7327974e2aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.456815 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:33.457638 18762 tablet_service.cc:1511] Processing CreateTablet for tablet 94efc7ae4146469f94df524ec5b89c77 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:22:33.459152 18887 leader_election.cc:343] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.459802 18887 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:33.454669 18903 tablet_service.cc:1511] Processing CreateTablet for tablet 34d2d90d352e40cb8b6cde778d729c24 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:33.461880 18968 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.467871 18835 tablet_service.cc:1511] Processing CreateTablet for tablet 987becbef0a24ee6a5e0c3eb9a3384cc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:33.473937 18964 tablet_bootstrap.cc:492] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:33.475569 18907 tablet_service.cc:1511] Processing CreateTablet for tablet 94efc7ae4146469f94df524ec5b89c77 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:33.475520 18962 tablet_bootstrap.cc:654] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.477367 18762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94efc7ae4146469f94df524ec5b89c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.477946 18905 tablet_service.cc:1511] Processing CreateTablet for tablet 987becbef0a24ee6a5e0c3eb9a3384cc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:33.481856 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:33.483013 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:33.486871 18836 tablet_service.cc:1511] Processing CreateTablet for tablet af66e45540ac4e07bf6fb0db4f2779d7 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 12:22:33.489202 18812 leader_election.cc:343] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.489794 18907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94efc7ae4146469f94df524ec5b89c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.490182 18910 tablet_service.cc:1511] Processing CreateTablet for tablet af66e45540ac4e07bf6fb0db4f2779d7 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:33.491088 18903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d2d90d352e40cb8b6cde778d729c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.492106 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af66e45540ac4e07bf6fb0db4f2779d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:33.490084 18812 leader_election.cc:343] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.493573 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987becbef0a24ee6a5e0c3eb9a3384cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.494560 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987becbef0a24ee6a5e0c3eb9a3384cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.501719 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:33.502082 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:33.503342 18834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94efc7ae4146469f94df524ec5b89c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.506565 18964 tablet_bootstrap.cc:654] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:33.506966 18814 leader_election.cc:343] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.507457 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:33.501927 18755 tablet_service.cc:1511] Processing CreateTablet for tablet af66e45540ac4e07bf6fb0db4f2779d7 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:33.508647 18969 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.509057 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af66e45540ac4e07bf6fb0db4f2779d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.509984 18836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af66e45540ac4e07bf6fb0db4f2779d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.522663 18832 tablet_service.cc:1511] Processing CreateTablet for tablet 77b6876202964e0eae9e454d22ceab60 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:33.526041 18831 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8499bcaf8d4fd3b0236d65471d7006 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:33.525439 18911 tablet_service.cc:1511] Processing CreateTablet for tablet 77b6876202964e0eae9e454d22ceab60 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:33.527496 18831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8499bcaf8d4fd3b0236d65471d7006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.527560 18911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b6876202964e0eae9e454d22ceab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.529489 18761 tablet_service.cc:1511] Processing CreateTablet for tablet 77b6876202964e0eae9e454d22ceab60 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:33.529703 18982 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.526041 18758 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8499bcaf8d4fd3b0236d65471d7006 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:33.530959 18761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b6876202964e0eae9e454d22ceab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.531131 18832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b6876202964e0eae9e454d22ceab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.538901 18908 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8499bcaf8d4fd3b0236d65471d7006 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:33.559005 18908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8499bcaf8d4fd3b0236d65471d7006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.543751 18962 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:33.544812 18963 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:33.562808 18758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8499bcaf8d4fd3b0236d65471d7006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.563158 18963 ts_tablet_manager.cc:1403] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.222s	user 0.017s	sys 0.005s
I20260709 12:22:33.562799 18838 tablet_service.cc:1511] Processing CreateTablet for tablet 0939ca2ad5484a34aa9e9f7f8075cb2d (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:33.564499 18838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0939ca2ad5484a34aa9e9f7f8075cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.548190 18756 tablet_service.cc:1511] Processing CreateTablet for tablet c1dd3ef9790a461facce64f14c3a5fce (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:33.567273 18756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1dd3ef9790a461facce64f14c3a5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.567037 18909 tablet_service.cc:1511] Processing CreateTablet for tablet c1dd3ef9790a461facce64f14c3a5fce (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:33.568464 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1dd3ef9790a461facce64f14c3a5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.570964 18922 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:33.570833 18963 raft_consensus.cc:359] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.571511 18754 tablet_service.cc:1511] Processing CreateTablet for tablet 0939ca2ad5484a34aa9e9f7f8075cb2d (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:33.573066 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0939ca2ad5484a34aa9e9f7f8075cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.573663 18912 tablet_service.cc:1511] Processing CreateTablet for tablet 0939ca2ad5484a34aa9e9f7f8075cb2d (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:33.574564 18814 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:33.575066 18912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0939ca2ad5484a34aa9e9f7f8075cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.575829 18969 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.578796 18962 ts_tablet_manager.cc:1403] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.142s	user 0.007s	sys 0.010s
I20260709 12:22:33.581624 18757 tablet_service.cc:1511] Processing CreateTablet for tablet ace8753143e94362a855362c6b9f55e9 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:33.583551 18757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace8753143e94362a855362c6b9f55e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.571944 18963 raft_consensus.cc:385] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.585225 18963 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.586197 18963 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.551069 18833 tablet_service.cc:1511] Processing CreateTablet for tablet c1dd3ef9790a461facce64f14c3a5fce (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:33.591809 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:33.592561 18833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1dd3ef9790a461facce64f14c3a5fce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:33.593853 18886 leader_election.cc:343] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.635246 18963 ts_tablet_manager.cc:1434] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.002s
I20260709 12:22:33.636601 18963 tablet_bootstrap.cc:492] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:33.671373 18760 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:33.672873 18760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.674505 18905 tablet_service.cc:1511] Processing CreateTablet for tablet ace8753143e94362a855362c6b9f55e9 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:33.674798 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:33.676077 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace8753143e94362a855362c6b9f55e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.679617 18837 tablet_service.cc:1511] Processing CreateTablet for tablet ace8753143e94362a855362c6b9f55e9 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:33.681182 18837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace8753143e94362a855362c6b9f55e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.695623 18968 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.696276 18968 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.700865 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:33.701691 18847 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:33.703788 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:33.667367 18982 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:33.707077 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:33.708992 18886 leader_election.cc:343] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.709717 18968 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:22:33.709347 18831 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:33.711066 18831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.707105 18982 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.711925 18982 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.712364 18982 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.720661 18963 tablet_bootstrap.cc:654] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.734989 18763 tablet_service.cc:1511] Processing CreateTablet for tablet cf1f0997197c4e63b1861b420a26416f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:33.736649 18763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1f0997197c4e63b1861b420a26416f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.740645 18982 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.746838 18964 tablet_bootstrap.cc:492] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:33.750502 18962 raft_consensus.cc:359] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.750509 18836 tablet_service.cc:1511] Processing CreateTablet for tablet cf1f0997197c4e63b1861b420a26416f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:33.802822 18962 raft_consensus.cc:385] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.805802 18964 ts_tablet_manager.cc:1403] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.332s	user 0.019s	sys 0.019s
W20260709 12:22:33.819785 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:33.824518 18836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1f0997197c4e63b1861b420a26416f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.830199 18964 raft_consensus.cc:359] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.831103 18964 raft_consensus.cc:385] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.831462 18964 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.807981 18969 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.812543 18962 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
W20260709 12:22:33.812367 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 108698us
W20260709 12:22:33.854547 18656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58169.3us
I20260709 12:22:33.856004 18970 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.856288 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:22:33.856674 18657 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53491.9us
I20260709 12:22:33.856581 18970 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.857244 18762 tablet_service.cc:1511] Processing CreateTablet for tablet 6c18380178684f0e93b10d0c7a912d02 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:33.858842 18970 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:33.860456 18834 tablet_service.cc:1511] Processing CreateTablet for tablet 6c18380178684f0e93b10d0c7a912d02 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:33.861878 18834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c18380178684f0e93b10d0c7a912d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.861654 18838 tablet_service.cc:1511] Processing CreateTablet for tablet 7e611ab2e6fe4fca8d3dd28957f1d17d (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:33.862030 18962 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.863056 18838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e611ab2e6fe4fca8d3dd28957f1d17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.863467 18830 tablet_service.cc:1511] Processing CreateTablet for tablet 9134ec4fb92645b28a9b4814179c1c7c (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:33.864588 18962 ts_tablet_manager.cc:1434] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.285s	user 0.017s	sys 0.002s
I20260709 12:22:33.864845 18830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9134ec4fb92645b28a9b4814179c1c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.865617 18962 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:33.866551 18772 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.867502 18835 tablet_service.cc:1511] Processing CreateTablet for tablet 084cf9f30114499b94cf93587f0788f5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:33.867908 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:33.868856 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084cf9f30114499b94cf93587f0788f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.873082 18762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c18380178684f0e93b10d0c7a912d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.872934 18758 tablet_service.cc:1511] Processing CreateTablet for tablet 7e611ab2e6fe4fca8d3dd28957f1d17d (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:33.860458 18757 tablet_service.cc:1511] Processing CreateTablet for tablet 9134ec4fb92645b28a9b4814179c1c7c (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:33.875211 18761 tablet_service.cc:1511] Processing CreateTablet for tablet 084cf9f30114499b94cf93587f0788f5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:33.875834 18757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9134ec4fb92645b28a9b4814179c1c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.876487 18761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084cf9f30114499b94cf93587f0788f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.878916 18758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e611ab2e6fe4fca8d3dd28957f1d17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.881821 18982 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:22:33.832444 18964 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.842195 18969 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.888820 18994 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:22:33.894924 18847 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:33.896517 18964 ts_tablet_manager.cc:1434] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.003s
I20260709 12:22:33.898533 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:33.903452 18964 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:33.903332 18970 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.904011 18970 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.904458 18970 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.908072 18969 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:33.910115 18848 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:33.911077 18969 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:33.911522 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:33.914764 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:33.916563 18814 leader_election.cc:343] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.917603 18964 tablet_bootstrap.cc:654] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.919726 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 1485e54f9795416785f4baf244599201 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:33.921465 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1485e54f9795416785f4baf244599201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.900822 18962 tablet_bootstrap.cc:654] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:33.918100 18812 leader_election.cc:343] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.923610 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:33.926115 18831 tablet_service.cc:1511] Processing CreateTablet for tablet 1485e54f9795416785f4baf244599201 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:33.930991 18831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1485e54f9795416785f4baf244599201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.932610 18756 tablet_service.cc:1511] Processing CreateTablet for tablet 93bc6f2b3fb14454abe2ad1ae89ea6e5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:33.934058 18756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bc6f2b3fb14454abe2ad1ae89ea6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.927763 18772 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:33.943575 18996 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.954979 18830 tablet_service.cc:1511] Processing CreateTablet for tablet 93bc6f2b3fb14454abe2ad1ae89ea6e5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:33.958447 18963 tablet_bootstrap.cc:492] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:33.959196 18963 ts_tablet_manager.cc:1403] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.323s	user 0.014s	sys 0.015s
I20260709 12:22:33.967653 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:33.970961 18908 tablet_service.cc:1511] Processing CreateTablet for tablet 6c18380178684f0e93b10d0c7a912d02 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:33.978137 18908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c18380178684f0e93b10d0c7a912d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.978694 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:33.983686 18912 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:33.985154 18912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.986618 18994 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.987531 18907 tablet_service.cc:1511] Processing CreateTablet for tablet cf1f0997197c4e63b1861b420a26416f (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:33.989071 18907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1f0997197c4e63b1861b420a26416f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.992743 18910 tablet_service.cc:1511] Processing CreateTablet for tablet 7e611ab2e6fe4fca8d3dd28957f1d17d (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:33.995486 18903 tablet_service.cc:1511] Processing CreateTablet for tablet 9134ec4fb92645b28a9b4814179c1c7c (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:33.994329 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e611ab2e6fe4fca8d3dd28957f1d17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.005748 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:34.006946 18848 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.987578 18994 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:33.962957 18970 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.009526 18994 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.012365 18970 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.014343 18905 tablet_service.cc:1511] Processing CreateTablet for tablet 084cf9f30114499b94cf93587f0788f5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:34.014869 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:34.015760 18847 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:34.016719 18739 leader_election.cc:343] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.017659 18830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bc6f2b3fb14454abe2ad1ae89ea6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.014997 18909 tablet_service.cc:1511] Processing CreateTablet for tablet 1485e54f9795416785f4baf244599201 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:34.023530 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1485e54f9795416785f4baf244599201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.032464 18903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9134ec4fb92645b28a9b4814179c1c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.035980 18964 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:34.037078 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084cf9f30114499b94cf93587f0788f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.039888 18755 tablet_service.cc:1511] Processing CreateTablet for tablet bea8b759be0c4fc6a36e2b34c6d643ae (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:34.040997 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea8b759be0c4fc6a36e2b34c6d643ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.025444 18963 raft_consensus.cc:359] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.036526 18964 ts_tablet_manager.cc:1403] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.008s
I20260709 12:22:34.014863 18887 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:34.052186 18836 tablet_service.cc:1511] Processing CreateTablet for tablet bea8b759be0c4fc6a36e2b34c6d643ae (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:34.053560 18836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea8b759be0c4fc6a36e2b34c6d643ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.056471 18763 tablet_service.cc:1511] Processing CreateTablet for tablet 3bac759d8cf2478e874f15f02c6c54fb (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:34.057884 18763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bac759d8cf2478e874f15f02c6c54fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.046788 18963 raft_consensus.cc:385] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.058450 18963 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.059422 18963 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.062152 18963 ts_tablet_manager.cc:1434] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 12:22:34.067813 18963 tablet_bootstrap.cc:492] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:34.070290 18832 tablet_service.cc:1511] Processing CreateTablet for tablet 3bac759d8cf2478e874f15f02c6c54fb (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:34.065243 18964 raft_consensus.cc:359] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.090142 18968 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.096916 18968 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:34.098124 18968 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.100765 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:34.101063 18832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bac759d8cf2478e874f15f02c6c54fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:34.108248 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 79828.7us
I20260709 12:22:34.108485 18982 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.109277 18982 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.111510 18982 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:34.113319 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:34.114003 18772 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:34.115211 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:34.116492 18982 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.117959 18982 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.088517 18964 raft_consensus.cc:385] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.118629 18982 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.119916 18847 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:34.118659 18964 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.121255 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:34.122280 19001 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.122594 18962 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.122822 19001 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:34.123106 18962 ts_tablet_manager.cc:1403] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.258s	user 0.034s	sys 0.024s
I20260709 12:22:34.123731 19001 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.127291 18964 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:34.130964 18887 consensus_peers.cc:597] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:34.134317 18835 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5f0fdf96074deb816d2d3b27fe7143 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:34.135708 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5f0fdf96074deb816d2d3b27fe7143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.139770 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 84ea4e9cc4d9482b920ad086bf4b1305 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:34.141973 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ea4e9cc4d9482b920ad086bf4b1305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.126173 18962 raft_consensus.cc:359] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.143538 18962 raft_consensus.cc:385] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.143913 18962 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.144701 18962 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.147140 18962 ts_tablet_manager.cc:1434] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 12:22:34.148239 18962 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.148001 18834 tablet_service.cc:1511] Processing CreateTablet for tablet 84ea4e9cc4d9482b920ad086bf4b1305 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:34.137449 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:34.149432 18834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ea4e9cc4d9482b920ad086bf4b1305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.132568 18758 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5f0fdf96074deb816d2d3b27fe7143 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:34.163635 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:34.164604 18912 tablet_service.cc:1511] Processing CreateTablet for tablet bea8b759be0c4fc6a36e2b34c6d643ae (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:34.163604 18909 tablet_service.cc:1511] Processing CreateTablet for tablet 93bc6f2b3fb14454abe2ad1ae89ea6e5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:34.166050 18912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea8b759be0c4fc6a36e2b34c6d643ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.166132 18982 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.168622 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bc6f2b3fb14454abe2ad1ae89ea6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.153712 18668 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.174250 18982 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:34.171900 18963 tablet_bootstrap.cc:654] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.167719 18757 tablet_service.cc:1511] Processing CreateTablet for tablet 847dd0f72f3f4a6c8834194b02858750 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:34.178646 18836 tablet_service.cc:1511] Processing CreateTablet for tablet 847dd0f72f3f4a6c8834194b02858750 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:34.180183 18836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847dd0f72f3f4a6c8834194b02858750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.182005 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:34.182724 18773 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.184904 18964 ts_tablet_manager.cc:1434] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.137s	user 0.007s	sys 0.001s
I20260709 12:22:34.171690 18758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5f0fdf96074deb816d2d3b27fe7143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.201579 18905 tablet_service.cc:1511] Processing CreateTablet for tablet 3bac759d8cf2478e874f15f02c6c54fb (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:34.203123 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bac759d8cf2478e874f15f02c6c54fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.206516 18762 tablet_service.cc:1511] Processing CreateTablet for tablet 5a38dabcd47249aebb1f53168be39bbc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:34.230618 18757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847dd0f72f3f4a6c8834194b02858750. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:34.232352 18739 leader_election.cc:343] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.232889 18907 tablet_service.cc:1511] Processing CreateTablet for tablet 847dd0f72f3f4a6c8834194b02858750 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 12:22:34.233450 18887 leader_election.cc:343] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.234355 18907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847dd0f72f3f4a6c8834194b02858750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.235870 18908 tablet_service.cc:1511] Processing CreateTablet for tablet 84ea4e9cc4d9482b920ad086bf4b1305 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:34.237702 18908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ea4e9cc4d9482b920ad086bf4b1305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.239980 18964 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:34.243463 18762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a38dabcd47249aebb1f53168be39bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.244866 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:34.246187 18962 tablet_bootstrap.cc:654] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:34.246603 18887 leader_election.cc:343] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.239321 18909 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5f0fdf96074deb816d2d3b27fe7143 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:34.269809 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5f0fdf96074deb816d2d3b27fe7143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.273417 18904 tablet_service.cc:1511] Processing CreateTablet for tablet 5a38dabcd47249aebb1f53168be39bbc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:34.276237 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a38dabcd47249aebb1f53168be39bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.274127 18963 tablet_bootstrap.cc:492] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:34.278191 18963 ts_tablet_manager.cc:1403] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.004s
I20260709 12:22:34.261065 18669 catalog_manager.cc:5697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.266083 18831 tablet_service.cc:1511] Processing CreateTablet for tablet 5a38dabcd47249aebb1f53168be39bbc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:34.290607 18963 raft_consensus.cc:359] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.291769 18963 raft_consensus.cc:385] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.292089 18963 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.292105 18831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a38dabcd47249aebb1f53168be39bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.300792 18835 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2498b4d0a8462b860b1e4040e4e5bc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:34.306142 18835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2498b4d0a8462b860b1e4040e4e5bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.306666 18903 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2498b4d0a8462b860b1e4040e4e5bc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:34.306957 18838 tablet_service.cc:1511] Processing CreateTablet for tablet d486b285b7724e2b928affadfca2a6ec (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:34.308115 18903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2498b4d0a8462b860b1e4040e4e5bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.308316 18838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d486b285b7724e2b928affadfca2a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.319171 18905 tablet_service.cc:1511] Processing CreateTablet for tablet d486b285b7724e2b928affadfca2a6ec (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:34.320657 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d486b285b7724e2b928affadfca2a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.325901 18756 tablet_service.cc:1511] Processing CreateTablet for tablet 9317d76b36ff4814b60c58870accf4ec (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:34.327358 18756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9317d76b36ff4814b60c58870accf4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.331899 18910 tablet_service.cc:1511] Processing CreateTablet for tablet 9317d76b36ff4814b60c58870accf4ec (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:34.333424 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9317d76b36ff4814b60c58870accf4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.334148 18964 tablet_bootstrap.cc:654] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.293071 18963 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.349103 18963 ts_tablet_manager.cc:1434] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:22:34.350266 18834 tablet_service.cc:1511] Processing CreateTablet for tablet 9317d76b36ff4814b60c58870accf4ec (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:34.351172 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2498b4d0a8462b860b1e4040e4e5bc (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:34.351855 18834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9317d76b36ff4814b60c58870accf4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.352375 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2498b4d0a8462b860b1e4040e4e5bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.350266 18963 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:34.359201 18763 tablet_service.cc:1511] Processing CreateTablet for tablet d486b285b7724e2b928affadfca2a6ec (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:34.360693 18763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d486b285b7724e2b928affadfca2a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.337953 18762 tablet_service.cc:1511] Processing CreateTablet for tablet 89cba94afb054c008d05b4ea99edd513 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:34.362542 18762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89cba94afb054c008d05b4ea99edd513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.367075 18668 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.370978 18837 tablet_service.cc:1511] Processing CreateTablet for tablet 89cba94afb054c008d05b4ea99edd513 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:34.372431 18837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89cba94afb054c008d05b4ea99edd513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.375964 18911 tablet_service.cc:1511] Processing CreateTablet for tablet 89cba94afb054c008d05b4ea99edd513 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:34.377437 18911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89cba94afb054c008d05b4ea99edd513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.380528 18833 tablet_service.cc:1511] Processing CreateTablet for tablet b37f46e9bd70474bbc330c12a42a76f5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:34.381919 18833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37f46e9bd70474bbc330c12a42a76f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.375694 18761 tablet_service.cc:1511] Processing CreateTablet for tablet b37f46e9bd70474bbc330c12a42a76f5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:34.383591 18773 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:34.384100 18761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37f46e9bd70474bbc330c12a42a76f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.386545 18829 tablet_service.cc:1511] Processing CreateTablet for tablet a24ba3693ff3438f831ba2ec6a724700 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:34.388419 18829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24ba3693ff3438f831ba2ec6a724700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.390780 18760 tablet_service.cc:1511] Processing CreateTablet for tablet a24ba3693ff3438f831ba2ec6a724700 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:34.392161 18760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24ba3693ff3438f831ba2ec6a724700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.394882 18906 tablet_service.cc:1511] Processing CreateTablet for tablet b37f46e9bd70474bbc330c12a42a76f5 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:34.396260 18906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37f46e9bd70474bbc330c12a42a76f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.397476 18996 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.398000 18996 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.400262 18996 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.401161 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:34.403283 18968 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.403815 18968 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:34.404706 18968 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.408097 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:34.426601 18814 leader_election.cc:343] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.427558 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:34.429328 18812 leader_election.cc:343] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.429821 18812 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:34.431286 18996 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.434353 18912 tablet_service.cc:1511] Processing CreateTablet for tablet a24ba3693ff3438f831ba2ec6a724700 (DEFAULT_TABLE table=test-workload [id=899df26751aa4f5ba89c72213f4cea84]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:34.435822 18912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24ba3693ff3438f831ba2ec6a724700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:34.450996 18963 tablet_bootstrap.cc:654] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.491751 18962 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.492347 18962 ts_tablet_manager.cc:1403] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.344s	user 0.019s	sys 0.018s
I20260709 12:22:34.495556 18962 raft_consensus.cc:359] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.503409 18962 raft_consensus.cc:385] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.503773 18962 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.504542 18962 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.507102 18962 ts_tablet_manager.cc:1434] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:22:34.509150 18964 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:34.509776 18964 ts_tablet_manager.cc:1403] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.271s	user 0.044s	sys 0.030s
I20260709 12:22:34.512276 18668 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.522483 18968 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.523032 18968 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.524049 18964 raft_consensus.cc:359] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.524789 18964 raft_consensus.cc:385] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.525218 18968 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:34.522550 19001 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.526214 19001 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.527297 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:34.528447 18847 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:34.529011 19001 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.530953 18962 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.531229 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:34.531916 18922 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:34.533452 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:34.534541 18963 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:34.535084 18963 ts_tablet_manager.cc:1403] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.185s	user 0.007s	sys 0.013s
I20260709 12:22:34.535360 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:34.525070 18964 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.538365 18994 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.538826 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:34.543208 19001 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.543627 19001 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.543776 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:34.544016 19001 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:34.545463 18738 leader_election.cc:343] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.549775 18994 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.549556 18963 raft_consensus.cc:359] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.550498 18963 raft_consensus.cc:385] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.550849 18963 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.551666 18963 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.552760 19001 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.554095 18963 ts_tablet_manager.cc:1434] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 12:22:34.556151 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:34.555932 18964 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.556770 18922 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.559118 19001 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.559846 18962 tablet_bootstrap.cc:654] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.562544 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:34.558377 18964 ts_tablet_manager.cc:1434] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.048s	user 0.000s	sys 0.006s
I20260709 12:22:34.566447 18963 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:34.569115 18968 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:34.569540 18738 leader_election.cc:343] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.570698 18968 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.572651 18922 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:34.572993 18963 tablet_bootstrap.cc:654] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.574043 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:34.575366 18970 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.574275 18964 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:34.578501 18970 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:34.581413 18970 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.596524 18962 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.597393 18962 ts_tablet_manager.cc:1403] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.001s
I20260709 12:22:34.587368 19001 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:22:34.599763 18964 tablet_bootstrap.cc:654] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.601359 18963 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:34.607251 18963 ts_tablet_manager.cc:1403] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.013s
I20260709 12:22:34.608799 18962 raft_consensus.cc:359] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.609604 18962 raft_consensus.cc:385] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.609938 18962 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.610713 18962 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.610909 18963 raft_consensus.cc:359] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.611651 18963 raft_consensus.cc:385] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.611974 18963 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.612660 18963 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.613198 18962 ts_tablet_manager.cc:1434] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:22:34.614854 18963 ts_tablet_manager.cc:1434] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:34.615633 18962 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.622984 18773 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.631736 18994 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.633805 18994 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.634285 18994 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.638489 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:34.639209 18848 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:34.640552 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:34.641474 18968 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.641830 18968 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.642174 18968 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.645772 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:34.646508 18994 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:34.646893 18771 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:34.652805 18962 tablet_bootstrap.cc:654] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.651907 18968 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.662981 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:34.664158 18772 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.657860 18668 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.670647 18970 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.671698 18963 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:34.671551 18970 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.675338 18962 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.674965 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:34.675915 18962 ts_tablet_manager.cc:1403] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
I20260709 12:22:34.676244 18845 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.678670 18963 tablet_bootstrap.cc:654] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.678722 18962 raft_consensus.cc:359] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.679502 18962 raft_consensus.cc:385] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.679807 18962 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.680677 18962 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.683236 18962 ts_tablet_manager.cc:1434] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:34.684947 18962 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.672266 18772 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:34.685904 18964 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:34.686460 18964 ts_tablet_manager.cc:1403] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.112s	user 0.022s	sys 0.009s
I20260709 12:22:34.686614 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:34.687896 18994 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.688568 18994 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:34.691015 18994 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.692368 18970 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.681517 18968 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:34.695567 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:34.697840 18962 tablet_bootstrap.cc:654] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.698045 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:34.698697 18982 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.706143 18968 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:22:34.709638 18982 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.713958 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:34.716006 18982 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:34.715626 18970 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:34.717864 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:34.718413 18970 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:22:34.729470 18887 leader_election.cc:343] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.726665 18669 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.724738 18845 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:34.720001 18964 raft_consensus.cc:359] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.743959 18964 raft_consensus.cc:385] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.744320 18964 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.747864 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:34.748631 18773 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:34.751259 18964 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.752887 18886 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:34.753235 18962 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.753744 18962 ts_tablet_manager.cc:1403] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.000s
I20260709 12:22:34.756450 18962 raft_consensus.cc:359] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.757192 18962 raft_consensus.cc:385] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.757476 18962 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.758488 18962 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.760044 18962 ts_tablet_manager.cc:1434] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:22:34.760133 18964 ts_tablet_manager.cc:1434] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 12:22:34.761207 18962 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.761248 18964 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:34.765455 18963 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:34.766144 18963 ts_tablet_manager.cc:1403] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.016s
I20260709 12:22:34.766647 18994 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.770519 18996 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.774767 18962 tablet_bootstrap.cc:654] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.774857 18996 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.778430 18964 tablet_bootstrap.cc:654] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.779080 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:34.779986 18772 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:34.783329 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:34.784754 18996 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.785986 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:34.787352 18962 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.787245 18996 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.788013 18962 ts_tablet_manager.cc:1403] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 12:22:34.787889 18996 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.788487 18996 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.788719 18921 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:34.792186 18994 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.792797 18994 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.796824 18964 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:34.797598 18964 ts_tablet_manager.cc:1403] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.002s
I20260709 12:22:34.797432 18962 raft_consensus.cc:359] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.798185 18962 raft_consensus.cc:385] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.798501 18962 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.799401 18962 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.801553 18962 ts_tablet_manager.cc:1434] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:34.801265 18964 raft_consensus.cc:359] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.802145 18964 raft_consensus.cc:385] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.802585 18964 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.803704 18964 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.803738 18963 raft_consensus.cc:359] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.804761 18963 raft_consensus.cc:385] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.805179 18963 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.802613 18962 tablet_bootstrap.cc:492] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.804931 18996 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.810446 18996 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.806331 18963 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.820191 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:22:34.830875 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:34.831120 18772 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.832098 18963 ts_tablet_manager.cc:1434] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.002s
I20260709 12:22:34.833137 18963 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:34.818884 18962 tablet_bootstrap.cc:654] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.821175 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:34.839674 18994 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.841100 18921 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:34.843082 18772 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:34.843111 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:34.844121 18773 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:34.844616 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:34.845544 18996 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.846031 18996 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:34.846946 18996 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.847506 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:34.849259 18887 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:34.850431 19029 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.851372 18994 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:34.823082 18964 ts_tablet_manager.cc:1434] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 12:22:34.853541 18964 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:34.844650 18963 tablet_bootstrap.cc:654] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.859740 19029 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:34.867604 18668 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.881271 18964 tablet_bootstrap.cc:654] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:34.888825 18887 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:34.897714 18963 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:34.898514 18963 ts_tablet_manager.cc:1403] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.018s
I20260709 12:22:34.899051 18962 tablet_bootstrap.cc:492] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.901726 18962 ts_tablet_manager.cc:1403] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.022s
I20260709 12:22:34.902109 18963 raft_consensus.cc:359] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.902915 18963 raft_consensus.cc:385] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.903200 18963 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.904116 18964 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:34.904081 18963 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.904795 18964 ts_tablet_manager.cc:1403] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.004s
I20260709 12:22:34.904743 18962 raft_consensus.cc:359] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.905503 18962 raft_consensus.cc:385] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.905789 18962 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.906754 18963 ts_tablet_manager.cc:1434] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:34.906636 18962 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.908196 18964 raft_consensus.cc:359] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.908833 18963 tablet_bootstrap.cc:492] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:34.908856 18962 ts_tablet_manager.cc:1434] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:34.909080 18964 raft_consensus.cc:385] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.909507 18964 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.909996 18962 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.910460 18964 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.916020 18963 tablet_bootstrap.cc:654] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.916090 18962 tablet_bootstrap.cc:654] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.917083 18964 ts_tablet_manager.cc:1434] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:22:34.918228 18996 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.918772 18996 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.921176 18996 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.923195 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:34.923933 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:34.924206 18773 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:34.924611 18921 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:34.926153 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:34.930964 18996 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.931480 18996 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.931939 18996 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.934640 18963 tablet_bootstrap.cc:492] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:34.935176 18963 ts_tablet_manager.cc:1403] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 12:22:34.933979 18962 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.938197 18963 raft_consensus.cc:359] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.938841 18962 ts_tablet_manager.cc:1403] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.006s
I20260709 12:22:34.939011 18963 raft_consensus.cc:385] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.939338 18963 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.940189 18963 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.942143 18964 tablet_bootstrap.cc:492] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:34.941787 18962 raft_consensus.cc:359] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.942610 18962 raft_consensus.cc:385] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.942683 18963 ts_tablet_manager.cc:1434] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:34.942955 18962 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.943737 18963 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:34.941780 18996 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.944209 18962 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.947367 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:34.948092 18773 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.950490 18963 tablet_bootstrap.cc:654] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.955696 18962 ts_tablet_manager.cc:1434] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:22:34.956853 18962 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.958122 18773 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:34.960240 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:34.961815 19035 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.963505 18962 tablet_bootstrap.cc:654] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.969182 18962 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:34.969662 18962 ts_tablet_manager.cc:1403] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:22:34.972340 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:34.972311 18962 raft_consensus.cc:359] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.973070 18962 raft_consensus.cc:385] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.973068 18921 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.973430 18996 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:34.974601 18962 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.975903 18962 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.976274 19035 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:34.977455 19035 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.978343 18963 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:34.978920 18963 ts_tablet_manager.cc:1403] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.025s
I20260709 12:22:34.984045 18921 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:34.988196 18962 ts_tablet_manager.cc:1434] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:22:34.981911 18963 raft_consensus.cc:359] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.989321 18962 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:34.989845 18982 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.990358 18982 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:34.992630 18982 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:34.994326 18668 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.995329 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:34.996024 18846 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:34.996387 18962 tablet_bootstrap.cc:654] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.996582 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:34.997298 18773 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:34.997526 18887 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:34.998512 18982 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.998946 18982 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.999302 18982 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.989497 18964 tablet_bootstrap.cc:654] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.989336 18963 raft_consensus.cc:385] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.001313 18963 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.002151 18963 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.004535 18963 ts_tablet_manager.cc:1434] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:22:35.005612 18963 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:35.007577 18982 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.011125 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:35.011837 18773 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.012784 18963 tablet_bootstrap.cc:654] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.028422 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:35.029258 18846 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.037190 18982 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:35.040109 18963 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:35.039924 18846 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:35.041321 18963 ts_tablet_manager.cc:1403] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.014s
I20260709 12:22:35.041826 18887 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:35.043506 18962 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:35.044026 18962 ts_tablet_manager.cc:1403] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.030s
I20260709 12:22:35.044278 18963 raft_consensus.cc:359] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.045007 18963 raft_consensus.cc:385] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.045267 18963 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.045951 18963 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.048173 18963 ts_tablet_manager.cc:1434] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:35.049180 18963 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:35.049314 18964 tablet_bootstrap.cc:492] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:35.049808 18964 ts_tablet_manager.cc:1403] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.108s	user 0.005s	sys 0.010s
I20260709 12:22:35.052714 19017 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.052770 18964 raft_consensus.cc:359] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.053548 18964 raft_consensus.cc:385] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.053848 18964 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.054615 18964 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.055758 18963 tablet_bootstrap.cc:654] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.043267 18982 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.065323 18982 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:35.065810 18962 raft_consensus.cc:359] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.066298 18982 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.067016 18962 raft_consensus.cc:385] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.069378 18964 ts_tablet_manager.cc:1434] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:22:35.069371 18962 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.040124 18773 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:35.071532 18962 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.079175 18964 tablet_bootstrap.cc:492] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:35.081947 18962 ts_tablet_manager.cc:1434] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:22:35.089540 18964 tablet_bootstrap.cc:654] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.095592 18962 tablet_bootstrap.cc:492] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:35.101577 18963 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:35.102154 18963 ts_tablet_manager.cc:1403] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.023s
I20260709 12:22:35.105132 18963 raft_consensus.cc:359] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.105899 18963 raft_consensus.cc:385] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.106191 18963 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.102017 18846 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.107060 18963 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.107990 18964 tablet_bootstrap.cc:492] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:35.108601 18964 ts_tablet_manager.cc:1403] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.006s
I20260709 12:22:35.111430 18962 tablet_bootstrap.cc:654] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.110776 18668 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.111785 18964 raft_consensus.cc:359] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.112489 18964 raft_consensus.cc:385] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.112788 18964 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.113682 18963 ts_tablet_manager.cc:1434] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:22:35.113829 18964 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.115139 18963 tablet_bootstrap.cc:492] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:35.121522 18964 ts_tablet_manager.cc:1434] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:22:35.121451 19018 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.124719 18962 tablet_bootstrap.cc:492] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:35.125337 18962 ts_tablet_manager.cc:1403] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.005s
I20260709 12:22:35.126569 19018 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.127581 18964 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:35.127101 19018 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.128520 18962 raft_consensus.cc:359] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.129359 18962 raft_consensus.cc:385] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.129710 18962 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.130507 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:22:35.132191 18738 leader_election.cc:343] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.132807 18962 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.137933 18963 tablet_bootstrap.cc:654] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.138579 18962 ts_tablet_manager.cc:1434] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:22:35.139634 18962 tablet_bootstrap.cc:492] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:35.134207 18964 tablet_bootstrap.cc:654] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.134521 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.145993 18922 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:35.134522 19018 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.148058 18739 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.149335 19018 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.149745 19018 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.150105 19018 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.150907 18962 tablet_bootstrap.cc:654] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.161324 19018 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.170724 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:22:35.172820 18738 leader_election.cc:343] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.177282 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:35.178203 18922 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.186040 18964 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:35.186651 18964 ts_tablet_manager.cc:1403] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.013s
I20260709 12:22:35.187098 18963 tablet_bootstrap.cc:492] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:35.187530 18963 ts_tablet_manager.cc:1403] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.073s	user 0.027s	sys 0.028s
I20260709 12:22:35.188532 18922 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:35.186547 19018 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.189826 18739 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.189666 18964 raft_consensus.cc:359] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.190536 18964 raft_consensus.cc:385] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.190889 19017 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.190533 18963 raft_consensus.cc:359] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.191143 18964 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.191457 18963 raft_consensus.cc:385] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.191494 19017 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:35.191859 18963 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.192677 18962 tablet_bootstrap.cc:492] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:35.192397 18964 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.192569 19017 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.193296 18962 ts_tablet_manager.cc:1403] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.015s
I20260709 12:22:35.192785 18963 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.194919 18964 ts_tablet_manager.cc:1434] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:35.196033 18964 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:35.196298 18962 raft_consensus.cc:359] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.197054 18962 raft_consensus.cc:385] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.197360 18962 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.198185 18962 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.200635 18962 ts_tablet_manager.cc:1434] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:22:35.201622 18962 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:35.201557 19035 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.202163 19035 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.203403 18964 tablet_bootstrap.cc:654] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.204126 18970 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.204633 18970 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.206048 18963 ts_tablet_manager.cc:1434] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:22:35.207409 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:35.208050 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:22:35.209817 18738 leader_election.cc:343] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.210911 18970 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.211683 18963 tablet_bootstrap.cc:492] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:35.212430 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.213119 18921 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:35.215294 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.216873 19001 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.217293 19001 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.217679 19001 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.217017 19035 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.221036 18963 tablet_bootstrap.cc:654] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.223672 18982 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.224192 18982 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.228353 18982 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:35.229355 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.231323 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:35.232153 18773 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:35.233431 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:35.235045 19035 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:35.236456 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:22:35.238616 18887 leader_election.cc:343] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.240254 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.242625 18994 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.243178 18994 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.243628 18994 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.258247 18982 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.258870 18963 tablet_bootstrap.cc:492] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:35.259804 18963 ts_tablet_manager.cc:1403] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.005s
I20260709 12:22:35.264525 18994 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.265314 19018 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.271633 19018 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.273083 18994 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:35.273594 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:35.275008 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:22:35.275522 18887 leader_election.cc:343] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.275926 18772 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.278851 18962 tablet_bootstrap.cc:654] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.281754 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.282923 18970 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.283746 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:35.283249 18671 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.283483 18970 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:35.285362 18738 leader_election.cc:343] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.286329 18970 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.250130 19001 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.287110 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:35.287819 18846 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:35.288054 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.288703 18921 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:35.289664 19001 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.290218 18772 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:35.290472 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:35.295006 18970 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.295428 18970 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.295790 18970 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.267438 18963 raft_consensus.cc:359] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.291949 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:35.274174 19018 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.292438 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:35.292562 18994 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.297592 18921 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.297791 18964 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:35.297672 18994 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.298344 18964 ts_tablet_manager.cc:1403] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.103s	user 0.033s	sys 0.051s
I20260709 12:22:35.296787 18963 raft_consensus.cc:385] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.299269 18963 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.299839 18963 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.303395 18922 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:35.304550 18963 ts_tablet_manager.cc:1434] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:22:35.332785 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.334095 19018 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.334192 18964 raft_consensus.cc:359] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.335081 18964 raft_consensus.cc:385] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.335402 18964 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.334657 19018 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.336445 19018 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.336161 18964 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.339398 18964 ts_tablet_manager.cc:1434] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.041s	user 0.019s	sys 0.012s
W20260709 12:22:35.339731 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46642.2us
I20260709 12:22:35.339964 18970 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.341516 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:35.342572 18963 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
W20260709 12:22:35.341429 18738 leader_election.cc:343] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.343254 18970 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.343329 18773 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:35.344085 18964 tablet_bootstrap.cc:492] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:35.346035 19035 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.346771 19035 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.348811 19035 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.349354 18846 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.349460 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:35.350116 18922 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.349943 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.342643 18921 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:35.362746 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.365155 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.365672 18982 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.343218 18994 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:35.366293 18982 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:35.367326 18982 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.368815 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:35.369123 19018 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.371162 18970 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.371660 18845 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.372610 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:35.373297 18847 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.374826 18922 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:35.376178 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:35.377270 18962 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:35.377161 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:35.379159 18962 ts_tablet_manager.cc:1403] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.010s
I20260709 12:22:35.378373 19029 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:35.381242 19001 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.381759 19001 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:35.381374 18964 tablet_bootstrap.cc:654] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.389817 18847 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:35.384637 19001 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.393842 18962 raft_consensus.cc:359] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.394659 18962 raft_consensus.cc:385] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.394573 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:35.395036 18962 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.395319 18922 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.380100 18970 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:35.392793 19018 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.426956 18922 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:35.506569 18964 tablet_bootstrap.cc:492] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:35.496392 18671 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.510937 19069 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:22:35.540671 18964 ts_tablet_manager.cc:1403] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.197s	user 0.030s	sys 0.039s
I20260709 12:22:35.540851 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:35.541796 19018 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.397485 18962 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.494618 18996 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 12:22:35.409619 18970 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.381906 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:22:35.552531 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 170713us
I20260709 12:22:35.552269 18964 raft_consensus.cc:359] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.553767 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.554062 18964 raft_consensus.cc:385] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.423825 18963 tablet_bootstrap.cc:654] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.555672 18994 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:35.542496 19018 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:35.554365 18964 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.559075 19069 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:35.559387 19018 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.555755 18962 ts_tablet_manager.cc:1434] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.176s	user 0.009s	sys 0.010s
I20260709 12:22:35.465080 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:35.573093 18962 tablet_bootstrap.cc:492] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
W20260709 12:22:35.573458 18738 leader_election.cc:343] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.562196 18964 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.576088 18964 ts_tablet_manager.cc:1434] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:22:35.577191 18964 tablet_bootstrap.cc:492] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:35.569242 18963 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:35.578755 18963 ts_tablet_manager.cc:1403] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.272s	user 0.012s	sys 0.007s
I20260709 12:22:35.579686 18962 tablet_bootstrap.cc:654] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.581653 18963 raft_consensus.cc:359] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.582454 18963 raft_consensus.cc:385] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.582814 18963 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.583547 18963 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.587131 18963 ts_tablet_manager.cc:1434] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:35.588295 18963 tablet_bootstrap.cc:492] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:35.580615 18668 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.590355 18994 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.590984 18964 tablet_bootstrap.cc:654] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.590997 18994 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.592240 18668 catalog_manager.cc:5697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.594903 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:35.597105 19069 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.598205 18772 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:35.597112 18994 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:35.601341 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:35.602147 18847 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:35.603238 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:35.604573 18994 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.605119 18994 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.605571 18994 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.608259 18847 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.613960 18994 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.617012 19069 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.619062 18962 tablet_bootstrap.cc:492] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:35.621492 18962 ts_tablet_manager.cc:1403] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.007s
I20260709 12:22:35.624663 18962 raft_consensus.cc:359] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.625535 18962 raft_consensus.cc:385] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.626027 18962 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.631369 18962 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.646466 18962 ts_tablet_manager.cc:1434] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:22:35.648290 18962 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:35.657688 18994 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:35.663542 18982 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.664120 18982 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.665830 18964 tablet_bootstrap.cc:492] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:35.666364 18964 ts_tablet_manager.cc:1403] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.017s
I20260709 12:22:35.656025 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:35.666654 18982 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:35.667088 18769 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.668284 19029 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:35.669943 18964 raft_consensus.cc:359] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.670888 18964 raft_consensus.cc:385] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.671455 18964 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.672561 18964 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.671439 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:35.674342 18771 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:35.679176 18964 ts_tablet_manager.cc:1434] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:22:35.682564 18964 tablet_bootstrap.cc:492] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:35.683193 18963 tablet_bootstrap.cc:654] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.686888 18671 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.690287 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:35.691249 19029 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.691660 19029 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.692008 19029 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.691912 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:35.694700 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:35.692576 18846 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:35.698442 18887 leader_election.cc:343] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.710578 18982 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.738168 18996 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.739023 18996 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.742057 18846 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:35.746315 19069 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.743927 19018 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.749266 19069 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.754287 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:35.749804 19018 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.755270 18968 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.761660 18968 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:35.762862 18968 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.765525 18769 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:35.768584 19029 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.771750 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:35.772428 18963 tablet_bootstrap.cc:492] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:35.772627 18773 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:35.772961 18963 ts_tablet_manager.cc:1403] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.023s
I20260709 12:22:35.773656 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:35.776249 18963 raft_consensus.cc:359] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.777117 18963 raft_consensus.cc:385] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.777486 18963 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.778232 18963 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.789165 19018 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.780102 18970 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.781040 19069 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.779754 18996 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.789846 18962 tablet_bootstrap.cc:654] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.790158 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:35.798187 18963 ts_tablet_manager.cc:1434] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:22:35.779098 19029 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:35.801111 18963 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:35.804087 18964 tablet_bootstrap.cc:654] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.814024 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.816166 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:35.818521 18996 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.820173 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.820956 18920 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
W20260709 12:22:35.824355 18738 leader_election.cc:343] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.822357 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:22:35.830132 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58799.8us
I20260709 12:22:35.839915 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:35.841755 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:35.842618 18771 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.846841 18962 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:35.847325 18962 ts_tablet_manager.cc:1403] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.199s	user 0.016s	sys 0.004s
I20260709 12:22:35.849759 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.850564 18920 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:35.856786 18671 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.872556 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.873926 18970 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.874482 18970 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.874907 18970 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:35.876200 19083 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:22:35.879576 18962 raft_consensus.cc:359] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.880476 18962 raft_consensus.cc:385] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.880767 18962 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.881449 18962 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.883745 18962 ts_tablet_manager.cc:1434] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:22:35.885206 18962 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:35.887593 18964 tablet_bootstrap.cc:492] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:35.890563 18964 ts_tablet_manager.cc:1403] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.208s	user 0.021s	sys 0.015s
I20260709 12:22:35.890864 19018 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.892453 19018 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:35.894002 18887 leader_election.cc:343] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.897972 19001 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.899535 18771 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:35.888285 18996 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:35.892397 18970 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.905093 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:35.905942 18964 raft_consensus.cc:359] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.906724 18964 raft_consensus.cc:385] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.907027 18964 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
W20260709 12:22:35.907788 18739 leader_election.cc:343] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.907745 18964 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.909072 18970 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.910544 19069 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:35.912395 19069 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:22:35.912554 18964 ts_tablet_manager.cc:1434] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:22:35.912842 19069 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:35.913583 18964 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:35.914979 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:35.915273 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:35.915912 18847 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:35.918365 18738 leader_election.cc:343] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.919047 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:35.920928 19018 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.919834 19001 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:35.920182 18962 tablet_bootstrap.cc:654] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.923946 18847 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:35.926774 18963 tablet_bootstrap.cc:654] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.929448 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:35.937294 18964 tablet_bootstrap.cc:654] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.926788 19018 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:35.943370 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:35.943720 18968 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.944232 18968 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:35.944329 19001 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.944859 19001 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:35.945243 18968 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.945719 19001 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.952420 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:35.953439 18922 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.950627 19085 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:22:35.959944 19069 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:35.965194 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:35.968096 19069 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:35.971520 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:35.977315 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:35.978820 19069 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:35.987372 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:35.987498 18962 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:35.989084 18962 ts_tablet_manager.cc:1403] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.008s
I20260709 12:22:35.991935 18847 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:36.004225 19090 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:36.008263 19001 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:36.011341 18847 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.013211 19001 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:36.013878 19001 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:36.015138 19001 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.020792 19001 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:36.022655 18922 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:36.028290 19085 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:36.034822 19017 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:36.033926 19090 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:36.033496 18738 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:36.050961 18963 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.051656 18963 ts_tablet_manager.cc:1403] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.251s	user 0.017s	sys 0.013s
I20260709 12:22:36.063776 18962 raft_consensus.cc:359] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.064430 18962 raft_consensus.cc:385] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.064719 18962 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.065915 18962 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.078758 19090 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:36.081079 18964 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.081751 18964 ts_tablet_manager.cc:1403] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.044s
I20260709 12:22:36.085623 18962 ts_tablet_manager.cc:1434] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.003s
I20260709 12:22:36.086750 18962 tablet_bootstrap.cc:492] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:36.112473 18963 raft_consensus.cc:359] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.113075 18963 raft_consensus.cc:385] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.113319 18963 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.113899 18963 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.125942 18963 ts_tablet_manager.cc:1434] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 12:22:36.126374 19035 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:22:36.138965 19035 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.139407 18964 raft_consensus.cc:359] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.140162 18964 raft_consensus.cc:385] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.140475 18964 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.141186 18964 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.144467 18963 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:36.152537 19035 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.161947 18964 ts_tablet_manager.cc:1434] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 12:22:36.164153 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:36.168088 18668 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.193029 18669 catalog_manager.cc:5697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:36.210361 18962 tablet_bootstrap.cc:654] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.246620 18996 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.276347 18996 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.279505 19017 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.255649 18964 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
W20260709 12:22:36.241047 19103 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:36.280279 19017 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.284894 18996 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.288866 18964 tablet_bootstrap.cc:654] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.258265 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:36.298506 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:36.286152 19017 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.310328 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.311437 18964 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.311542 18996 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:36.312129 18964 ts_tablet_manager.cc:1403] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.009s
I20260709 12:22:36.315157 18964 raft_consensus.cc:359] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.316064 18964 raft_consensus.cc:385] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.316509 18964 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.266041 18963 tablet_bootstrap.cc:654] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.317353 18964 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.320111 18964 ts_tablet_manager.cc:1434] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:36.321314 18964 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
W20260709 12:22:36.321266 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45909us
I20260709 12:22:36.322685 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:36.323529 18771 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:36.326723 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:36.330705 19085 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:36.331069 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:36.332067 19029 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:36.342938 18738 leader_election.cc:343] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.345773 19029 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.346776 19029 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.349839 19029 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:36.351830 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:22:36.351264 18739 leader_election.cc:343] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:36.354815 18887 leader_election.cc:343] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.354790 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:36.356475 18773 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:36.357479 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.357934 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:36.359308 19085 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.359730 19085 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.360072 19085 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.360957 19018 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.364640 18964 tablet_bootstrap.cc:654] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.367895 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.369649 19035 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.383193 18963 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.383725 18963 ts_tablet_manager.cc:1403] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.239s	user 0.007s	sys 0.008s
I20260709 12:22:36.408540 19035 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.411679 18963 raft_consensus.cc:359] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.412469 18963 raft_consensus.cc:385] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.412755 18963 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.415189 18962 tablet_bootstrap.cc:492] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:36.415766 18962 ts_tablet_manager.cc:1403] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.329s	user 0.031s	sys 0.036s
I20260709 12:22:36.413412 18963 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.417863 18963 ts_tablet_manager.cc:1434] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.004s
I20260709 12:22:36.419901 18963 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:36.426379 18962 raft_consensus.cc:359] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.426656 19085 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.427225 18962 raft_consensus.cc:385] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.427567 18962 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.428776 18964 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.429232 18964 ts_tablet_manager.cc:1403] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.004s
I20260709 12:22:36.429134 19085 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:36.429991 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:36.430733 18771 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.436417 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:36.437929 19029 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:36.438910 18771 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:36.439451 18962 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.440229 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:36.443250 19029 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.443887 18962 ts_tablet_manager.cc:1434] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:22:36.443838 19029 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:36.444868 19029 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.447286 18963 tablet_bootstrap.cc:654] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.449057 18962 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
W20260709 12:22:36.457032 18887 leader_election.cc:343] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.460047 18962 tablet_bootstrap.cc:654] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.459880 18964 raft_consensus.cc:359] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.461521 18964 raft_consensus.cc:385] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.461915 18964 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.462668 18964 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.464922 18964 ts_tablet_manager.cc:1434] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:22:36.465965 18964 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:36.468555 18963 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.469213 18963 ts_tablet_manager.cc:1403] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.002s
I20260709 12:22:36.473191 18963 raft_consensus.cc:359] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.474313 18963 raft_consensus.cc:385] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.474768 18963 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.475521 18963 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.477510 19085 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.478060 19085 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.480312 19085 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:36.480741 18968 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:36.482882 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:36.483551 18964 tablet_bootstrap.cc:654] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.483956 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:36.484688 18771 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
W20260709 12:22:36.486508 18887 leader_election.cc:343] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.488225 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:36.490054 18968 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.490532 18968 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.490929 18968 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.507577 18845 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.515866 18963 ts_tablet_manager.cc:1434] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:22:36.518213 18963 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:36.526518 18963 tablet_bootstrap.cc:654] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.528672 18964 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.529269 18964 ts_tablet_manager.cc:1403] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.007s
I20260709 12:22:36.526607 18962 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:36.519878 18968 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.530822 18962 ts_tablet_manager.cc:1403] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.005s
I20260709 12:22:36.532771 18964 raft_consensus.cc:359] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.533892 18964 raft_consensus.cc:385] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.534269 18964 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.534931 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:36.535254 18964 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.536307 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:36.536966 18773 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.537688 18962 raft_consensus.cc:359] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.538332 18964 ts_tablet_manager.cc:1434] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:36.538430 18962 raft_consensus.cc:385] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.538923 18962 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.539799 18964 tablet_bootstrap.cc:492] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:36.539688 18962 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.542044 18962 ts_tablet_manager.cc:1434] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
W20260709 12:22:36.543028 18887 leader_election.cc:343] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.551067 18968 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:36.551610 18964 tablet_bootstrap.cc:654] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.556806 18773 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:36.558589 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:36.559927 18968 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.560496 18968 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:36.561271 18962 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:36.561362 18968 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.565901 18964 tablet_bootstrap.cc:492] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.566650 18964 ts_tablet_manager.cc:1403] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 12:22:36.569890 18964 raft_consensus.cc:359] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.570603 18964 raft_consensus.cc:385] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.571990 19018 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:36.570880 18964 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.583199 18964 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.585723 18668 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.588440 18962 tablet_bootstrap.cc:654] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.595072 18963 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.595678 18963 ts_tablet_manager.cc:1403] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.078s	user 0.028s	sys 0.016s
I20260709 12:22:36.596922 18964 ts_tablet_manager.cc:1434] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:22:36.598274 18964 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:36.605613 18963 raft_consensus.cc:359] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.606352 18963 raft_consensus.cc:385] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.606665 18963 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.608032 18963 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.611641 18963 ts_tablet_manager.cc:1434] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:22:36.612663 18963 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:36.615056 18970 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:36.620926 18963 tablet_bootstrap.cc:654] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.629783 18964 tablet_bootstrap.cc:654] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.646816 18667 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.689692 18963 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.690281 18963 ts_tablet_manager.cc:1403] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.010s
I20260709 12:22:36.690097 18964 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.691772 18964 ts_tablet_manager.cc:1403] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.094s	user 0.025s	sys 0.027s
I20260709 12:22:36.692915 18962 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:36.693162 18963 raft_consensus.cc:359] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.694031 18963 raft_consensus.cc:385] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.694082 18962 ts_tablet_manager.cc:1403] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.024s
I20260709 12:22:36.694438 18963 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.694900 18964 raft_consensus.cc:359] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.695730 18964 raft_consensus.cc:385] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.695389 18963 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.696051 18964 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.697062 18964 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.697629 18963 ts_tablet_manager.cc:1434] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:36.698153 18962 raft_consensus.cc:359] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.698705 18963 tablet_bootstrap.cc:492] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:36.698979 18962 raft_consensus.cc:385] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.699321 18962 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.700146 18964 ts_tablet_manager.cc:1434] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:36.700208 18962 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.701247 18964 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:36.703069 18962 ts_tablet_manager.cc:1434] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:22:36.704203 18962 tablet_bootstrap.cc:492] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:36.706240 18963 tablet_bootstrap.cc:654] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.707911 18964 tablet_bootstrap.cc:654] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.711019 18962 tablet_bootstrap.cc:654] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.719933 18963 tablet_bootstrap.cc:492] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.720609 18963 ts_tablet_manager.cc:1403] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:22:36.723698 18963 raft_consensus.cc:359] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.724115 18962 tablet_bootstrap.cc:492] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:36.724464 18963 raft_consensus.cc:385] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.724789 18963 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.724802 18962 ts_tablet_manager.cc:1403] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:22:36.725790 18963 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.730430 18963 ts_tablet_manager.cc:1434] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:22:36.730937 18962 raft_consensus.cc:359] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.731454 18963 tablet_bootstrap.cc:492] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:36.736826 18962 raft_consensus.cc:385] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.737754 18964 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.737928 18962 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.738298 18964 ts_tablet_manager.cc:1403] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.011s
I20260709 12:22:36.738530 18963 tablet_bootstrap.cc:654] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.739025 18962 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.741894 18964 raft_consensus.cc:359] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.742643 18964 raft_consensus.cc:385] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.742570 19001 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.743108 18964 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.743399 19001 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.744021 18964 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.747387 19035 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.747947 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:36.747884 19035 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:36.749634 18739 leader_election.cc:343] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.751766 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:36.753429 18814 leader_election.cc:343] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.754843 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:36.755204 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:36.755559 18773 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:36.756171 18845 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:36.758788 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.758826 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.760349 19018 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.760902 19018 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.761194 18996 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.761628 18996 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.761564 19018 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.762120 18996 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.766572 19001 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.768260 19035 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.773460 19001 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.773993 19001 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.777684 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:36.778434 18922 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:36.779767 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:36.780596 19017 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.780961 19017 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.781313 19017 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.784904 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:36.785967 18845 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:36.787407 18970 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.788105 18970 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.791352 18970 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.792277 19017 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.794520 19001 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.772888 18996 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.796203 18964 ts_tablet_manager.cc:1434] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:22:36.798321 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:36.799064 18847 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.798941 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:36.799459 18964 tablet_bootstrap.cc:492] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:36.799379 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:22:36.800649 18814 leader_election.cc:343] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.802486 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:36.802649 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:22:36.803792 18738 leader_election.cc:343] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:36.804504 18739 leader_election.cc:343] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.805029 18739 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.805809 19017 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.811276 19017 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.775203 18962 ts_tablet_manager.cc:1434] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:22:36.806685 18964 tablet_bootstrap.cc:654] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.812618 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:36.813421 18922 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.819465 18962 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:36.823232 19018 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.826059 19018 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.827437 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:22:36.829118 18739 leader_election.cc:343] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.829777 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:36.830103 18964 tablet_bootstrap.cc:492] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.807327 18847 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:36.830510 18845 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:36.834664 18964 ts_tablet_manager.cc:1403] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.002s
I20260709 12:22:36.835582 18738 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:36.836014 18773 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:36.836649 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.837513 19017 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.807135 18996 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.838020 19017 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:36.838361 19018 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.837947 18964 raft_consensus.cc:359] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.839128 19017 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.841176 18962 tablet_bootstrap.cc:654] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.841984 18963 tablet_bootstrap.cc:492] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.842533 18963 ts_tablet_manager.cc:1403] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.111s	user 0.041s	sys 0.054s
I20260709 12:22:36.842906 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.844123 18996 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.845515 18963 raft_consensus.cc:359] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.845932 18922 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:36.846249 18963 raft_consensus.cc:385] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.846675 18963 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.847566 18963 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.839139 18964 raft_consensus.cc:385] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.849836 18964 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.850723 18964 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.851833 18962 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:36.852321 18670 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:36.853279 18964 ts_tablet_manager.cc:1434] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:22:36.853986 18963 ts_tablet_manager.cc:1434] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:36.854589 18964 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:36.854975 18963 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:36.861200 18963 tablet_bootstrap.cc:654] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.861599 18964 tablet_bootstrap.cc:654] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.852303 18962 ts_tablet_manager.cc:1403] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.008s
I20260709 12:22:36.867993 18962 raft_consensus.cc:359] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.869264 18962 raft_consensus.cc:385] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.869567 18962 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.869594 18968 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.870481 18962 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.870121 18968 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.873795 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:36.873970 18968 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:36.874524 18773 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:36.875864 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:36.877602 18962 ts_tablet_manager.cc:1434] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:22:36.877732 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:36.878458 18845 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:36.878710 18962 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:36.880867 19029 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.881271 19029 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.881596 19029 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.886332 18962 tablet_bootstrap.cc:654] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.888602 18963 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.889514 18963 ts_tablet_manager.cc:1403] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.009s
I20260709 12:22:36.891567 18996 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.892062 18996 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.893849 18996 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.894738 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:36.895545 18773 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:36.895663 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:36.897833 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:36.899515 18996 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.905686 18964 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:36.906454 18964 ts_tablet_manager.cc:1403] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.000s
I20260709 12:22:36.893456 18963 raft_consensus.cc:359] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.908991 18963 raft_consensus.cc:385] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.909727 18964 raft_consensus.cc:359] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.910604 18964 raft_consensus.cc:385] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.910943 18964 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.911660 18964 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.913856 18964 ts_tablet_manager.cc:1434] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:22:36.916280 18996 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.916880 18964 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:36.909448 18963 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.915201 19029 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.918085 18963 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.920413 18962 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:36.920564 18963 ts_tablet_manager.cc:1434] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:22:36.921005 18962 ts_tablet_manager.cc:1403] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.025s
I20260709 12:22:36.925381 18963 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:36.932461 19085 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:36.925872 18964 tablet_bootstrap.cc:654] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.925747 18962 raft_consensus.cc:359] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.928027 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:36.938707 18773 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.939106 18963 tablet_bootstrap.cc:654] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.928973 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:36.945149 18845 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.953068 18962 raft_consensus.cc:385] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.953593 18962 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.958560 18996 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.959074 18996 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.959159 18962 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.961637 18962 ts_tablet_manager.cc:1434] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.002s
I20260709 12:22:36.961906 18963 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:36.962460 18963 ts_tablet_manager.cc:1403] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.002s
I20260709 12:22:36.962661 18962 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:36.929455 19029 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:36.963263 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:36.964164 18770 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:36.965847 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:36.967128 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:36.968020 18921 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:36.968225 18845 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:36.968420 19035 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.968870 19035 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.969233 19035 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.969424 18773 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:36.972529 18996 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:36.975172 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:36.977820 19029 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.978652 19029 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:36.979991 19029 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:36.988665 18962 tablet_bootstrap.cc:654] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.001061 18964 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.001936 18964 ts_tablet_manager.cc:1403] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.034s
I20260709 12:22:37.003360 19085 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.005086 18964 raft_consensus.cc:359] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.005934 18964 raft_consensus.cc:385] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.006234 18964 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.008085 18964 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.009675 19035 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.011014 18964 ts_tablet_manager.cc:1434] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:22:37.013276 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:37.014143 18921 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.014232 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:37.014968 18773 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.016904 18964 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.018890 19029 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.013360 18962 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.022363 18962 ts_tablet_manager.cc:1403] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.003s
I20260709 12:22:37.023901 18996 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.029428 18964 tablet_bootstrap.cc:654] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.027594 18669 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.019618 19029 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.033535 18921 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:37.033780 19029 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.035778 18773 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:37.038906 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:22:37.042240 18887 leader_election.cc:343] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.965642 18963 raft_consensus.cc:359] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.042941 18963 raft_consensus.cc:385] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.043259 18963 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.043951 18963 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.044867 19035 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.043443 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:37.045820 18962 raft_consensus.cc:359] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.046612 18962 raft_consensus.cc:385] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.046836 18962 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.047307 18962 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.052953 19086 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.024565 18996 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.053591 19086 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.055042 18968 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.055523 18963 ts_tablet_manager.cc:1434] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.001s
I20260709 12:22:37.055614 18968 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.056559 18963 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:37.057307 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.057715 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.057993 18773 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:37.058646 18771 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:37.056088 19086 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.058079 18968 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.061619 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:37.060123 19035 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.062692 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.060568 18962 ts_tablet_manager.cc:1434] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 12:22:37.068172 18962 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.070165 18845 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:37.070165 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.071396 18847 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:37.069504 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.074988 18771 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:37.076273 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:37.077909 18887 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.078840 19029 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.080334 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.081234 18771 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:37.084522 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:37.086374 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:37.086807 19086 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.087407 19086 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.087898 19086 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.098234 19029 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.090615 18996 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.092633 18968 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.109879 18968 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.110332 18968 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:37.107133 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:37.108161 19085 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.121268 18963 tablet_bootstrap.cc:654] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.122969 19145 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.121002 19035 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:37.116534 19141 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.129570 19141 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.130944 19035 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.126135 19086 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.161119 19145 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.176075 18962 tablet_bootstrap.cc:654] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.169595 18968 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.179922 19086 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.181427 18963 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:37.181207 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:37.181974 18963 ts_tablet_manager.cc:1403] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.002s
I20260709 12:22:37.181944 18773 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.182889 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:37.187016 18963 raft_consensus.cc:359] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.187638 18963 raft_consensus.cc:385] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.187893 18963 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.178277 19085 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:22:37.189051 18963 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:37.195917 18887 leader_election.cc:343] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.196511 18963 ts_tablet_manager.cc:1434] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260709 12:22:37.197517 18963 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:37.204083 19141 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.204929 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.205624 18772 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:37.205890 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:37.206295 18964 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.206596 18921 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:37.206871 18964 ts_tablet_manager.cc:1403] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.190s	user 0.019s	sys 0.008s
I20260709 12:22:37.207306 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:37.208789 19141 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.209255 19141 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.209362 18773 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:37.209722 19141 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.201409 18669 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.212651 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:37.209851 18964 raft_consensus.cc:359] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.213442 18964 raft_consensus.cc:385] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.213522 18772 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.213809 18964 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.215163 18964 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.217856 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:37.219442 19029 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.219972 19029 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:37.220500 18968 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.220871 19029 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.223795 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:37.224490 18847 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.227694 18964 ts_tablet_manager.cc:1434] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:22:37.227478 19018 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.228792 18964 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.236195 18847 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:37.224807 18963 tablet_bootstrap.cc:654] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.237772 18887 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.239293 19146 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.239887 19146 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:37.240942 19146 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.252115 18772 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:37.253108 18964 tablet_bootstrap.cc:654] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.254323 19141 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.258378 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:37.259214 18922 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.261472 19018 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.267423 18922 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:37.268779 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.269793 19035 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.270359 19035 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:37.271255 19035 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.278028 19141 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.283015 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:37.289261 18962 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.289875 18962 ts_tablet_manager.cc:1403] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.222s	user 0.014s	sys 0.012s
I20260709 12:22:37.288406 18772 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.306952 18962 raft_consensus.cc:359] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.307566 18962 raft_consensus.cc:385] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.307839 18962 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.308491 18962 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.311002 18962 ts_tablet_manager.cc:1434] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:22:37.312072 18962 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.313045 18772 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:37.319528 18963 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:37.320050 18963 ts_tablet_manager.cc:1403] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.002s
I20260709 12:22:37.321043 19141 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.322289 19141 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.325726 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:37.326449 18922 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:37.327481 19141 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.339396 18962 tablet_bootstrap.cc:654] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.341271 18963 raft_consensus.cc:359] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.341948 18963 raft_consensus.cc:385] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.342218 18963 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.343397 18963 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.347806 18964 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.348505 18964 ts_tablet_manager.cc:1403] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.002s
I20260709 12:22:37.350679 18814 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.351076 18963 ts_tablet_manager.cc:1434] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:22:37.350847 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.351871 19141 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:22:37.352339 18812 leader_election.cc:343] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.352381 19141 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.353770 19141 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.355392 18964 raft_consensus.cc:359] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.356248 18964 raft_consensus.cc:385] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.356632 18964 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.357620 18964 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.367585 18964 ts_tablet_manager.cc:1434] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:22:37.368746 18964 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.370719 18669 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.376224 19141 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.372857 18669 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.384145 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:37.388741 18963 tablet_bootstrap.cc:492] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
W20260709 12:22:37.388808 18812 leader_election.cc:343] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.389225 19141 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.394506 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:37.395241 18922 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.396179 18962 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.396683 18962 ts_tablet_manager.cc:1403] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.010s
I20260709 12:22:37.399605 18962 raft_consensus.cc:359] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.400321 18962 raft_consensus.cc:385] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.400511 18962 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.401059 18962 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.404055 18962 ts_tablet_manager.cc:1434] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:22:37.413359 18962 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.416072 18667 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.418205 19017 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.418812 19017 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.424180 19017 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.427079 19085 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.432521 19160 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.429867 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.433245 18964 tablet_bootstrap.cc:654] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.430560 18962 tablet_bootstrap.cc:654] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.434993 19085 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:37.437620 18848 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:37.433698 19160 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.445081 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:37.446708 18922 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:37.446868 18739 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:37.449420 19001 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.448282 18814 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:37.451076 19141 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.451828 19141 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:37.453238 19141 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.471542 19001 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.480726 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.481957 19160 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.484171 19001 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.484862 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.484766 19001 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.485342 18963 tablet_bootstrap.cc:654] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:37.489032 18887 leader_election.cc:343] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.490935 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.494902 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:37.496749 18738 leader_election.cc:343] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:37.499565 18886 leader_election.cc:343] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.501217 18887 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:37.498832 19001 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.500397 18964 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.508059 18964 ts_tablet_manager.cc:1403] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.014s
I20260709 12:22:37.510746 19160 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:37.512925 18739 leader_election.cc:343] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.513460 18739 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:37.513471 18964 raft_consensus.cc:359] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.514472 18964 raft_consensus.cc:385] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.514990 19017 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.517119 19141 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.524727 18670 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.533039 18962 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.533684 18962 ts_tablet_manager.cc:1403] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.033s
I20260709 12:22:37.536569 18962 raft_consensus.cc:359] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.537109 19146 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:22:37.537388 18962 raft_consensus.cc:385] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.537824 18962 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.537706 19146 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.540874 19141 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.540972 18962 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.541493 19141 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.541379 19146 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.515008 18964 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.543929 18962 ts_tablet_manager.cc:1434] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:22:37.545004 18962 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.545298 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.545466 19141 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.543495 18964 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.546077 18772 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:22:37.546204 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:37.547748 18922 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:37.549214 18963 tablet_bootstrap.cc:492] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:37.546993 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.549584 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.550072 18770 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:22:37.549893 18963 ts_tablet_manager.cc:1403] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.006s
I20260709 12:22:37.550614 19146 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:37.549217 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.551136 19146 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:22:37.551347 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.551715 19146 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:37.552196 18847 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:37.553794 18963 raft_consensus.cc:359] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.554658 18963 raft_consensus.cc:385] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.554723 19141 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:37.555032 18963 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.556007 18963 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.556715 19141 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.557171 19141 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:37.558578 18964 ts_tablet_manager.cc:1434] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:22:37.558686 18963 ts_tablet_manager.cc:1434] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:37.563398 18964 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.563690 18963 tablet_bootstrap.cc:492] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:37.566159 18962 tablet_bootstrap.cc:654] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.561722 19146 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.573757 18963 tablet_bootstrap.cc:654] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.572908 18964 tablet_bootstrap.cc:654] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.576758 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:37.584528 18964 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.586714 18964 ts_tablet_manager.cc:1403] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 12:22:37.588810 19145 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.591102 18962 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.591708 18962 ts_tablet_manager.cc:1403] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.004s
I20260709 12:22:37.594609 18962 raft_consensus.cc:359] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.595517 18962 raft_consensus.cc:385] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.597067 18962 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.597885 18962 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.596382 18964 raft_consensus.cc:359] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.599021 18964 raft_consensus.cc:385] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.599396 18964 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.601394 19146 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.601637 18964 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.600798 18962 ts_tablet_manager.cc:1434] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:22:37.598263 19141 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.603255 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:37.604174 18848 raft_consensus.cc:2368] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:22:37.605859 18962 tablet_bootstrap.cc:492] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.605762 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:37.606010 18887 leader_election.cc:400] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:22:37.606127 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:37.606539 18887 leader_election.cc:403] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:22:37.606586 18921 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:37.605778 18964 ts_tablet_manager.cc:1434] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:22:37.610684 18964 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.614779 18921 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:22:37.615789 19146 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:22:37.618744 19141 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.620147 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:37.620118 18962 tablet_bootstrap.cc:654] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.621734 19141 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:37.626781 18964 tablet_bootstrap.cc:654] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.625658 19141 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:37.627574 19145 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.628062 19145 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.631742 18963 tablet_bootstrap.cc:492] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:37.632329 18963 ts_tablet_manager.cc:1403] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.005s
I20260709 12:22:37.633620 19145 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.634629 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.635388 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:37.635406 18773 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
W20260709 12:22:37.636885 18814 leader_election.cc:343] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.637465 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:37.638749 19145 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.639372 19145 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.639748 19145 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.625702 18770 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:22:37.645766 18963 raft_consensus.cc:359] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.648829 18963 raft_consensus.cc:385] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.649421 18963 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.650516 18963 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.651667 19161 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.659389 19145 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.662415 18963 ts_tablet_manager.cc:1434] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:22:37.663415 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:37.664922 18773 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.666455 19141 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.670066 18964 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.670636 18964 ts_tablet_manager.cc:1403] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.018s
I20260709 12:22:37.672336 18773 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:37.673635 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:37.673594 18964 raft_consensus.cc:359] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.674494 18964 raft_consensus.cc:385] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.674798 18964 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.674937 19144 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.675436 19144 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:37.675520 18964 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.676403 19144 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.682547 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:37.683071 18847 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:37.684780 18814 leader_election.cc:343] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.675745 18963 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:37.688228 18962 tablet_bootstrap.cc:492] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.688992 18962 ts_tablet_manager.cc:1403] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.003s
I20260709 12:22:37.694732 19035 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.700774 19145 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.702479 19161 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.703213 19161 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.707959 19161 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.707825 19160 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.709108 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:37.710842 18886 leader_election.cc:343] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.711771 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.712132 19161 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.713627 18963 tablet_bootstrap.cc:654] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:37.715497 18887 leader_election.cc:343] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.716583 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:37.717559 19161 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.719520 18962 raft_consensus.cc:359] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.729079 18962 raft_consensus.cc:385] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.729523 18962 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.732402 18964 ts_tablet_manager.cc:1434] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.061s	user 0.027s	sys 0.026s
I20260709 12:22:37.733413 18964 tablet_bootstrap.cc:492] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.741555 18962 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.744875 18962 ts_tablet_manager.cc:1434] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 12:22:37.746223 18962 tablet_bootstrap.cc:492] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.745786 19177 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.754602 18964 tablet_bootstrap.cc:654] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.755759 18962 tablet_bootstrap.cc:654] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.767757 18964 tablet_bootstrap.cc:492] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.768280 18964 ts_tablet_manager.cc:1403] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.002s
I20260709 12:22:37.771143 18964 raft_consensus.cc:359] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.771915 18964 raft_consensus.cc:385] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.772215 18964 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.772912 18964 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.775265 18964 ts_tablet_manager.cc:1434] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:37.775818 18963 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:37.776243 18964 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.776288 18963 ts_tablet_manager.cc:1403] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.006s
I20260709 12:22:37.786247 18963 raft_consensus.cc:359] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.787263 18963 raft_consensus.cc:385] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.787599 18963 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.789475 19161 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.789597 18963 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.792690 18963 ts_tablet_manager.cc:1434] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:22:37.793676 18963 tablet_bootstrap.cc:492] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:37.795843 18962 tablet_bootstrap.cc:492] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.796396 18962 ts_tablet_manager.cc:1403] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.008s
I20260709 12:22:37.798022 18964 tablet_bootstrap.cc:654] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.798233 19141 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.798825 19141 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.799149 18962 raft_consensus.cc:359] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.798560 18669 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 3, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.802277 19141 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.802685 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.803300 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:37.804363 18812 leader_election.cc:343] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:37.805012 18814 leader_election.cc:343] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.805481 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:37.806931 19141 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.808929 18962 raft_consensus.cc:385] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.809285 18962 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.809998 18962 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.811092 18963 tablet_bootstrap.cc:654] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.812283 18962 ts_tablet_manager.cc:1434] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:22:37.813347 18962 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.821468 18962 tablet_bootstrap.cc:654] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.825645 18964 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.826172 18964 ts_tablet_manager.cc:1403] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.003s
I20260709 12:22:37.828574 18668 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.829799 18964 raft_consensus.cc:359] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.830552 18964 raft_consensus.cc:385] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.830842 18964 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.831916 18964 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.834672 18964 ts_tablet_manager.cc:1434] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:37.835695 18964 tablet_bootstrap.cc:492] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.842520 18964 tablet_bootstrap.cc:654] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.852195 19141 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.852840 19141 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.856287 18962 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.856879 18962 ts_tablet_manager.cc:1403] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.001s
I20260709 12:22:37.857251 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:37.859056 18814 leader_election.cc:343] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.859732 19141 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.859740 18962 raft_consensus.cc:359] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.861142 18962 raft_consensus.cc:385] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.861447 18962 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.862641 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.862833 18962 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.863868 18773 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:37.865447 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:37.867164 19141 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.867580 19141 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.868057 18964 tablet_bootstrap.cc:492] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:37.868101 19141 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.868176 18962 ts_tablet_manager.cc:1434] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:22:37.868919 18964 ts_tablet_manager.cc:1403] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.004s
I20260709 12:22:37.869748 18962 tablet_bootstrap.cc:492] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.871948 18964 raft_consensus.cc:359] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.872792 18964 raft_consensus.cc:385] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.873203 18964 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.874105 18964 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.876799 18964 ts_tablet_manager.cc:1434] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:37.877947 18964 tablet_bootstrap.cc:492] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:37.879443 18962 tablet_bootstrap.cc:654] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.890219 19017 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.890429 19001 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.890862 19017 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.891131 19001 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.893430 18964 tablet_bootstrap.cc:654] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.893358 19017 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.893980 19001 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.895642 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.896059 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.896695 18845 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:37.897241 18962 tablet_bootstrap.cc:492] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:37.897927 18962 ts_tablet_manager.cc:1403] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 12:22:37.899219 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:37.899588 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:37.899945 18922 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:37.900192 18921 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:37.901542 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.901707 18962 raft_consensus.cc:359] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:37.902522 18738 leader_election.cc:343] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.902747 18962 raft_consensus.cc:385] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.903151 18962 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.903707 19017 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.904114 19017 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.902544 18739 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.904596 19017 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.904006 18962 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.906497 18970 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.906898 18970 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.907186 18962 ts_tablet_manager.cc:1434] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 12:22:37.907219 18970 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.908617 18962 tablet_bootstrap.cc:492] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:37.918195 19177 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.918149 18962 tablet_bootstrap.cc:654] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.926244 19085 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.926923 19085 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.875607 19141 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.931187 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:37.932109 18773 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:37.933594 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:37.934000 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:37.934926 19161 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.935490 19161 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:37.935750 18814 leader_election.cc:343] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.935997 19161 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.936717 19141 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:37.931011 18970 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.944591 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:37.945614 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:37.943568 19085 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:37.947556 18970 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:22:37.957254 18887 leader_election.cc:343] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.945647 18847 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.979280 19029 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.981752 19029 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:37.987998 19029 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.000182 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:38.003896 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.005147 18770 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:38.007993 19161 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.015731 19017 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.016607 18963 tablet_bootstrap.cc:492] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:38.017128 18963 ts_tablet_manager.cc:1403] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.224s	user 0.053s	sys 0.056s
I20260709 12:22:38.020438 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:38.020992 18963 raft_consensus.cc:359] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.021698 18963 raft_consensus.cc:385] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.021994 18963 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
W20260709 12:22:38.022085 18738 leader_election.cc:343] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.022724 18963 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.023331 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:38.023939 18770 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.032006 18770 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:38.033123 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.037050 18887 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:38.039294 19146 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.044396 18968 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.045020 18968 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:38.045928 18968 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.049403 19146 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.052506 18963 ts_tablet_manager.cc:1434] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:22:38.057684 18847 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:38.059311 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:38.060117 19017 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.060180 18970 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.062006 18970 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:38.053736 18963 tablet_bootstrap.cc:492] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:38.063010 18970 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.065485 19161 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.067185 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:22:38.070538 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 144419us
I20260709 12:22:38.075100 19001 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.075721 18964 tablet_bootstrap.cc:492] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:38.075681 19001 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.076296 18964 ts_tablet_manager.cc:1403] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.199s	user 0.026s	sys 0.027s
I20260709 12:22:38.078097 19001 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.079290 18964 raft_consensus.cc:359] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.080068 18964 raft_consensus.cc:385] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.080363 18964 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.080408 18921 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:38.080526 18963 tablet_bootstrap.cc:654] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.081120 18964 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.080943 18668 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.075145 18962 tablet_bootstrap.cc:492] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:38.082589 18962 ts_tablet_manager.cc:1403] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.174s	user 0.069s	sys 0.069s
W20260709 12:22:38.085039 18887 leader_election.cc:343] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.085603 18962 raft_consensus.cc:359] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.086374 18962 raft_consensus.cc:385] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.086706 18962 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.087261 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:38.087589 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:38.087349 18962 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.087951 18921 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.088165 18922 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.089913 18962 ts_tablet_manager.cc:1434] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:38.091040 18962 tablet_bootstrap.cc:492] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:38.094434 19141 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:38.095134 18922 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:38.095789 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:38.103667 18963 tablet_bootstrap.cc:492] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:38.104265 18963 ts_tablet_manager.cc:1403] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.002s
I20260709 12:22:38.108310 19141 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:38.111404 18964 ts_tablet_manager.cc:1434] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 12:22:38.112500 18964 tablet_bootstrap.cc:492] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:38.113304 18963 raft_consensus.cc:359] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.114219 18963 raft_consensus.cc:385] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.114598 18963 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
W20260709 12:22:38.117785 18738 leader_election.cc:343] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.118969 18669 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.133001 18964 tablet_bootstrap.cc:654] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.115561 18963 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.129664 18962 tablet_bootstrap.cc:654] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.135912 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:38.134378 18921 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:38.136555 18773 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.139894 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:38.145309 18773 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:38.153159 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:38.137820 18963 ts_tablet_manager.cc:1434] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:22:38.156486 18963 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:38.157032 18970 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.158115 18970 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:38.159109 18970 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.161142 19141 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.161805 19141 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.164546 18963 tablet_bootstrap.cc:654] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.169240 18962 tablet_bootstrap.cc:492] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:38.169768 18962 ts_tablet_manager.cc:1403] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.000s
I20260709 12:22:38.172096 19141 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:22:38.173066 18739 leader_election.cc:343] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.174095 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:38.175136 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:38.176627 18814 leader_election.cc:343] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.177312 19001 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.182904 19177 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:38.183055 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:38.183568 18773 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.183779 18962 raft_consensus.cc:359] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.184517 18962 raft_consensus.cc:385] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.184685 19177 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.184821 18962 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.185212 19177 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:38.185655 18962 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.186049 19177 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.189710 18962 ts_tablet_manager.cc:1434] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:22:38.191046 18962 tablet_bootstrap.cc:492] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:38.192390 18773 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:38.198261 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.198951 18773 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
W20260709 12:22:38.201272 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:38.201792 18963 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:38.204733 18964 tablet_bootstrap.cc:492] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:38.205281 18964 ts_tablet_manager.cc:1403] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.093s	user 0.007s	sys 0.009s
I20260709 12:22:38.202443 18963 ts_tablet_manager.cc:1403] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 12:22:38.212796 18962 tablet_bootstrap.cc:654] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.216555 19177 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:38.217056 18963 raft_consensus.cc:359] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.220531 18963 raft_consensus.cc:385] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.220942 18963 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.221728 18963 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.223179 19177 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:38.225435 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:38.226006 18963 ts_tablet_manager.cc:1434] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:22:38.227039 19141 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.227456 19141 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.227813 19141 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.229061 18670 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.233758 18963 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:38.233721 18964 raft_consensus.cc:359] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.244710 18964 raft_consensus.cc:385] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.245060 18964 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.245788 18964 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.248163 18964 ts_tablet_manager.cc:1434] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.007s
I20260709 12:22:38.249140 19161 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.249689 19161 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.250425 18964 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:38.251866 19161 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.254840 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.262436 18770 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:38.263286 18964 tablet_bootstrap.cc:654] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.263790 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.264705 18968 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.265189 18968 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.255887 18668 catalog_manager.cc:5697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.265616 18968 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.279487 18964 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:38.280059 18964 ts_tablet_manager.cc:1403] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.006s
I20260709 12:22:38.281265 18963 tablet_bootstrap.cc:654] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.287498 18964 raft_consensus.cc:359] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.288394 18964 raft_consensus.cc:385] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.288698 18964 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.237143 19141 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.261631 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:38.289422 18964 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:38.290788 18887 leader_election.cc:343] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.296880 18963 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:38.297650 18963 ts_tablet_manager.cc:1403] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 12:22:38.300566 18963 raft_consensus.cc:359] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.293861 18968 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.301174 18963 raft_consensus.cc:385] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.304358 18963 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.305246 18963 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.306947 18963 ts_tablet_manager.cc:1434] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:38.306591 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:38.307525 18772 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.307997 18963 tablet_bootstrap.cc:492] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:38.297626 18964 ts_tablet_manager.cc:1434] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:22:38.303140 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:38.310819 18920 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.311360 18964 tablet_bootstrap.cc:492] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:38.316188 19141 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.318955 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:38.319648 18770 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.324008 18963 tablet_bootstrap.cc:654] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.325054 18920 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:38.326340 18814 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.327246 19141 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.327827 19141 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:38.328933 18770 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:38.329385 18964 tablet_bootstrap.cc:654] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.329490 19141 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.332407 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:22:38.334105 18887 leader_election.cc:343] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.336948 18968 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.340487 19141 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.345255 18962 tablet_bootstrap.cc:492] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:38.345871 18962 ts_tablet_manager.cc:1403] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.155s	user 0.008s	sys 0.040s
I20260709 12:22:38.346508 18970 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.346037 19141 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.347108 18970 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.349310 18962 raft_consensus.cc:359] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.350670 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:38.350427 18668 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.351354 18847 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:38.353016 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:38.353040 19141 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.353799 18919 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:38.355309 18963 tablet_bootstrap.cc:492] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:38.355504 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:38.355566 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.353628 18964 tablet_bootstrap.cc:492] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:38.356525 18964 ts_tablet_manager.cc:1403] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.001s
I20260709 12:22:38.357859 19001 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.358160 19177 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.358312 19001 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.358664 19177 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.358814 19001 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.359122 19177 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.359503 18964 raft_consensus.cc:359] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.360270 18964 raft_consensus.cc:385] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.360546 18964 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.349375 18970 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.355850 18963 ts_tablet_manager.cc:1403] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 12:22:38.350170 18962 raft_consensus.cc:385] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.362879 18962 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.363637 18962 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.365970 18962 ts_tablet_manager.cc:1434] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:22:38.368248 19177 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.369750 18962 tablet_bootstrap.cc:492] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:38.371615 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:38.372329 18919 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.374522 19001 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.376718 18962 tablet_bootstrap.cc:654] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.377149 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:38.361462 18964 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.378996 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:38.379312 19001 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.379573 18847 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.380445 18964 ts_tablet_manager.cc:1434] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:22:38.381454 18964 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:38.382118 18919 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:38.383477 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.384537 19145 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.385015 19145 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:38.385843 19145 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.386363 18847 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:38.388077 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.396217 18773 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:38.396565 19177 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.397305 18964 tablet_bootstrap.cc:654] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.396261 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:38.400611 18970 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.401788 18970 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:38.390202 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:38.403764 18970 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:38.393103 18739 leader_election.cc:343] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.393165 18772 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:38.388846 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:38.415033 18770 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.387434 18963 raft_consensus.cc:359] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.430739 18963 raft_consensus.cc:385] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.431257 18963 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
W20260709 12:22:38.439196 18739 leader_election.cc:343] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.442492 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:38.443787 18968 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.444394 18968 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:38.445252 18968 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.449906 19177 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.450733 19177 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.454588 19177 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.445737 18668 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.457890 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:38.458968 18921 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:38.460655 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.461845 19145 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:38.462425 19145 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.463018 19145 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.437829 18963 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.487222 19146 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.454640 18770 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:38.481706 18964 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:38.487792 19146 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.488466 18964 ts_tablet_manager.cc:1403] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.055s
W20260709 12:22:38.489938 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49263.6us
I20260709 12:22:38.489666 18963 ts_tablet_manager.cc:1434] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.001s
I20260709 12:22:38.492733 18963 tablet_bootstrap.cc:492] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:38.495088 18964 raft_consensus.cc:359] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.495870 18964 raft_consensus.cc:385] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.496353 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.497140 18770 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:38.486260 19145 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.497291 19146 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.500664 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:38.501317 18919 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.502913 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:38.503672 18845 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:38.505046 18963 tablet_bootstrap.cc:654] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.507180 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:38.508572 18886 leader_election.cc:343] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.508935 18919 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:22:38.496157 18964 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.510082 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.510578 18964 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.511009 19141 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:38.511755 19141 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:38.512247 18964 ts_tablet_manager.cc:1434] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:22:38.513109 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:38.513500 19145 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.512763 19141 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.513708 18773 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.514655 18964 tablet_bootstrap.cc:492] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:38.514973 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:38.516263 19146 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.518692 19146 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.519155 19146 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.519934 18963 tablet_bootstrap.cc:492] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:38.520533 18963 ts_tablet_manager.cc:1403] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.007s
I20260709 12:22:38.522081 18964 tablet_bootstrap.cc:654] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.510211 18670 catalog_manager.cc:5697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.524500 18963 raft_consensus.cc:359] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.525349 18963 raft_consensus.cc:385] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.525943 19161 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.526675 19161 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.529825 19161 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.532668 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:38.532698 19146 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.535379 18962 tablet_bootstrap.cc:492] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:38.521731 18668 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.535940 18962 ts_tablet_manager.cc:1403] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.166s	user 0.024s	sys 0.044s
I20260709 12:22:38.525892 18963 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.538062 18963 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.543669 19035 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.547003 19035 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.549295 19035 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.542771 18963 ts_tablet_manager.cc:1434] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:22:38.551298 18963 tablet_bootstrap.cc:492] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:38.551402 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:38.557847 18814 leader_election.cc:343] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.539904 18962 raft_consensus.cc:359] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.559047 18962 raft_consensus.cc:385] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.559499 18962 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.560506 19035 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.561033 19035 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.563782 19035 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.565727 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:38.566684 18919 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:38.558178 18963 tablet_bootstrap.cc:654] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.569983 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.571254 18770 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:38.571534 19146 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.574000 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:38.574842 18848 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.560149 18962 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.589027 18962 ts_tablet_manager.cc:1434] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:22:38.592645 18773 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:22:38.598042 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.598781 18962 tablet_bootstrap.cc:492] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:38.602789 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.603600 18848 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:38.605219 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.608887 19146 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.611488 19146 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:38.614845 19146 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.621352 18886 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:38.623906 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:38.624293 19161 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.623229 18670 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 2, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:38.625771 18812 leader_election.cc:343] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.626305 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:38.626761 18968 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:38.627159 19141 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.628089 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:38.630378 19035 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:38.636564 19141 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.649860 18970 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:38.654698 18963 tablet_bootstrap.cc:492] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:38.655314 18963 ts_tablet_manager.cc:1403] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.104s	user 0.031s	sys 0.030s
I20260709 12:22:38.655855 19161 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.658326 18963 raft_consensus.cc:359] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.659171 18963 raft_consensus.cc:385] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.659474 18963 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.664748 18963 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.667889 18963 ts_tablet_manager.cc:1434] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:22:38.668365 18886 leader_election.cc:343] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:38.669019 18963 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:38.673038 19141 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.658860 18962 tablet_bootstrap.cc:654] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.688864 18668 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.698875 18963 tablet_bootstrap.cc:654] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.715546 19226 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.717672 19177 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.718266 19177 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.720073 18968 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:38.721299 18887 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.720577 18968 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.727979 18968 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.716130 19226 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.722671 19017 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:22:38.741887 18964 tablet_bootstrap.cc:492] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:38.742513 18964 ts_tablet_manager.cc:1403] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.228s	user 0.051s	sys 0.066s
I20260709 12:22:38.743952 19194 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:22:38.752379 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:38.753466 18847 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:38.754340 18970 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:38.757893 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.758668 18772 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:38.759336 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.760329 18770 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:38.762017 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.777789 18968 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.778764 18968 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.779201 18968 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.757915 19226 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.749229 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:38.789273 19177 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.789588 18968 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.791823 18968 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:38.795543 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:38.796274 18771 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:38.826793 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68817.4us
I20260709 12:22:38.820883 19145 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:22:38.844904 18962 tablet_bootstrap.cc:492] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:38.845660 18962 ts_tablet_manager.cc:1403] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.247s	user 0.016s	sys 0.012s
I20260709 12:22:38.862207 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:38.863133 18922 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:38.856348 18964 raft_consensus.cc:359] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.863983 18964 raft_consensus.cc:385] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.864255 18964 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.866186 18964 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.870558 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:38.874192 19145 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:38.874693 19145 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.875036 19145 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.871344 18963 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:38.878813 18963 ts_tablet_manager.cc:1403] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.210s	user 0.021s	sys 0.007s
I20260709 12:22:38.884770 19145 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.887382 19145 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:38.890851 19194 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:38.891197 19145 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:38.899504 18964 ts_tablet_manager.cc:1434] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.001s
I20260709 12:22:38.900697 18964 tablet_bootstrap.cc:492] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:38.904461 18771 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:38.885931 18962 raft_consensus.cc:359] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.906561 18962 raft_consensus.cc:385] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.907019 18962 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.913873 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:38.929445 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:38.930326 18968 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:38.930662 19226 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:38.930841 18968 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:38.931758 18968 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.926175 18963 raft_consensus.cc:359] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.934818 18963 raft_consensus.cc:385] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:38.935135 18963 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:38.933288 18962 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.937136 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:38.938933 18963 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:38.940640 18963 ts_tablet_manager.cc:1434] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:22:38.943027 19226 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:38.943189 19232 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:38.950999 18963 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:38.971019 18962 ts_tablet_manager.cc:1434] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.000s
I20260709 12:22:38.974665 18963 tablet_bootstrap.cc:654] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:38.979584 18962 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:38.984511 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:38.989095 18845 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:38.999541 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:39.005517 18846 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:39.008633 18964 tablet_bootstrap.cc:654] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.010105 18963 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:39.010746 18963 ts_tablet_manager.cc:1403] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.008s
I20260709 12:22:39.013181 18963 raft_consensus.cc:359] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.013758 18963 raft_consensus.cc:385] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.014008 18963 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.078162 19194 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.082372 19145 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.083453 19145 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.087795 19145 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:39.072193 18963 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.095566 18964 tablet_bootstrap.cc:492] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.096642 18964 ts_tablet_manager.cc:1403] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.002s
I20260709 12:22:39.097834 18842 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.079873 19194 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.113824 18919 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:39.101218 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:39.119284 18772 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:39.128950 18964 raft_consensus.cc:359] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.129261 19017 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:39.130231 18964 raft_consensus.cc:385] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.130731 18964 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.131500 18964 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.133554 18964 ts_tablet_manager.cc:1434] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 12:22:39.145776 18963 ts_tablet_manager.cc:1434] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.135s	user 0.010s	sys 0.000s
I20260709 12:22:39.111500 19145 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:22:39.160390 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:39.164799 19194 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:39.143703 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:39.168057 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:39.182513 19145 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:39.183554 18964 tablet_bootstrap.cc:492] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.178572 19035 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:39.192857 18963 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:39.199689 19146 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:39.203255 18962 tablet_bootstrap.cc:654] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.210742 18767 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:39.216456 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:39.220624 18772 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.220806 18964 tablet_bootstrap.cc:654] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:39.224400 18812 leader_election.cc:343] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.227779 19177 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:39.247669 19226 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 12:22:39.249570 18739 leader_election.cc:343] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.252147 18968 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:22:39.239919 19145 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 12:22:39.269078 18814 leader_election.cc:343] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.272656 18814 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:39.285610 19146 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.286345 19146 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.288399 18963 tablet_bootstrap.cc:654] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.292508 18668 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.293529 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:39.305228 18886 leader_election.cc:343] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.310928 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:39.291080 19145 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:39.289018 19146 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:22:39.302605 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77371.2us
I20260709 12:22:39.337066 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:39.337966 18841 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
W20260709 12:22:39.338850 18887 leader_election.cc:343] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.344660 18887 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:39.351421 19226 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:39.430137 19001 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.430994 19001 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.445238 18968 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.450695 19226 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:39.445969 18968 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.454922 18968 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:39.456593 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:39.457691 18841 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:39.459645 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:39.461130 19146 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.461599 19146 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.462026 19146 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.471459 18964 tablet_bootstrap.cc:492] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.472247 18964 ts_tablet_manager.cc:1403] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.289s	user 0.032s	sys 0.041s
I20260709 12:22:39.477797 18962 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:39.478559 18962 ts_tablet_manager.cc:1403] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.506s	user 0.024s	sys 0.003s
I20260709 12:22:39.481820 18962 raft_consensus.cc:359] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.489202 18964 raft_consensus.cc:359] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.490615 18964 raft_consensus.cc:385] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.490213 18962 raft_consensus.cc:385] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.491346 18962 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.491006 18964 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.485792 19146 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.493855 19001 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:39.492113 18962 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.501246 18963 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:39.501818 18963 ts_tablet_manager.cc:1403] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.312s	user 0.009s	sys 0.012s
I20260709 12:22:39.502188 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:39.503067 18772 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:39.503444 19146 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:39.505861 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:39.506783 18842 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.513882 18964 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.517314 18963 raft_consensus.cc:359] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.518551 18963 raft_consensus.cc:385] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.518888 18963 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.522336 18964 ts_tablet_manager.cc:1434] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.050s	user 0.001s	sys 0.005s
I20260709 12:22:39.523150 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:39.523646 18964 tablet_bootstrap.cc:492] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.526201 18963 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.530740 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:39.531424 18772 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.529424 18962 ts_tablet_manager.cc:1434] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.050s	user 0.016s	sys 0.008s
W20260709 12:22:39.547420 19249 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.072s	user 0.001s	sys 0.027s
I20260709 12:22:39.550200 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:39.551074 19017 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.551522 19017 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.551888 19017 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.555975 19244 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:39.558669 18962 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:39.562794 18842 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:39.565088 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:39.566224 18963 ts_tablet_manager.cc:1434] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 12:22:39.567108 19029 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:39.572060 19029 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:39.575327 18963 tablet_bootstrap.cc:492] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:39.573174 19029 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.575621 19244 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:39.576711 18772 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:39.581508 19244 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.585004 19244 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.589592 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:39.598845 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:39.599066 19141 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.598919 19244 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:39.604693 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:39.602101 19141 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.613682 19141 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:39.620345 19017 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:39.625275 18887 leader_election.cc:343] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.626441 18963 tablet_bootstrap.cc:654] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.630616 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:39.632081 18964 tablet_bootstrap.cc:654] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:39.632583 18886 leader_election.cc:343] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:39.633785 18812 leader_election.cc:343] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.633080 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:39.632874 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:39.633733 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:39.632109 18962 tablet_bootstrap.cc:654] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:39.637809 18814 leader_election.cc:343] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.638200 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:39.640069 19144 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:39.636471 19001 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:39.637913 19244 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:39.659775 19017 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:39.673483 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:39.674383 18847 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.685460 18962 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:39.697162 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:39.697530 18962 ts_tablet_manager.cc:1403] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.139s	user 0.022s	sys 0.015s
W20260709 12:22:39.699875 18739 leader_election.cc:343] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:39.700477 18962 raft_consensus.cc:359] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.701241 18962 raft_consensus.cc:385] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.701537 18962 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.711700 18963 tablet_bootstrap.cc:492] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:39.712267 18963 ts_tablet_manager.cc:1403] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.137s	user 0.016s	sys 0.002s
I20260709 12:22:39.718290 18847 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:39.721602 18964 tablet_bootstrap.cc:492] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.721400 18963 raft_consensus.cc:359] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.722203 18964 ts_tablet_manager.cc:1403] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.199s	user 0.041s	sys 0.024s
I20260709 12:22:39.722218 18963 raft_consensus.cc:385] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.725320 18964 raft_consensus.cc:359] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.726131 18964 raft_consensus.cc:385] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.726490 18964 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.727113 18964 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.728856 18964 ts_tablet_manager.cc:1434] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:22:39.730046 18964 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.722905 18963 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.702216 18962 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.731801 18963 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.734563 18963 ts_tablet_manager.cc:1434] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:22:39.735817 18963 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:39.736452 18964 tablet_bootstrap.cc:654] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.737363 18962 ts_tablet_manager.cc:1434] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:22:39.738840 18962 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
W20260709 12:22:39.740166 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:39.745711 18963 tablet_bootstrap.cc:654] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.746862 18962 tablet_bootstrap.cc:654] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.757031 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:39.757963 19017 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:39.758705 19017 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:39.759948 19017 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.767590 18964 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.768168 18964 ts_tablet_manager.cc:1403] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.006s
I20260709 12:22:39.775208 18964 raft_consensus.cc:359] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.776046 18964 raft_consensus.cc:385] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.775236 18668 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.776321 18964 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.777055 18964 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.779330 18964 ts_tablet_manager.cc:1434] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:39.780367 18964 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.784798 18963 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:39.785375 18963 ts_tablet_manager.cc:1403] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.023s
I20260709 12:22:39.786757 18964 tablet_bootstrap.cc:654] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.809006 18963 raft_consensus.cc:359] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.809806 18963 raft_consensus.cc:385] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.810114 18963 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.810824 18964 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.811358 18964 ts_tablet_manager.cc:1403] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.003s
I20260709 12:22:39.814097 18964 raft_consensus.cc:359] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.818171 18964 raft_consensus.cc:385] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.818500 18964 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.819195 18964 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.819290 18963 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.821594 18964 ts_tablet_manager.cc:1434] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:22:39.833407 18964 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.835316 18963 ts_tablet_manager.cc:1434] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:22:39.836730 18963 tablet_bootstrap.cc:492] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:39.840395 18962 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:39.841024 18962 ts_tablet_manager.cc:1403] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.021s
I20260709 12:22:39.843567 18963 tablet_bootstrap.cc:654] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.843888 18964 tablet_bootstrap.cc:654] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.844105 18962 raft_consensus.cc:359] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.844836 18962 raft_consensus.cc:385] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.845155 18962 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.845839 18962 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.859570 18667 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.861493 18962 ts_tablet_manager.cc:1434] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:22:39.867326 18962 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:39.871728 18964 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.872279 18964 ts_tablet_manager.cc:1403] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.005s
I20260709 12:22:39.873551 18962 tablet_bootstrap.cc:654] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.875151 18964 raft_consensus.cc:359] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.875905 18964 raft_consensus.cc:385] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.876165 18964 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.876931 18964 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.879984 18964 ts_tablet_manager.cc:1434] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:39.881398 18964 tablet_bootstrap.cc:492] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.889988 18964 tablet_bootstrap.cc:654] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.897224 18962 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:39.897672 18962 ts_tablet_manager.cc:1403] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.015s
I20260709 12:22:39.897998 18964 tablet_bootstrap.cc:492] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.898491 18964 ts_tablet_manager.cc:1403] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:22:39.900336 18962 raft_consensus.cc:359] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.901108 18962 raft_consensus.cc:385] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.901356 18962 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.901404 18964 raft_consensus.cc:359] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.902143 18964 raft_consensus.cc:385] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.902024 18962 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.902482 18964 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.904393 18964 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.903746 18962 ts_tablet_manager.cc:1434] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:39.906596 18964 ts_tablet_manager.cc:1434] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:39.907478 18962 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:39.907737 18964 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.914729 18964 tablet_bootstrap.cc:654] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.914773 18962 tablet_bootstrap.cc:654] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.921744 18964 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.922488 18964 ts_tablet_manager.cc:1403] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.002s
I20260709 12:22:39.925110 18964 raft_consensus.cc:359] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.925858 18964 raft_consensus.cc:385] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.926153 18964 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.926839 18964 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.929086 18964 ts_tablet_manager.cc:1434] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:39.930209 18964 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.936414 18964 tablet_bootstrap.cc:654] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.937165 19017 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.937700 19017 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.940251 19017 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:39.941895 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:39.942584 18847 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:39.942835 18963 tablet_bootstrap.cc:492] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:39.943420 18963 ts_tablet_manager.cc:1403] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.107s	user 0.029s	sys 0.008s
I20260709 12:22:39.944352 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:39.944653 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:39.945032 18922 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:39.945474 19017 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.946282 18963 raft_consensus.cc:359] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.946849 19017 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.947072 18963 raft_consensus.cc:385] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.947228 19017 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.947383 18963 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.948132 18963 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.948485 19279 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.949115 19279 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.950558 18963 ts_tablet_manager.cc:1434] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:39.952225 18963 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:39.953238 18964 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:39.953820 18964 ts_tablet_manager.cc:1403] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 12:22:39.955418 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:39.956116 18770 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:39.958666 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:39.959913 19029 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:39.960292 19029 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.960636 19029 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.961251 18962 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:39.961731 18962 ts_tablet_manager.cc:1403] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.013s
I20260709 12:22:39.962708 19279 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:39.958861 18963 tablet_bootstrap.cc:654] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.964567 18962 raft_consensus.cc:359] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.965349 18962 raft_consensus.cc:385] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.965628 18962 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.966310 18962 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.968782 18962 ts_tablet_manager.cc:1434] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:22:39.969885 18962 tablet_bootstrap.cc:492] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:39.970875 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:39.971616 18847 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:39.972525 19017 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.974838 19017 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:39.976490 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:39.977195 18842 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.978168 19029 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.979579 18964 raft_consensus.cc:359] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.981947 18964 raft_consensus.cc:385] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.982327 18964 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.983136 18964 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:39.983418 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:39.984935 18770 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.987187 18964 ts_tablet_manager.cc:1434] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 12:22:39.988641 18964 tablet_bootstrap.cc:492] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:39.991209 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:39.991918 18922 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.992070 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:39.992642 18847 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.997336 19144 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.997869 19144 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.000039 19144 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.002347 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.003661 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:39.981621 18962 tablet_bootstrap.cc:654] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.983922 19001 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.984323 19029 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:40.007813 19001 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.010872 19001 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.011250 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:40.012125 18964 tablet_bootstrap.cc:654] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.012027 18846 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:40.013517 18847 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:40.013583 18738 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:40.014611 19001 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:40.015134 19001 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.015381 18963 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:40.015707 19001 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.006304 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:40.015913 18963 ts_tablet_manager.cc:1403] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.003s
I20260709 12:22:40.016952 19145 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:40.018088 18887 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:40.021787 19029 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:40.006983 18770 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:40.024197 18963 raft_consensus.cc:359] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.022614 19029 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:40.022993 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.026206 18963 raft_consensus.cc:385] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.026580 18963 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.027091 19029 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.027349 18963 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.030236 18963 ts_tablet_manager.cc:1434] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:22:40.030489 18921 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:40.031441 18963 tablet_bootstrap.cc:492] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:40.032284 19194 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.032770 19194 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.035720 18922 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:40.040730 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:40.041600 18846 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:40.043372 18738 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:40.043234 18739 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:40.046706 19001 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.046974 19263 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:40.047839 19263 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:40.048763 19001 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.050698 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.051714 18922 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:40.053579 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:40.054289 18921 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.055006 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:40.045477 19017 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:40.055610 18846 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.057372 19017 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.058384 19017 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.022186 18842 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:40.044968 19194 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.074250 18968 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.074863 18968 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.049268 19263 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.087859 18963 tablet_bootstrap.cc:654] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.088049 18846 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:40.095878 19017 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.095276 18968 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:40.097481 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:40.097962 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:40.098333 18842 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:40.099208 18968 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:40.102145 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:40.102854 18842 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.103134 18962 tablet_bootstrap.cc:492] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:40.103066 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:40.103698 18962 ts_tablet_manager.cc:1403] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.017s
I20260709 12:22:40.105310 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:40.105911 18922 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.100993 18921 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:40.106716 19279 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.114357 18922 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:40.115844 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:40.116683 19263 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:40.117203 19263 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:40.127218 18738 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:40.106627 19017 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.138558 18964 tablet_bootstrap.cc:492] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:40.139089 18964 ts_tablet_manager.cc:1403] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.005s
I20260709 12:22:40.140816 18962 raft_consensus.cc:359] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.142434 18962 raft_consensus.cc:385] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.142707 18962 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.143352 18962 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.146199 18962 ts_tablet_manager.cc:1434] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:22:40.135473 19194 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:40.151677 18968 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.146538 18669 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.152403 18968 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.157266 18962 tablet_bootstrap.cc:492] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:40.154874 19194 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:40.160583 18968 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:40.160492 19194 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.137004 19263 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.164426 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:40.166268 18667 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:40.163271 18964 raft_consensus.cc:359] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.169339 18964 raft_consensus.cc:385] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.169660 18964 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.170291 18964 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:40.177604 18887 leader_election.cc:343] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.177438 18968 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:40.179045 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:40.181330 18964 ts_tablet_manager.cc:1434] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:22:40.224722 18964 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:40.241796 18842 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:40.351667 19144 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.352418 19144 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.355789 19177 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.356871 19177 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.360442 19177 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.362596 18964 tablet_bootstrap.cc:654] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.362989 19279 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:40.369065 18963 tablet_bootstrap.cc:492] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:40.369772 18963 ts_tablet_manager.cc:1403] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.339s	user 0.016s	sys 0.039s
W20260709 12:22:40.374851 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 200324us
W20260709 12:22:40.380774 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 144123us
I20260709 12:22:40.395143 18962 tablet_bootstrap.cc:654] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.400054 18964 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:40.400723 18964 ts_tablet_manager.cc:1403] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.184s	user 0.010s	sys 0.005s
I20260709 12:22:40.403009 19001 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:40.384845 19177 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.407734 18963 raft_consensus.cc:359] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.408588 18963 raft_consensus.cc:385] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.408933 18963 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.413122 18963 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.419271 19144 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.452329 18964 raft_consensus.cc:359] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.453504 18964 raft_consensus.cc:385] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.453969 18964 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.455092 18964 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.414331 19177 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:40.461630 18886 leader_election.cc:343] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.461928 18963 ts_tablet_manager.cc:1434] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.002s
I20260709 12:22:40.463022 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:40.457228 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:40.485186 19294 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:22:40.468218 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:40.493289 18768 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:40.493954 19194 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.494702 19194 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.483163 19244 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:40.505812 18963 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:40.515012 18964 ts_tablet_manager.cc:1434] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.114s	user 0.010s	sys 0.001s
I20260709 12:22:40.516348 18964 tablet_bootstrap.cc:492] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:40.588521 18667 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.594610 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.591212 18667 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:40.615492 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 149714us
I20260709 12:22:40.586653 19145 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.620307 18812 leader_election.cc:343] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.621030 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:40.614981 19177 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.615234 19302 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.628189 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 141052us
I20260709 12:22:40.617129 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:40.626547 19194 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.634092 18964 tablet_bootstrap.cc:654] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.622819 19145 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:40.652667 18814 leader_election.cc:343] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.653213 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:40.642092 18839 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:40.658901 18962 tablet_bootstrap.cc:492] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:40.659539 18962 ts_tablet_manager.cc:1403] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.503s	user 0.018s	sys 0.008s
I20260709 12:22:40.662879 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:40.641925 19302 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.663616 19177 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:40.786700 18970 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:40.672618 19311 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:40.786895 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:40.792505 19293 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:22:40.791090 19145 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.792044 18970 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.812088 18962 raft_consensus.cc:359] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.813174 18962 raft_consensus.cc:385] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.813531 18962 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
W20260709 12:22:40.816525 18812 leader_election.cc:343] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.816622 19302 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:40.820966 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.826021 18963 tablet_bootstrap.cc:654] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.811189 18970 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:40.819953 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:40.842306 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.865648 19304 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.866489 19304 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.870252 18970 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.871682 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:40.880534 18812 leader_election.cc:343] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.886840 19304 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:40.890767 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:22:40.894361 18812 leader_election.cc:343] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.899551 18964 tablet_bootstrap.cc:492] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:40.900192 18964 ts_tablet_manager.cc:1403] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.384s	user 0.031s	sys 0.033s
W20260709 12:22:40.902822 19300 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.342s	user 0.004s	sys 0.000s
I20260709 12:22:40.904768 18964 raft_consensus.cc:359] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.905352 18964 raft_consensus.cc:385] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.905596 18964 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.906239 18964 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:40.906653 18814 leader_election.cc:343] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.907168 18814 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:40.907907 18964 ts_tablet_manager.cc:1434] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:22:40.908838 18814 leader_election.cc:343] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.910490 19308 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:40.914460 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.915985 18962 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.917706 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.918814 18773 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:40.918985 18963 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:40.919601 18963 ts_tablet_manager.cc:1403] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.414s	user 0.020s	sys 0.008s
I20260709 12:22:40.922436 18962 ts_tablet_manager.cc:1434] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.263s	user 0.011s	sys 0.000s
I20260709 12:22:40.924065 18962 tablet_bootstrap.cc:492] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:40.924814 18963 raft_consensus.cc:359] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.925390 18963 raft_consensus.cc:385] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.925632 18963 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.926298 18963 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:40.927114 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:40.928838 18964 tablet_bootstrap.cc:492] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:40.928972 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:22:40.930795 18814 leader_election.cc:343] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.931243 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:40.933699 19311 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:40.936754 18964 tablet_bootstrap.cc:654] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.937465 18842 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:40.938009 18814 leader_election.cc:343] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.938500 18814 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:40.942967 19311 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:40.950132 18962 tablet_bootstrap.cc:654] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.954824 19314 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:40.959220 19017 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:40.977612 18739 leader_election.cc:343] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:41.032302 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54735.7us
I20260709 12:22:40.995549 19177 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.999621 18963 ts_tablet_manager.cc:1434] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.000s
I20260709 12:22:41.007320 18964 tablet_bootstrap.cc:492] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
W20260709 12:22:41.033051 18739 leader_election.cc:343] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.033303 18964 ts_tablet_manager.cc:1403] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.046s
I20260709 12:22:41.002950 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:41.012473 19302 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.020226 19279 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:41.020704 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:41.034209 19177 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.034381 18846 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:41.034315 19302 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.026613 18970 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:22:41.030591 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:41.035696 18968 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.036094 18968 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.036399 18968 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.036769 19302 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:41.037878 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:41.030715 19312 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.038614 18846 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:41.038694 19312 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.040874 19312 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:41.043498 19177 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.043673 18968 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.044893 19017 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:41.045711 19177 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:41.042181 19001 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:22:41.047082 18968 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:41.046723 18963 tablet_bootstrap.cc:492] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:41.051017 18968 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:41.056484 19194 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:41.059708 19314 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:41.064921 18887 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:41.065163 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:41.065950 18842 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.073444 18842 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:41.047916 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:41.079083 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:41.080404 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:22:41.082260 18814 leader_election.cc:343] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:41.082971 18814 leader_election.cc:343] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.083267 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:41.083784 19161 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.084175 19161 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.084339 18968 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.084545 19161 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.084797 18968 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:41.085556 18968 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.093432 18848 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:41.098800 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:41.100243 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:41.100886 18767 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.103973 18964 raft_consensus.cc:359] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.112891 18964 raft_consensus.cc:385] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.113235 18964 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
W20260709 12:22:41.114149 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51416.4us
I20260709 12:22:41.115562 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:41.116202 18964 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:41.120219 18886 leader_election.cc:343] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:41.131772 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 69156us
I20260709 12:22:41.122902 19263 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:41.143683 18964 ts_tablet_manager.cc:1434] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.001s
I20260709 12:22:41.115089 19161 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.185200 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:41.186101 18771 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:41.231168 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:41.232033 19144 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:41.254794 18964 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:41.268103 19263 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:41.245537 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:41.300034 19161 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:22:41.311920 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 124921us
I20260709 12:22:41.316877 18963 tablet_bootstrap.cc:654] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.333864 18962 tablet_bootstrap.cc:492] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:41.334523 18962 ts_tablet_manager.cc:1403] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.411s	user 0.028s	sys 0.006s
W20260709 12:22:41.338049 18812 leader_election.cc:343] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.338559 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:41.341142 18964 tablet_bootstrap.cc:654] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.342034 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:41.336576 19311 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.385435 18962 raft_consensus.cc:359] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.392838 18962 raft_consensus.cc:385] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.393266 18962 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.383839 18845 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.398864 18962 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.418769 18962 ts_tablet_manager.cc:1434] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 12:22:41.403632 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:41.381788 19311 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.440128 18767 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:41.445719 18962 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:41.452440 19295 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:41.455248 18845 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:41.472041 19311 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:41.474782 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:41.475607 18772 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:41.484253 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:41.484992 18922 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:41.489116 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:41.519549 19311 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.520007 19311 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.520391 19311 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:41.537847 18886 leader_election.cc:343] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.553845 18670 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:41.671502 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 132657us
W20260709 12:22:41.682972 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 119215us
W20260709 12:22:41.672971 19340 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:22:41.687309 18887 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:41.699155 18964 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:41.699479 18963 tablet_bootstrap.cc:492] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:41.699712 18964 ts_tablet_manager.cc:1403] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.496s	user 0.006s	sys 0.018s
I20260709 12:22:41.700069 18963 ts_tablet_manager.cc:1403] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.654s	user 0.014s	sys 0.002s
I20260709 12:22:41.712169 19146 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.712798 19146 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:41.715348 19146 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.724592 18964 raft_consensus.cc:359] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.725436 18964 raft_consensus.cc:385] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.725711 18964 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.729023 18963 raft_consensus.cc:359] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.729840 18963 raft_consensus.cc:385] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.732991 18962 tablet_bootstrap.cc:654] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.730121 18963 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.744736 19311 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.736320 18964 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.752687 18964 ts_tablet_manager.cc:1434] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:22:41.758105 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:41.759647 18768 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.751756 18963 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:41.768357 19346 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
I20260709 12:22:41.780921 19306 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.066s
I20260709 12:22:41.790381 18964 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:41.824308 18963 ts_tablet_manager.cc:1434] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.124s	user 0.006s	sys 0.002s
I20260709 12:22:41.840258 18964 tablet_bootstrap.cc:654] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.813437 19308 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.822543 19311 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:41.850647 19308 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.853385 19308 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:41.863412 18963 tablet_bootstrap.cc:492] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:41.870842 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:41.878794 18814 leader_election.cc:343] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.879128 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:41.879870 18919 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.893128 18768 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
W20260709 12:22:41.902115 19347 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:22:41.926921 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:41.929457 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:41.930346 19312 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.930991 19312 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:41.932971 19312 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:41.940124 18812 leader_election.cc:343] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.940734 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:41.954695 19161 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:41.943390 19311 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:41.981972 18962 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:41.982654 18962 ts_tablet_manager.cc:1403] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.541s	user 0.026s	sys 0.020s
I20260709 12:22:41.991556 18919 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:41.992113 18964 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:41.992045 18962 raft_consensus.cc:359] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:41.992758 18964 ts_tablet_manager.cc:1403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.214s	user 0.012s	sys 0.009s
I20260709 12:22:41.992930 18962 raft_consensus.cc:385] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.993280 18962 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.993875 18962 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.008354 18962 ts_tablet_manager.cc:1434] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:22:42.012624 18963 tablet_bootstrap.cc:654] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.020530 18962 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:42.022787 18964 raft_consensus.cc:359] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.023527 18964 raft_consensus.cc:385] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.023824 18964 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.024498 18964 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.037395 18962 tablet_bootstrap.cc:654] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.044080 18964 ts_tablet_manager.cc:1434] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.005s
I20260709 12:22:42.068298 18964 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:42.091437 19029 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.092029 19029 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.100152 18964 tablet_bootstrap.cc:654] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:42.101301 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:42.103113 18670 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.106613 19029 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:42.109138 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.110010 18765 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:42.110837 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:42.111661 18839 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:42.118773 18963 tablet_bootstrap.cc:492] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:42.119266 18963 ts_tablet_manager.cc:1403] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.256s	user 0.018s	sys 0.006s
I20260709 12:22:42.122012 18963 raft_consensus.cc:359] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.122989 18963 raft_consensus.cc:385] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.123358 18963 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.123919 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:42.124322 18963 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.125921 19029 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.130208 18964 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:42.130927 18964 ts_tablet_manager.cc:1403] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.001s
I20260709 12:22:42.134706 18962 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:42.135294 18962 ts_tablet_manager.cc:1403] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.115s	user 0.005s	sys 0.012s
I20260709 12:22:42.137970 18962 raft_consensus.cc:359] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.138689 18962 raft_consensus.cc:385] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.138952 18962 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.139557 18962 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.141687 18962 ts_tablet_manager.cc:1434] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:42.142753 18962 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:42.143530 18669 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.148733 18962 tablet_bootstrap.cc:654] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.152319 18964 raft_consensus.cc:359] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.153088 18964 raft_consensus.cc:385] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.153386 18964 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.154062 18964 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.156316 18963 ts_tablet_manager.cc:1434] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:22:42.157480 18963 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:42.160723 18964 ts_tablet_manager.cc:1434] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:22:42.161851 18964 tablet_bootstrap.cc:492] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:42.177326 18964 tablet_bootstrap.cc:654] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.180514 18963 tablet_bootstrap.cc:654] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.186820 19029 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.199631 19263 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.201576 19263 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.203439 18962 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:42.206444 18962 ts_tablet_manager.cc:1403] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.010s
I20260709 12:22:42.208384 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.207799 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:42.211261 18841 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 1: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:22:42.212669 18738 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:42.210237 19263 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.217470 19326 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.221508 18962 raft_consensus.cc:359] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.222424 18962 raft_consensus.cc:385] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.222712 18962 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.223403 18962 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.225802 18962 ts_tablet_manager.cc:1434] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:22:42.226934 18962 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:42.231594 18964 tablet_bootstrap.cc:492] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:42.232161 18964 ts_tablet_manager.cc:1403] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.001s
I20260709 12:22:42.236317 18964 raft_consensus.cc:359] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.237046 18964 raft_consensus.cc:385] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.237356 18964 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.238016 18964 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.241137 18964 ts_tablet_manager.cc:1434] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:22:42.244743 18964 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:42.245452 19326 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.249246 18963 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:42.249842 18963 ts_tablet_manager.cc:1403] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.013s
I20260709 12:22:42.252941 18963 raft_consensus.cc:359] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.253643 18963 raft_consensus.cc:385] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.255523 19311 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.256086 19311 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.256764 18962 tablet_bootstrap.cc:654] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.258491 19311 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.259569 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.260022 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:42.261121 18812 leader_election.cc:343] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:42.261627 18814 leader_election.cc:343] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.262008 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:42.262226 18964 tablet_bootstrap.cc:654] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.262732 19311 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.263420 18963 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.266711 18963 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.268419 18963 ts_tablet_manager.cc:1434] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:22:42.274101 18962 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:42.274708 18962 ts_tablet_manager.cc:1403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.004s
I20260709 12:22:42.275815 18963 tablet_bootstrap.cc:492] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:42.277552 18962 raft_consensus.cc:359] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.278259 18962 raft_consensus.cc:385] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.278560 18962 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.288118 18963 tablet_bootstrap.cc:654] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.289745 18964 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:42.290416 18964 ts_tablet_manager.cc:1403] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.003s
I20260709 12:22:42.293686 18964 raft_consensus.cc:359] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.294608 18964 raft_consensus.cc:385] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.294988 18964 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.295830 18964 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.298288 18964 ts_tablet_manager.cc:1434] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:22:42.298695 18962 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.300079 18962 ts_tablet_manager.cc:1434] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:22:42.300956 18962 tablet_bootstrap.cc:492] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:42.316872 18962 tablet_bootstrap.cc:654] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.321696 19161 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.323071 18963 tablet_bootstrap.cc:492] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:42.323724 18963 ts_tablet_manager.cc:1403] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.016s
I20260709 12:22:42.327488 18963 raft_consensus.cc:359] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.330008 18963 raft_consensus.cc:385] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.330860 18963 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.333956 18964 tablet_bootstrap.cc:492] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Bootstrap starting.
I20260709 12:22:42.342226 18964 tablet_bootstrap.cc:654] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.345178 18962 tablet_bootstrap.cc:492] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:42.345731 18962 ts_tablet_manager.cc:1403] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.007s
I20260709 12:22:42.332084 18963 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.347941 18963 ts_tablet_manager.cc:1434] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:22:42.348683 18962 raft_consensus.cc:359] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.349522 18962 raft_consensus.cc:385] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.349893 18962 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.349191 18963 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:42.350796 18962 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.358749 18962 ts_tablet_manager.cc:1434] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:22:42.361331 19029 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.363571 18963 tablet_bootstrap.cc:654] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.364948 18962 tablet_bootstrap.cc:492] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:42.369053 19323 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.369654 19323 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.371977 19323 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.375072 18962 tablet_bootstrap.cc:654] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.375154 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:42.376319 18839 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:42.377772 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:42.378656 19323 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.380703 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:42.390980 18739 leader_election.cc:343] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.379091 19323 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.392877 19323 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.409399 18964 tablet_bootstrap.cc:492] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: No bootstrap required, opened a new log
I20260709 12:22:42.410275 18964 ts_tablet_manager.cc:1403] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.018s
I20260709 12:22:42.413480 19308 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.414032 19308 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.416335 18964 raft_consensus.cc:359] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.418335 19308 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.418527 18964 raft_consensus.cc:385] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.418998 18964 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.420279 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.423714 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.434795 18922 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:42.419999 18964 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.436301 18963 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:42.436836 18963 ts_tablet_manager.cc:1403] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.088s	user 0.027s	sys 0.010s
I20260709 12:22:42.429800 19308 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:42.430840 18812 leader_election.cc:343] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.446749 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:42.447458 18963 raft_consensus.cc:359] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.448688 18963 raft_consensus.cc:385] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.448992 18963 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.449653 18963 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.450074 19304 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.450503 19304 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.450847 19304 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.453325 18963 ts_tablet_manager.cc:1434] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:22:42.454514 18963 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:42.460780 18963 tablet_bootstrap.cc:654] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.461508 18964 ts_tablet_manager.cc:1434] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.004s
I20260709 12:22:42.469952 19323 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.473191 19311 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.500962 19311 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.501660 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:42.474758 18963 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:42.503006 18963 ts_tablet_manager.cc:1403] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.003s
I20260709 12:22:42.503829 19311 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.475301 19304 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.506129 18963 raft_consensus.cc:359] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.506976 18963 raft_consensus.cc:385] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.483265 19298 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:22:42.507318 18963 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.508349 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.508559 19304 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.508430 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:42.509305 18919 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:42.512130 18814 leader_election.cc:343] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.502341 18839 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.515618 18963 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.516191 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.517480 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:42.520138 18768 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:42.520870 19263 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:42.523569 18812 leader_election.cc:343] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.523557 19263 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.528246 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:42.529094 18841 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:42.530026 18919 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:42.537186 19323 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.538424 18839 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:42.540941 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:42.530583 18738 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:42.542995 19311 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.543632 19311 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:42.544598 19311 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.554996 19263 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.555835 19263 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.556238 19263 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.556675 19263 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.556133 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:42.560218 19323 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.561074 19323 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:42.562196 19304 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.562337 19323 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.562911 19304 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.566751 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.567567 18916 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:42.543159 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:42.570737 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:42.571002 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:42.571379 18922 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.573087 19312 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.573467 19312 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.573812 19312 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.574949 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.576123 19308 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.576529 19308 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.576874 19308 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.585208 19298 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.585816 19298 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.588055 19298 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.590066 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.590837 18919 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 0.
I20260709 12:22:42.592010 19304 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.592446 18814 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:42.533514 18963 ts_tablet_manager.cc:1434] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:22:42.594645 18962 tablet_bootstrap.cc:492] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:42.594651 19298 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.595217 18962 ts_tablet_manager.cc:1403] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.231s	user 0.035s	sys 0.089s
I20260709 12:22:42.595518 19298 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.596165 19298 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.597198 18922 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:42.598524 18962 raft_consensus.cc:359] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.599280 18962 raft_consensus.cc:385] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.599573 18962 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.600339 18962 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.601948 18962 ts_tablet_manager.cc:1434] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:22:42.602996 18962 tablet_bootstrap.cc:492] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:42.585443 19308 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.612902 18962 tablet_bootstrap.cc:654] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.617439 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:42.619635 19308 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.593955 18963 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:42.628654 18962 tablet_bootstrap.cc:492] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:42.629293 18962 ts_tablet_manager.cc:1403] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
W20260709 12:22:42.621244 18739 leader_election.cc:343] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.622339 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.636734 19298 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:42.640494 18814 leader_election.cc:343] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.632808 19312 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.661734 19380 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.683475 19380 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.685791 19380 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.715464 18962 raft_consensus.cc:359] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:22:42.719305 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 83623.9us
I20260709 12:22:42.729539 18962 raft_consensus.cc:385] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:42.731813 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:42.732532 18919 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.717317 19380 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.733676 19380 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.733940 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:42.734648 18916 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.737135 18962 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.737910 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:22:42.738747 18812 leader_election.cc:343] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.738960 18962 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.687639 19312 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:22:42.746243 18814 leader_election.cc:343] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.688453 19298 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.749671 18962 ts_tablet_manager.cc:1434] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.016s
I20260709 12:22:42.756088 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.682025 19263 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.751560 19380 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.773355 18919 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
W20260709 12:22:42.774600 18814 leader_election.cc:343] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.783495 19029 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.785678 19029 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.780586 18670 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.798019 19029 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:42.798916 18962 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:42.798041 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:42.800630 19312 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.801123 19312 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:42.804839 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.806057 18773 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:42.807065 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.808859 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:42.809482 18767 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.809815 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:42.811381 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:42.812829 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.813040 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:42.814105 19341 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.814601 19341 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.815016 19341 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:42.817360 18812 leader_election.cc:343] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.818120 19378 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.818743 19378 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.820344 18768 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:42.821170 18812 leader_election.cc:343] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:42.824108 18812 leader_election.cc:343] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.824466 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:42.836833 19304 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.852866 19194 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.854803 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:42.859656 19312 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.862257 18767 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:42.857949 19194 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.830672 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:22:42.872532 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48427.5us
I20260709 12:22:42.874784 19194 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.875290 19263 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.878321 18839 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:42.885497 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:42.886268 18841 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
W20260709 12:22:42.888597 18812 leader_election.cc:343] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.889070 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:42.890843 19298 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.892357 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:42.893808 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:42.893994 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.890192 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:42.895290 18916 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:42.896037 19298 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.896149 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.896556 18814 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:22:42.896926 18921 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:42.894047 18963 tablet_bootstrap.cc:654] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.897394 19380 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.898068 19380 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:22:42.899771 18739 leader_election.cc:343] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.878417 19378 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:22:42.900461 18739 leader_election.cc:343] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:42.900664 19326 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.903676 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:42.893831 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:42.904398 18843 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.904253 19326 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.896617 19298 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:22:42.904942 19387 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.905786 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:42.908876 19298 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.919003 19326 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:42.922132 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:42.919942 19380 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.907455 19387 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.922811 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:42.922871 18919 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:42.931568 18839 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:42.928561 19387 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.940366 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:42.943603 18962 tablet_bootstrap.cc:654] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:42.942731 19326 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:42.949574 19326 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.950011 19326 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.961994 18768 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:22:42.962818 19383 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.985509 18963 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:42.986030 18963 ts_tablet_manager.cc:1403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.392s	user 0.014s	sys 0.015s
I20260709 12:22:42.969254 19341 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:42.993714 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:42.994531 18768 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.001713 18768 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:43.002947 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:43.003862 19029 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.002776 19387 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.004576 19029 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:43.005399 19029 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.010330 18843 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:43.011873 18738 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:43.013132 19378 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.020864 18962 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:43.021420 18962 ts_tablet_manager.cc:1403] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.242s	user 0.023s	sys 0.009s
I20260709 12:22:43.023131 18669 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.039247 18963 raft_consensus.cc:359] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.040041 18963 raft_consensus.cc:385] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.040351 18963 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.041169 18963 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.038137 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:43.024456 19378 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:22:43.044488 18739 leader_election.cc:343] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:43.044679 18670 catalog_manager.cc:5697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.025643 19387 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:43.046334 18963 ts_tablet_manager.cc:1434] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 12:22:43.033522 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:43.046749 18670 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.048734 18670 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.054672 18963 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:43.036615 19341 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:22:43.057843 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:43.053892 18841 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.053534 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:43.062700 18839 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.076001 18962 raft_consensus.cc:359] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.076869 18962 raft_consensus.cc:385] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.077203 18962 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.079769 19326 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.080508 19312 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.057678 19378 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.082783 18667 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.087935 19383 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.089031 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:43.089840 18848 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.077919 18962 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.090112 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:43.092092 18916 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.097662 18962 ts_tablet_manager.cc:1434] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:22:43.082270 19326 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:43.129559 18841 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:43.133410 18962 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:43.135651 18848 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:22:43.144261 18963 tablet_bootstrap.cc:654] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:43.115942 18839 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:43.155335 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:43.164429 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:43.165190 19326 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:43.167430 18916 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:22:43.175516 19326 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:43.176522 19326 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.178637 18962 tablet_bootstrap.cc:654] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:43.184581 19378 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.167208 19387 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.188170 19387 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:43.189177 19387 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.204159 18963 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:43.204851 18963 ts_tablet_manager.cc:1403] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.011s
I20260709 12:22:43.203747 18667 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:43.215785 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51452.1us
I20260709 12:22:43.213433 18963 raft_consensus.cc:359] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.224159 18963 raft_consensus.cc:385] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.232700 18963 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.238183 18667 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 2, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.250675 18667 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.264725 18962 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:43.265329 18962 ts_tablet_manager.cc:1403] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.149s	user 0.028s	sys 0.027s
I20260709 12:22:43.268592 18962 raft_consensus.cc:359] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.269486 18962 raft_consensus.cc:385] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.269775 18962 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.273216 18963 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.275072 18963 ts_tablet_manager.cc:1434] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.070s	user 0.003s	sys 0.006s
I20260709 12:22:43.276072 18963 tablet_bootstrap.cc:492] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:43.279049 18962 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.283741 18962 ts_tablet_manager.cc:1434] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:22:43.285737 18962 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:43.292114 18962 tablet_bootstrap.cc:654] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:43.295288 18963 tablet_bootstrap.cc:654] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:43.315531 18962 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:43.316188 18962 ts_tablet_manager.cc:1403] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.002s
I20260709 12:22:43.320118 18962 raft_consensus.cc:359] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.320856 18962 raft_consensus.cc:385] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.321135 18962 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.321794 18962 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.328735 19380 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.332075 18962 ts_tablet_manager.cc:1434] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:22:43.336823 18962 tablet_bootstrap.cc:492] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Bootstrap starting.
I20260709 12:22:43.343350 18963 tablet_bootstrap.cc:492] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:43.343887 18963 ts_tablet_manager.cc:1403] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.012s
I20260709 12:22:43.344012 18962 tablet_bootstrap.cc:654] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:43.344924 19326 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.345484 19326 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.346895 18963 raft_consensus.cc:359] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.347669 18963 raft_consensus.cc:385] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.347976 18963 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.348030 19326 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:43.348863 18963 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.350332 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:43.351593 18963 ts_tablet_manager.cc:1434] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:22:43.359519 18962 tablet_bootstrap.cc:492] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: No bootstrap required, opened a new log
I20260709 12:22:43.360284 18962 ts_tablet_manager.cc:1403] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 12:22:43.361059 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:43.361680 18963 tablet_bootstrap.cc:492] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:43.362993 18765 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.362924 18739 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:22:43.366550 18962 raft_consensus.cc:359] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.367323 18962 raft_consensus.cc:385] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.367640 18962 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.368331 18962 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.370896 18962 ts_tablet_manager.cc:1434] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:22:43.380596 19326 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:43.381824 18963 tablet_bootstrap.cc:654] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:43.384946 19330 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.385715 19330 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.385735 19380 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:22:43.393011 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:43.394372 18765 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:22:43.396014 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:43.398726 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:43.401347 19341 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.404639 19330 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:43.417834 19386 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.422569 18963 tablet_bootstrap.cc:492] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
W20260709 12:22:43.418735 18719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:43.420153 19029 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.423090 18963 ts_tablet_manager.cc:1403] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.062s	user 0.034s	sys 0.008s
I20260709 12:22:43.424408 19029 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.426369 19029 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:43.427254 18963 raft_consensus.cc:359] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.427520 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:43.428452 18963 raft_consensus.cc:385] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.428762 18963 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.429446 18963 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.431924 18963 ts_tablet_manager.cc:1434] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:22:43.433017 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:43.434019 18839 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 1: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:22:43.435508 19330 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.436034 19330 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.438089 19330 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:43.439783 18963 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: Bootstrap starting.
I20260709 12:22:43.440224 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:43.440903 18765 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:43.446592 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:43.447521 19146 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:43.447921 19146 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.448328 19146 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.448098 19304 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.448992 18963 tablet_bootstrap.cc:654] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:43.451812 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:43.452479 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:43.453176 18839 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 0.
I20260709 12:22:43.453327 19029 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.457794 19341 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:43.460978 19029 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:43.460932 19304 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.472348 19146 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.475091 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:22:43.475729 18768 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.480911 19386 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:22:43.488737 19146 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:43.501406 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:43.502173 18841 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.511053 18768 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:43.511433 18841 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:22:43.512602 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:43.519622 19146 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.521111 19146 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:22:43.522516 19146 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.529697 18963 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: No bootstrap required, opened a new log
I20260709 12:22:43.530193 18963 ts_tablet_manager.cc:1403] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.047s
I20260709 12:22:43.533058 18963 raft_consensus.cc:359] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.539708 18963 raft_consensus.cc:385] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:43.540045 18963 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.540719 18963 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.543516 18963 ts_tablet_manager.cc:1434] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:22:43.564715 18668 catalog_manager.cc:5697] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.580731 18772 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.591297 19326 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.591874 19326 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.595697 19387 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.597931 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:22:43.598701 18916 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:43.598807 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:43.594026 19326 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:43.599447 18839 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 0.
I20260709 12:22:43.600857 18739 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:22:43.601652 19326 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:43.602022 19326 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.602452 19326 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.609061 18916 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.627270 19326 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.630259 19029 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.631629 19029 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.632567 19387 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.633905 19146 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.634929 19146 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.635830 18918 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:43.638142 19378 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.648444 19326 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:43.650586 19146 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:43.653330 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:22:43.655402 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:22:43.656132 18915 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.658829 18839 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:43.660006 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:22:43.665477 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:22:43.666942 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:22:43.667925 18844 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:43.680984 19383 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.708040 18915 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:43.716892 18844 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:22:43.718837 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:22:43.719624 19326 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:43.720273 19326 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:22:43.721208 19326 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:22:43.722466 19146 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:43.757903 18669 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.804169 19378 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.807078 19326 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:43.995877 19146 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:44.006903 19330 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:44.224076 19378 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:44.235725 19378 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:44.832475 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:44.840895 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50922.8us
W20260709 12:22:44.849763 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 94079.5us
W20260709 12:22:44.875036 19446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.880337 19447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.894647 19449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:44.899837 17568 server_base.cc:1061] running on GCE node
I20260709 12:22:44.901014 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:44.901234 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:44.901384 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783599764901373 us; error 0 us; skew 500 ppm
I20260709 12:22:44.902055 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:44.905061 17568 webserver.cc:533] Webserver started at http://127.17.40.4:44223/ using document root <none> and password file <none>
I20260709 12:22:44.905635 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:44.905856 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:44.906209 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:44.907505 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-3-root/instance:
uuid: "43b520eabb65493abe84f4cf06806cba"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-tjfs"
I20260709 12:22:44.913054 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:22:44.918783 19454 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.919714 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:44.920064 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-3-root
uuid: "43b520eabb65493abe84f4cf06806cba"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-tjfs"
I20260709 12:22:44.920347 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:44.938896 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:44.940237 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:44.941867 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:44.944463 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:44.944664 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.945021 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:44.945181 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:45.028265 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.4:44937
I20260709 12:22:45.028656 19516 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.4:44937 every 8 connection(s)
I20260709 12:22:45.033638 17568 auto_leader_rebalancer-test.cc:439] add a tserver: 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:45.050292 19517 heartbeater.cc:344] Connected to a master server at 127.17.40.62:43633
I20260709 12:22:45.050817 19517 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:45.051803 19517 heartbeater.cc:507] Master 127.17.40.62:43633 requested a full tablet report, sending...
I20260709 12:22:45.054060 18669 ts_manager.cc:194] Registered new tserver with Master: 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:22:45.055599 18669 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52758
W20260709 12:22:45.496767 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800041900 after lost signal to thread 17571
W20260709 12:22:45.498461 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08002785a0 after lost signal to thread 18797
W20260709 12:22:45.499397 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08001798e0 after lost signal to thread 18872
W20260709 12:22:45.500247 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08002986c0 after lost signal to thread 18946
I20260709 12:22:45.691066 18915 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:45.699904 18841 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:45.701625 19521 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:45.715636 18765 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:45.734175 19443 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:45.741828 19444 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:22:45.766351 18845 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:22:45.783468 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44164.4us
W20260709 12:22:45.812278 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 88173us
W20260709 12:22:45.842726 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca478d842a8f406087ef2855fb0363a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:45.872148 18669 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:45.872665 18766 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:22:45.900527 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53243.5us
W20260709 12:22:45.917819 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 69566.5us
I20260709 12:22:45.927968 18772 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:45.955104 18915 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:45.957275 19326 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:45.959220 18844 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:45.961416 19539 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:45.997242 19539 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:45.999218 18915 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:46.017611 18844 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:22:46.018862 18737 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a38dabcd47249aebb1f53168be39bbc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.020165 18670 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:46.031816 18915 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:46.058211 19517 heartbeater.cc:499] Master 127.17.40.62:43633 was elected leader, sending a full tablet report...
I20260709 12:22:46.081087 18844 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:46.083735 18766 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:46.083992 19443 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:22:46.086031 18886 consensus_peers.cc:597] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91bf73a138f349e787495351ffd803b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.087113 19443 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:46.095070 19443 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:46.098426 18845 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:46.127027 18670 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.158097 19550 ts_tablet_manager.cc:933] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:46.196122 18766 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:46.216333 19550 tablet_copy_client.cc:323] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:22:46.222332 18845 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:46.257040 18915 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:46.258807 19529 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:46.264581 18766 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:46.267772 19420 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:46.289891 18812 consensus_peers.cc:597] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a2498b4d0a8462b860b1e4040e4e5bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.292804 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet ca478d842a8f406087ef2855fb0363a8 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:22:46.299044 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet ca478d842a8f406087ef2855fb0363a8 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-ca478d842a8f406087ef2855fb0363a8
I20260709 12:22:46.322079 19420 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:46.324515 18915 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:46.326330 18766 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:46.328691 18932 tablet_copy_source_session.cc:215] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:46.340760 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca478d842a8f406087ef2855fb0363a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.361351 18669 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.417598 19550 tablet_copy_client.cc:806] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:46.418509 19550 tablet_copy_client.cc:670] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:46.438452 19550 tablet_copy_client.cc:538] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:46.451493 19550 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:46.508602 19550 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:46.510138 19550 tablet_bootstrap.cc:492] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:46.512488 19550 ts_tablet_manager.cc:1403] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.011s
I20260709 12:22:46.515802 19550 raft_consensus.cc:359] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:46.516912 19550 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:46.517791 19550 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:46.526028 19559 ts_tablet_manager.cc:933] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:22:46.529820 19550 ts_tablet_manager.cc:1434] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:22:46.538601 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-ca478d842a8f406087ef2855fb0363a8 received from {username='slave'} at 127.0.0.1:57874
I20260709 12:22:46.539323 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-ca478d842a8f406087ef2855fb0363a8 on tablet ca478d842a8f406087ef2855fb0363a8 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:46.557586 19550 ts_tablet_manager.cc:933] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:46.559595 19491 raft_consensus.cc:1217] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:46.571238 19550 tablet_copy_client.cc:323] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:22:46.573220 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet 91bf73a138f349e787495351ffd803b7 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:22:46.573782 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet 91bf73a138f349e787495351ffd803b7 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-91bf73a138f349e787495351ffd803b7
I20260709 12:22:46.583686 18932 tablet_copy_source_session.cc:215] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:46.588114 19559 tablet_copy_client.cc:323] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:22:46.589484 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bf73a138f349e787495351ffd803b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.612629 19550 tablet_copy_client.cc:806] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:46.613324 19550 tablet_copy_client.cc:670] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:46.634506 19550 tablet_copy_client.cc:538] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:46.654235 19550 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:46.655212 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet 5a38dabcd47249aebb1f53168be39bbc from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:22:46.655912 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet 5a38dabcd47249aebb1f53168be39bbc from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-5a38dabcd47249aebb1f53168be39bbc
I20260709 12:22:46.687922 18783 tablet_copy_source_session.cc:215] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:46.688724 19550 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:46.694641 19559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a38dabcd47249aebb1f53168be39bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.694689 19550 tablet_bootstrap.cc:492] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:46.705737 19561 ts_tablet_manager.cc:933] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:46.707562 19550 ts_tablet_manager.cc:1403] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.054s	user 0.028s	sys 0.004s
I20260709 12:22:46.714246 19550 raft_consensus.cc:359] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:46.719972 19550 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:46.721424 19550 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:46.723663 19561 tablet_copy_client.cc:323] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:22:46.742147 19550 ts_tablet_manager.cc:1434] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:22:46.751611 19559 tablet_copy_client.cc:806] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:46.752470 19559 tablet_copy_client.cc:670] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:46.753144 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-91bf73a138f349e787495351ffd803b7 received from {username='slave'} at 127.0.0.1:57874
I20260709 12:22:46.753628 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-91bf73a138f349e787495351ffd803b7 on tablet 91bf73a138f349e787495351ffd803b7 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:46.757483 19559 tablet_copy_client.cc:538] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:46.771278 19559 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:46.779384 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 5a2498b4d0a8462b860b1e4040e4e5bc from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:22:46.780113 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 5a2498b4d0a8462b860b1e4040e4e5bc from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-5a2498b4d0a8462b860b1e4040e4e5bc
I20260709 12:22:46.807454 18858 tablet_copy_source_session.cc:215] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:46.815666 19561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2498b4d0a8462b860b1e4040e4e5bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.856135 19561 tablet_copy_client.cc:806] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:46.857900 19561 tablet_copy_client.cc:670] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:46.874929 19561 tablet_copy_client.cc:538] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:46.929581 19561 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:46.937150 19528 raft_consensus.cc:1064] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:46.940546 19528 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:46.963804 19491 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:46.964098 18765 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:46.963892 18844 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:46.967305 19444 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:46.968803 19330 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.974587 19559 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:46.975306 19444 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:46.975919 19559 tablet_bootstrap.cc:492] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:46.977385 19559 ts_tablet_manager.cc:1403] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.206s	user 0.026s	sys 0.014s
I20260709 12:22:46.985971 19559 raft_consensus.cc:359] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:46.989238 19559 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:46.992583 19559 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:47.018117 19559 ts_tablet_manager.cc:1434] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.004s
I20260709 12:22:47.032249 19528 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.035888 18844 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.039726 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-5a38dabcd47249aebb1f53168be39bbc received from {username='slave'} at 127.0.0.1:33308
I20260709 12:22:47.051853 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-5a38dabcd47249aebb1f53168be39bbc on tablet 5a38dabcd47249aebb1f53168be39bbc with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:47.054553 18765 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.062541 18670 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.063866 19491 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.102996 19561 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:47.104121 19561 tablet_bootstrap.cc:492] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:47.114611 19561 ts_tablet_manager.cc:1403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.185s	user 0.021s	sys 0.011s
I20260709 12:22:47.121974 19561 raft_consensus.cc:359] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:47.123297 19561 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:47.124073 19561 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:47.127043 19561 ts_tablet_manager.cc:1434] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:47.129124 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-5a2498b4d0a8462b860b1e4040e4e5bc received from {username='slave'} at 127.0.0.1:45432
I20260709 12:22:47.129642 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-5a2498b4d0a8462b860b1e4040e4e5bc on tablet 5a2498b4d0a8462b860b1e4040e4e5bc with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:47.160615 19491 raft_consensus.cc:1217] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:47.181409 18915 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:47.197136 19491 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:47.198841 19330 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:22:47.206789 18765 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:47.212355 19571 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:47.216545 19330 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.248308 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca478d842a8f406087ef2855fb0363a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:47.266203 18669 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:47.273307 19492 raft_consensus.cc:1217] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:47.272840 19491 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.280897 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet ca478d842a8f406087ef2855fb0363a8 with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:22:47.289984 18766 raft_consensus.cc:2955] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.308724 19580 tablet_replica.cc:333] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:22:47.310113 19580 raft_consensus.cc:2243] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.316658 19580 raft_consensus.cc:2272] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.320416 19492 raft_consensus.cc:1217] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:47.336012 19580 ts_tablet_manager.cc:1916] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:22:47.421985 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65235.7us
I20260709 12:22:47.423223 19580 ts_tablet_manager.cc:1929] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:47.423924 19580 log.cc:1199] T ca478d842a8f406087ef2855fb0363a8 P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/ca478d842a8f406087ef2855fb0363a8
I20260709 12:22:47.434278 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet ca478d842a8f406087ef2855fb0363a8 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:47.746367 19571 raft_consensus.cc:1064] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:47.749347 19571 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:47.769740 19491 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:47.772019 18772 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:47.772701 19579 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:47.775286 19330 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.786630 18844 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:47.791555 19579 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.793269 19583 raft_consensus.cc:1064] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:47.796279 19583 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:47.846276 18915 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:47.848215 19420 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.849884 19442 raft_consensus.cc:1064] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:47.853674 19442 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:47.865463 19571 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.877321 19492 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.893528 19491 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:47.900593 18772 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.917547 18766 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:47.927985 18669 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:47.950361 19582 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:22:48.012698 19582 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:48.014235 18839 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.040599 19491 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:48.050115 19531 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:48.061465 18845 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:48.071943 19420 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.078650 18916 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:48.092355 18770 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.095955 18919 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.112506 19590 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:48.118129 18668 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.136286 19442 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:48.156678 18919 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:48.201434 19568 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:22:48.207108 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75482.8us
I20260709 12:22:48.203563 18916 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.241567 19492 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.258795 18841 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:48.264040 19491 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.276221 18668 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.277218 19490 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:48.283349 18839 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:48.290544 18919 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:48.286653 18841 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.293286 19582 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:48.303598 19420 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.305317 19607 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:22:48.309002 18919 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.315523 19604 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:22:48.350684 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a2498b4d0a8462b860b1e4040e4e5bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:48.350687 19607 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.359237 18765 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:48.363871 18841 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.379300 19489 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:48.381862 19584 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:48.391341 18839 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:48.365971 19490 raft_consensus.cc:2955] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.392252 18670 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.401767 19568 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.404109 19489 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.421583 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a2498b4d0a8462b860b1e4040e4e5bc with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33726
I20260709 12:22:48.427505 19590 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:48.428995 19491 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:48.433733 19582 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:48.436113 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a38dabcd47249aebb1f53168be39bbc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:48.442358 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 91bf73a138f349e787495351ffd803b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:48.440815 18841 raft_consensus.cc:2955] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.443961 19491 raft_consensus.cc:2955] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.457717 18669 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.473209 19609 tablet_replica.cc:333] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:22:48.473513 18758 tablet_service.cc:1558] Processing DeleteTablet for tablet 91bf73a138f349e787495351ffd803b7 with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33726
I20260709 12:22:48.474438 19609 raft_consensus.cc:2243] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:48.475955 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46223.8us
I20260709 12:22:48.481372 18670 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:48.485298 19609 raft_consensus.cc:2272] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.499393 19609 ts_tablet_manager.cc:1916] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:48.515631 18906 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a38dabcd47249aebb1f53168be39bbc with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
I20260709 12:22:48.532994 19609 ts_tablet_manager.cc:1929] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:48.533672 19609 log.cc:1199] T 5a2498b4d0a8462b860b1e4040e4e5bc P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/5a2498b4d0a8462b860b1e4040e4e5bc
I20260709 12:22:48.536487 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet 5a2498b4d0a8462b860b1e4040e4e5bc (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:48.537854 19609 tablet_replica.cc:333] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:22:48.541587 19609 raft_consensus.cc:2243] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.543363 19609 raft_consensus.cc:2272] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.559927 19610 tablet_replica.cc:333] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:22:48.560883 19610 raft_consensus.cc:2243] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.561674 19610 raft_consensus.cc:2272] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.562811 19609 ts_tablet_manager.cc:1916] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:48.567857 19610 ts_tablet_manager.cc:1916] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:48.585997 19610 ts_tablet_manager.cc:1929] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:48.586540 19610 log.cc:1199] T 5a38dabcd47249aebb1f53168be39bbc P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/5a38dabcd47249aebb1f53168be39bbc
I20260709 12:22:48.589023 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet 5a38dabcd47249aebb1f53168be39bbc (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:48.589967 19609 ts_tablet_manager.cc:1929] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:48.590500 19609 log.cc:1199] T 91bf73a138f349e787495351ffd803b7 P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/91bf73a138f349e787495351ffd803b7
I20260709 12:22:48.592435 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet 91bf73a138f349e787495351ffd803b7 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:49.620929 18768 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:49.642715 18841 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:49.642903 18737 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 987becbef0a24ee6a5e0c3eb9a3384cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:49.644738 19584 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:49.647360 18915 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:49.649081 19584 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:49.662186 19605 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:49.667850 18841 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:49.666518 18915 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:49.684638 18768 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:49.695757 18667 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:49.822578 18841 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:49.829350 19568 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:22:49.840739 18737 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84ea4e9cc4d9482b920ad086bf4b1305. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:49.862840 18915 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:49.863329 19623 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:49.867820 18845 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:49.900910 19624 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:49.909832 18915 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.014434 18668 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.050076 19631 ts_tablet_manager.cc:933] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:22:50.050736 18919 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:50.061014 18839 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:50.061946 18886 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 084cf9f30114499b94cf93587f0788f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:50.067407 19614 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:50.069739 18768 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:50.079252 19444 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:50.083297 19631 tablet_copy_client.cc:323] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:22:50.097116 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet 987becbef0a24ee6a5e0c3eb9a3384cc from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:22:50.097846 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet 987becbef0a24ee6a5e0c3eb9a3384cc from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-987becbef0a24ee6a5e0c3eb9a3384cc
I20260709 12:22:50.128362 19612 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:50.135368 18783 tablet_copy_source_session.cc:215] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:50.145287 18841 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:50.146425 18768 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:50.151257 19631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987becbef0a24ee6a5e0c3eb9a3384cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:50.172821 18915 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.185865 18669 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:50.221812 18886 consensus_peers.cc:597] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5cbcb3f54b5453eaa89ac9bf8859e93. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:50.223248 18768 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:50.224776 19631 tablet_copy_client.cc:806] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:50.226409 19444 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.230893 18839 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:50.228636 19631 tablet_copy_client.cc:670] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:50.241489 19612 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:50.244614 19631 tablet_copy_client.cc:538] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:50.248400 19613 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:50.260066 18773 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:50.261780 19631 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:50.282938 18669 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:50.318440 18841 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:50.376601 19641 ts_tablet_manager.cc:933] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:22:50.382903 19641 tablet_copy_client.cc:323] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:22:50.386469 19631 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:50.386890 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet 84ea4e9cc4d9482b920ad086bf4b1305 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:22:50.387527 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet 84ea4e9cc4d9482b920ad086bf4b1305 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-84ea4e9cc4d9482b920ad086bf4b1305
I20260709 12:22:50.396660 18783 tablet_copy_source_session.cc:215] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:50.387686 19631 tablet_bootstrap.cc:492] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:50.399163 19631 ts_tablet_manager.cc:1403] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.040s
I20260709 12:22:50.403299 19631 raft_consensus.cc:359] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.404451 19631 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:50.405342 19631 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.417342 19631 ts_tablet_manager.cc:1434] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 12:22:50.419950 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-987becbef0a24ee6a5e0c3eb9a3384cc received from {username='slave'} at 127.0.0.1:33308
I20260709 12:22:50.420516 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-987becbef0a24ee6a5e0c3eb9a3384cc on tablet 987becbef0a24ee6a5e0c3eb9a3384cc with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:50.437214 19641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ea4e9cc4d9482b920ad086bf4b1305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:50.452879 19631 ts_tablet_manager.cc:933] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:50.471410 19631 tablet_copy_client.cc:323] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:22:50.484849 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet 084cf9f30114499b94cf93587f0788f5 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:22:50.485453 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet 084cf9f30114499b94cf93587f0788f5 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-084cf9f30114499b94cf93587f0788f5
I20260709 12:22:50.495795 19491 raft_consensus.cc:1217] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:50.510089 19641 tablet_copy_client.cc:806] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:50.510870 19641 tablet_copy_client.cc:670] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:50.517452 18932 tablet_copy_source_session.cc:215] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:50.521513 19631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084cf9f30114499b94cf93587f0788f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:50.529737 19641 tablet_copy_client.cc:538] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:50.545902 19631 tablet_copy_client.cc:806] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:50.546732 19631 tablet_copy_client.cc:670] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:50.551205 19631 tablet_copy_client.cc:538] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:50.564827 19641 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:50.570259 19631 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:50.633831 19631 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:50.635445 19631 tablet_bootstrap.cc:492] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:50.636395 19631 ts_tablet_manager.cc:1403] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.006s
I20260709 12:22:50.639976 19631 raft_consensus.cc:359] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.641388 19631 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:50.642269 19631 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.645751 19631 ts_tablet_manager.cc:1434] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:50.649121 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-084cf9f30114499b94cf93587f0788f5 received from {username='slave'} at 127.0.0.1:57874
I20260709 12:22:50.649677 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-084cf9f30114499b94cf93587f0788f5 on tablet 084cf9f30114499b94cf93587f0788f5 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:50.698072 19641 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:50.699361 19641 tablet_bootstrap.cc:492] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:50.703058 19641 ts_tablet_manager.cc:1403] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.139s	user 0.038s	sys 0.009s
I20260709 12:22:50.706372 19641 raft_consensus.cc:359] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.707397 19641 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:50.708101 19641 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.712057 19641 ts_tablet_manager.cc:1434] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:50.714221 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-84ea4e9cc4d9482b920ad086bf4b1305 received from {username='slave'} at 127.0.0.1:33308
I20260709 12:22:50.714854 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-84ea4e9cc4d9482b920ad086bf4b1305 on tablet 84ea4e9cc4d9482b920ad086bf4b1305 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:50.732177 19631 ts_tablet_manager.cc:933] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:50.746465 19631 tablet_copy_client.cc:323] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:22:50.749449 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet f5cbcb3f54b5453eaa89ac9bf8859e93 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:22:50.750157 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet f5cbcb3f54b5453eaa89ac9bf8859e93 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-f5cbcb3f54b5453eaa89ac9bf8859e93
I20260709 12:22:50.774626 19491 raft_consensus.cc:1217] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:50.813700 18932 tablet_copy_source_session.cc:215] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:50.817422 19631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cbcb3f54b5453eaa89ac9bf8859e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:50.851361 19631 tablet_copy_client.cc:806] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:50.851996 19631 tablet_copy_client.cc:670] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:50.857874 19631 tablet_copy_client.cc:538] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:50.877580 19631 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:50.888273 19623 raft_consensus.cc:1064] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:50.891369 19623 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:50.934135 19491 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:50.936134 19622 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:50.937336 18841 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:50.937693 18920 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:50.939400 19648 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:50.942426 19624 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:50.955595 19631 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:50.956564 19631 tablet_bootstrap.cc:492] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:50.957334 19631 ts_tablet_manager.cc:1403] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.006s
I20260709 12:22:50.960916 19648 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:50.962999 18841 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:50.963914 19631 raft_consensus.cc:359] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.964686 19631 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:50.965380 19631 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:50.967630 19631 ts_tablet_manager.cc:1434] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:22:50.975431 18920 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:50.981950 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-f5cbcb3f54b5453eaa89ac9bf8859e93 received from {username='slave'} at 127.0.0.1:57874
I20260709 12:22:50.982800 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-f5cbcb3f54b5453eaa89ac9bf8859e93 on tablet f5cbcb3f54b5453eaa89ac9bf8859e93 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:50.988163 18668 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.002246 19491 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.065937 19490 raft_consensus.cc:1217] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:51.118052 18768 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:51.130517 19491 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:51.132871 19623 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:51.133241 18841 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:51.138340 19648 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:51.144114 19622 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.147997 19491 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.158573 18844 raft_consensus.cc:2955] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.168501 18667 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.170058 19624 raft_consensus.cc:1064] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:51.172623 19624 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:51.186679 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 987becbef0a24ee6a5e0c3eb9a3384cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:51.187886 18906 tablet_service.cc:1558] Processing DeleteTablet for tablet 987becbef0a24ee6a5e0c3eb9a3384cc with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
I20260709 12:22:51.208184 18916 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.212762 19623 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:51.215613 19491 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.218582 19648 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:51.227732 18844 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.230062 19648 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:51.230880 19660 tablet_replica.cc:333] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:22:51.237222 19660 raft_consensus.cc:2243] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.238220 19660 raft_consensus.cc:2272] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.250259 19660 ts_tablet_manager.cc:1916] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:51.249645 19624 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.251547 18916 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.269367 18667 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.277056 19491 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.281828 18844 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.285380 19660 ts_tablet_manager.cc:1929] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:51.286309 19660 log.cc:1199] T 987becbef0a24ee6a5e0c3eb9a3384cc P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/987becbef0a24ee6a5e0c3eb9a3384cc
I20260709 12:22:51.288545 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet 987becbef0a24ee6a5e0c3eb9a3384cc (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:51.306012 18773 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:51.317325 19490 raft_consensus.cc:1217] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:51.333962 19490 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:51.337684 19661 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:51.344832 18916 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:51.385922 19622 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.407855 19648 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:51.418831 19490 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.443926 18919 raft_consensus.cc:2955] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.449062 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 84ea4e9cc4d9482b920ad086bf4b1305 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:51.472978 18668 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.489627 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet 84ea4e9cc4d9482b920ad086bf4b1305 with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:22:51.493602 19665 tablet_replica.cc:333] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:22:51.503396 19665 raft_consensus.cc:2243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.513830 19665 raft_consensus.cc:2272] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.517812 19665 ts_tablet_manager.cc:1916] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:51.540084 19665 ts_tablet_manager.cc:1929] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:51.540692 19665 log.cc:1199] T 84ea4e9cc4d9482b920ad086bf4b1305 P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/84ea4e9cc4d9482b920ad086bf4b1305
I20260709 12:22:51.544533 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet 84ea4e9cc4d9482b920ad086bf4b1305 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:51.639619 19444 raft_consensus.cc:1064] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:51.642498 19444 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:51.653172 18841 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.654305 19490 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.655870 18768 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.657517 19444 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:51.659358 19614 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:51.660573 19612 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:51.709751 19444 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.711544 19490 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.737964 18839 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.738466 18670 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.775655 18919 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:22:51.829048 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 112096us
I20260709 12:22:51.832335 18768 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.836740 19490 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:51.846917 19670 raft_consensus.cc:1064] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:51.847908 19612 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:51.849658 19670 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:51.875602 18773 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:51.885332 19444 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:51.886454 19612 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.888288 19490 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.899678 18839 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.898801 18773 raft_consensus.cc:2955] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.902266 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 084cf9f30114499b94cf93587f0788f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:51.911087 19670 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:51.901206 19491 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.902001 18768 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:51.918286 19671 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:51.914366 18667 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.920589 19612 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:51.946085 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet 084cf9f30114499b94cf93587f0788f5 with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:22:51.949771 19665 tablet_replica.cc:333] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:22:51.950870 19665 raft_consensus.cc:2243] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.951668 19665 raft_consensus.cc:2272] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.976554 19665 ts_tablet_manager.cc:1916] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:51.978047 19670 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.984496 18773 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:51.996105 18841 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:52.007741 19665 ts_tablet_manager.cc:1929] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:52.008278 19665 log.cc:1199] T 084cf9f30114499b94cf93587f0788f5 P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/084cf9f30114499b94cf93587f0788f5
I20260709 12:22:52.010111 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet 084cf9f30114499b94cf93587f0788f5 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:52.010984 18668 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:52.016144 19491 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:52.047818 18920 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:52.054662 18841 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:52.055989 19657 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:52.057026 19491 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:52.058964 19657 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:52.067739 19490 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:52.065877 19670 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:52.100853 18845 raft_consensus.cc:2955] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:52.102934 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5cbcb3f54b5453eaa89ac9bf8859e93 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:52.115715 18670 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.134459 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet f5cbcb3f54b5453eaa89ac9bf8859e93 with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33726
I20260709 12:22:52.140874 19677 tablet_replica.cc:333] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:22:52.147902 19677 raft_consensus.cc:2243] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:52.148721 19677 raft_consensus.cc:2272] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:52.153843 19677 ts_tablet_manager.cc:1916] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:52.168910 19677 ts_tablet_manager.cc:1929] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:52.169332 19677 log.cc:1199] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/f5cbcb3f54b5453eaa89ac9bf8859e93
I20260709 12:22:52.170876 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet f5cbcb3f54b5453eaa89ac9bf8859e93 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:53.231280 18845 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:53.238354 18920 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:53.239946 19582 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.240456 18773 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:53.240931 18812 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d8499bcaf8d4fd3b0236d65471d7006. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:53.241984 19582 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.260507 19420 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.261687 18920 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.264814 18773 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.286748 18669 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.296337 18845 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:53.314276 18773 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:53.314888 18920 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:53.316248 18812 consensus_peers.cc:597] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8038db5456b47f5af9508f8dcb3883b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:53.317159 19420 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.319348 19582 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.344815 19684 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.346735 18773 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.350114 18920 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.369374 18920 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:53.382687 18670 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.389328 18841 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:53.391764 19678 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:53.400198 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9168ac06d4b4b11ac8272d328166702. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:53.401162 18773 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:53.403779 19678 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.406510 19657 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.415386 18773 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.425112 18841 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.427879 18670 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.428982 18845 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:53.447890 18916 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:22:53.450006 18812 consensus_peers.cc:597] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6c1ae2a327b421383ffacb5d5831a0e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:53.450683 19683 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.451196 18768 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:53.453832 19683 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.470741 19684 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.472761 18916 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.479306 18768 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:53.494035 18670 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.793470 19699 ts_tablet_manager.cc:933] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:53.795821 19699 tablet_copy_client.cc:323] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:22:53.797804 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet e8038db5456b47f5af9508f8dcb3883b from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:22:53.798374 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet e8038db5456b47f5af9508f8dcb3883b from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-e8038db5456b47f5af9508f8dcb3883b
I20260709 12:22:53.806787 18858 tablet_copy_source_session.cc:215] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:53.811177 19701 ts_tablet_manager.cc:933] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:53.812335 19699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8038db5456b47f5af9508f8dcb3883b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:53.829588 19701 tablet_copy_client.cc:323] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:22:53.831759 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 0d8499bcaf8d4fd3b0236d65471d7006 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:22:53.832430 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 0d8499bcaf8d4fd3b0236d65471d7006 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-0d8499bcaf8d4fd3b0236d65471d7006
I20260709 12:22:53.841419 18858 tablet_copy_source_session.cc:215] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:53.845363 19701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8499bcaf8d4fd3b0236d65471d7006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:53.867403 19701 tablet_copy_client.cc:806] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:53.868079 19701 tablet_copy_client.cc:670] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:53.871606 19699 tablet_copy_client.cc:806] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:53.872463 19699 tablet_copy_client.cc:670] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:53.872924 19701 tablet_copy_client.cc:538] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:53.882450 19699 tablet_copy_client.cc:538] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:53.889806 19703 ts_tablet_manager.cc:933] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:22:53.906196 19701 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:53.911265 19699 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:53.968568 19703 tablet_copy_client.cc:323] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:22:53.970646 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet e9168ac06d4b4b11ac8272d328166702 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:22:53.971314 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet e9168ac06d4b4b11ac8272d328166702 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-e9168ac06d4b4b11ac8272d328166702
I20260709 12:22:53.982477 18932 tablet_copy_source_session.cc:215] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:53.985941 19703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9168ac06d4b4b11ac8272d328166702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:54.004392 19703 tablet_copy_client.cc:806] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:54.005048 19703 tablet_copy_client.cc:670] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:54.010071 19703 tablet_copy_client.cc:538] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:54.021289 19703 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:54.034436 19699 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:54.035485 19699 tablet_bootstrap.cc:492] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:54.036235 19699 ts_tablet_manager.cc:1403] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.125s	user 0.023s	sys 0.009s
I20260709 12:22:54.039512 19699 raft_consensus.cc:359] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:54.040416 19699 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:54.041126 19699 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:54.054872 19703 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:54.056504 19703 tablet_bootstrap.cc:492] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:54.057348 19703 ts_tablet_manager.cc:1403] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.010s
I20260709 12:22:54.062247 19699 ts_tablet_manager.cc:1434] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.021s
I20260709 12:22:54.064432 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-e8038db5456b47f5af9508f8dcb3883b received from {username='slave'} at 127.0.0.1:45432
I20260709 12:22:54.065055 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-e8038db5456b47f5af9508f8dcb3883b on tablet e8038db5456b47f5af9508f8dcb3883b with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:54.065984 19701 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:54.067451 19701 tablet_bootstrap.cc:492] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:54.068203 19701 ts_tablet_manager.cc:1403] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.162s	user 0.020s	sys 0.011s
I20260709 12:22:54.061141 19703 raft_consensus.cc:359] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:54.069092 19703 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:54.070076 19703 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:54.071587 19701 raft_consensus.cc:359] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:54.072484 19701 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:54.073554 19703 ts_tablet_manager.cc:1434] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:22:54.074301 19699 ts_tablet_manager.cc:933] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:54.075685 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-e9168ac06d4b4b11ac8272d328166702 received from {username='slave'} at 127.0.0.1:57874
I20260709 12:22:54.076153 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-e9168ac06d4b4b11ac8272d328166702 on tablet e9168ac06d4b4b11ac8272d328166702 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:54.073140 19701 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:54.080127 19701 ts_tablet_manager.cc:1434] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:22:54.083400 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-0d8499bcaf8d4fd3b0236d65471d7006 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:22:54.083887 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-0d8499bcaf8d4fd3b0236d65471d7006 on tablet 0d8499bcaf8d4fd3b0236d65471d7006 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:54.086342 19699 tablet_copy_client.cc:323] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:22:54.089378 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet d6c1ae2a327b421383ffacb5d5831a0e from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:22:54.093549 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet d6c1ae2a327b421383ffacb5d5831a0e from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-d6c1ae2a327b421383ffacb5d5831a0e
I20260709 12:22:54.103732 18858 tablet_copy_source_session.cc:215] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:54.108148 19699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c1ae2a327b421383ffacb5d5831a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:54.137562 19699 tablet_copy_client.cc:806] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:54.138278 19699 tablet_copy_client.cc:670] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:54.159996 19699 tablet_copy_client.cc:538] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:54.183373 19699 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:54.379482 19699 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:54.380779 19699 tablet_bootstrap.cc:492] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:54.381850 19699 ts_tablet_manager.cc:1403] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.199s	user 0.028s	sys 0.009s
I20260709 12:22:54.386715 19699 raft_consensus.cc:359] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:54.388151 19699 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:54.389268 19699 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:54.404036 19699 ts_tablet_manager.cc:1434] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:22:54.461159 19490 raft_consensus.cc:1217] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:54.461393 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-d6c1ae2a327b421383ffacb5d5831a0e received from {username='slave'} at 127.0.0.1:45432
I20260709 12:22:54.462616 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-d6c1ae2a327b421383ffacb5d5831a0e on tablet d6c1ae2a327b421383ffacb5d5831a0e with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:54.532217 19490 raft_consensus.cc:1217] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:54.607409 19490 raft_consensus.cc:1217] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:54.652143 19490 raft_consensus.cc:1217] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:22:54.951288 19713 raft_consensus.cc:1064] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:54.954114 19713 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:54.965329 19490 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:54.969344 18772 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:54.971246 19683 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:54.973484 19683 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:54.978498 18920 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:54.980147 19683 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:55.000065 19683 raft_consensus.cc:1064] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:55.006843 19683 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:55.041841 18772 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.027231 19713 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.064428 19723 raft_consensus.cc:1064] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:55.067241 19723 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:55.073427 18667 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.076622 19490 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:55.078888 18772 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:55.078686 19720 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:55.081709 18919 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:55.074263 18918 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.086568 19720 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:55.090960 19491 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:55.090257 18846 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:55.093263 19715 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:55.096697 19718 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:55.101729 19657 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:55.112984 18765 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:55.115984 19670 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:55.124387 19489 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.150524 19720 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.171424 18918 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.179500 19670 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.189011 19490 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.199707 18846 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.202960 19491 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.217926 18765 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:22:55.233865 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08002980a0 after lost signal to thread 17571
W20260709 12:22:55.235105 18702 debug-util.cc:398] Leaking SignalData structure 0x7b080028d080 after lost signal to thread 18705
W20260709 12:22:55.236333 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800041e80 after lost signal to thread 18797
W20260709 12:22:55.237417 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800287ec0 after lost signal to thread 18872
I20260709 12:22:55.239318 18766 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:22:55.246652 18702 debug-util.cc:398] Leaking SignalData structure 0x7b080031d5a0 after lost signal to thread 18946
W20260709 12:22:55.249594 18702 debug-util.cc:398] Leaking SignalData structure 0x7b080031a5e0 after lost signal to thread 19516
I20260709 12:22:55.253225 19713 raft_consensus.cc:1064] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:55.255949 19713 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:55.285472 18918 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:55.286026 19490 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:55.287616 18765 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:55.287631 19713 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:22:55.290828 19720 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:55.310436 19717 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:55.313150 18841 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:55.350762 19491 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:55.321879 18669 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.362130 19717 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:55.360011 18765 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:55.365906 18669 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.381130 19713 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:55.390494 19720 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.396306 18920 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:55.401319 18845 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:55.399219 19490 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.415614 19491 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:55.415124 19683 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.418126 19717 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:55.421433 18919 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.433354 18766 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:55.434854 18765 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:55.435206 19489 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:55.440008 19723 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:55.442128 19723 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:22:55.449074 19717 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.469365 19489 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.470947 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d8499bcaf8d4fd3b0236d65471d7006 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:55.469835 19492 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.461474 19657 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.479985 19491 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.484043 18669 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.486668 18768 raft_consensus.cc:2955] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.500849 19718 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:55.506217 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8038db5456b47f5af9508f8dcb3883b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:55.498972 18765 raft_consensus.cc:2955] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.499189 18766 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.546942 18772 raft_consensus.cc:2955] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.543308 18667 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.551136 18667 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.592412 18669 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.604487 18845 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:55.605301 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet e8038db5456b47f5af9508f8dcb3883b with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
I20260709 12:22:55.606660 18906 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d8499bcaf8d4fd3b0236d65471d7006 with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
I20260709 12:22:55.611574 18918 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:55.611789 19491 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:55.613288 19718 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:55.614763 19713 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:55.620600 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet e9168ac06d4b4b11ac8272d328166702 with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:22:55.623934 19718 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.632828 18919 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.636348 19750 tablet_replica.cc:333] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:22:55.641723 19490 raft_consensus.cc:2955] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:55.666615 19749 tablet_replica.cc:333] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:22:55.670708 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d6c1ae2a327b421383ffacb5d5831a0e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:55.680342 18670 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 4 to 5, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.687211 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9168ac06d4b4b11ac8272d328166702 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:55.698064 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c1ae2a327b421383ffacb5d5831a0e with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33726
I20260709 12:22:55.703155 19749 raft_consensus.cc:2243] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.704035 19749 raft_consensus.cc:2272] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.707769 19749 ts_tablet_manager.cc:1916] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:55.717962 19750 raft_consensus.cc:2243] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.719497 19750 raft_consensus.cc:2272] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.723918 19750 ts_tablet_manager.cc:1916] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:55.741744 19749 ts_tablet_manager.cc:1929] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:55.742266 19749 log.cc:1199] T e8038db5456b47f5af9508f8dcb3883b P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/e8038db5456b47f5af9508f8dcb3883b
I20260709 12:22:55.744094 19751 tablet_replica.cc:333] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:22:55.746306 19749 tablet_replica.cc:333] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:22:55.748169 19749 raft_consensus.cc:2243] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.749025 19749 raft_consensus.cc:2272] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.752728 19749 ts_tablet_manager.cc:1916] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:55.744094 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet e8038db5456b47f5af9508f8dcb3883b (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:55.759215 19751 raft_consensus.cc:2243] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.760272 19751 raft_consensus.cc:2272] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.764955 19751 ts_tablet_manager.cc:1916] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:55.771070 19750 ts_tablet_manager.cc:1929] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:55.771633 19750 log.cc:1199] T e9168ac06d4b4b11ac8272d328166702 P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/e9168ac06d4b4b11ac8272d328166702
I20260709 12:22:55.772225 19749 ts_tablet_manager.cc:1929] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:55.772730 19749 log.cc:1199] T 0d8499bcaf8d4fd3b0236d65471d7006 P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/0d8499bcaf8d4fd3b0236d65471d7006
I20260709 12:22:55.773712 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet e9168ac06d4b4b11ac8272d328166702 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:55.774569 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet 0d8499bcaf8d4fd3b0236d65471d7006 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:55.785691 19751 ts_tablet_manager.cc:1929] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:22:55.786648 19751 log.cc:1199] T d6c1ae2a327b421383ffacb5d5831a0e P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/d6c1ae2a327b421383ffacb5d5831a0e
I20260709 12:22:55.788458 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet d6c1ae2a327b421383ffacb5d5831a0e (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:56.828469 18845 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:22:56.836153 18812 consensus_peers.cc:597] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4eda139ea8094bec9f34a061ca15f982. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.838124 18765 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:56.839897 19713 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:56.838171 18920 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:56.848838 19718 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:56.865556 19756 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:56.868269 18768 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:56.889935 18670 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:56.895495 18919 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:56.897859 18768 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:22:56.922097 18737 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4cd048e748d347889eab552ac02ed00f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.924638 18846 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:56.931131 19752 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:56.932365 18919 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:56.957851 19752 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:56.986361 19679 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:56.988942 18845 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:56.990638 18920 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:57.004495 18768 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.009029 18668 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.015707 18920 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:57.016312 18737 consensus_peers.cc:597] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b37f46e9bd70474bbc330c12a42a76f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:57.017571 19752 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:57.018203 18841 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:57.019968 19679 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:57.050065 19752 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:57.051471 18845 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:57.054852 18920 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:57.071334 18670 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.080667 18845 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.112150 18920 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:22:57.112780 18812 consensus_peers.cc:597] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0406e95e375e45c495fe295f541d7cd4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:57.113780 19755 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:57.127230 19756 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:57.129457 18919 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:57.135299 18766 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:57.137554 19713 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:57.158831 18766 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:57.164918 18670 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:22:57.354672 19773 ts_tablet_manager.cc:933] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:57.362430 19773 tablet_copy_client.cc:323] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:22:57.364712 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 4eda139ea8094bec9f34a061ca15f982 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:22:57.365353 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 4eda139ea8094bec9f34a061ca15f982 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-4eda139ea8094bec9f34a061ca15f982
I20260709 12:22:57.374014 18858 tablet_copy_source_session.cc:215] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:57.385694 19773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eda139ea8094bec9f34a061ca15f982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.402149 19773 tablet_copy_client.cc:806] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:57.402905 19773 tablet_copy_client.cc:670] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:57.408520 19773 tablet_copy_client.cc:538] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:57.419816 19773 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:57.439565 19776 ts_tablet_manager.cc:933] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:22:57.442016 19776 tablet_copy_client.cc:323] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:22:57.444124 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet 4cd048e748d347889eab552ac02ed00f from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:22:57.444746 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet 4cd048e748d347889eab552ac02ed00f from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-4cd048e748d347889eab552ac02ed00f
I20260709 12:22:57.446348 19773 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:57.447391 19773 tablet_bootstrap.cc:492] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:57.448173 19773 ts_tablet_manager.cc:1403] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.009s
I20260709 12:22:57.452849 19773 raft_consensus.cc:359] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.453241 18783 tablet_copy_source_session.cc:215] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:57.453907 19773 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:57.455928 19773 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.460090 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd048e748d347889eab552ac02ed00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.461799 19773 ts_tablet_manager.cc:1434] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:22:57.463944 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-4eda139ea8094bec9f34a061ca15f982 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:22:57.464416 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-4eda139ea8094bec9f34a061ca15f982 on tablet 4eda139ea8094bec9f34a061ca15f982 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:57.487547 19776 tablet_copy_client.cc:806] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:57.488202 19776 tablet_copy_client.cc:670] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:57.492586 19776 tablet_copy_client.cc:538] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:57.504056 19776 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:57.528479 19776 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:57.529330 19776 tablet_bootstrap.cc:492] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:57.530066 19776 ts_tablet_manager.cc:1403] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.001s
I20260709 12:22:57.533078 19776 raft_consensus.cc:359] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.534017 19776 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:57.534837 19776 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.537359 19776 ts_tablet_manager.cc:1434] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:57.546334 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-4cd048e748d347889eab552ac02ed00f received from {username='slave'} at 127.0.0.1:33308
I20260709 12:22:57.546856 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-4cd048e748d347889eab552ac02ed00f on tablet 4cd048e748d347889eab552ac02ed00f with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:57.597365 19776 ts_tablet_manager.cc:933] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:22:57.599300 19776 tablet_copy_client.cc:323] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:22:57.601140 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet b37f46e9bd70474bbc330c12a42a76f5 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:22:57.601836 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet b37f46e9bd70474bbc330c12a42a76f5 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-b37f46e9bd70474bbc330c12a42a76f5
I20260709 12:22:57.611518 18783 tablet_copy_source_session.cc:215] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:57.614813 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37f46e9bd70474bbc330c12a42a76f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.628336 19776 tablet_copy_client.cc:806] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:57.629050 19776 tablet_copy_client.cc:670] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:57.635512 19776 tablet_copy_client.cc:538] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:57.644394 19776 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:57.664471 19773 ts_tablet_manager.cc:933] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:22:57.666527 19773 tablet_copy_client.cc:323] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:22:57.668264 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 0406e95e375e45c495fe295f541d7cd4 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:22:57.668812 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 0406e95e375e45c495fe295f541d7cd4 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-0406e95e375e45c495fe295f541d7cd4
I20260709 12:22:57.669289 19776 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:57.670315 19776 tablet_bootstrap.cc:492] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:57.671300 19776 ts_tablet_manager.cc:1403] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.000s
I20260709 12:22:57.675495 18858 tablet_copy_source_session.cc:215] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:57.674625 19776 raft_consensus.cc:359] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.677165 19776 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:57.679243 19776 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.682865 19776 ts_tablet_manager.cc:1434] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:22:57.680310 19773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0406e95e375e45c495fe295f541d7cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.699780 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-b37f46e9bd70474bbc330c12a42a76f5 received from {username='slave'} at 127.0.0.1:33308
I20260709 12:22:57.700340 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-b37f46e9bd70474bbc330c12a42a76f5 on tablet b37f46e9bd70474bbc330c12a42a76f5 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:57.718887 19773 tablet_copy_client.cc:806] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:57.720306 19773 tablet_copy_client.cc:670] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:57.740124 19773 tablet_copy_client.cc:538] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:57.750311 19773 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:22:57.775524 19773 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:57.776546 19773 tablet_bootstrap.cc:492] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:22:57.777297 19773 ts_tablet_manager.cc:1403] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.005s
I20260709 12:22:57.780575 19773 raft_consensus.cc:359] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.781836 19773 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:22:57.782577 19773 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:22:57.792179 19773 ts_tablet_manager.cc:1434] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:22:57.794122 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-0406e95e375e45c495fe295f541d7cd4 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:22:57.794665 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-0406e95e375e45c495fe295f541d7cd4 on tablet 0406e95e375e45c495fe295f541d7cd4 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:22:57.839031 19492 raft_consensus.cc:1217] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:57.948397 19490 raft_consensus.cc:1217] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:58.214260 19490 raft_consensus.cc:1217] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:58.264755 19490 raft_consensus.cc:1217] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:58.389001 19713 raft_consensus.cc:1064] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:58.391867 19713 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:58.399204 18919 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.400682 19713 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:58.400924 19490 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.401177 18768 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.402843 19713 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:58.406014 19787 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:58.421825 19755 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.423513 19490 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.431618 18768 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.435951 18918 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.449213 18670 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:58.585321 19752 raft_consensus.cc:1064] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:58.591495 19752 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:22:58.606526 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74883.3us
I20260709 12:22:58.630852 19793 raft_consensus.cc:1064] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:58.633455 19793 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:58.653591 19492 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.656201 19796 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:58.658854 18918 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.665027 19794 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:58.688014 19768 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.699473 18918 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.727551 19492 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.734658 19793 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:22:58.749563 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51241.1us
W20260709 12:22:58.754053 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66998.7us
I20260709 12:22:58.766453 18841 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.770952 18845 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:58.775300 18841 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.777326 19752 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:58.778292 19793 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:22:58.788019 18920 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:58.794584 18920 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.803474 19787 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:58.822126 19491 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.833636 19798 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.843287 18920 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:22:58.853870 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44102.2us
I20260709 12:22:58.857895 19491 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:58.860239 19807 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.862427 19491 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.878665 18845 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.885842 18841 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.865275 18670 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.895339 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4eda139ea8094bec9f34a061ca15f982 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:58.896416 19747 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:58.904340 19755 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:58.907439 19787 raft_consensus.cc:1064] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:22:58.911087 19787 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:58.915393 18669 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.921363 19492 raft_consensus.cc:2955] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.935518 18671 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:58.954653 18916 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.959149 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet 4eda139ea8094bec9f34a061ca15f982 with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33726
I20260709 12:22:58.961282 18768 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.958964 19798 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:58.963644 19492 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:58.965641 19713 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:58.968932 19787 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:58.995543 19814 tablet_replica.cc:333] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:22:58.997360 19814 raft_consensus.cc:2243] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.999017 19814 raft_consensus.cc:2272] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.005631 19814 ts_tablet_manager.cc:1916] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:59.008347 18919 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.013145 19713 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.022083 19492 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.027587 19814 ts_tablet_manager.cc:1929] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:59.028108 19814 log.cc:1199] T 4eda139ea8094bec9f34a061ca15f982 P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/4eda139ea8094bec9f34a061ca15f982
I20260709 12:22:59.030115 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet 4eda139ea8094bec9f34a061ca15f982 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:59.030606 18920 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.042088 18671 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.043958 18768 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.060884 18841 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:59.073575 18919 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:59.075485 19797 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:59.075863 19492 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:59.077494 19787 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:59.086977 19797 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.099973 18920 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.175700 19492 raft_consensus.cc:2955] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.180004 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0406e95e375e45c495fe295f541d7cd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:59.188876 18671 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:59.207955 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet 0406e95e375e45c495fe295f541d7cd4 with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33726
I20260709 12:22:59.211344 19814 tablet_replica.cc:333] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:22:59.220961 19814 raft_consensus.cc:2243] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.221863 19814 raft_consensus.cc:2272] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.236116 19814 ts_tablet_manager.cc:1916] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:22:59.239351 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49914.1us
I20260709 12:22:59.262439 19814 ts_tablet_manager.cc:1929] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:59.262959 19814 log.cc:1199] T 0406e95e375e45c495fe295f541d7cd4 P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/0406e95e375e45c495fe295f541d7cd4
I20260709 12:22:59.298527 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet 0406e95e375e45c495fe295f541d7cd4 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
W20260709 12:22:59.420979 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52997us
I20260709 12:22:59.453819 18768 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:59.497308 19490 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:59.499904 19752 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:59.519479 19492 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.521210 19807 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.553068 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b37f46e9bd70474bbc330c12a42a76f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:59.567312 18846 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:59.575079 18668 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.593482 18768 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:22:59.600917 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet b37f46e9bd70474bbc330c12a42a76f5 with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
I20260709 12:22:59.611240 19828 tablet_replica.cc:333] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:22:59.612746 19828 raft_consensus.cc:2243] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.614318 19828 raft_consensus.cc:2272] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.620199 19752 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:59.630142 19828 ts_tablet_manager.cc:1916] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:59.644037 19490 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:59.646833 18921 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:59.648204 19796 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:59.655872 19828 ts_tablet_manager.cc:1929] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:59.656529 19828 log.cc:1199] T b37f46e9bd70474bbc330c12a42a76f5 P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/b37f46e9bd70474bbc330c12a42a76f5
I20260709 12:22:59.659680 19796 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.665203 19490 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.668162 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet b37f46e9bd70474bbc330c12a42a76f5 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:22:59.667913 19824 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:59.690788 18846 raft_consensus.cc:2955] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:22:59.692585 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4cd048e748d347889eab552ac02ed00f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:59.681322 18921 raft_consensus.cc:2955] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:22:59.711275 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43698.6us
I20260709 12:22:59.710557 18669 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:59.751328 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd048e748d347889eab552ac02ed00f with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:22:59.753947 19829 tablet_replica.cc:333] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:22:59.755187 19829 raft_consensus.cc:2243] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.756035 19829 raft_consensus.cc:2272] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.760308 19829 ts_tablet_manager.cc:1916] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:59.778110 19829 ts_tablet_manager.cc:1929] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:59.778601 19829 log.cc:1199] T 4cd048e748d347889eab552ac02ed00f P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/4cd048e748d347889eab552ac02ed00f
I20260709 12:22:59.781226 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet 4cd048e748d347889eab552ac02ed00f (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
W20260709 12:23:00.876459 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 91587.8us
W20260709 12:23:00.888181 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 82320.1us
W20260709 12:23:00.954910 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57755.1us
W20260709 12:23:00.958613 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63058.2us
I20260709 12:23:00.998899 18770 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:23:01.042094 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 49937.9us
W20260709 12:23:01.052191 18737 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d14b13acceee47439963d9c58e4b6d39. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.060232 18920 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:01.065236 19832 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:01.067983 18841 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:01.072180 19796 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.079468 19832 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.081351 18920 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.084329 18839 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.097502 18841 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.103760 18667 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.118709 18921 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:01.120257 19836 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:01.123445 18812 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34d2d90d352e40cb8b6cde778d729c24. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.125247 18768 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:01.126930 19837 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.134763 19836 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.140758 18920 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.144878 18768 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.155731 18921 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.165119 18668 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.175410 18839 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:01.179648 18770 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:01.181457 19833 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:01.183930 18886 consensus_peers.cc:597] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73828daf5c2b417fb99b9a563c19c850. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.184861 19833 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.195655 19840 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.196832 18839 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.215451 18770 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.216264 18768 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.218664 18667 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:01.230726 18737 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9134ec4fb92645b28a9b4814179c1c7c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.231108 18839 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:01.233971 18921 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:01.234540 19796 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.240091 19807 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.252121 19824 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.258652 18845 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.275280 18667 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.280514 18920 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:01.536265 19857 ts_tablet_manager.cc:933] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:01.539415 19857 tablet_copy_client.cc:323] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:23:01.541519 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet d14b13acceee47439963d9c58e4b6d39 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:23:01.542173 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet d14b13acceee47439963d9c58e4b6d39 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-d14b13acceee47439963d9c58e4b6d39
I20260709 12:23:01.551393 18783 tablet_copy_source_session.cc:215] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:01.556236 19857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14b13acceee47439963d9c58e4b6d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.581728 19859 ts_tablet_manager.cc:933] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:01.591475 19859 tablet_copy_client.cc:323] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:23:01.591605 19857 tablet_copy_client.cc:806] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:01.592440 19857 tablet_copy_client.cc:670] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:01.593798 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 34d2d90d352e40cb8b6cde778d729c24 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:23:01.594522 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 34d2d90d352e40cb8b6cde778d729c24 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-34d2d90d352e40cb8b6cde778d729c24
I20260709 12:23:01.598778 19857 tablet_copy_client.cc:538] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:01.609815 19857 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:01.612224 18858 tablet_copy_source_session.cc:215] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:01.617404 19859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d2d90d352e40cb8b6cde778d729c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.628978 19861 ts_tablet_manager.cc:933] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:01.636322 19859 tablet_copy_client.cc:806] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:01.636991 19859 tablet_copy_client.cc:670] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:01.653736 19861 tablet_copy_client.cc:323] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:23:01.659718 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet 73828daf5c2b417fb99b9a563c19c850 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:23:01.660430 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet 73828daf5c2b417fb99b9a563c19c850 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-73828daf5c2b417fb99b9a563c19c850
I20260709 12:23:01.660861 19859 tablet_copy_client.cc:538] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:01.676980 18932 tablet_copy_source_session.cc:215] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:01.689002 19861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73828daf5c2b417fb99b9a563c19c850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.699103 19857 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:01.700140 19857 tablet_bootstrap.cc:492] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:01.702927 19857 ts_tablet_manager.cc:1403] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.093s	user 0.048s	sys 0.020s
I20260709 12:23:01.698727 19859 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:01.712195 19861 tablet_copy_client.cc:806] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:01.706908 19857 raft_consensus.cc:359] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.712935 19861 tablet_copy_client.cc:670] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:01.713084 19857 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:01.715392 19857 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.719815 19861 tablet_copy_client.cc:538] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:01.738337 19861 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:01.741698 19857 ts_tablet_manager.cc:1434] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.004s
I20260709 12:23:01.784324 19859 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:01.784324 19861 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:01.785352 19859 tablet_bootstrap.cc:492] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:01.785733 19861 tablet_bootstrap.cc:492] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:01.786191 19859 ts_tablet_manager.cc:1403] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.013s
I20260709 12:23:01.786513 19861 ts_tablet_manager.cc:1403] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.021s
I20260709 12:23:01.790426 19861 raft_consensus.cc:359] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.791311 19861 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:01.792284 19861 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.792776 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-d14b13acceee47439963d9c58e4b6d39 received from {username='slave'} at 127.0.0.1:33308
I20260709 12:23:01.793349 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-d14b13acceee47439963d9c58e4b6d39 on tablet d14b13acceee47439963d9c58e4b6d39 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:01.796451 19861 ts_tablet_manager.cc:1434] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:23:01.802134 19857 ts_tablet_manager.cc:933] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:01.791348 19859 raft_consensus.cc:359] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.803520 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-73828daf5c2b417fb99b9a563c19c850 received from {username='slave'} at 127.0.0.1:57874
I20260709 12:23:01.805388 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-73828daf5c2b417fb99b9a563c19c850 on tablet 73828daf5c2b417fb99b9a563c19c850 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:01.805053 19859 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:01.808439 19859 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.812526 19859 ts_tablet_manager.cc:1434] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 12:23:01.820204 19857 tablet_copy_client.cc:323] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:23:01.821563 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-34d2d90d352e40cb8b6cde778d729c24 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:23:01.822095 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-34d2d90d352e40cb8b6cde778d729c24 on tablet 34d2d90d352e40cb8b6cde778d729c24 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:01.823197 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet 9134ec4fb92645b28a9b4814179c1c7c from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:23:01.823808 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet 9134ec4fb92645b28a9b4814179c1c7c from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-9134ec4fb92645b28a9b4814179c1c7c
I20260709 12:23:01.835992 18783 tablet_copy_source_session.cc:215] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:01.852413 19857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9134ec4fb92645b28a9b4814179c1c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:01.873607 19857 tablet_copy_client.cc:806] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:01.874229 19857 tablet_copy_client.cc:670] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:01.879103 19857 tablet_copy_client.cc:538] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:01.886160 19857 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:01.906029 19857 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:01.907172 19857 tablet_bootstrap.cc:492] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:01.907953 19857 ts_tablet_manager.cc:1403] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.022s	user 0.024s	sys 0.000s
I20260709 12:23:01.911100 19857 raft_consensus.cc:359] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.912081 19857 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:01.912801 19857 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:01.916256 19857 ts_tablet_manager.cc:1434] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:01.919320 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-9134ec4fb92645b28a9b4814179c1c7c received from {username='slave'} at 127.0.0.1:33308
I20260709 12:23:01.919776 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-9134ec4fb92645b28a9b4814179c1c7c on tablet 9134ec4fb92645b28a9b4814179c1c7c with peer 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:01.955073 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080009cc60 after lost signal to thread 17571
W20260709 12:23:01.956326 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080009f680 after lost signal to thread 18705
W20260709 12:23:01.957449 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4260 after lost signal to thread 18797
W20260709 12:23:01.958354 18794 debug-util.cc:398] Leaking SignalData structure 0x7b0800238200 after lost signal to thread 18872
W20260709 12:23:01.959509 18794 debug-util.cc:398] Leaking SignalData structure 0x7b0800222680 after lost signal to thread 18946
W20260709 12:23:01.960665 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080019a840 after lost signal to thread 19516
I20260709 12:23:01.971092 19490 raft_consensus.cc:1217] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:02.122888 19492 raft_consensus.cc:1217] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:02.171761 19492 raft_consensus.cc:1217] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:02.202929 19490 raft_consensus.cc:1217] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:23:02.236457 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54468.4us
I20260709 12:23:02.503649 19807 raft_consensus.cc:1064] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:02.516031 19807 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:02.562605 19492 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.562793 18921 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.564903 19824 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:02.566538 19867 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:02.622632 18845 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.626457 19833 raft_consensus.cc:1064] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:02.628446 19873 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:02.629208 19833 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:02.632282 19839 raft_consensus.cc:1064] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:02.635247 19839 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:02.670953 19492 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.667721 19824 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.675828 19840 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:02.680707 19492 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.687438 19807 raft_consensus.cc:1064] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:02.703224 19807 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:02.709885 18845 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.725996 18921 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.722517 19871 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:23:02.747042 19491 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.750355 18921 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.754884 19836 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:02.760454 18768 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.764281 19876 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:02.769847 18667 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:02.805683 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77089.5us
I20260709 12:23:02.818861 19885 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.822630 19836 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:02.840787 19491 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.843623 19875 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:02.842549 19490 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.867475 18916 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.870610 19875 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:02.877733 19878 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.052s	user 0.006s	sys 0.008s
I20260709 12:23:02.882957 18770 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:02.888703 18916 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.898347 18766 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.899811 18839 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:02.913964 19891 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:23:02.916497 18839 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.923151 19841 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.926865 19840 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:02.974651 19883 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:02.981284 18846 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:02.988817 18671 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:02.999781 18768 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:03.027981 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46811us
I20260709 12:23:03.031980 19883 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:03.038674 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56140.5us
I20260709 12:23:03.042855 19492 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.044659 18921 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.048106 18846 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.062136 19490 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.098641 18770 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:03.115914 18846 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:03.118258 19492 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:03.132701 18919 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:03.137413 19873 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:03.149374 19874 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.161034 19492 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:03.161196 19491 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.163282 19887 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:03.161196 18768 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:03.172868 19837 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.177829 19839 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:03.179661 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48406.7us
I20260709 12:23:03.181046 19883 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:03.186134 18772 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.196641 18919 raft_consensus.cc:2955] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.203768 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d14b13acceee47439963d9c58e4b6d39 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:03.202244 19490 raft_consensus.cc:2955] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.215754 18669 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.224836 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 34d2d90d352e40cb8b6cde778d729c24 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:03.248296 18667 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:03.273728 18656 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet d14b13acceee47439963d9c58e4b6d39 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:23:03.275761 18921 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:03.278139 18770 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:03.285485 19490 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:03.287154 19835 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:03.287487 19492 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:03.292162 19874 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:03.294947 18669 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.296851 18921 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:03.296734 18669 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.298476 19883 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:03.300175 19898 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.302196 19489 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.303397 18839 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:03.308775 19833 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:03.317256 19875 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.318946 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet d14b13acceee47439963d9c58e4b6d39 with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:23:03.328614 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet 34d2d90d352e40cb8b6cde778d729c24 with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
I20260709 12:23:03.331385 18839 raft_consensus.cc:2955] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.364492 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9134ec4fb92645b28a9b4814179c1c7c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:03.370564 18669 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.321559 19492 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.369784 19904 tablet_replica.cc:333] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:23:03.387969 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet 73828daf5c2b417fb99b9a563c19c850 with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33726
I20260709 12:23:03.398809 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73828daf5c2b417fb99b9a563c19c850 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:03.428128 19906 tablet_replica.cc:333] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:23:03.483072 19906 raft_consensus.cc:2243] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:03.484308 19906 raft_consensus.cc:2272] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:03.489562 19906 ts_tablet_manager.cc:1916] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:03.504093 18671 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.513177 19905 tablet_replica.cc:333] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:23:03.525170 18919 raft_consensus.cc:2955] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:03.528019 19905 raft_consensus.cc:2243] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:03.532296 19905 raft_consensus.cc:2272] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:03.543543 19905 ts_tablet_manager.cc:1916] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:03.544353 19904 raft_consensus.cc:2243] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:03.546008 19904 raft_consensus.cc:2272] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:03.555830 19904 ts_tablet_manager.cc:1916] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:03.557209 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet 9134ec4fb92645b28a9b4814179c1c7c with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:23:03.567914 19906 ts_tablet_manager.cc:1929] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:03.569417 19906 log.cc:1199] T 73828daf5c2b417fb99b9a563c19c850 P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/73828daf5c2b417fb99b9a563c19c850
I20260709 12:23:03.571882 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet 73828daf5c2b417fb99b9a563c19c850 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:03.599244 19904 ts_tablet_manager.cc:1929] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:03.599864 19904 log.cc:1199] T d14b13acceee47439963d9c58e4b6d39 P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/d14b13acceee47439963d9c58e4b6d39
I20260709 12:23:03.607165 19905 ts_tablet_manager.cc:1929] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:03.608053 19905 log.cc:1199] T 34d2d90d352e40cb8b6cde778d729c24 P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/34d2d90d352e40cb8b6cde778d729c24
I20260709 12:23:03.610139 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet 34d2d90d352e40cb8b6cde778d729c24 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:03.612890 19904 tablet_replica.cc:333] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:23:03.613251 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet d14b13acceee47439963d9c58e4b6d39 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:03.615063 19904 raft_consensus.cc:2243] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:03.615839 19904 raft_consensus.cc:2272] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:03.619817 19904 ts_tablet_manager.cc:1916] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:03.634918 19904 ts_tablet_manager.cc:1929] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:03.635354 19904 log.cc:1199] T 9134ec4fb92645b28a9b4814179c1c7c P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/9134ec4fb92645b28a9b4814179c1c7c
I20260709 12:23:03.637339 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet 9134ec4fb92645b28a9b4814179c1c7c (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:04.647683 18841 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:04.654282 18921 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:04.656311 18772 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:04.656735 19837 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:04.659591 18812 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0adcb82468fe454b951282d52761a6c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:04.659816 19839 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:04.693784 19908 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.705926 18772 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.708829 18921 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.722412 18770 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:04.728021 18671 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:04.755728 18737 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20fd9926cbc04b9b9436afef7b0d1f6f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:04.765113 18921 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:04.768918 19807 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:04.770323 18841 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:04.772475 19807 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:04.805425 19807 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.812647 18921 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.827862 18846 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.836301 18669 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.833774 18839 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:04.887876 18919 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:04.888360 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9317d76b36ff4814b60c58870accf4ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:04.890159 19911 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:04.899163 18772 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:04.911720 19836 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:04.922941 19839 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.924921 18921 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.946187 18669 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:04.979600 18839 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:04.982066 18772 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:05.014048 18919 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:05.016152 19908 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:05.017127 18770 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:05.019223 19911 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:05.022341 18812 consensus_peers.cc:597] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7d5f339cce949e5b5159e03d3d9f348. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:05.046648 19908 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:05.051095 18770 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:05.052537 18919 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:05.075963 18671 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:05.142005 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.244045 18846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:05.244843 18846 raft_consensus.cc:606] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:05.271720 18770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:05.272399 18770 raft_consensus.cc:606] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:05.275681 18770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:05.276301 18770 raft_consensus.cc:606] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:05.286514 18770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:05.287199 18770 raft_consensus.cc:606] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:05.293475 19932 ts_tablet_manager.cc:933] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:05.312188 18916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:05.312965 18916 raft_consensus.cc:606] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:05.313316 19932 tablet_copy_client.cc:323] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:23:05.315649 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 0adcb82468fe454b951282d52761a6c3 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:23:05.316103 18770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:05.316256 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 0adcb82468fe454b951282d52761a6c3 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-0adcb82468fe454b951282d52761a6c3
I20260709 12:23:05.316854 18770 raft_consensus.cc:606] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:05.323143 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:05.325112 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.329314 19921 raft_consensus.cc:993] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.329970 19921 raft_consensus.cc:1081] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.335467 19911 raft_consensus.cc:993] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.336009 19837 raft_consensus.cc:1081] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.338289 19492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45478
I20260709 12:23:05.339002 19492 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.339376 19492 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.340181 18858 tablet_copy_source_session.cc:215] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:05.343122 19489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45480
I20260709 12:23:05.343896 19489 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.344368 19489 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.326207 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.374749 19935 ts_tablet_manager.cc:933] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:05.377923 19932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcb82468fe454b951282d52761a6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.390359 19489 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.394989 19936 ts_tablet_manager.cc:933] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:05.399627 19489 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:05.401034 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:05.401872 18919 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.402549 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:05.403683 18839 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.404074 18839 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:05.406119 18839 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.410326 18919 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:05.412300 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:05.414122 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45779.3us
I20260709 12:23:05.407212 18839 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.430975 19940 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.440809 19921 raft_consensus.cc:993] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.444437 19920 raft_consensus.cc:1081] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.446374 19489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45478
I20260709 12:23:05.447016 19489 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.447394 19489 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.466595 19912 raft_consensus.cc:993] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:05.467151 19912 raft_consensus.cc:1081] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:05.476109 19492 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.497972 18770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33738
I20260709 12:23:05.499089 18770 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.499789 18770 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.501232 19936 tablet_copy_client.cc:323] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:23:05.503434 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 9317d76b36ff4814b60c58870accf4ec from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:23:05.504112 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 9317d76b36ff4814b60c58870accf4ec from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-9317d76b36ff4814b60c58870accf4ec
I20260709 12:23:05.514796 19492 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:05.516938 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:05.517642 18916 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.520180 19935 tablet_copy_client.cc:323] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:23:05.520176 19940 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:05.522037 19940 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.528694 18916 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:05.529868 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:05.530977 19941 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.529754 18839 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:05.539006 19941 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:05.540117 19941 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.541329 19489 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.550148 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:05.551050 18916 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.560051 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:05.560827 18766 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.561167 18766 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:05.548971 19489 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:05.561931 18766 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.566941 18916 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:05.567207 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:05.530884 18770 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:05.567926 18768 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.570719 18768 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:05.571907 18768 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.573468 18768 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.574891 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:05.576419 19943 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.578042 18766 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.603587 18770 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:05.604341 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 125122us
I20260709 12:23:05.607267 18766 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:05.608052 18768 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:05.568702 18858 tablet_copy_source_session.cc:215] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:05.569028 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet 20fd9926cbc04b9b9436afef7b0d1f6f from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:23:05.629849 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:05.630838 18921 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.631259 18921 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:05.608664 19943 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:05.641223 18921 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:05.626566 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet 20fd9926cbc04b9b9436afef7b0d1f6f from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-20fd9926cbc04b9b9436afef7b0d1f6f
I20260709 12:23:05.655053 18921 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.659153 19945 ts_tablet_manager.cc:933] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:05.662425 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43575.3us
I20260709 12:23:05.673014 18921 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:05.674508 18783 tablet_copy_source_session.cc:215] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:05.677870 19932 tablet_copy_client.cc:806] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:05.682902 19942 raft_consensus.cc:993] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.683375 19932 tablet_copy_client.cc:670] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:05.683485 19942 raft_consensus.cc:1081] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.678340 19943 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.693585 19492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45478
I20260709 12:23:05.694314 19492 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.694828 19492 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.696933 19936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9317d76b36ff4814b60c58870accf4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.701736 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:05.702493 18846 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.706549 19920 raft_consensus.cc:993] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.707185 19920 raft_consensus.cc:1081] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:05.715318 18669 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.721482 18846 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:05.718096 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:05.729449 19920 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.730062 19920 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:05.730999 19920 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:05.744041 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 46061.5us
I20260709 12:23:05.789561 19489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45478
I20260709 12:23:05.796248 19489 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.796763 19489 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.797241 19935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fd9926cbc04b9b9436afef7b0d1f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.798875 19492 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:05.800010 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63827.2us
I20260709 12:23:05.804612 19492 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:05.849086 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:05.849776 18770 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.850073 18770 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:05.858772 18770 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:05.862973 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67191.3us
I20260709 12:23:05.863466 18770 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.868217 19945 tablet_copy_client.cc:323] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:23:05.876053 19932 tablet_copy_client.cc:538] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:05.898321 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:05.899358 18845 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.893493 18770 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:05.913952 18845 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:05.922111 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:05.923188 19940 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.923738 19940 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:05.924633 19940 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:05.925185 19489 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:05.916709 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57286.5us
I20260709 12:23:05.979756 18919 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:05.985453 18772 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:05.995015 19941 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:06.008019 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet b7d5f339cce949e5b5159e03d3d9f348 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:23:06.008351 19941 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:06.008715 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet b7d5f339cce949e5b5159e03d3d9f348 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-b7d5f339cce949e5b5159e03d3d9f348
I20260709 12:23:06.026060 19936 tablet_copy_client.cc:806] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:06.028208 18843 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:06.036000 19489 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:06.037855 19492 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:06.054322 19921 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:06.056337 19921 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:06.056715 19921 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:06.057621 19921 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:06.059026 19921 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.058086 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:06.062983 18844 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.094751 19936 tablet_copy_client.cc:670] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:06.103772 19943 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:23:06.118549 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 122684us
I20260709 12:23:06.144649 19932 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:06.157912 18858 tablet_copy_source_session.cc:215] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:06.165895 18844 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:06.185480 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:06.187518 18921 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:06.200629 19941 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:06.205219 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:06.225773 19946 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:06.226543 19946 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:06.233346 19936 tablet_copy_client.cc:538] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:06.242875 18671 catalog_manager.cc:5697] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.249774 19945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d5f339cce949e5b5159e03d3d9f348. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:06.253834 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70342.5us
W20260709 12:23:06.255635 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 66228us
I20260709 12:23:06.285729 18765 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:06.287209 18767 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:06.249218 19946 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:06.336120 19936 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:06.341903 18667 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:06.351764 19941 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:23:06.358450 19935 tablet_copy_client.cc:806] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:06.387796 19935 tablet_copy_client.cc:670] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:06.426867 18919 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:23:06.494647 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 150772us
I20260709 12:23:06.464124 19946 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:23:06.512372 18845 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:06.513820 19946 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:06.534257 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 184170us
I20260709 12:23:06.562986 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.569535 18916 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.579583 18766 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:06.585387 18668 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.591543 19807 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.602293 18668 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.609035 18668 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.693094 19945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45480 (request call id 196) took 1145 ms. Trace:
I20260709 12:23:06.693801 19945 rpcz_store.cc:276] 0709 12:23:05.547882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.548844 (+   962us) service_pool.cc:224] Handling call
0709 12:23:05.663029 (+114185us) ts_tablet_manager.cc:934] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
0709 12:23:06.239552 (+576523us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:06.548078 (+308526us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:06.548258 (+   180us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:06.692245 (+143987us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:06.692552 (+   307us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:06.692926 (+   374us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:06.692995 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":83114,"tablet-copy.queue_time_us":109690,"thread_start_us":191094,"threads_started":2}
I20260709 12:23:06.734690 19945 tablet_copy_client.cc:806] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
W20260709 12:23:06.735949 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54388.3us
I20260709 12:23:06.747329 18846 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.758612 19940 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:06.769424 19935 tablet_copy_client.cc:538] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:06.791980 19939 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:06.735620 19945 tablet_copy_client.cc:670] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:06.878719 19932 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.085s	user 0.002s	sys 0.001s
I20260709 12:23:06.917343 18845 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:06.931216 19935 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:06.935248 19940 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:06.941608 19936 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:06.943156 19936 tablet_bootstrap.cc:492] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:06.944103 19936 ts_tablet_manager.cc:1403] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.608s	user 0.023s	sys 0.017s
I20260709 12:23:06.972504 19932 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:06.989054 19945 tablet_copy_client.cc:538] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:06.997339 19932 tablet_bootstrap.cc:492] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:06.998505 19932 ts_tablet_manager.cc:1403] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.854s	user 0.071s	sys 0.036s
W20260709 12:23:07.027472 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 213930us
W20260709 12:23:07.061082 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 258214us
W20260709 12:23:07.134284 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52267.6us
I20260709 12:23:07.159698 18771 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:23:07.312402 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 478536us
I20260709 12:23:07.322733 19936 raft_consensus.cc:359] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.323820 19936 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
W20260709 12:23:07.325704 19983 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:23:07.214589 19946 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
W20260709 12:23:07.328590 19982 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:23:07.393510 19932 raft_consensus.cc:359] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.394554 19932 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:07.373838 19936 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.461467 19835 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:07.462564 19835 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.456696 18920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:07.470085 18920 raft_consensus.cc:606] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:07.401050 19932 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.503084 19945 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:07.537358 19835 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:07.561478 19936 ts_tablet_manager.cc:1434] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.617s	user 0.010s	sys 0.005s
I20260709 12:23:07.568943 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:07.596513 19936 ts_tablet_manager.cc:1467] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Tablet startup took 651ms
I20260709 12:23:07.554245 19932 ts_tablet_manager.cc:1434] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.555s	user 0.013s	sys 0.001s
W20260709 12:23:07.601612 19932 ts_tablet_manager.cc:1467] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Tablet startup took 602ms
W20260709 12:23:07.594445 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 197803us
W20260709 12:23:07.602031 19932 ts_tablet_manager.cc:1469] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Trace:
0709 12:23:05.273618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.273991 (+   373us) service_pool.cc:224] Handling call
0709 12:23:05.293827 (+ 19836us) ts_tablet_manager.cc:934] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
0709 12:23:05.300448 (+  6621us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b18002b2460. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ff9d682 00007f335ff550fc 00007f33594e0857
0709 12:23:05.369638 (+ 69190us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:05.431883 (+ 62245us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:05.432033 (+   150us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:05.676693 (+244660us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:05.676980 (+   287us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:05.677318 (+   338us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:05.677470 (+   152us) inbound_call.cc:177] Queueing success response
0709 12:23:06.144216 (+466746us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:23:06.998905 (+854689us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:23:07.084341 (+ 85436us) tablet_replica.cc:261] Starting instrumentation
0709 12:23:07.164239 (+ 79898us) tablet_replica.cc:280] Starting consensus
0709 12:23:07.553033 (+388794us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5400112b70. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357eefbec 00007f335e983623 00007f335ff9fe04 00007f335ff9e48d 00007f335ffcff4e 00007f335ffb4fdd 00007f335ffb4f89 00007f335ffb4f19 00007f335ffb4ee1 00007f335ffb410d
Metrics: {"dns_us":270,"raft.queue_time_us":11765,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"spinlock_wait_cycles":53970944,"tablet-copy.queue_time_us":18971,"tablet-download-pool.queue_time_us":157,"tablet-download-pool.run_cpu_time_us":1363,"tablet-download-pool.run_wall_time_us":187101,"thread_start_us":35192,"threads_started":2}
W20260709 12:23:07.610065 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 209901us
I20260709 12:23:07.629371 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:07.638726 18764 raft_consensus.cc:606] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:07.597016 19936 ts_tablet_manager.cc:1469] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Trace:
0709 12:23:05.361865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.362013 (+   148us) service_pool.cc:224] Handling call
0709 12:23:05.395397 (+ 33384us) ts_tablet_manager.cc:934] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
0709 12:23:05.691852 (+296455us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:05.888036 (+196184us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:05.892301 (+  4265us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:06.025142 (+132841us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:06.025460 (+   318us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:06.025761 (+   301us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:06.025821 (+    60us) inbound_call.cc:177] Queueing success response
0709 12:23:06.335720 (+309899us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:23:06.944537 (+608817us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:23:06.998882 (+ 54345us) tablet_replica.cc:261] Starting instrumentation
0709 12:23:07.068604 (+ 69722us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":336,"raft.queue_time_us":23766,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":8304,"tablet-copy.queue_time_us":32277,"tablet-download-pool.queue_time_us":32185,"tablet-download-pool.run_cpu_time_us":1395,"tablet-download-pool.run_wall_time_us":73115,"thread_start_us":133054,"threads_started":2}
I20260709 12:23:07.637769 19935 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:07.682104 19935 tablet_bootstrap.cc:492] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:07.689864 19935 ts_tablet_manager.cc:1403] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.759s	user 0.034s	sys 0.000s
I20260709 12:23:07.684130 18771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:07.700779 18771 raft_consensus.cc:606] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:07.688117 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:07.684103 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 65824.6us
I20260709 12:23:07.695789 19492 raft_consensus.cc:1217] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:07.697511 19489 raft_consensus.cc:1217] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:07.706029 19935 raft_consensus.cc:359] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.707013 19935 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:07.707821 19935 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.718039 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:07.718899 18919 raft_consensus.cc:606] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:07.720613 19489 raft_consensus.cc:1217] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:07.723459 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-0adcb82468fe454b951282d52761a6c3 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:23:07.723985 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-0adcb82468fe454b951282d52761a6c3 on tablet 0adcb82468fe454b951282d52761a6c3 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:07.725455 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:07.725653 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-9317d76b36ff4814b60c58870accf4ec received from {username='slave'} at 127.0.0.1:45432
I20260709 12:23:07.726197 18919 raft_consensus.cc:606] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:07.726235 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-9317d76b36ff4814b60c58870accf4ec on tablet 9317d76b36ff4814b60c58870accf4ec with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:07.727931 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:07.729957 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.730943 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.732479 19935 ts_tablet_manager.cc:1434] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
I20260709 12:23:07.759068 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-20fd9926cbc04b9b9436afef7b0d1f6f received from {username='slave'} at 127.0.0.1:33308
I20260709 12:23:07.759582 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-20fd9926cbc04b9b9436afef7b0d1f6f on tablet 20fd9926cbc04b9b9436afef7b0d1f6f with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:07.792953 18887 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:07.794212 19835 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:07.813212 19953 raft_consensus.cc:993] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:07.813757 19953 raft_consensus.cc:1081] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:07.819942 18767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33738
I20260709 12:23:07.820689 18767 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:07.821157 18767 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.885953 18767 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:07.903287 19912 raft_consensus.cc:993] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:07.903940 19912 raft_consensus.cc:1081] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
W20260709 12:23:07.907912 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 77410.9us
I20260709 12:23:07.911973 19491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45466
I20260709 12:23:07.912588 19491 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:07.912931 19491 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.901543 19945 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:07.915261 19945 tablet_bootstrap.cc:492] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:07.916106 19945 ts_tablet_manager.cc:1403] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.413s	user 0.024s	sys 0.005s
I20260709 12:23:07.919884 19945 raft_consensus.cc:359] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.921794 19945 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:07.922716 19945 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:07.924952 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:07.925338 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:07.925601 18844 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.925951 18921 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:07.926270 18921 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:07.927119 18921 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:07.928346 18921 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.930279 19945 ts_tablet_manager.cc:1434] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:23:07.938239 18844 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:07.940116 18738 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:07.934259 19491 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:07.942589 20000 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:07.943168 20000 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:07.944105 20000 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:07.945861 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:07.946537 18919 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:07.946861 18919 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:07.947577 18919 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:07.948297 18767 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:07.948552 18919 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.944563 19491 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:07.954607 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-b7d5f339cce949e5b5159e03d3d9f348 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:23:07.955122 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-b7d5f339cce949e5b5159e03d3d9f348 on tablet b7d5f339cce949e5b5159e03d3d9f348 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:07.964252 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:07.964916 18845 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.965090 18921 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:07.976459 18845 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:07.978822 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:07.984118 18919 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:07.985498 20003 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:07.995162 20003 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:07.996134 20003 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:08.056619 20005 raft_consensus.cc:993] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:08.057204 20005 raft_consensus.cc:1081] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:08.066453 18845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:23:08.067147 18845 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:08.067540 18845 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.075635 19955 raft_consensus.cc:993] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:08.079497 19955 raft_consensus.cc:1081] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:08.094357 18770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33738
I20260709 12:23:08.095048 18770 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:08.095435 18770 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.116647 18845 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:08.099303 18669 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.128527 18770 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:08.131793 18845 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:08.136293 18770 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:08.137308 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:08.137959 18921 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:08.138291 18921 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:08.147392 18921 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:08.101312 19911 raft_consensus.cc:1064] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:08.152069 18921 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.153095 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:08.153733 18845 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.167824 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:08.168478 18919 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.180505 20013 raft_consensus.cc:1064] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:08.197999 20000 raft_consensus.cc:1064] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:08.201432 19490 raft_consensus.cc:1217] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:08.201537 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:08.207441 18845 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:08.210193 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:08.213032 19977 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:08.213701 19977 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:08.214072 19978 raft_consensus.cc:993] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:08.223084 19911 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:08.222015 19978 raft_consensus.cc:1081] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:08.228355 19490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45478
I20260709 12:23:08.229123 19490 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:08.229897 19490 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.230329 18921 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:08.230553 18919 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:08.232095 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:08.239192 19977 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:08.234228 20000 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:08.251459 19990 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:08.252905 18772 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:08.253394 18772 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:08.254061 19490 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:08.257087 19490 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:08.262789 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:08.263718 18845 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.265739 19990 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:08.269728 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:08.270473 18764 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:08.270941 18764 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:08.270515 19990 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:08.271787 18764 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:08.273200 18764 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.254181 18772 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:08.267776 18668 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:08.284648 18772 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:08.287202 18845 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:08.293511 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:08.301281 19940 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:08.301842 19940 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:08.302778 19940 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:08.309150 18772 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:08.332087 20013 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:08.348316 18764 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:08.383795 19490 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.383844 18919 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.386627 20005 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:08.387391 18921 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.389372 19490 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.393821 18844 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.394976 19977 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:08.395560 18764 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:08.405210 20020 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 12:23:08.409276 19994 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:23:08.418551 18919 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.408414 20015 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:23:08.434572 18919 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:08.436524 19966 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:08.428512 19908 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:23:08.441843 19990 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:08.431802 20013 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:23:08.452562 19490 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.455485 20015 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:08.512259 18764 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.520810 19949 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:08.535987 18844 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:08.542259 20013 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:08.584566 20004 raft_consensus.cc:1064] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:08.611511 18848 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:08.613025 20004 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:08.647089 19939 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:08.668635 20003 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:08.671540 18916 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:08.705999 18667 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.779143 19939 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:08.814075 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 108745us
I20260709 12:23:08.824231 18919 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:08.858521 18771 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:08.876974 18920 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:08.887706 19492 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:08.937186 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 65514.4us
I20260709 12:23:08.936470 18919 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:08.941421 18916 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:08.954283 20038 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.118s	user 0.006s	sys 0.000s
I20260709 12:23:08.917582 19908 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:08.960208 20037 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 12:23:08.960908 18916 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:08.959647 18668 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:08.988205 19839 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:08.953148 18669 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:08.994097 18669 catalog_manager.cc:5697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.942126 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:08.974105 20039 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 12:23:08.934674 19911 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:23:09.000976 19990 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:09.001531 19911 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:09.004974 19492 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:09.006968 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59845.3us
I20260709 12:23:09.009056 18845 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:09.013862 18772 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:09.017946 19966 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:09.029253 20048 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 12:23:09.040329 18767 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:09.071439 19490 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:09.073283 18846 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:09.092155 18918 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:09.113832 19940 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:09.117220 19492 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:09.127928 18767 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:09.128551 19977 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 12:23:09.173950 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 54800us
I20260709 12:23:09.182420 18918 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:09.154979 18667 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:09.178606 19994 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:23:09.224951 19977 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:23:09.264333 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 120946us
W20260709 12:23:09.279995 20055 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:23:09.293386 20000 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:23:09.365916 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58976.4us
W20260709 12:23:09.392565 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 167959us
I20260709 12:23:09.395403 19492 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:09.572602 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 115378us
W20260709 12:23:09.585172 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 106335us
I20260709 12:23:09.596421 20061 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:09.611738 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 94685.1us
W20260709 12:23:09.619191 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 175109us
W20260709 12:23:09.783378 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 158155us
W20260709 12:23:09.810165 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 146287us
W20260709 12:23:09.898639 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 233828us
W20260709 12:23:09.906489 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75381.8us
I20260709 12:23:09.936820 19987 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:09.938405 19987 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:09.942224 19987 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:09.979594 20046 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:09.986122 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 313936us
I20260709 12:23:09.980942 20046 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:10.005228 20046 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:10.035509 20079 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 12:23:10.257306 20005 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:10.258113 20005 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:10.260526 20005 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:10.271935 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 258885us
I20260709 12:23:10.346040 20067 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.346943 20067 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:10.349764 20067 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:10.367100 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.367956 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.368873 18918 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:10.401906 18916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:10.402755 18916 raft_consensus.cc:606] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:10.407249 18916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:10.409240 18916 raft_consensus.cc:606] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:10.412812 18844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:10.413362 18844 raft_consensus.cc:606] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:10.422530 20002 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:10.423411 20002 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:10.426347 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.428987 20002 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:10.437402 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.450753 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:10.476956 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.488670 18739 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:10.494683 20043 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.497524 19949 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:10.498064 20005 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:10.498438 19949 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.498863 20005 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.501230 20005 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:10.503739 19949 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:10.520722 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:10.517266 19990 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:10.528085 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:10.528307 19990 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.533243 18667 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 105) took 1442 ms. Trace:
I20260709 12:23:10.534948 19990 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:10.548377 19491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.009s
W20260709 12:23:10.548910 19491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.011s	sys 0.009s
I20260709 12:23:10.562469 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.564224 20041 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:10.566642 20041 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.569945 20041 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:10.571051 20092 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:10.571899 20092 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:10.533806 18667 rpcz_store.cc:276] 0709 12:23:09.090928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.091386 (+   458us) service_pool.cc:224] Handling call
0709 12:23:10.533002 (+1441616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:09.206663 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:09.283058 (+ 76395us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:09.287137 (+  4079us) write_op.cc:435] Acquired schema lock
0709 12:23:09.288636 (+  1499us) tablet.cc:662] Decoding operations
0709 12:23:09.316463 (+ 27827us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:09.366273 (+ 49810us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:09.386174 (+ 19901us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:09.413228 (+ 27054us) tablet.cc:701] Row locks acquired
0709 12:23:09.413259 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:23:09.444824 (+ 31565us) write_op.cc:270] Start()
0709 12:23:09.464067 (+ 19243us) write_op.cc:276] Timestamp: P: 1783599789441180 usec, L: 0
0709 12:23:09.472357 (+  8290us) op_driver.cc:348] REPLICATION: starting
0709 12:23:09.632875 (+160518us) log.cc:844] Serialized 591 byte log entry
0709 12:23:10.033823 (+400948us) op_driver.cc:464] REPLICATION: finished
0709 12:23:10.092236 (+ 58413us) write_op.cc:301] APPLY: starting
0709 12:23:10.092428 (+   192us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:10.092624 (+   196us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:10.092791 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:10.093193 (+   402us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:10.093517 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:10.093599 (+    82us) write_op.cc:312] APPLY: finished
0709 12:23:10.094086 (+   487us) log.cc:844] Serialized 23 byte log entry
0709 12:23:10.094340 (+   254us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:10.094564 (+   224us) write_op.cc:454] Released schema lock
0709 12:23:10.094629 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:10.115331 (+ 20702us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:10.115368 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":57827,"apply.run_cpu_time_us":3033,"apply.run_wall_time_us":23085,"num_ops":1,"prepare.queue_time_us":1922,"prepare.run_cpu_time_us":8929,"prepare.run_wall_time_us":462127,"replication_time_us":548784,"thread_start_us":24811,"threads_started":1}]]}
I20260709 12:23:10.574517 20092 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:10.576146 20092 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:10.586087 20092 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.589093 20092 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:10.584908 20004 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.590376 20004 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.575213 18668 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 221) took 1354 ms. Trace:
I20260709 12:23:10.592718 20004 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:10.593803 19978 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:10.594590 19978 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:10.597180 19978 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:10.596653 18671 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.592720 18668 rpcz_store.cc:276] 0709 12:23:09.220726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.220906 (+   180us) service_pool.cc:224] Handling call
0709 12:23:10.574933 (+1354027us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141373,"reported_tablets":1}
I20260709 12:23:10.602352 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.605643 19990 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.606333 19990 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.607074 19986 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.607801 19986 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.608850 19990 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:10.609882 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.611128 19986 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:10.614171 20078 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.614917 20078 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.594015 18669 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 212) took 1433 ms. Trace:
I20260709 12:23:10.616868 18669 rpcz_store.cc:276] 0709 12:23:09.160259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.160470 (+   211us) service_pool.cc:224] Handling call
0709 12:23:10.593810 (+1433340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10020,"reported_tablets":2}
I20260709 12:23:10.589669 20041 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:10.618654 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.621060 20041 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:10.623131 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.623521 20041 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:10.622622 20049 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:10.631593 20078 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:10.613443 19986 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.632572 19986 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:10.634604 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 52950.3us
I20260709 12:23:10.636562 19986 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:10.638464 18769 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:10.640635 18767 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:10.642334 19833 raft_consensus.cc:993] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:10.642891 20067 raft_consensus.cc:1081] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:10.645169 20046 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:10.675856 19953 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.676520 19953 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.680717 19953 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:10.681619 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:10.681769 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.683039 20078 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.683758 20078 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:10.726385 20078 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:10.732293 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.732661 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.733525 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.734198 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.735481 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:10.736088 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:10.735404 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:10.737231 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.742802 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.743193 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:10.746534 18737 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:10.747690 20044 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:10.750732 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.755343 18840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35888
I20260709 12:23:10.759163 18840 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:10.759600 18840 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.762838 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.764176 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.762862 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.768041 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.769145 19833 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.770767 20067 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:10.771436 20067 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.769784 19833 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.776654 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.736842 19486 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:10.786952 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.788477 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.790320 20067 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:10.790916 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:10.792547 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.793998 19833 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:10.792616 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.798733 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.748323 20044 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.806007 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.793537 18913 raft_consensus.cc:2955] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:10.823732 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:10.824826 20004 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:10.799135 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.760896 19485 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:10.821506 20067 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.841255 19986 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.853777 18768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:10.858078 18768 raft_consensus.cc:606] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:10.853314 20002 raft_consensus.cc:993] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:10.856681 20044 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:10.860847 20002 raft_consensus.cc:1081] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:10.846063 18840 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.870131 18812 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:10.878649 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:10.885944 18920 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:10.891232 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 75291.2us
W20260709 12:23:10.893205 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 79863.3us
I20260709 12:23:10.903124 20046 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.869346 18840 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:10.918782 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44619.8us
I20260709 12:23:10.924388 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:10.925058 18918 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:10.925359 18918 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:10.926244 18918 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:10.927976 18918 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.913040 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:10.906167 19949 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:10.933256 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54743.9us
I20260709 12:23:10.934206 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:10.936683 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:10.938127 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:10.945024 19908 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.912329 20004 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.935316 18739 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:10.953717 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:10.933043 20005 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.954937 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:10.957888 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.962555 20103 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:10.965376 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:10.948909 19990 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.967674 19939 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.969154 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.971724 20070 raft_consensus.cc:993] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:10.972452 20070 raft_consensus.cc:1081] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:10.972965 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.975106 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.979493 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.986557 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:10.988778 18739 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:10.991971 19949 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.956243 20041 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.998831 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:10.999635 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:11.010922 18915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:11.011679 18915 raft_consensus.cc:606] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:11.014761 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:11.016973 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:11.021660 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:11.023476 18765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33742
I20260709 12:23:11.024103 18765 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.024466 18765 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.989382 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:11.027928 20100 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.018203 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:11.033020 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:10.962008 19978 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.033795 18767 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.038115 18918 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:11.033893 20049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33726 (request call id 74) took 1933 ms. Trace:
I20260709 12:23:11.038702 18765 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.045722 18768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33738
I20260709 12:23:11.059075 18768 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.048678 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:11.061964 20061 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.063993 18765 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:11.059623 18768 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.052860 18767 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:11.073740 18772 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:11.085103 18702 debug-util.cc:398] Leaking SignalData structure 0x7b080028c920 after lost signal to thread 17571
W20260709 12:23:11.086745 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb820 after lost signal to thread 18705
W20260709 12:23:11.088649 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3660 after lost signal to thread 18797
W20260709 12:23:11.090346 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08002985a0 after lost signal to thread 18872
I20260709 12:23:11.072041 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:11.094287 19989 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.098453 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:11.058151 20049 rpcz_store.cc:276] 0709 12:23:09.037645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.037837 (+   192us) service_pool.cc:224] Handling call
0709 12:23:09.044644 (+  6807us) log.cc:844] Serialized 487 byte log entry
0709 12:23:09.172905 (+128261us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b180007f420. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:23:10.959660 (+1786755us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17932,"raft.queue_time_us":212,"raft.run_cpu_time_us":1439,"raft.run_wall_time_us":5909,"spinlock_wait_cycles":21305472}
I20260709 12:23:11.102438 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:11.111440 18702 debug-util.cc:398] Leaking SignalData structure 0x7b080033f340 after lost signal to thread 18946
I20260709 12:23:11.114610 18920 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.115350 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:11.117369 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3f40 after lost signal to thread 19516
W20260709 12:23:11.118664 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800308880 after lost signal to thread 20023
W20260709 12:23:11.119598 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb340 after lost signal to thread 20054
I20260709 12:23:11.119700 18886 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:11.122004 19948 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.117986 20078 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:11.124091 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:11.124428 19958 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.124764 18847 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.125154 18847 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:11.126840 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20fd9926cbc04b9b9436afef7b0d1f6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:11.136624 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:11.138787 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:11.125968 18847 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.146236 18847 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.152494 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:11.155814 18847 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:11.158711 19989 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:11.160255 19989 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.174901 18920 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:11.150816 20067 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.165519 19948 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.155362 19958 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.207564 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:11.208632 20111 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.212024 20100 raft_consensus.cc:993] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:11.212601 20100 raft_consensus.cc:1081] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
W20260709 12:23:11.214809 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 95764us
I20260709 12:23:11.215503 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:11.228148 20104 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.228708 20104 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:11.229666 20104 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.346712 18844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:23:11.347605 18844 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.348044 18844 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:11.358640 19948 raft_consensus.cc:993] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
W20260709 12:23:11.361012 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 128122us
I20260709 12:23:11.380865 18768 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.382279 20078 raft_consensus.cc:1081] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:11.396181 18841 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:11.456669 18844 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.487890 18844 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:11.490213 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 109808us
W20260709 12:23:11.498445 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 136607us
I20260709 12:23:11.505815 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:11.508805 18769 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:11.509272 18769 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:11.524679 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:11.525490 18919 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.525827 18919 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:11.526788 18919 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.528016 18768 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:11.528064 18919 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.540081 18765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33738
I20260709 12:23:11.540208 18845 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:11.540968 18765 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.541455 18765 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.563557 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:11.564507 18847 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.573553 18841 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:11.561044 18667 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:11.572229 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.576542 18765 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:11.585871 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.510238 18769 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.591964 18847 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:11.590360 18772 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:11.579924 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:11.581027 18667 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:11.615599 20103 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:11.614254 18919 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:11.617476 19486 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:11.628625 19485 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:11.629973 18765 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:11.643008 18766 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:11.644405 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:11.645144 19488 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:11.654323 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46790.3us
I20260709 12:23:11.655931 20118 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:23:11.658751 19990 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:11.661587 18769 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:11.631085 18913 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:11.670944 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:11.688657 20104 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.689584 20104 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:11.693970 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:11.694696 18919 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.695012 18919 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:11.700948 20119 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:23:11.709640 18765 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:11.710593 18764 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:11.712055 19488 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:11.747347 19990 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:23:11.747539 20109 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:23:11.756902 20104 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.747874 18913 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:11.773188 18919 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:11.775367 18919 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.780303 18771 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.784518 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:11.791599 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:11.794337 19989 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:11.797500 20114 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:11.798115 20114 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:11.802199 18915 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.799183 20114 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:11.806519 20005 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.807442 20005 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:11.814924 18919 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:11.809006 20005 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:11.866091 19487 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:11.870664 18847 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:11.860297 20117 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:23:11.878041 20101 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:23:11.854596 19908 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:23:11.880553 20108 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:11.877269 18769 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:11.940382 18765 raft_consensus.cc:2955] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:11.956189 20002 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:11.964919 18915 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.978163 20113 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:23:11.981886 19485 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:12.005589 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0adcb82468fe454b951282d52761a6c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:12.006855 18771 raft_consensus.cc:2955] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:12.111469 18671 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.153591 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet 20fd9926cbc04b9b9436afef7b0d1f6f with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:23:12.186321 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9317d76b36ff4814b60c58870accf4ec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:12.211297 18841 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:12.211339 18668 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:23:12.219905 18669 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:12.221793 18669 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:12.232635 20141 tablet_replica.cc:333] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:23:12.238889 20141 raft_consensus.cc:2243] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:12.239827 20141 pending_rounds.cc:70] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: Trying to abort 1 pending ops.
I20260709 12:23:12.240231 20141 pending_rounds.cc:77] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305624732596649984 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } } }
I20260709 12:23:12.241864 20141 raft_consensus.cc:2917] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:23:12.242461 20141 raft_consensus.cc:2889] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:23:12.242974 20141 raft_consensus.cc:2272] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.247057 20141 ts_tablet_manager.cc:1916] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:12.255093 18671 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.257629 18671 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.274312 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet 9317d76b36ff4814b60c58870accf4ec with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
I20260709 12:23:12.274636 19487 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:12.275704 18906 tablet_service.cc:1558] Processing DeleteTablet for tablet 0adcb82468fe454b951282d52761a6c3 with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
I20260709 12:23:12.276400 20101 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:12.290831 18915 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:12.292027 19487 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:12.292423 19990 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:12.293236 20141 ts_tablet_manager.cc:1929] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:12.293833 20141 log.cc:1199] T 20fd9926cbc04b9b9436afef7b0d1f6f P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/20fd9926cbc04b9b9436afef7b0d1f6f
I20260709 12:23:12.295405 19990 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:12.298321 18915 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:12.300007 20108 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:12.308990 18913 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:12.311090 20103 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:12.312031 18921 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.318490 20144 tablet_replica.cc:333] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:23:12.319674 20144 raft_consensus.cc:2243] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:12.320444 20144 raft_consensus.cc:2272] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.323568 20144 ts_tablet_manager.cc:1916] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:12.324263 20103 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.343802 18841 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.367806 20103 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:12.368551 20144 ts_tablet_manager.cc:1929] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:12.369150 20144 log.cc:1199] T 9317d76b36ff4814b60c58870accf4ec P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/9317d76b36ff4814b60c58870accf4ec
I20260709 12:23:12.371610 20144 tablet_replica.cc:333] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:23:12.371603 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet 9317d76b36ff4814b60c58870accf4ec (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:12.374958 20144 raft_consensus.cc:2243] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:12.376398 20144 raft_consensus.cc:2272] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.382576 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet 20fd9926cbc04b9b9436afef7b0d1f6f (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:12.460738 18771 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:12.473143 20144 ts_tablet_manager.cc:1916] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:12.486812 19989 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 12:23:12.529323 20150 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:23:12.535759 20108 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:12.601894 20129 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.063s	user 0.004s	sys 0.000s
I20260709 12:23:12.607982 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7d5f339cce949e5b5159e03d3d9f348 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:12.643404 18667 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 2 to 3, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:23:12.656622 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 109192us
I20260709 12:23:12.679584 18921 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:12.699833 19488 raft_consensus.cc:2955] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:12.702802 20144 ts_tablet_manager.cc:1929] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:12.703334 20144 log.cc:1199] T 0adcb82468fe454b951282d52761a6c3 P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/0adcb82468fe454b951282d52761a6c3
I20260709 12:23:12.711182 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet 0adcb82468fe454b951282d52761a6c3 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
W20260709 12:23:12.731043 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 65432.3us
I20260709 12:23:12.758641 18667 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:12.807760 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet b7d5f339cce949e5b5159e03d3d9f348 with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33726
I20260709 12:23:12.809960 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:12.880580 20161 tablet_replica.cc:333] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:23:12.895349 20161 raft_consensus.cc:2243] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:12.904958 20161 raft_consensus.cc:2272] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.918805 20161 ts_tablet_manager.cc:1916] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:12.972934 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:12.973712 18769 raft_consensus.cc:606] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:13.042733 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c18545306c9477ba3e214f788705644"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:13.047663 18769 raft_consensus.cc:606] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:13.057226 18845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:13.057806 18845 raft_consensus.cc:606] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:13.065982 18914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:13.066813 18914 raft_consensus.cc:606] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:13.070626 18845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:13.071228 18845 raft_consensus.cc:606] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:13.074968 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:13.076475 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:13.077205 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:13.091706 20161 ts_tablet_manager.cc:1929] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:13.092260 20161 log.cc:1199] T b7d5f339cce949e5b5159e03d3d9f348 P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/b7d5f339cce949e5b5159e03d3d9f348
I20260709 12:23:13.094549 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet b7d5f339cce949e5b5159e03d3d9f348 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:13.155388 20153 raft_consensus.cc:993] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:13.156040 20153 raft_consensus.cc:1081] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:13.161839 18845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c18545306c9477ba3e214f788705644"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:23:13.162580 18845 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.163076 18845 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.180572 18845 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.186573 18845 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:13.186805 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:13.187592 18914 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.191581 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:13.192312 18765 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.192713 18765 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:13.193614 18765 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.196738 18914 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:13.198343 18765 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.198773 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:13.199784 20155 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.201139 20155 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:13.202203 20155 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.204710 20067 raft_consensus.cc:993] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:13.205281 20067 raft_consensus.cc:1081] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:13.225638 18845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35888
I20260709 12:23:13.226370 18845 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.226890 18845 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.241407 18668 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.234843 18845 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.250065 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:13.250787 18914 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.251134 18914 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:13.252012 18914 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.253995 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:13.254700 18769 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.255779 18914 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.254679 18845 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:13.269244 18769 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:13.265331 18765 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:13.273255 18914 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:13.275856 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:13.282857 20002 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.284035 20002 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:13.285027 20002 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.344940 20153 raft_consensus.cc:993] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:13.345692 20153 raft_consensus.cc:1081] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:13.349077 19486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45478
I20260709 12:23:13.349884 19486 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.350508 19486 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.364878 19486 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:13.381311 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:13.382050 18914 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.387475 19486 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:13.388751 18668 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.423012 20158 raft_consensus.cc:993] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:13.423542 20158 raft_consensus.cc:1081] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:13.424845 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:13.425486 18765 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.426129 20004 raft_consensus.cc:993] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:13.426667 20004 raft_consensus.cc:1081] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:13.422045 18914 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:13.425776 18765 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:13.428529 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:13.428642 18765 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:13.429558 20093 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.430085 20093 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:13.430186 18765 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.431401 19486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45480
I20260709 12:23:13.431121 20093 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:13.432090 19486 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.432554 19486 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.448945 18769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33742
I20260709 12:23:13.449747 18769 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.450181 18769 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.456772 18668 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.462543 19486 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:13.464442 18765 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:13.458141 18769 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.467501 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:13.468178 18845 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.468495 18845 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:13.468770 18769 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:13.469367 18845 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:13.476279 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:13.476693 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:13.477062 18844 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:13.477476 18844 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:13.478340 18844 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.479388 18845 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.479758 18844 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.478065 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:13.481416 18914 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:13.486642 18765 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.488140 18844 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:13.489456 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:13.490281 20153 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:13.490775 20153 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:13.491528 20153 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:13.499608 18765 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:13.501053 19486 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:13.502763 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:13.504549 20162 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.506759 18845 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:13.513058 18668 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 3, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.514066 18914 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:13.515789 20162 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:13.519872 20162 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:13.547194 18668 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.679380 18765 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.681326 20004 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:13.751950 18915 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.753827 20002 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.834685 18914 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.845587 20004 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:13.869545 18766 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.873845 20158 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:13.884557 18765 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:13.887746 20169 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:13.889868 18845 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:13.895026 20153 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.932174 18766 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:13.932534 18914 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:13.934372 20103 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:13.941510 20162 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:13.943943 18915 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:14.083264 18765 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:14.115656 20184 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.124212 18845 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:14.131196 18844 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:14.135465 20169 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:14.145346 18886 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38d69daa256f430796196f10dfcaad2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.195544 20194 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.211732 18769 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.243532 20194 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.247391 18844 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:14.248481 18913 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:14.256654 20093 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:14.298457 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51978.1us
I20260709 12:23:14.312906 18667 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:23:14.357203 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb6c5143fb3041fbbbae7d5f3d73f3c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.357517 18769 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:14.359572 20189 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.369607 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.414913 20158 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.419588 18769 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.448675 18845 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.479416 18913 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:14.484037 20198 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 12:23:14.504027 18915 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:14.513751 20189 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.556838 18913 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.572258 20206 ts_tablet_manager.cc:933] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:14.565606 18668 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.598526 20206 tablet_copy_client.cc:323] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:23:14.601418 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet 38d69daa256f430796196f10dfcaad2f from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:23:14.602021 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet 38d69daa256f430796196f10dfcaad2f from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-38d69daa256f430796196f10dfcaad2f
I20260709 12:23:14.634451 18932 tablet_copy_source_session.cc:215] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:14.639452 20206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d69daa256f430796196f10dfcaad2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:14.641525 18886 consensus_peers.cc:597] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fc1e9b0ef764c7a9e9a1470da4ccd66. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.645100 18766 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:14.645519 18846 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:14.648835 20184 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:23:14.654093 20166 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.668432 18845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:14.669131 18845 raft_consensus.cc:606] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:14.682823 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:14.683499 18766 raft_consensus.cc:606] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:14.691769 18915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91bf73a138f349e787495351ffd803b7"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:14.692505 18915 raft_consensus.cc:606] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:14.696187 18845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:14.696852 18845 raft_consensus.cc:606] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:14.697393 20166 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.699438 18769 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.703202 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:14.705140 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:14.706041 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.729640 18668 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.718706 20206 tablet_copy_client.cc:806] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:14.757687 20206 tablet_copy_client.cc:670] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:14.764200 20206 tablet_copy_client.cc:538] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:14.777966 18766 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:14.785738 20210 ts_tablet_manager.cc:933] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:14.791608 20206 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:14.792228 18847 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:14.827034 20210 tablet_copy_client.cc:323] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:23:14.832994 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:23:14.833590 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-cb6c5143fb3041fbbbae7d5f3d73f3c4
I20260709 12:23:14.846240 18858 tablet_copy_source_session.cc:215] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:23:14.849332 18737 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3bac759d8cf2478e874f15f02c6c54fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.860401 20206 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:14.861868 20206 tablet_bootstrap.cc:492] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:14.862792 20206 ts_tablet_manager.cc:1403] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.007s
I20260709 12:23:14.863874 18913 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:14.866384 20206 raft_consensus.cc:359] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:14.867558 20206 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:14.868590 20206 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:14.870217 20193 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:14.872251 20206 ts_tablet_manager.cc:1434] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:23:14.875342 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-38d69daa256f430796196f10dfcaad2f received from {username='slave'} at 127.0.0.1:57874
I20260709 12:23:14.875905 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-38d69daa256f430796196f10dfcaad2f on tablet 38d69daa256f430796196f10dfcaad2f with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:14.881635 20210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:14.889978 20004 raft_consensus.cc:993] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:14.890568 20004 raft_consensus.cc:1081] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:14.898927 18915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54084
I20260709 12:23:14.899593 18915 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.900044 18915 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.913395 20210 tablet_copy_client.cc:806] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:14.914753 18847 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:14.916478 20210 tablet_copy_client.cc:670] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:14.937620 19486 raft_consensus.cc:1217] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:14.948025 20153 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:23:14.980995 20158 raft_consensus.cc:993] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:14.981729 20158 raft_consensus.cc:1081] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:14.988430 18915 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:14.990801 20101 raft_consensus.cc:993] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:15.011123 20153 raft_consensus.cc:1081] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:15.007330 18765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33742
I20260709 12:23:15.012054 18765 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.012594 18765 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.999711 20210 tablet_copy_client.cc:538] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:15.020877 18915 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:15.024677 18765 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.026693 18765 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:15.039145 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:15.039974 19488 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.045617 18915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54070
I20260709 12:23:15.046325 18915 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.048168 18915 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.028463 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:15.050313 19486 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.060606 18915 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.065445 18915 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:15.066097 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:15.066893 18765 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:15.067229 18765 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:15.068065 18765 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.071040 18765 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.077715 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:15.078706 19485 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:15.084288 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52100.8us
I20260709 12:23:15.096761 18765 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
W20260709 12:23:15.097289 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 64816us
I20260709 12:23:15.098564 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:15.099080 20214 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:23:15.104728 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:15.107262 18847 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:15.107633 18847 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:15.108835 20194 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.108711 18847 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.109409 20194 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:15.109757 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:15.110132 18847 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.110427 18845 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:15.110809 18845 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:15.111536 18845 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.112411 19486 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:15.112677 18845 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.113181 19487 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:15.112514 20194 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.119837 20193 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:15.121462 19488 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:15.122884 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:15.123854 20101 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.124377 20101 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:15.125152 20101 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.130573 20210 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:15.131206 18920 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:15.133553 18845 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:15.141175 20192 raft_consensus.cc:993] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:15.142014 20192 raft_consensus.cc:1081] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:15.142380 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:15.143474 20192 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.144248 20192 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:15.148612 19485 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:15.145246 20192 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.148191 18845 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:15.151104 18847 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:15.160260 18667 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 2 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.164811 18847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91bf73a138f349e787495351ffd803b7"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35888
I20260709 12:23:15.165565 18847 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.165990 18847 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.172384 20206 ts_tablet_manager.cc:933] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:15.191677 20206 tablet_copy_client.cc:323] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:23:15.196260 18668 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:15.201062 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:23:15.201701 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-6fc1e9b0ef764c7a9e9a1470da4ccd66
I20260709 12:23:15.224386 18847 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.225063 18932 tablet_copy_source_session.cc:215] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:15.229207 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:15.229943 19485 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.231348 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:15.231985 18915 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:15.232295 18915 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:15.233238 18915 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.234463 18915 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:15.234534 20206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:15.227212 18671 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.238823 18847 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:15.258298 18915 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:15.261073 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:15.262048 20216 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:15.262657 20216 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:15.263640 20216 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.238302 19485 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:15.288465 18667 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 2 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.296054 20206 tablet_copy_client.cc:806] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:15.296888 20206 tablet_copy_client.cc:670] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:15.311734 20206 tablet_copy_client.cc:538] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:15.322057 18671 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.323210 20206 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:15.345399 20210 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.346727 20210 tablet_bootstrap.cc:492] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:15.347711 20210 ts_tablet_manager.cc:1403] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.217s	user 0.023s	sys 0.009s
I20260709 12:23:15.372992 20224 ts_tablet_manager.cc:933] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:15.372478 20210 raft_consensus.cc:359] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:15.386237 20210 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:15.406025 20224 tablet_copy_client.cc:323] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:23:15.405834 20210 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:15.408696 20192 raft_consensus.cc:1064] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:15.408782 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet 3bac759d8cf2478e874f15f02c6c54fb from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:23:15.409610 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet 3bac759d8cf2478e874f15f02c6c54fb from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-3bac759d8cf2478e874f15f02c6c54fb
I20260709 12:23:15.412395 20192 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.415840 20210 ts_tablet_manager.cc:1434] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.005s
I20260709 12:23:15.423167 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-cb6c5143fb3041fbbbae7d5f3d73f3c4 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:23:15.423768 18783 tablet_copy_source_session.cc:215] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:15.423893 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-cb6c5143fb3041fbbbae7d5f3d73f3c4 on tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:15.436985 20224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bac759d8cf2478e874f15f02c6c54fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:15.447610 20206 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.449369 20206 tablet_bootstrap.cc:492] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:15.451828 20206 ts_tablet_manager.cc:1403] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.129s	user 0.020s	sys 0.007s
I20260709 12:23:15.459437 18846 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:15.459944 19485 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:15.461006 18766 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:15.463192 20194 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:15.465461 20194 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:15.455071 20206 raft_consensus.cc:359] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:15.466953 20206 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:15.467908 20206 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:15.470193 20184 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:15.474555 20206 ts_tablet_manager.cc:1434] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:23:15.476599 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-6fc1e9b0ef764c7a9e9a1470da4ccd66 received from {username='slave'} at 127.0.0.1:57874
I20260709 12:23:15.477068 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-6fc1e9b0ef764c7a9e9a1470da4ccd66 on tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:15.498324 20224 tablet_copy_client.cc:806] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:15.499069 20224 tablet_copy_client.cc:670] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:15.521323 20192 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:15.528679 19486 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:15.533281 20224 tablet_copy_client.cc:538] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:15.553161 20224 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:15.553470 18847 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:15.562448 18671 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:15.603932 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 47519.4us
I20260709 12:23:15.632061 20224 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:15.637104 20224 tablet_bootstrap.cc:492] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:15.637952 20224 ts_tablet_manager.cc:1403] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.009s
I20260709 12:23:15.653913 20224 raft_consensus.cc:359] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:15.655018 20224 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:15.655827 20224 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:15.662699 20224 ts_tablet_manager.cc:1434] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.002s
I20260709 12:23:15.673864 18913 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:15.678237 19486 raft_consensus.cc:1217] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:15.703644 19486 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:23:15.714241 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 73872.9us
W20260709 12:23:15.714294 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74640.5us
I20260709 12:23:15.735707 19488 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:15.742352 20230 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:15.741888 20194 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:15.751873 18769 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:15.759447 19485 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:15.762223 20103 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:15.753882 18766 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:15.780196 19492 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:23:15.781944 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57554.9us
I20260709 12:23:15.782909 18845 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:15.788146 18765 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:15.788710 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-3bac759d8cf2478e874f15f02c6c54fb received from {username='slave'} at 127.0.0.1:33308
I20260709 12:23:15.789283 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-3bac759d8cf2478e874f15f02c6c54fb on tablet 3bac759d8cf2478e874f15f02c6c54fb with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:15.790199 20230 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:15.791085 19487 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:23:15.791245 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51875.6us
I20260709 12:23:15.795395 20004 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:15.794854 20194 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:23:15.806602 18847 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:15.807053 19491 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:15.808332 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:15.814808 20188 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:15.824836 20194 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:15.799256 19487 raft_consensus.cc:1217] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:15.832118 20101 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:15.862464 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 38d69daa256f430796196f10dfcaad2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:15.870940 18920 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:15.882813 20004 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:15.893635 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69606us
I20260709 12:23:15.904701 18671 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:15.909612 20188 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:15.951236 19492 raft_consensus.cc:1217] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:15.961140 18766 raft_consensus.cc:2955] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:15.968669 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet 38d69daa256f430796196f10dfcaad2f with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35874
I20260709 12:23:16.058748 20245 tablet_replica.cc:333] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:23:16.099242 20245 raft_consensus.cc:2243] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:16.120905 20245 raft_consensus.cc:2272] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:16.149555 20245 ts_tablet_manager.cc:1916] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:16.213493 20194 raft_consensus.cc:1064] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:16.233762 20194 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:16.254535 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 51994.9us
I20260709 12:23:16.381399 20245 ts_tablet_manager.cc:1929] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:16.390703 19490 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.392459 18766 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.423928 18846 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.449739 20245 log.cc:1199] T 38d69daa256f430796196f10dfcaad2f P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/38d69daa256f430796196f10dfcaad2f
I20260709 12:23:16.454118 20192 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:16.460992 20188 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.462630 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet 38d69daa256f430796196f10dfcaad2f (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:16.537403 20194 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:16.561470 20184 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.564711 18766 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.569811 20101 raft_consensus.cc:1064] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:16.579844 20158 raft_consensus.cc:1064] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:16.575132 20101 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:16.594323 20158 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:16.612640 18765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:16.613363 18765 raft_consensus.cc:606] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:16.614252 19492 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.620599 18846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:16.621407 18846 raft_consensus.cc:606] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:16.624516 18671 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.630805 18913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:16.631585 18913 raft_consensus.cc:606] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:16.633697 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:16.635583 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:16.636586 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.655438 20188 raft_consensus.cc:993] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:16.656261 20188 raft_consensus.cc:1081] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:16.684152 18913 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.686633 20189 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.718010 20254 raft_consensus.cc:993] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:16.718593 20254 raft_consensus.cc:1081] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
W20260709 12:23:16.775971 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46220.8us
I20260709 12:23:16.779439 19492 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:16.781193 20183 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.782347 18915 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:16.785063 20153 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:16.786875 18846 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:16.797274 20101 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:16.832257 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55574.5us
I20260709 12:23:16.837548 20153 raft_consensus.cc:993] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:16.838138 20153 raft_consensus.cc:1081] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:16.840878 18846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:23:16.841563 18846 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:16.841984 18846 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.847470 20153 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.854074 19492 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.860735 19490 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.861651 18913 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.874295 18766 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:16.874761 18846 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:16.876962 18915 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:16.880810 18766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33742
I20260709 12:23:16.881513 18766 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:16.881942 18766 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:16.885622 19486 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:16.891167 18766 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:16.890271 20192 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:23:16.893311 18766 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:16.895278 18765 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:16.896788 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:16.899088 18846 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:16.902868 20230 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.905747 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:16.968861 18917 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.911954 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:16.913707 20254 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:16.969636 18845 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:16.970001 18845 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:16.930913 18847 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.970878 18845 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:16.972084 18845 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:16.974819 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:16.975515 18769 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:16.975836 18769 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:16.976576 18769 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:16.977695 18769 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.981362 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:16.979472 18917 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:16.985971 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:16.987318 20216 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:16.991163 20216 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:16.992133 20216 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:16.936933 18667 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.939226 19486 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.943430 18841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35888
I20260709 12:23:16.947342 18843 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:16.994850 18841 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:16.995337 18841 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:16.967660 18920 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:17.006224 18920 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:17.021448 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:17.024653 20193 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:17.025278 20193 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:17.026649 20193 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:17.032296 18845 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:17.037587 18841 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:17.052173 18842 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.060638 20004 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:17.078719 18766 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:17.080781 18769 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:17.084537 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:17.084396 18841 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:17.085275 18920 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:17.085667 18920 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:17.086488 18920 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:17.087597 18920 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:17.086833 19485 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:17.090271 20101 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:17.093044 18668 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 3, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.095356 18669 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 1 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.100736 18920 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:17.109917 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:17.111758 18917 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:17.115551 20193 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:17.117653 20254 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:17.116799 20101 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.120882 19485 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.134763 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33726
I20260709 12:23:17.148494 18917 raft_consensus.cc:2955] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.155990 20254 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:17.157101 20254 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:17.153383 18668 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 4, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 4 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.184773 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:17.185642 18769 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:17.197721 18769 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:17.211602 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3bac759d8cf2478e874f15f02c6c54fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.217062 18668 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 4 to 5, VOTER 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) evicted. New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.218988 20194 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:23:17.243496 20269 tablet_replica.cc:333] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:23:17.267818 20269 raft_consensus.cc:2243] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.268877 20269 raft_consensus.cc:2272] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:17.288820 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75794.1us
W20260709 12:23:17.296464 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 75443.4us
W20260709 12:23:17.301330 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 74057.8us
I20260709 12:23:17.325106 20269 ts_tablet_manager.cc:1916] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.326360 18829 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bac759d8cf2478e874f15f02c6c54fb with delete_type TABLET_DATA_TOMBSTONED (TS 47b48b5c69f245b79ecb292eff89927f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35874
I20260709 12:23:17.327557 18671 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.356001 18845 raft_consensus.cc:2955] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.368822 20216 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.388015 18766 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.392465 18917 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.402060 20280 tablet_replica.cc:333] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:23:17.403265 20280 raft_consensus.cc:2243] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.404083 20280 raft_consensus.cc:2272] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.412178 18669 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.415067 19486 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.435242 20280 ts_tablet_manager.cc:1916] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:23:17.438905 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 46215us
I20260709 12:23:17.443362 18920 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:17.463060 20158 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.483353 18843 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:17.486465 20101 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.506857 18765 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:17.511358 20279 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:23:17.522171 20269 ts_tablet_manager.cc:1929] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:17.525235 20269 log.cc:1199] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/6fc1e9b0ef764c7a9e9a1470da4ccd66
I20260709 12:23:17.527483 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet 6fc1e9b0ef764c7a9e9a1470da4ccd66 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:17.572862 18843 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:17.588384 18920 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:17.593827 19485 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.597430 18766 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.601282 20193 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.609340 20279 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:17.612402 20277 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:17.688306 20280 ts_tablet_manager.cc:1929] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:23:17.688946 20280 log.cc:1199] T 3bac759d8cf2478e874f15f02c6c54fb P 47b48b5c69f245b79ecb292eff89927f: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/wals/3bac759d8cf2478e874f15f02c6c54fb
I20260709 12:23:17.694468 18915 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.703164 18766 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:17.714478 18766 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.737845 18657 catalog_manager.cc:5028] TS 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): tablet 3bac759d8cf2478e874f15f02c6c54fb (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:17.739675 20189 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:23:17.692540 20158 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.787787 18669 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 1 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.796815 20216 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
W20260709 12:23:17.859365 20267 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:23:17.874958 18657 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.922111 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54066
W20260709 12:23:17.967350 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 226997us
I20260709 12:23:17.986034 20302 tablet_replica.cc:333] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:23:17.987350 20302 raft_consensus.cc:2243] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.986786 19485 raft_consensus.cc:2955] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:17.988219 20302 raft_consensus.cc:2272] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:17.990020 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 237991us
I20260709 12:23:18.019537 20302 ts_tablet_manager.cc:1916] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:23:18.111523 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58493.9us
I20260709 12:23:18.127924 20302 ts_tablet_manager.cc:1929] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:18.129093 20302 log.cc:1199] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/cb6c5143fb3041fbbbae7d5f3d73f3c4
I20260709 12:23:18.131377 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet cb6c5143fb3041fbbbae7d5f3d73f3c4 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:23:18.409865 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.474529 18843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:18.475278 18843 raft_consensus.cc:606] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:18.485301 18920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:18.486143 18920 raft_consensus.cc:606] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:18.494004 18765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:18.494814 18765 raft_consensus.cc:606] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:18.498126 18843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c18545306c9477ba3e214f788705644"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:18.498879 18843 raft_consensus.cc:606] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:18.500003 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:18.501276 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:18.501951 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.632881 20305 raft_consensus.cc:993] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:18.633486 20305 raft_consensus.cc:1081] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:18.636292 18913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54070
I20260709 12:23:18.636969 18913 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.637367 18913 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.645344 18913 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:18.647341 18913 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:18.648605 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:18.648568 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:18.649432 18769 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:18.649571 19485 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.649791 18769 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:18.650848 18769 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:18.651906 18769 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.660887 18769 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:18.661650 19485 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:18.662851 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:18.663712 20281 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:18.664284 20281 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:18.666635 20281 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:18.696285 18669 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 2 to 3, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 3 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.710000 20300 raft_consensus.cc:993] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:18.710644 20300 raft_consensus.cc:1081] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Signalling peer 43b520eabb65493abe84f4cf06806cba to start an election
I20260709 12:23:18.713276 19490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:45480
I20260709 12:23:18.713858 19490 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.714247 19490 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.725613 19490 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:18.728444 19490 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:18.729079 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:18.729600 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:18.729821 18769 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.730181 18845 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.730538 18845 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:18.731211 18845 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:18.732074 18845 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.738131 18845 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:18.738231 18769 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:18.739794 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:18.740873 20232 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.741436 20232 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:18.742540 20232 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:18.757454 18669 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.864748 20296 raft_consensus.cc:993] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:18.865300 20300 raft_consensus.cc:1081] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:18.867137 18771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c18545306c9477ba3e214f788705644"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33742
I20260709 12:23:18.867684 18771 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.868007 18771 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.874225 18771 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:18.875984 18771 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:18.876905 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:18.877324 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:18.877651 18845 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:18.877898 18920 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.878011 18845 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:18.878890 18845 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:18.880085 18845 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.887156 18920 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:18.888860 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:18.889654 18845 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:18.889664 20153 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:18.891644 20153 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:18.892447 20153 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:18.923286 18669 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 3, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.938514 20188 raft_consensus.cc:993] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:18.939075 20281 raft_consensus.cc:1081] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:23:18.940860 18843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35888
I20260709 12:23:18.941689 18843 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.942420 18843 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.952028 18843 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:18.955224 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:18.955899 18769 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.954656 18843 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:18.956218 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:18.956874 18920 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.957144 18920 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:18.957903 18920 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:18.960871 18920 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.964071 18769 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:18.965395 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:18.967530 20296 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.977480 18920 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:18.979434 20296 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:18.980563 20296 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:19.007030 18669 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.072957 18769 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:19.074760 20188 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:19.111694 19490 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:19.116658 20283 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:19.119213 18843 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:19.143158 18920 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:19.145005 20312 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.145910 18771 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:23:19.145006 18812 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf32cd3655eb4943abc0cdbf54a32206. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.149180 20276 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.172984 20276 raft_consensus.cc:2955] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.192164 18771 raft_consensus.cc:2955] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.207568 18920 raft_consensus.cc:2955] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.215755 18667 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.246057 18771 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:23:19.264892 18737 consensus_peers.cc:597] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1485e54f9795416785f4baf244599201. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.269114 18913 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:19.271502 20305 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:19.273038 18845 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:19.276508 20305 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:19.287621 20153 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.307210 18845 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:19.306910 18913 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.309011 20232 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:19.315073 18920 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:23:19.315619 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44311.7us
I20260709 12:23:19.315125 18842 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.318435 18771 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:19.318830 18847 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:19.328792 18841 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:19.332154 20101 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:19.336054 20101 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:19.350008 18667 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index -1 to 2, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.358562 20232 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:19.464143 18812 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbadce60e960476289740ec2afd0a5c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.466274 18917 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:19.469129 20296 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:19.516460 18771 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:19.550311 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 121363us
I20260709 12:23:19.554944 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.540875 20296 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:23:19.606001 18769 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:19.609230 20312 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:19.616820 18915 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:19.626616 20300 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:19.627328 20344 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.638317 18917 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.652472 18847 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:19.716740 18668 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:19.736550 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 177886us
I20260709 12:23:19.738790 20351 ts_tablet_manager.cc:933] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:19.751267 18843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:23:19.755836 18843 raft_consensus.cc:606] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:19.769572 18771 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:19.774662 20347 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:19.779973 18765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:19.780696 18765 raft_consensus.cc:606] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:19.782749 18917 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:23:19.787959 18812 consensus_peers.cc:597] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c18380178684f0e93b10d0c7a912d02. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.794895 18769 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.803020 20344 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:19.806196 18917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:19.806946 18917 raft_consensus.cc:606] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:19.810812 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:19.813246 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.817291 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.836349 20351 tablet_copy_client.cc:323] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.1:46365
I20260709 12:23:19.850937 20352 ts_tablet_manager.cc:933] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:19.859086 18783 tablet_copy_service.cc:140] P 1e2529a8cff04207bb1b07c108e16983: Received BeginTabletCopySession request for tablet 1485e54f9795416785f4baf244599201 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:33308)
I20260709 12:23:19.864506 18783 tablet_copy_service.cc:161] P 1e2529a8cff04207bb1b07c108e16983: Beginning new tablet copy session on tablet 1485e54f9795416785f4baf244599201 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:33308: session id = 43b520eabb65493abe84f4cf06806cba-1485e54f9795416785f4baf244599201
I20260709 12:23:19.880453 20305 raft_consensus.cc:993] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:19.881225 20153 raft_consensus.cc:1081] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:19.883601 18917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54070
I20260709 12:23:19.886915 18917 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.887909 18917 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.909533 18783 tablet_copy_source_session.cc:215] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.913749 20351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1485e54f9795416785f4baf244599201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.914831 20347 raft_consensus.cc:993] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:19.915410 20347 raft_consensus.cc:1081] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:19.916522 20312 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.930063 18769 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:19.942687 18765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33742
I20260709 12:23:19.946167 20355 ts_tablet_manager.cc:933] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:19.930090 18917 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:19.965736 18917 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:19.957877 20341 raft_consensus.cc:993] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:19.963143 20352 tablet_copy_client.cc:323] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:23:19.966810 20341 raft_consensus.cc:1081] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:23:19.968513 20351 tablet_copy_client.cc:806] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.969156 20351 tablet_copy_client.cc:670] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.970294 20355 tablet_copy_client.cc:323] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:23:19.955825 18765 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.041224 18765 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:20.072466 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 105377us
I20260709 12:23:20.073325 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:20.075090 18843 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.031857 18671 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.135282 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet bf32cd3655eb4943abc0cdbf54a32206 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:23:20.136510 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet bf32cd3655eb4943abc0cdbf54a32206 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-bf32cd3655eb4943abc0cdbf54a32206
I20260709 12:23:20.139010 18857 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet bbadce60e960476289740ec2afd0a5c8 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:23:20.139817 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:20.140988 18766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33738
I20260709 12:23:20.139883 18857 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet bbadce60e960476289740ec2afd0a5c8 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-bbadce60e960476289740ec2afd0a5c8
I20260709 12:23:20.146736 18766 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.152813 18766 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.163427 20351 tablet_copy_client.cc:538] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:20.168727 18771 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:20.169589 18771 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:20.143352 18920 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:23:20.185374 18771 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:20.187629 18771 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.205724 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:20.209380 18766 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:20.225584 18858 tablet_copy_source_session.cc:215] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:20.245273 18857 tablet_copy_source_session.cc:215] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:23:20.249024 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71877.1us
I20260709 12:23:20.237200 18765 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:20.273138 20351 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:20.279654 18771 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:20.295828 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:20.279794 18766 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:20.300304 18765 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:20.314083 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:20.327509 20343 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.328446 20343 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:20.329895 20343 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:20.341426 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:20.346141 20352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf32cd3655eb4943abc0cdbf54a32206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:20.349900 18913 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:20.350559 18913 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:20.351913 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:20.352639 18920 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.352262 18913 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:20.354118 18913 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.365633 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:20.370541 18920 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:20.380944 19490 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.397424 18843 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:20.397985 18843 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:20.399596 18843 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:20.404471 18843 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.386096 20355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbadce60e960476289740ec2afd0a5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:20.414614 18843 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
W20260709 12:23:20.428501 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64516.5us
I20260709 12:23:20.451975 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:20.453238 20360 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:20.453876 20360 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:20.459699 20360 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:20.488065 19490 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:20.489077 20355 tablet_copy_client.cc:806] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:20.494171 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:20.501981 20360 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.493482 20355 tablet_copy_client.cc:670] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:20.522464 20360 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:20.523595 20360 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:20.541247 18913 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:20.608103 20355 tablet_copy_client.cc:538] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:20.615597 18669 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 2 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.635215 20355 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:20.646047 18771 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:20.657101 20351 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.666170 20351 tablet_bootstrap.cc:492] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:20.675114 20351 ts_tablet_manager.cc:1403] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.402s	user 0.037s	sys 0.023s
I20260709 12:23:20.680207 18669 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 3, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.682595 20365 ts_tablet_manager.cc:933] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:20.682612 18669 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.687464 20352 tablet_copy_client.cc:806] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:20.696806 20352 tablet_copy_client.cc:670] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:20.705546 20352 tablet_copy_client.cc:538] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:20.701081 20351 raft_consensus.cc:359] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:20.711072 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33726
I20260709 12:23:20.712154 18766 raft_consensus.cc:606] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:23:20.709506 20351 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:20.718727 20351 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:20.721706 20351 ts_tablet_manager.cc:1434] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:23:20.736263 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33726
I20260709 12:23:20.737008 18766 raft_consensus.cc:606] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Received request to transfer leadership
W20260709 12:23:20.738490 18656 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 6c18380178684f0e93b10d0c7a912d02 already in progress [suppressed 4 similar messages]
I20260709 12:23:20.747622 20365 tablet_copy_client.cc:323] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:23:20.751024 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 6c18380178684f0e93b10d0c7a912d02 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:23:20.751616 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 6c18380178684f0e93b10d0c7a912d02 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-6c18380178684f0e93b10d0c7a912d02
I20260709 12:23:20.753118 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33726
I20260709 12:23:20.753448 20352 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:23:20.753746 18767 raft_consensus.cc:606] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:23:20.760996 18858 tablet_copy_source_session.cc:215] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:20.767762 20365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c18380178684f0e93b10d0c7a912d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:20.768054 18783 tablet_copy_service.cc:342] P 1e2529a8cff04207bb1b07c108e16983: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-1485e54f9795416785f4baf244599201 received from {username='slave'} at 127.0.0.1:33308
I20260709 12:23:20.768718 18783 tablet_copy_service.cc:434] P 1e2529a8cff04207bb1b07c108e16983: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-1485e54f9795416785f4baf244599201 on tablet 1485e54f9795416785f4baf244599201 with peer 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:20.771862 18719 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:23:20.772454 18719 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 6c18380178684f0e93b10d0c7a912d02 already in progress
W20260709 12:23:20.772761 18719 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 6c18380178684f0e93b10d0c7a912d02 already in progress
I20260709 12:23:20.822417 20365 tablet_copy_client.cc:806] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:20.823153 20365 tablet_copy_client.cc:670] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:20.832850 18767 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:20.835348 20343 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:20.868516 20365 tablet_copy_client.cc:538] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:20.875120 20355 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.876544 20355 tablet_bootstrap.cc:492] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:20.883591 20355 ts_tablet_manager.cc:1403] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.249s	user 0.024s	sys 0.038s
I20260709 12:23:20.887652 20355 raft_consensus.cc:359] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:20.888653 20355 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:20.891175 20365 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
W20260709 12:23:20.918902 20371 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:23:20.889461 20355 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:20.935038 19490 raft_consensus.cc:1217] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:20.938539 20355 ts_tablet_manager.cc:1434] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.004s
I20260709 12:23:20.947775 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-bbadce60e960476289740ec2afd0a5c8 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:23:20.948297 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-bbadce60e960476289740ec2afd0a5c8 on tablet bbadce60e960476289740ec2afd0a5c8 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:20.965132 18846 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:20.968109 20343 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:20.972559 20352 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.979760 20352 tablet_bootstrap.cc:492] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:20.980628 20352 ts_tablet_manager.cc:1403] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.253s	user 0.056s	sys 0.042s
I20260709 12:23:20.990821 18917 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:20.992125 20352 raft_consensus.cc:359] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:20.992799 20360 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:20.993057 20352 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:21.018097 19486 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:21.023061 18913 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:21.023773 20352 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:21.030445 20305 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:21.024619 20153 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:23:21.051779 20352 ts_tablet_manager.cc:1434] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.002s
I20260709 12:23:21.078986 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-bf32cd3655eb4943abc0cdbf54a32206 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:23:21.079481 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-bf32cd3655eb4943abc0cdbf54a32206 on tablet bf32cd3655eb4943abc0cdbf54a32206 with peer 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:21.084858 18737 consensus_peers.cc:597] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.086366 20365 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:21.095543 20365 tablet_bootstrap.cc:492] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:23:21.096613 20365 ts_tablet_manager.cc:1403] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.206s	user 0.025s	sys 0.018s
W20260709 12:23:21.120802 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 73586.3us
I20260709 12:23:21.176949 19492 raft_consensus.cc:1217] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:21.211206 20153 raft_consensus.cc:993] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:21.218130 20153 raft_consensus.cc:1081] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:21.225210 18845 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:21.233486 20305 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:21.279098 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 70684.3us
W20260709 12:23:21.280234 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 106237us
I20260709 12:23:21.284176 20365 raft_consensus.cc:359] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:21.285159 20365 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:23:21.285943 20365 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:21.344496 18917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54070
I20260709 12:23:21.397823 18917 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.398291 18917 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.416925 20365 ts_tablet_manager.cc:1434] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.320s	user 0.012s	sys 0.002s
I20260709 12:23:21.436555 18917 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:21.446022 18917 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:21.460783 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:21.461494 18765 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:21.461833 18765 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:21.462621 18765 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:21.482190 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:21.483003 18841 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.483848 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.491523 20383 raft_consensus.cc:1064] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:21.491487 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-6c18380178684f0e93b10d0c7a912d02 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:23:21.495127 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-6c18380178684f0e93b10d0c7a912d02 on tablet 6c18380178684f0e93b10d0c7a912d02 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:21.494992 20383 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:21.500218 18765 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.558770 18841 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:21.560730 19486 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:21.564718 20380 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:21.589568 19490 raft_consensus.cc:1217] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:21.592942 18765 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:21.594348 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:21.595984 20362 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:21.597038 20362 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:21.598284 20362 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:23:21.603135 20400 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:23:21.616220 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 68229.5us
I20260709 12:23:21.619706 18914 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:21.631845 20101 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:21.633129 18668 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 3 to 4, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 4 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.665484 18841 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:21.717475 20398 raft_consensus.cc:1064] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:21.724117 20398 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:21.747228 18921 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:21.747478 19492 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:21.749904 20300 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:21.751259 20347 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:21.773798 20385 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:22.610631 18668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.009s	sys 0.011s
W20260709 12:23:22.611045 18668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.009s	sys 0.011s
I20260709 12:23:22.706249 20409 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:22.707028 20409 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:22.707706 20407 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.708316 20407 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:22.709503 20409 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:22.725080 20384 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:22.733949 20410 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:22.741755 20378 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:22.742447 20378 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.744777 20378 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:22.744902 20411 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:22.739197 20384 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.750344 18915 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:22.753765 20384 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:22.751174 20411 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.747670 20410 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:22.766562 20410 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:22.769631 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:22.786866 20378 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.789804 20411 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:22.787601 20378 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:22.797451 20378 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:22.798122 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd180 after lost signal to thread 17571
I20260709 12:23:22.818295 20333 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:22.821568 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:22.823777 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:22.836702 20415 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.833861 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:22.837456 20415 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:22.818955 20333 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.847512 20416 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:22.855248 20383 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:22.871996 18767 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:22.872747 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1257) took 1097 ms. Trace:
I20260709 12:23:22.873145 18767 rpcz_store.cc:276] 0709 12:23:21.776112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.871240 (+1095128us) service_pool.cc:224] Handling call
0709 12:23:22.871596 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.872470 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.872671 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.874994 20360 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:22.875725 20360 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.883832 20333 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:22.885313 20415 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:22.887128 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:22.852582 20416 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.890352 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:22.891942 20414 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:22.892560 20414 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.906705 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:22.912060 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 62682.7us
W20260709 12:23:22.930449 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72319us
I20260709 12:23:22.899514 20378 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:22.914646 20416 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:22.947537 20281 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:22.987025 20281 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.948585 20414 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:22.961575 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:22.961586 20428 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:22.962718 20418 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.964313 20409 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.966115 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:22.964890 20425 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.973636 20410 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.957510 20343 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:22.976197 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:22.977006 20305 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.977597 19490 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:22.980294 20427 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:22.946303 20408 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:23.021903 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45810.6us
I20260709 12:23:22.990882 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:22.992085 20384 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:22.993363 20281 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:22.994525 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:22.995968 20414 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:23.015864 20418 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:22.996861 20419 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:23.000161 20395 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:23.006822 20345 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:23.015339 20397 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:22.983076 20399 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:23.024295 20412 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.026008 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:23.023319 20416 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:23.026971 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:23.031597 20422 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:23.031844 20333 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.032056 20305 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.017406 20409 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.032873 20386 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:23.031478 20383 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.048729 20383 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.050006 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:23.037029 20415 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:23.039438 20387 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:23.009829 20378 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.041639 20101 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:23.027748 20410 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.046924 20426 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.048022 20418 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:23.023703 20343 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.064514 20101 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.016521 20428 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.033118 20414 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.034462 20384 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.068967 20420 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:23.039610 20345 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.045145 20394 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:23.061111 20416 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.023226 20425 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.091064 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:23.043740 20333 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.029603 20427 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.045764 20397 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.098290 20101 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:23.097040 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:23.104436 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55639.1us
I20260709 12:23:23.035466 20395 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.033356 20408 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.110041 20101 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:23.085820 20415 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.091483 20420 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.070233 20426 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.115355 20101 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.106506 19487 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 3 LEARNER]: Advancing to term 4
I20260709 12:23:23.045651 20399 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.059126 20422 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.124621 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:23.108861 20416 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.109752 20430 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.066057 20386 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.119633 18842 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:23.038520 20419 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.118745 20281 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:23.117672 20415 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:23.076208 20387 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.045466 20412 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:23.115852 20394 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.580303 20101 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.155416 20426 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.707288 20281 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.472558 20343 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:23.267017 20418 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:23.487167 20383 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.154528 20305 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.155779 20427 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:23.489517 20416 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.487762 20409 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.490540 20345 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:23.293185 20432 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.876250 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1526) took 1128 ms. Trace:
I20260709 12:23:23.313773 20429 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:23.877401 18917 rpcz_store.cc:276] 0709 12:23:22.747458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.875074 (+1127616us) service_pool.cc:224] Handling call
0709 12:23:23.875525 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.875785 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.875831 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:23.875890 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:23.875935 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.876012 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:23.876167 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:23.878610 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.001s	sys 0.014s
W20260709 12:23:23.879511 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.001s	sys 0.014s
I20260709 12:23:23.839195 20422 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.846415 20343 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:23.884142 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.005s	sys 0.009s
W20260709 12:23:23.887328 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.006s	sys 0.009s
I20260709 12:23:23.885804 20386 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:23.888011 20386 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:23.884693 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:23.289450 20431 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:23.889127 18917 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:23.888619 20386 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.290354 18840 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:23.896111 19490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.007s	sys 0.024s
I20260709 12:23:23.876152 20345 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:23.176712 20430 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.871331 20407 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.879612 20418 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:23.896549 19490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.007s	sys 0.024s
W20260709 12:23:24.055815 18813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.002s	sys 0.013s
I20260709 12:23:24.230010 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1850) took 1410 ms. Trace:
W20260709 12:23:24.055294 19458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.005s	sys 0.032s
W20260709 12:23:24.055611 18885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.002s	sys 0.009s
W20260709 12:23:24.349126 19458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.018s	sys 0.037s
I20260709 12:23:24.056562 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1514) took 1246 ms. Trace:
I20260709 12:23:23.966861 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:24.380990 18917 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
W20260709 12:23:23.931965 18737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.016s	sys 0.019s
W20260709 12:23:24.388072 18737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.044s	sys 0.059s
W20260709 12:23:24.389446 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 1.29389e+06us
I20260709 12:23:24.055434 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:23.893369 19487 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.773s	user 0.019s	sys 0.030s
I20260709 12:23:24.378309 18848 rpcz_store.cc:276] 0709 12:23:22.809878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.995721 (+1185843us) service_pool.cc:224] Handling call
0709 12:23:24.055695 (+ 59974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.055974 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.056016 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.056075 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:24.056124 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.056201 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.056350 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:24.393443 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:24.388396 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 343) took 1435 ms. Trace:
I20260709 12:23:24.391017 18768 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:24.348367 18765 rpcz_store.cc:276] 0709 12:23:22.819238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.820135 (+   897us) service_pool.cc:224] Handling call
0709 12:23:24.209519 (+1389384us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:24.209836 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.210094 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.210132 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.210192 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:24.210234 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.210307 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.229883 (+ 19576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6617344}
W20260709 12:23:24.226091 20435 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 12:23:24.396520 19455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.011s	sys 0.009s
I20260709 12:23:23.880967 20420 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.402637 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1345) took 1521 ms. Trace:
I20260709 12:23:24.403143 20420 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:24.397580 18885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.006s	sys 0.014s
I20260709 12:23:24.403347 18916 rpcz_store.cc:276] 0709 12:23:22.881379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.393189 (+1511810us) service_pool.cc:224] Handling call
0709 12:23:24.402030 (+  8841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.402174 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.402197 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.402227 (+    30us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:24.402255 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.402301 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.402458 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:24.405011 20409 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:24.405128 20411 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:24.405668 20409 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.969415 20412 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.235054 20397 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:23.970494 20408 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:24.265735 20387 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.398361 20347 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:24.406489 19457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.010s	sys 0.015s
W20260709 12:23:24.443699 19457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.010s	sys 0.015s
I20260709 12:23:24.394272 19490 rpcz_store.cc:276] 0709 12:23:22.912392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.912532 (+   140us) service_pool.cc:224] Handling call
0709 12:23:22.975188 (+ 62656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.977183 (+  1995us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:23.098253 (+121070us) log.cc:844] Serialized 14 byte log entry
0709 12:23:24.347211 (+1248958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.347276 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:24.347322 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.347402 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.347549 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1248420,"threads_started":1}
I20260709 12:23:24.184837 20428 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:24.391774 20383 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:24.403729 20420 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:24.400373 19455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.011s	sys 0.009s
I20260709 12:23:23.895244 20384 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:24.226769 20394 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:24.198939 20281 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:24.227202 20415 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.254983 20386 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:23.971702 20425 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.122347 20410 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.190755 20422 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:24.264428 20441 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:24.407066 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:23.954381 20414 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.405139 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:24.415695 20442 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:24.415750 20323 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:24.266187 20399 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:23.926375 20436 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:23.968935 20443 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:24.395901 18917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 165) took 1389 ms (client timeout 1826 ms). Trace:
I20260709 12:23:24.451743 20397 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:24.509914 20153 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:24.510912 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:24.058696 20429 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:23.896373 20343 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:24.387362 20345 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:23.889436 20432 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.058540 20431 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:24.508908 19487 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 4 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:24.573464 20447 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:24.514187 20437 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:24.575423 18916 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
W20260709 12:23:24.605194 18916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 166) took 1612 ms (client timeout 1850 ms). Trace:
W20260709 12:23:24.605757 18916 rpcz_store.cc:269] 0709 12:23:22.992815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.404822 (+1412007us) service_pool.cc:224] Handling call
0709 12:23:24.605111 (+200289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:24.554888 20394 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:24.580170 18919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1355) took 1527 ms (client timeout 1858 ms). Trace:
I20260709 12:23:24.557193 20387 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:24.453269 20347 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:24.583519 18917 rpcz_store.cc:269] 0709 12:23:22.992168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.966522 (+974354us) service_pool.cc:224] Handling call
0709 12:23:24.381757 (+415235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:24.565194 20419 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.555501 20383 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:24.568162 20408 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:24.590232 20153 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:24.615535 18919 rpcz_store.cc:269] 0709 12:23:23.052681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.406637 (+1353956us) service_pool.cc:224] Handling call
0709 12:23:24.580079 (+173442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:24.630684 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1353) took 1739 ms. Trace:
I20260709 12:23:24.621106 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 407) took 1531 ms. Trace:
I20260709 12:23:24.638262 18917 rpcz_store.cc:276] 0709 12:23:22.890937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.629421 (+1738484us) service_pool.cc:224] Handling call
0709 12:23:24.629886 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.630142 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.630185 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.630247 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:24.630296 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.630385 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.630592 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:24.589848 20323 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.634132 20451 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:24.603996 20414 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:24.576607 20422 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.591229 20397 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:24.587535 20441 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.603642 20436 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.587836 20442 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:24.587332 20443 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.588961 20452 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:24.643445 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 163) took 1685 ms. Trace:
I20260709 12:23:25.286857 18917 rpcz_store.cc:276] 0709 12:23:22.958174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.641930 (+1683756us) service_pool.cc:224] Handling call
0709 12:23:24.642309 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.642967 (+   658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.643009 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.643073 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:24.643116 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.643200 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.643359 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.130846 20444 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:25.286561 20451 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.288295 20444 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.290174 20451 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:24.812855 20445 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:25.290788 20451 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:25.290938 20445 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.291239 20323 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.291329 20451 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:24.819298 20343 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:25.218904 20456 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:25.143000 20432 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.294232 20456 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.820735 20429 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.295403 20429 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:25.295945 20429 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.293653 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:25.299166 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 484819us
I20260709 12:23:25.300786 20441 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:25.301404 20441 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:25.104714 20409 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:24.813898 20347 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.084712 20430 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:24.979668 20438 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:23:24.821974 20345 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:24.981057 20383 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.300940 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.297117 20456 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.742744 20281 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:24.815716 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:25.297665 20452 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.840757 20420 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:25.284577 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1528) took 2536 ms. Trace:
W20260709 12:23:24.812731 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 158899us
I20260709 12:23:24.670320 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.298259 20429 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:24.618463 20446 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:24.838949 20435 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:25.301908 20441 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.373427 18920 rpcz_store.cc:276] 0709 12:23:22.748013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.283635 (+2535622us) service_pool.cc:224] Handling call
0709 12:23:25.284022 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.284220 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.284249 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.284296 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:25.284323 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.284378 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.284504 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.376804 20153 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:25.293463 20451 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:24.817404 20431 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:25.244880 20385 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 3.468s	user 0.012s	sys 0.032s
I20260709 12:23:25.384811 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:24.640928 20419 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:25.387028 18916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1541) took 2428 ms (client timeout 1976 ms). Trace:
I20260709 12:23:25.293502 20445 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.387235 20429 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:25.388355 18920 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:25.386137 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.392201 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:24.784049 20418 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:24.640506 19487 rpcz_store.cc:276] 0709 12:23:23.089832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.105800 (+ 15968us) service_pool.cc:224] Handling call
0709 12:23:23.106211 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.605252 (+1499041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.621034 (+ 15782us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:25.390398 18916 rpcz_store.cc:269] 0709 12:23:22.954641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.619168 (+1664527us) service_pool.cc:224] Handling call
0709 12:23:25.382947 (+763779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.358126 20444 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.363667 20281 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:24.669878 20428 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:25.392937 19486 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:24.703269 20450 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:24.623371 20394 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.642752 20387 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.398674 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 164) took 2437 ms. Trace:
I20260709 12:23:25.389945 20451 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:25.403224 18917 rpcz_store.cc:276] 0709 12:23:22.960935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.397875 (+2436940us) service_pool.cc:224] Handling call
0709 12:23:25.398204 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.398334 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.398349 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.398377 (+    28us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:25.398445 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.398511 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.398616 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.427600 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 167) took 2393 ms. Trace:
I20260709 12:23:25.428135 18917 rpcz_store.cc:276] 0709 12:23:23.034480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.426465 (+2391985us) service_pool.cc:224] Handling call
0709 12:23:25.426930 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.427143 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.427183 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.427241 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:25.427283 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.427353 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.427515 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:24.672190 20408 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.411535 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.362713 20414 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.430378 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 168) took 2389 ms. Trace:
I20260709 12:23:25.127171 20449 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:25.214542 20454 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:25.447844 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.449322 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:25.468277 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75883.7us
I20260709 12:23:25.469790 20459 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:24.618160 20447 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.395383 20419 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:24.626463 20437 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.393702 20429 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.460714 20443 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:25.491008 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 169) took 2446 ms. Trace:
I20260709 12:23:25.491573 18916 rpcz_store.cc:276] 0709 12:23:23.044263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.460242 (+2415979us) service_pool.cc:224] Handling call
0709 12:23:25.490284 (+ 30042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.490546 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.490584 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.490641 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:25.490685 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.490759 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.490924 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.493053 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.493896 18916 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:25.471690 20414 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.610278 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1356) took 2503 ms. Trace:
I20260709 12:23:25.610926 18916 rpcz_store.cc:276] 0709 12:23:23.107130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.496639 (+2389509us) service_pool.cc:224] Handling call
0709 12:23:25.609561 (+112922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.609802 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.609844 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.609913 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:25.609962 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.610037 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.610189 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.612620 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:24.750703 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:25.458639 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.399338 20428 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.598912 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:25.631942 20444 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:25.634475 20447 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:25.455540 20451 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.635555 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:25.450618 18917 rpcz_store.cc:276] 0709 12:23:23.041754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.429325 (+2387571us) service_pool.cc:224] Handling call
0709 12:23:25.429719 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.429954 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.429993 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.430049 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:25.430093 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.430162 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.430311 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.607759 20281 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.400142 20463 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:25.637530 20442 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.699817 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.700644 18920 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:25.701581 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:25.701766 20394 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:25.702847 20387 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.703634 20419 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.704030 20451 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:25.705546 20428 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.706851 20441 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.644984 20443 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:25.707965 20443 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:25.708459 20443 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.726912 20397 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.729187 20429 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.606817 19458 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:25.644928 20461 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:25.730685 20422 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.731483 20422 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:25.731899 20422 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:25.732355 20422 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.680557 20408 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:25.617421 20432 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:25.776304 20432 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.699982 20436 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.614254 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:25.730221 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 123499us
I20260709 12:23:25.676553 20437 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:25.780843 18916 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
W20260709 12:23:25.805528 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 144511us
I20260709 12:23:25.853626 20432 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:25.833364 20444 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:23:25.888625 20443 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.892632 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1357) took 2720 ms. Trace:
I20260709 12:23:25.453115 20449 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.382959 20446 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.470711 20459 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.454134 20454 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:25.451983 20450 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:25.963943 18886 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.4:44937 timed out after 1.552s (SENT) [suppressed 6 similar messages]
I20260709 12:23:25.699467 20463 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:25.730764 20461 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.039116 18916 rpcz_store.cc:276] 0709 12:23:23.171814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.782006 (+2610192us) service_pool.cc:224] Handling call
0709 12:23:25.782476 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.782711 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.782752 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.892181 (+109429us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:25.892245 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.892345 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.892540 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.046953 20461 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:24.815130 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:26.047976 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 84089.2us
W20260709 12:23:26.048432 19484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 413) took 1432 ms (client timeout 1552 ms). Trace:
W20260709 12:23:26.048986 19484 rpcz_store.cc:269] 0709 12:23:24.615875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.621295 (+  5420us) service_pool.cc:224] Handling call
0709 12:23:26.048338 (+1427043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.972767 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 411) took 1357 ms. Trace:
I20260709 12:23:26.037871 20422 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.050546 19490 rpcz_store.cc:276] 0709 12:23:24.615126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.615273 (+   147us) service_pool.cc:224] Handling call
0709 12:23:24.635541 (+ 20268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.383564 (+748023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.383601 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.383644 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:25.383679 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.972378 (+588699us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b5400720bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:25.972450 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.972670 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719758720}
I20260709 12:23:26.052959 20422 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.040467 20443 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.040545 20449 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:26.040983 20446 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:26.054064 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 431552us
W20260709 12:23:26.054986 20385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.009s	sys 0.038s
I20260709 12:23:26.042927 20459 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.045099 19483 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
W20260709 12:23:26.056517 20385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.009s	sys 0.038s
I20260709 12:23:26.044773 20450 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.042948 20454 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:26.044977 20463 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:26.069303 20360 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.071285 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 408) took 2959 ms. Trace:
I20260709 12:23:26.071693 19491 rpcz_store.cc:276] 0709 12:23:23.111648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.111805 (+   157us) service_pool.cc:224] Handling call
0709 12:23:23.119402 (+  7597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.126999 (+  7597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.127050 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:23.127113 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:23.127160 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.070987 (+2943827us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b54005c17d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.071026 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.071159 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16711424}
W20260709 12:23:26.249910 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9a80 after lost signal to thread 18705
W20260709 12:23:26.251381 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080009ad20 after lost signal to thread 18797
W20260709 12:23:26.252575 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080009f300 after lost signal to thread 18872
W20260709 12:23:26.252900 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1320 after lost signal to thread 18873
W20260709 12:23:26.264014 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080036c820 after lost signal to thread 18946
W20260709 12:23:26.264443 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08003084e0 after lost signal to thread 18947
W20260709 12:23:26.265362 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080031c6a0 after lost signal to thread 19516
I20260709 12:23:26.266145 18771 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:26.266985 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1855) took 3202 ms. Trace:
I20260709 12:23:26.267351 18771 rpcz_store.cc:276] 0709 12:23:23.064417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.265310 (+3200893us) service_pool.cc:224] Handling call
0709 12:23:26.265708 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.266656 (+   948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.266912 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.293843 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1853) took 3239 ms. Trace:
I20260709 12:23:26.295792 18772 rpcz_store.cc:276] 0709 12:23:23.054610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.054847 (+   237us) service_pool.cc:224] Handling call
0709 12:23:23.066648 (+ 11801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.789093 (+722445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.789143 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:23.789208 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:23.789264 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.293376 (+2504112us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b540029d6d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.293435 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.293612 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660740352}
I20260709 12:23:26.310964 20455 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:26.311708 20455 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.313809 20153 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:26.314209 20455 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.315680 20455 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:26.316279 20455 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.318897 20455 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.324059 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 406) took 3250 ms. Trace:
I20260709 12:23:26.324604 19488 rpcz_store.cc:276] 0709 12:23:23.074058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.091138 (+ 17080us) service_pool.cc:224] Handling call
0709 12:23:23.091557 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.106245 (+ 14688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.106284 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:23.106348 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:23.106385 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.323480 (+3217095us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b54006743d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.323564 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.323802 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18272512}
I20260709 12:23:26.314476 20153 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.329028 20153 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.351470 20300 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:26.352165 20300 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.354758 20300 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.355449 20300 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:26.356069 20300 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.358945 20300 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.374507 20467 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:26.375293 20467 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.377707 20467 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.382176 20300 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.382860 20300 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:26.385076 20333 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.393054 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 224) took 3574 ms. Trace:
I20260709 12:23:26.393519 18769 rpcz_store.cc:276] 0709 12:23:22.818305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.819695 (+  1390us) service_pool.cc:224] Handling call
0709 12:23:26.392221 (+3572526us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:26.392427 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.392605 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.392630 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.392671 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:26.392698 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.392750 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.392868 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4892544}
I20260709 12:23:26.394755 20300 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.395452 20300 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:26.396176 20300 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.398623 20300 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:26.399365 18814 connection.cc:256] RPC call timeout handler was delayed by -1.9539302940002017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 12:23:26.400353 18814 connection.cc:256] RPC call timeout handler was delayed by -1.9394775300002038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 12:23:26.400767 18814 connection.cc:256] RPC call timeout handler was delayed by -1.6544017639998856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 12:23:26.401122 18814 connection.cc:256] RPC call timeout handler was delayed by -1.1029756650000309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 12:23:26.399863 20300 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:26.402100 20300 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.405519 20300 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.412367 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:26.413386 20467 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:26.413897 20467 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:26.414362 20467 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.425979 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.428200 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.429023 18841 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:26.429606 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.432058 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 222) took 3614 ms. Trace:
I20260709 12:23:26.432492 18766 rpcz_store.cc:276] 0709 12:23:22.817645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.819681 (+  2036us) service_pool.cc:224] Handling call
0709 12:23:22.821854 (+  2173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.893547 (+ 71693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.893581 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.893625 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:22.893654 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.431826 (+3538172us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b54002a1554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.431873 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.431997 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164344704}
I20260709 12:23:26.433350 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.434932 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1849) took 3615 ms. Trace:
I20260709 12:23:26.435293 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.435365 18764 rpcz_store.cc:276] 0709 12:23:22.818965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.821219 (+  2254us) service_pool.cc:224] Handling call
0709 12:23:22.966501 (+145282us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:22.966724 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.119898 (+153174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.124305 (+  4407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:23.136055 (+ 11750us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:23.140590 (+  4535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.434579 (+3293989us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002a0654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.434631 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.434757 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348547840}
I20260709 12:23:26.434937 20467 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.437386 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.438007 18846 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:26.438593 20467 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.439890 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.440292 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.440863 18843 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:26.442281 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.443972 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.444620 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:26.448823 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.449695 18845 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:26.456234 20398 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:26.456620 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1523) took 3430 ms. Trace:
I20260709 12:23:26.456984 20398 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.457136 18840 rpcz_store.cc:276] 0709 12:23:23.026343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.028318 (+  1975us) service_pool.cc:224] Handling call
0709 12:23:23.031632 (+  3314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:23.032109 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.032147 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:23.067037 (+ 34890us) log.cc:844] Serialized 548 byte log entry
0709 12:23:23.290150 (+223113us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:24.358272 (+1068122us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.455801 (+2097529us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b54000ac420. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af06733 00007f335af8bdbf 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c
0709 12:23:26.455875 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.456062 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.456193 (+   131us) raft_consensus.cc:1685] finished
0709 12:23:26.456304 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.456505 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5859,"raft.queue_time_us":169452,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":5994,"spinlock_wait_cycles":158519680,"thread_start_us":360406,"threads_started":2,"wal-append.queue_time_us":779947}
I20260709 12:23:26.458961 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1854) took 3399 ms. Trace:
I20260709 12:23:26.459444 18770 rpcz_store.cc:276] 0709 12:23:23.059138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.452683 (+3393545us) service_pool.cc:224] Handling call
0709 12:23:26.453100 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.453297 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.453320 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.453361 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:26.453393 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.458599 (+  5206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.458755 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.476617 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1523) took 3737 ms. Trace:
I20260709 12:23:26.477226 18921 rpcz_store.cc:276] 0709 12:23:22.739519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.475439 (+3735920us) service_pool.cc:224] Handling call
0709 12:23:26.475901 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.476148 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.476188 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.476245 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:26.476287 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.476359 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.476534 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.594327 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 410) took 3476 ms. Trace:
I20260709 12:23:26.599056 19489 rpcz_store.cc:276] 0709 12:23:23.118221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.401455 (+1283234us) service_pool.cc:224] Handling call
0709 12:23:24.401880 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.388253 (+986373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.389824 (+  1571us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.393241 (+  3417us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:25.393764 (+   523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.593765 (+1200001us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400536454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.593858 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.594118 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251105024}
I20260709 12:23:26.608144 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 403) took 3563 ms. Trace:
I20260709 12:23:26.608677 19492 rpcz_store.cc:276] 0709 12:23:23.044423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.044585 (+   162us) service_pool.cc:224] Handling call
0709 12:23:23.044883 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.782308 (+737425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.782355 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:23.782445 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:23.782483 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.607782 (+2825299us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b540044d754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.607849 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.608057 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695211904}
I20260709 12:23:26.632174 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1354) took 3740 ms. Trace:
I20260709 12:23:26.633085 18919 rpcz_store.cc:276] 0709 12:23:22.891276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.641529 (+1750253us) service_pool.cc:224] Handling call
0709 12:23:25.288794 (+647265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.456427 (+167633us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:25.456474 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.456537 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:25.456583 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.631815 (+1175232us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400032fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.631874 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.632050 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384840448}
I20260709 12:23:26.654274 20378 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.687070 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1530) took 3938 ms. Trace:
I20260709 12:23:26.687723 20398 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.687584 18918 rpcz_store.cc:276] 0709 12:23:22.748496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.873733 (+1125237us) service_pool.cc:224] Handling call
0709 12:23:23.890344 (+ 16611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.629828 (+739484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.629879 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.629938 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:24.629983 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.686605 (+2056622us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.686662 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.686824 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699990400}
I20260709 12:23:26.691783 20431 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:26.692586 20431 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.694054 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:26.695881 20333 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:26.696405 20333 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:26.696859 20333 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:26.697758 18842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1522) took 3671 ms (client timeout 1648 ms). Trace:
W20260709 12:23:26.682173 19483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 414) took 2060 ms (client timeout 1637 ms). Trace:
W20260709 12:23:26.698331 18842 rpcz_store.cc:269] 0709 12:23:23.026022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.026566 (+   544us) service_pool.cc:224] Handling call
0709 12:23:26.697424 (+3670858us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b5400285854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:26.697602 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180359424}
W20260709 12:23:26.705242 19483 rpcz_store.cc:269] 0709 12:23:24.621519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.625101 (+  3582us) service_pool.cc:224] Handling call
0709 12:23:26.681835 (+2056734us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54001f4854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:26.682041 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931154688}
I20260709 12:23:26.717566 20431 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:26.725790 20469 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:26.725970 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:26.727751 18738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.164s	user 0.026s	sys 0.027s
W20260709 12:23:26.728180 18738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.164s	user 0.026s	sys 0.027s
I20260709 12:23:26.728621 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.729511 18917 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:26.727404 20469 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.731292 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.732762 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.733868 18918 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:26.734211 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 345) took 3773 ms. Trace:
I20260709 12:23:26.735088 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.731635 20469 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.740576 20467 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:26.741331 20467 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.734647 19485 rpcz_store.cc:276] 0709 12:23:22.960935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.703599 (+1742664us) service_pool.cc:224] Handling call
0709 12:23:24.704076 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.289552 (+585476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.289582 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.289624 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:25.289658 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.733857 (+1444199us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400562a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:26.733905 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.734039 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346001792}
I20260709 12:23:26.750190 18668 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 269) took 5120 ms. Trace:
I20260709 12:23:26.750674 18668 rpcz_store.cc:276] 0709 12:23:21.629472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.629596 (+   124us) service_pool.cc:224] Handling call
0709 12:23:26.750079 (+5120483us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:21.681725 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:21.683405 (+  1680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:21.683455 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:23:21.683486 (+    31us) tablet.cc:662] Decoding operations
0709 12:23:21.683992 (+   506us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:21.684110 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:21.684159 (+    49us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:21.684452 (+   293us) tablet.cc:701] Row locks acquired
0709 12:23:21.684484 (+    32us) write_op.cc:260] PREPARE: finished
0709 12:23:21.684704 (+   220us) write_op.cc:270] Start()
0709 12:23:21.684888 (+   184us) write_op.cc:276] Timestamp: P: 1783599801684632 usec, L: 0
0709 12:23:21.684922 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:23:22.792402 (+1107480us) log.cc:844] Serialized 591 byte log entry
0709 12:23:22.815427 (+ 23025us) op_driver.cc:464] REPLICATION: finished
0709 12:23:22.858807 (+ 43380us) write_op.cc:301] APPLY: starting
0709 12:23:22.867586 (+  8779us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:22.881383 (+ 13797us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:22.898085 (+ 16702us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:22.898416 (+   331us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:22.898645 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:22.898717 (+    72us) write_op.cc:312] APPLY: finished
0709 12:23:22.900771 (+  2054us) log.cc:844] Serialized 23 byte log entry
0709 12:23:22.914775 (+ 14004us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:22.914879 (+   104us) write_op.cc:454] Released schema lock
0709 12:23:22.914920 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:23.871044 (+956124us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af86e28 00007f335e9c1581 00007f335e9c0d58 00007f335e9c59f1 00007f335e9c59a9 00007f335e9c5939 00007f335e9c5901 00007f335e9c4b2d 0000000000388634 0000000000388479
0709 12:23:23.887372 (+ 16328us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:23.889016 (+  1644us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":697694,"reported_tablets":1,"spinlock_wait_cycles":271232,"child_traces":[["op",{"apply.queue_time_us":33484,"apply.run_cpu_time_us":2474,"apply.run_wall_time_us":61996,"num_ops":1,"prepare.queue_time_us":44886,"prepare.run_cpu_time_us":56266,"prepare.run_wall_time_us":2191978,"raft.queue_time_us":2353,"raft.run_cpu_time_us":5607,"raft.run_wall_time_us":27667,"replication_time_us":1130266,"spinlock_wait_cycles":2545380096,"thread_start_us":1020481,"threads_started":4,"wal-append.queue_time_us":17752,"wal-append.run_cpu_time_us":4660,"wal-append.run_wall_time_us":1116461}]]}
I20260709 12:23:26.755673 20452 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.755889 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.750870 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.758993 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.759671 18919 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:26.762156 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.762428 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.762805 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.762876 18918 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:26.763788 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.765254 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.766748 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.768097 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.769965 18913 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:26.773464 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.774235 18916 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:26.774904 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.776085 18913 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:26.777087 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.779570 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.788936 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.785074 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.791045 19485 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:23:26.792127 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.793198 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:26.794268 18671 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 261) took 3828 ms. Trace:
I20260709 12:23:26.794762 18671 rpcz_store.cc:276] 0709 12:23:22.966257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.966435 (+   178us) service_pool.cc:224] Handling call
0709 12:23:26.794146 (+3827711us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3739574,"reported_tablets":1}
I20260709 12:23:26.795161 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.802474 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:26.803550 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.749897 20333 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.805473 20466 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:26.839449 20466 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.806423 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.806589 20153 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:26.843045 20153 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.843600 20466 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.845269 20153 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.807533 20407 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:26.846014 20407 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:26.846314 20333 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.808766 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.848745 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:26.817945 20361 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:26.870800 20361 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.871232 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.873487 20361 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.818648 20439 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.874328 20439 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:26.877050 20439 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.819257 20360 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:26.877395 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.877904 20360 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.878479 18769 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:26.880424 20360 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.828943 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.829898 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:26.881830 18922 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.882620 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.831416 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.886972 18920 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:26.833374 20467 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.834311 20395 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:26.835599 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.806054 20408 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:26.891698 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.808341 20411 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:26.892429 18764 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:26.892633 20411 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.894299 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.894692 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.895185 20411 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:26.896500 18772 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:26.846509 20407 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.899166 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.899986 18765 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:26.854694 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.905588 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.906337 18765 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:26.780786 18670 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 2 to 3, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:26.858448 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.859664 18916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:26.911847 18916 raft_consensus.cc:606] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:26.859788 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.861156 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.850783 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.866333 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.869305 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.914783 18770 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:26.889984 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.915758 18771 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:26.891510 20408 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:26.892897 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.917017 18773 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:26.862598 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:26.918268 20408 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:26.880936 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:26.919304 19483 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:26.924794 18922 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:26.857067 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.926255 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.999577 18913 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:26.999711 18842 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:27.000999 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:27.002365 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:27.002760 18739 connection.cc:256] RPC call timeout handler was delayed by -1.857223673000135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:23:27.003052 18913 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
W20260709 12:23:27.003420 18739 connection.cc:256] RPC call timeout handler was delayed by -1.7114236729998993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
I20260709 12:23:27.004200 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.005479 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:27.008827 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.009294 20411 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:27.009811 20411 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:27.010222 20411 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.010915 19486 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:27.014123 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:27.016588 20439 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.017098 20439 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.017510 20439 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.023209 20411 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:26.928956 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:26.932101 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.045423 19491 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:27.046584 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.047869 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.048188 20411 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.048560 19491 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:26.933872 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.934114 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:26.934814 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 86136.3us
I20260709 12:23:26.934952 20333 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:27.056473 20333 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:27.057051 20333 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.935722 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.937049 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.069887 18843 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:26.937568 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.939256 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.074744 18846 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:26.940727 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.941887 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.944932 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.078816 19492 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:26.946003 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.079909 19488 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:26.947654 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.950384 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:27.081722 18916 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:26.954552 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.082772 19484 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:23:26.955206 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.956640 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.974009 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.978523 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.086741 18841 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:26.980682 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.087903 18847 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:26.983582 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:26.983763 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.089515 19487 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:26.986505 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:26.989663 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.090698 18839 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:26.990583 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:27.091952 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 101455us
I20260709 12:23:26.991878 20467 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:27.092974 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.093811 20432 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:27.093535 20467 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:27.094221 20432 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:27.094741 20432 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.096011 20467 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.097656 20452 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:27.098124 20452 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:27.098966 20437 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:27.100589 20469 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:27.101055 20469 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:27.102173 20469 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.107147 20469 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.119321 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.119997 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.120621 20467 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.121014 20437 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.121127 20467 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:27.121578 20437 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.031026 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.034646 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.122136 20437 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.122344 18844 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
W20260709 12:23:27.122781 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 88365.9us
I20260709 12:23:27.124951 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.129118 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:27.027354 20439 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:27.044018 18738 connection.cc:256] RPC call timeout handler was delayed by -2.4137501939999311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 12:23:27.132220 18738 connection.cc:256] RPC call timeout handler was delayed by -1.0557473630001368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:23:27.132587 18738 connection.cc:256] RPC call timeout handler was delayed by -1.0251473630000874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 12:23:27.132917 18738 connection.cc:256] RPC call timeout handler was delayed by -1.01434736300007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 12:23:26.928165 20407 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.136152 20407 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.130827 20360 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:27.137099 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.137543 19487 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.138535 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.139026 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:27.139822 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.090188 18921 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:27.099344 20452 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.141511 18767 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:27.026026 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.131296 19458 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.121712 20467 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.146333 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.150921 18771 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:27.147419 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.149195 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.153604 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.149971 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.155088 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.152806 18769 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:27.154366 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.162459 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.164350 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.165524 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.165787 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.166433 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.166725 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.170562 20472 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.171130 20472 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.171550 20472 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.171978 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.172771 19492 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:27.173810 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:27.160861 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.174858 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.165524 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.178692 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.179425 18769 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:27.180210 20439 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.174751 18767 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:27.182037 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.166325 18766 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:23:27.175618 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.183280 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.183980 20361 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:27.184043 20470 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:27.184618 20470 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:27.183679 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.185032 20470 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.185335 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.186954 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.188316 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.152102 20411 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:27.189198 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.189505 20411 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:27.189824 20384 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:27.190002 20411 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:27.190295 20384 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.191471 20384 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:27.040454 18913 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:27.066295 20333 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.199766 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.196105 20398 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.187472 20443 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.187304 20407 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.201850 20153 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:27.203377 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.142125 20437 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.206956 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.159726 20468 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:23:27.207758 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.161131 20432 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.209892 19485 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.186403 20471 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.209615 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.211627 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.211948 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.212946 20333 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.198565 20360 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:27.214740 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:27.218676 20432 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.219437 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.221786 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.202294 20398 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:27.241050 18842 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:27.241394 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:27.223614 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 130745us
I20260709 12:23:27.205417 20443 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:27.242522 20443 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.244061 20333 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:23:27.230122 18869 debug-util.cc:398] Leaking SignalData structure 0x7b08001639e0 after lost signal to thread 17571
I20260709 12:23:27.259939 20468 raft_consensus.cc:1064] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
W20260709 12:23:27.260497 20468 raft_consensus.cc:1068] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Unable to promote non-voter 43b520eabb65493abe84f4cf06806cba: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:27.228778 20361 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:27.205757 20407 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.271328 20361 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.271487 20407 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.274570 20361 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.239686 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.240089 20437 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.230350 19490 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:27.222615 20360 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.279166 20360 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.244585 20398 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.215930 20471 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:27.245167 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:27.270802 20333 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:27.287834 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.288646 19483 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:27.288532 20333 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.289546 20471 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:27.260710 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800165100 after lost signal to thread 18705
I20260709 12:23:27.269609 20384 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.282730 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.300819 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.284004 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.303897 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:27.305953 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:27.306650 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.307107 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:27.307302 18773 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:27.293323 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:27.299265 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.309660 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:27.279985 20408 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:27.314244 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 130615us
I20260709 12:23:27.313184 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:27.310840 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:27.322077 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.322887 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:27.299579 20437 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.324139 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.324479 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.322420 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:27.323706 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 192476us
I20260709 12:23:27.328683 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.329466 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.329548 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.317351 20432 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.335445 20432 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.335863 20432 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.337148 20470 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.326627 20437 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.338866 20437 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.339323 20472 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:27.341717 20472 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.334795 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:27.317023 18869 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3bc0 after lost signal to thread 18797
I20260709 12:23:27.345193 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.342948 18770 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:27.352936 18847 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:27.356662 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.361505 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.374833 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.376552 18769 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:27.377796 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.379534 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.380255 20470 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.382519 20472 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:27.386850 20483 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.387378 20483 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.387795 20483 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:27.392001 19457 leader_election.cc:336] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.826s (SENT)
I20260709 12:23:27.345072 20431 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.395274 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.396626 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.400564 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.321920 20452 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:27.402704 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 203840us
I20260709 12:23:27.419485 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:27.425925 19457 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.850s (SENT)
I20260709 12:23:27.426509 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:27.428164 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.428821 18919 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.356676 20411 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.392405 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.454766 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.457751 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.458866 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.459780 18772 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:27.460832 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.461879 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.365562 20443 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.461951 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.463095 19490 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:27.446138 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800337b60 after lost signal to thread 18872
I20260709 12:23:27.463151 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.418661 20431 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:27.473176 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.474315 18771 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:27.470520 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.472337 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.476250 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.477651 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.450780 20482 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:27.467247 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800339260 after lost signal to thread 18873
I20260709 12:23:27.475486 18770 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:27.469699 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.485498 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.485563 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.471319 20431 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.494022 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.497326 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.470106 20384 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.508829 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.509888 18771 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:23:27.512188 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.486756 20482 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:27.516273 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.529623 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.532105 20333 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:27.536554 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.490613 20360 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:27.540870 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800376e20 after lost signal to thread 18946
I20260709 12:23:27.524261 20482 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.562259 18767 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.518828 20467 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:27.569809 20407 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.572038 20467 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.572260 18768 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:27.555117 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:27.549410 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800376e00 after lost signal to thread 18947
W20260709 12:23:27.585539 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800376560 after lost signal to thread 19516
I20260709 12:23:27.585415 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:27.586352 18869 debug-util.cc:398] Leaking SignalData structure 0x7b08003762c0 after lost signal to thread 20397
I20260709 12:23:27.583715 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.577512 20407 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.586975 20439 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:27.591836 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:27.592605 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 266874us
I20260709 12:23:27.593730 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.589601 20439 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:27.596287 19486 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.606750 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.607986 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.659224 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.590835 18839 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:27.617628 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.646617 20443 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.607123 20452 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:27.658666 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50125.5us
W20260709 12:23:27.658797 18887 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.552s (SENT)
I20260709 12:23:27.666308 18919 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:27.599884 18764 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:27.662474 18768 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:27.662281 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.668006 20471 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.604137 20469 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:27.669034 20469 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:27.669454 20469 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:27.670738 18918 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.671602 18769 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:27.660246 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63278.1us
I20260709 12:23:27.666258 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:27.664578 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 219765us
I20260709 12:23:27.675776 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.591997 20398 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:27.679483 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 253589us
I20260709 12:23:27.680254 20485 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.686821 20485 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:27.687247 20485 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.674708 20443 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:27.690673 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.674055 20360 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.691646 20333 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:27.694315 20333 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:27.694089 20413 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:27.684348 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.697742 20413 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:27.698184 20413 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:27.699105 18887 leader_election.cc:336] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.637s (SENT)
I20260709 12:23:27.699086 20413 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.700886 20413 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.702736 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.706171 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.707098 20300 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:27.703990 20470 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.711889 20470 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:27.712005 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:27.712539 20470 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.713500 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.709481 20467 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:23:27.680007 20431 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.727814 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.729559 20431 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.732789 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.736470 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.738200 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.694998 20333 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:27.740381 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.741108 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.756546 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.679447 20432 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.764710 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:27.768343 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:27.743671 20360 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:27.777026 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.758879 20472 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.783315 18848 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:27.787724 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.767596 20300 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:27.774211 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.768330 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:27.797586 18764 raft_consensus.cc:606] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:27.799425 20439 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.800606 20439 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.802845 20407 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:27.803400 20407 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:27.803905 20407 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.804836 20398 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.807111 20471 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.795907 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.809842 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.813627 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.785408 20472 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:27.821709 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.837036 19485 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.837854 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.820578 18670 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.841610 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.848265 20153 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:23:27.855118 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.821237 20471 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:27.857177 20153 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:27.858235 20153 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:27.860167 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.864089 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.864821 19486 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.866801 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.867602 19489 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:27.870713 20153 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.871934 20153 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.838838 20472 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.795051 20483 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.878238 20384 raft_consensus.cc:1064] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:27.891307 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:27.892156 20384 raft_consensus.cc:1068] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Unable to promote non-voter 43b520eabb65493abe84f4cf06806cba: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:27.893560 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.894930 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.896761 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.879518 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.880733 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.880916 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.881266 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.882026 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.882941 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.891292 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.903294 18845 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:27.908418 20408 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:27.909070 20408 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.911414 20408 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.919198 18918 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:27.931470 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61915.7us
I20260709 12:23:27.808481 20333 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:27.905113 20437 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.562s	user 0.014s	sys 0.000s
I20260709 12:23:27.890146 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.901226 20411 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.939004 18839 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
W20260709 12:23:27.935031 20361 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.000s
I20260709 12:23:27.935815 20482 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.943665 20361 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:27.945935 20482 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.935411 20489 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:27.935662 20407 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.946957 20489 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:27.948678 20407 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:27.949235 20489 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.950627 18765 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.940526 20437 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:27.956215 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.956629 19485 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:27.957592 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:27.958709 19486 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:27.959057 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:27.960206 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:27.962957 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:28.000206 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.058846 18843 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:28.060093 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.061304 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.974552 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:28.062687 19484 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:27.966986 20432 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:27.966907 20496 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.063601 20496 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:28.063359 20472 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.064881 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.065555 18843 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:28.065855 20472 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.067970 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.069242 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.997394 18842 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.938593 20300 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.082257 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.082042 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.084287 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.085292 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.085863 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:28.040228 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 75676.3us
I20260709 12:23:28.087924 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:27.971138 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.064522 20496 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:27.969285 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.969712 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.015130 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.074383 18918 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:27.946167 20361 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:27.970542 20486 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:27.968056 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.083657 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:28.099668 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 84613.8us
I20260709 12:23:28.100185 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.100543 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.978916 20333 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.981079 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.093182 18848 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:28.093901 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.096340 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.084333 20488 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.109095 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.994938 20437 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:28.095525 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 321396us
I20260709 12:23:28.102387 20408 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.102821 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.111857 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.103318 20467 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:27.968436 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.106048 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.090025 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.106280 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.967620 20483 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:28.111351 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:27.954320 20469 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.109275 20486 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:28.095814 20470 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.137090 20486 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.138152 20470 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.083657 20498 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:23:28.106680 20472 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.149324 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.152626 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:27.969326 20489 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 12:23:28.154110 20489 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.154651 20489 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:28.156705 19484 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:27.977939 20384 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 12:23:27.965931 20485 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.118134 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.117702 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.164808 18841 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:28.164597 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:28.124961 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.129978 20411 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:28.166317 20411 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:28.125711 20361 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:28.118129 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.166917 20411 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.119095 20492 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:23:28.118366 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:28.121075 20496 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:28.168102 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 82894.7us
I20260709 12:23:28.125504 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.131790 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.132619 18918 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:28.149482 20472 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:28.170097 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.107666 20499 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:28.178074 20472 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:28.172449 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47024.8us
I20260709 12:23:28.173249 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.181063 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.156175 20489 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.184567 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:28.185968 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:28.186769 18913 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:28.181972 20153 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:28.187484 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.188174 20499 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.188416 20470 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:28.188622 20499 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:28.189107 20499 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.187664 20153 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:28.190680 20153 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.176568 20361 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.175604 20408 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.192785 18845 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:28.192958 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.179694 20487 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.182924 20469 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.205725 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:28.208760 20153 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.210724 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:28.194489 20495 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.197475 20408 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:28.185149 20413 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:23:28.216665 18669 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 3, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.213125 20489 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.222745 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.223532 20153 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.199204 20487 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:28.240844 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44064.1us
I20260709 12:23:28.225690 20408 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.199995 20300 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:28.218263 20503 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.243925 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.247088 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.247952 20153 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:28.248325 20153 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:28.248564 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.248672 20153 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.249022 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.251820 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:28.243988 20504 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:28.257230 20504 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:28.257937 20504 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.263115 20408 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.264806 20488 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:28.265285 20488 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:28.265890 20408 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.271688 20485 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.252928 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.253996 20361 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.278900 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.280557 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.254631 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.284166 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.286985 20471 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.287495 20471 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:28.287917 20471 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.289877 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.224112 20470 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:23:28.291519 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.296003 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:28.252477 20495 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.274127 20398 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.275578 20485 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:28.292690 20467 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:28.310185 20413 raft_consensus.cc:1064] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:28.289472 20300 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:28.296913 20439 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.314669 20384 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:28.307981 20153 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.268354 20488 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:28.319073 20505 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:23:28.321682 20411 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.323657 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.293144 20487 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.292671 20498 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:23:28.293354 20503 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:23:28.343315 18922 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:28.304927 20398 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:28.365985 20153 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.366106 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.343057 20361 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:28.367607 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 77778.8us
I20260709 12:23:28.388921 18738 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:28.349777 20413 raft_consensus.cc:1068] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Unable to promote non-voter 43b520eabb65493abe84f4cf06806cba: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:28.348212 20495 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:28.393805 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.394235 20487 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.344558 20439 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:28.349326 20384 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:28.393347 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 85919.6us
I20260709 12:23:28.396174 20153 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:28.398025 20153 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:28.398497 20153 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:28.396811 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.400211 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:28.402670 18887 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.509s (SENT)
I20260709 12:23:28.384507 20408 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:28.412966 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:28.434950 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.415493 20507 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:28.418567 20472 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.389974 20398 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.390270 20361 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:28.447028 20361 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.450634 20153 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:28.451731 20411 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.452814 20153 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.422560 20407 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:28.393335 20360 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.392988 20495 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:28.432246 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.438194 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:28.399067 20439 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.440199 20431 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:28.401144 20488 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:28.462929 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 264284us
I20260709 12:23:28.437275 20413 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.433872 20408 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:28.482882 19485 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:28.462301 20407 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:28.473233 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:28.461529 20511 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.456571 20510 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:23:28.470223 20495 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.479298 20486 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.492552 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:28.492852 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:28.494199 18768 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:28.499076 18770 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.494850 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:28.492581 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:28.483852 20413 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:28.485070 20408 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.496589 18767 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:28.485733 20407 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.504168 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:28.508070 20153 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:28.509788 18768 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:28.510897 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:28.511710 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:28.512619 18768 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:28.487669 20511 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:28.515583 18767 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:28.520409 20153 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:28.517599 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:28.521057 20153 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.521742 18768 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:28.501520 20486 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:28.524217 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.505505 20413 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.523185 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:28.486630 20471 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.529433 20153 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:28.527086 18771 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:28.530786 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:28.532164 18767 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.537782 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.532174 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:28.540319 18768 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:28.540772 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:28.522472 20431 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:28.484822 20384 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.528349 20411 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.485980 20512 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:23:28.556468 18769 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:28.532091 20486 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.533433 20516 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:23:28.569578 20516 consensus_queue.cc:1243] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:28.547150 20431 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:28.570674 20431 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.557662 18845 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:28.558377 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.558614 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.558547 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.568684 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.562341 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:28.587612 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 123087us
I20260709 12:23:28.608992 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.610774 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.611562 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.612519 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:28.613385 20472 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:28.589762 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.615744 18767 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:28.615986 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:28.605738 20521 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:28.553066 20411 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:28.543955 20504 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:28.632994 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.633102 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.607440 20512 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:28.656210 20408 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.662931 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:28.632268 20384 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:28.759019 20467 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:28.771253 20510 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:28.869230 20495 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:28.784413 20408 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.664378 20512 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:28.767251 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:28.775043 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.581494 20519 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:28.633982 20524 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:29.231190 20524 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:29.231691 20524 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:28.668399 20520 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:29.234724 20520 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:29.235211 20520 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:29.236487 18671 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 2 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.613425 20511 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.816222 20523 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:29.238804 20522 consensus_queue.cc:1175] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "43b520eabb65493abe84f4cf06806cba" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:23:28.930117 18770 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:29.240190 18770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:28.951622 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:28.986315 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:29.240725 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 624771us
I20260709 12:23:29.241146 18764 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
W20260709 12:23:29.241550 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 279459us
I20260709 12:23:29.242074 18767 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:29.242760 20497 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.069263 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:29.244062 18771 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:29.074128 18840 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.062492 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:29.245409 18769 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:29.078284 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.245757 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.246649 18840 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:29.079481 18842 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:29.075839 18811 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.030s	sys 0.030s
I20260709 12:23:29.121941 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:29.248247 18811 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.031s	sys 0.031s
W20260709 12:23:29.157994 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.062s	sys 0.114s
I20260709 12:23:29.169348 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:23:29.248761 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.063s	sys 0.115s
W20260709 12:23:29.249375 18887 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.513s (SENT)
W20260709 12:23:29.249871 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.253372 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.170476 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.254679 18845 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:29.240799 18770 raft_consensus.cc:606] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.254194 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.256108 18916 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:29.174552 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58665.2us
W20260709 12:23:29.179771 18888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.020s	sys 0.040s
W20260709 12:23:29.259845 18888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.020s	sys 0.040s
I20260709 12:23:29.263096 20532 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:29.263096 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.707s (SENT)
W20260709 12:23:29.250262 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.265586 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.187019 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:29.266918 18670 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 160) took 1655 ms. Trace:
I20260709 12:23:29.198177 18841 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.199577 18844 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:29.204301 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.842384 20300 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:28.862048 20361 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.834059 20407 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.361599 20407 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:28.800432 20411 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.000664 20431 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.377061 20431 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:28.931468 20439 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.387293 20439 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:28.865823 20398 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.985572 20413 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.390233 20398 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:29.390815 20413 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:29.095003 20469 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.393517 20469 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:28.830279 20471 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:28.928805 20485 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:29.399370 20485 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:29.400413 20485 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.401855 20485 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.983207 20486 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.404651 18922 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:29.405903 20486 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:29.000326 20487 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.009s
W20260709 12:23:28.866825 20489 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.625s	user 0.001s	sys 0.011s
I20260709 12:23:28.879189 20495 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:28.928885 20496 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.003s
I20260709 12:23:28.534876 20498 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:28.854769 20499 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.008s
I20260709 12:23:29.419579 20499 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.420892 18772 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:29.422060 20499 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:28.826434 20504 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:29.227589 18765 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.729s	user 0.014s	sys 0.016s
I20260709 12:23:28.876592 20512 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.241619 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:29.032245 18768 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.431077 18765 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
W20260709 12:23:29.431890 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 190353us
I20260709 12:23:29.432039 20504 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.432801 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.433059 20469 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:29.433647 20526 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.242722 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:29.435045 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 192417us
I20260709 12:23:29.436055 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.437366 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.438103 20407 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.438812 20407 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.438676 20439 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:29.134416 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.439895 18848 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:29.269182 18845 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:29.440475 20439 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.441306 20439 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:29.271482 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.285730 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.267366 18670 rpcz_store.cc:276] 0709 12:23:27.609380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.662022 (+ 52642us) service_pool.cc:224] Handling call
0709 12:23:29.265088 (+1603066us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:28.133007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:28.133624 (+   617us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:28.133660 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:23:28.133679 (+    19us) tablet.cc:662] Decoding operations
0709 12:23:28.134032 (+   353us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:28.134090 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:28.134116 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:28.134303 (+   187us) tablet.cc:701] Row locks acquired
0709 12:23:28.134321 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:28.134550 (+   229us) write_op.cc:270] Start()
0709 12:23:28.134669 (+   119us) write_op.cc:276] Timestamp: P: 1783599808134496 usec, L: 0
0709 12:23:28.134692 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:23:28.135510 (+   818us) log.cc:844] Serialized 530 byte log entry
0709 12:23:29.152560 (+1017050us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b540006a7a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af00dbe 00007f335af0b930 00007f335af0b8d8 00007f335af0b858 00007f335af0b813 00007f335af0aa9c 00007f3360df62f6 00007f3360df0aa8 00007f335af477cb 00007f335af4a2c0
0709 12:23:29.163679 (+ 11119us) op_driver.cc:464] REPLICATION: finished
0709 12:23:29.176344 (+ 12665us) write_op.cc:301] APPLY: starting
0709 12:23:29.176464 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:29.176579 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:29.176601 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:29.176906 (+   305us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:29.177069 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:29.177115 (+    46us) write_op.cc:312] APPLY: finished
0709 12:23:29.177324 (+   209us) log.cc:844] Serialized 23 byte log entry
0709 12:23:29.178179 (+   855us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:29.178258 (+    79us) write_op.cc:454] Released schema lock
0709 12:23:29.178297 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:29.179049 (+   752us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:29.179078 (+    29us) write_op.cc:454] Released schema lock
0709 12:23:29.182212 (+  3134us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:29.182249 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28573,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":12364,"apply.run_cpu_time_us":1724,"apply.run_wall_time_us":2704,"num_ops":1,"prepare.queue_time_us":261071,"prepare.run_cpu_time_us":30641,"prepare.run_wall_time_us":81108,"raft.queue_time_us":17190,"raft.run_cpu_time_us":8291,"raft.run_wall_time_us":19038,"replication_time_us":1028804,"spinlock_wait_cycles":5150464,"thread_start_us":185154,"threads_started":4,"wal-append.queue_time_us":102186}]]}
I20260709 12:23:29.289058 19484 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
W20260709 12:23:29.442490 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 156825us
I20260709 12:23:29.443583 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.444340 20539 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.444711 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.445474 20532 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.445917 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.295989 18841 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:29.296095 20520 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.297284 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:29.282954 20384 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:29.285579 20537 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:23:29.465931 20384 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.466624 20537 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:29.467039 20537 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:29.467198 20520 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:29.310706 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44155.6us
I20260709 12:23:29.467942 20537 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.468968 20384 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:29.469278 20537 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:29.470773 20540 consensus_queue.cc:1175] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
W20260709 12:23:29.471462 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.698s (SENT)
I20260709 12:23:29.471961 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.472126 18914 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:29.473296 20384 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.315557 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.318480 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.474879 20500 raft_consensus.cc:993] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
W20260709 12:23:29.475016 18887 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.797s (SENT)
I20260709 12:23:29.475412 20360 raft_consensus.cc:1081] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:23:29.475513 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.321882 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:29.476603 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.877s (SENT)
I20260709 12:23:29.322310 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.477015 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:29.321905 19457 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.825s (SENT)
I20260709 12:23:29.477772 20487 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:29.478116 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 156237us
I20260709 12:23:29.478475 20487 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:29.479588 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.948s (SENT)
W20260709 12:23:29.480082 19457 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.014s (SENT)
I20260709 12:23:29.339677 18669 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 264) took 1130 ms. Trace:
I20260709 12:23:29.480561 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.342242 20538 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:29.481185 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.481474 20538 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:23:29.481695 19457 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.025s (SENT)
I20260709 12:23:29.329808 20300 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:29.482432 20538 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.483143 20300 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.483778 20538 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:29.484493 20300 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:29.332144 20525 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.343058 20361 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:29.486703 20525 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.343644 18773 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:29.480608 18669 rpcz_store.cc:276] 0709 12:23:28.209176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.209449 (+   273us) service_pool.cc:224] Handling call
0709 12:23:29.339587 (+1130138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:28.253225 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:28.256208 (+  2983us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:28.256238 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:23:28.256250 (+    12us) tablet.cc:662] Decoding operations
0709 12:23:28.288823 (+ 32573us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:28.297333 (+  8510us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:28.299448 (+  2115us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:28.334093 (+ 34645us) tablet.cc:701] Row locks acquired
0709 12:23:28.334129 (+    36us) write_op.cc:260] PREPARE: finished
0709 12:23:28.372297 (+ 38168us) write_op.cc:270] Start()
0709 12:23:28.390382 (+ 18085us) write_op.cc:276] Timestamp: P: 1783599808365007 usec, L: 0
0709 12:23:28.390438 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 12:23:28.472102 (+ 81664us) log.cc:844] Serialized 530 byte log entry
0709 12:23:29.176548 (+704446us) op_driver.cc:464] REPLICATION: finished
0709 12:23:29.179987 (+  3439us) write_op.cc:301] APPLY: starting
0709 12:23:29.180065 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:29.180171 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:29.180297 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:29.180565 (+   268us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:29.180722 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:29.180775 (+    53us) write_op.cc:312] APPLY: finished
0709 12:23:29.180985 (+   210us) log.cc:844] Serialized 23 byte log entry
0709 12:23:29.181165 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:29.181246 (+    81us) write_op.cc:454] Released schema lock
0709 12:23:29.181289 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":54168,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":3194,"apply.run_cpu_time_us":1605,"apply.run_wall_time_us":1605,"num_ops":1,"prepare.queue_time_us":4647,"prepare.run_cpu_time_us":4278,"prepare.run_wall_time_us":233792,"replication_time_us":783856,"thread_start_us":5325,"threads_started":1}]]}
I20260709 12:23:29.351213 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.486608 20532 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:29.358073 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:29.292447 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.027s	sys 0.039s
I20260709 12:23:29.388012 18766 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:29.508690 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.030s	sys 0.039s
W20260709 12:23:29.509052 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 968344us
I20260709 12:23:29.509647 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 259) took 1015 ms. Trace:
I20260709 12:23:29.510041 18766 rpcz_store.cc:276] 0709 12:23:28.494453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.495310 (+   857us) service_pool.cc:224] Handling call
0709 12:23:28.495584 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:29.508822 (+1013238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.509404 (+   582us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54002116d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:29.509582 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047348992}
I20260709 12:23:29.409148 20398 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:29.512117 20398 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:29.512579 20398 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:29.409502 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:29.513598 20398 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.415158 18843 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:29.163198 20503 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:29.015843 20516 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:29.292287 20524 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.454669 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:29.441707 20439 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:29.455498 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.456521 20539 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.456920 20512 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:29.527051 20398 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:29.528496 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 220) took 1526 ms. Trace:
I20260709 12:23:29.528800 20524 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:29.529022 18843 rpcz_store.cc:276] 0709 12:23:28.002138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.108815 (+106677us) service_pool.cc:224] Handling call
0709 12:23:29.528237 (+1419422us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400285354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:29.528383 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3002111872}
I20260709 12:23:29.529042 20516 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.530350 18916 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:29.531069 20439 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.532900 20439 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.534639 20504 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:29.535058 20504 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:29.535447 20504 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.443583 20469 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.467304 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:29.480005 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.492494 20540 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.537704 20361 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.380256 20511 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.538520 20540 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:29.538746 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.384624 20411 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.498736 18915 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:29.499758 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.528822 20503 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:29.501688 20520 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:29.544247 20503 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:29.546028 20503 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:29.546868 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 92342.7us
I20260709 12:23:29.505383 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.547600 20525 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:29.550642 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 112206us
I20260709 12:23:29.551267 20524 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:29.554576 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75000.6us
I20260709 12:23:29.555275 20516 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:29.556034 20526 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:29.566449 20526 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:29.566879 20526 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:29.567049 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:29.567893 20526 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.569382 20526 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:29.556838 20520 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:29.571782 20516 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:29.572402 20516 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:29.573496 20516 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:29.582237 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 76946.7us
I20260709 12:23:29.588071 18915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54070
I20260709 12:23:29.588806 18915 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:29.589200 18915 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.591009 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:29.595618 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:29.509985 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:29.597061 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 87155.9us
I20260709 12:23:29.597914 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:29.482157 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.592630 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:29.593549 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 112435us
I20260709 12:23:29.601095 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:29.604736 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.599192 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:29.606391 18738 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.603636 20520 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.607172 20408 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.607298 20538 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:29.627802 20538 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:29.608129 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.628839 20538 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.631937 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:29.632436 20485 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.632617 18766 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
W20260709 12:23:29.608927 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127239us
I20260709 12:23:29.610095 20300 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.614281 20537 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:29.636281 19457 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.082s (SENT)
I20260709 12:23:29.614886 20384 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:29.637287 20384 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:29.637749 20384 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.638011 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:29.639964 20439 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:29.640610 20439 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.640978 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:29.642128 20487 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:29.611166 20361 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.622614 20413 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:29.618793 20398 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.645897 20398 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.649847 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:29.650496 20398 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:29.649871 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:29.651796 18919 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:29.652781 20487 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:29.653292 20487 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:29.653869 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:29.654840 20384 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:29.655581 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.656006 18917 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.611366 20525 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.638192 18839 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:29.658474 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:29.612555 20532 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:29.665563 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1560) took 1107 ms. Trace:
I20260709 12:23:29.658421 20487 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.663439 20439 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:29.668433 20487 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:29.669265 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.662989 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56859us
W20260709 12:23:29.663184 18887 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.675s (SENT)
I20260709 12:23:29.663285 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:29.671332 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.665007 20361 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.666481 18839 rpcz_store.cc:276] 0709 12:23:28.557950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.558137 (+   187us) service_pool.cc:224] Handling call
0709 12:23:29.665371 (+1107234us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400194e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:29.665497 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2431155072}
I20260709 12:23:29.680576 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:29.680893 18766 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:29.684367 19485 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.685865 19492 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:29.687620 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:29.688416 19492 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:29.689220 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.690156 20407 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.689726 20408 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:29.691534 20408 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:29.691939 20408 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:29.692788 20408 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:29.695582 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.696084 18915 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.698570 20408 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.711273 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:29.715739 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:29.718554 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.700850 19492 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:29.669157 20398 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:29.717350 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:29.705757 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.733088 18915 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:29.736150 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:29.737632 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:29.738708 19489 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:29.740074 18772 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:29.742429 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:29.743244 18765 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:29.743831 18773 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.744933 18765 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:29.744287 18766 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.746604 19485 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.746950 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.747812 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:29.748584 18765 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:29.749320 18766 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.751324 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:29.744963 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:29.753742 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46623.8us
I20260709 12:23:29.763260 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:29.763921 19486 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:29.769743 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.680766 20503 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:23:29.723541 20524 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.723834 20398 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.723505 20516 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.732429 20439 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.776371 19485 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.799226 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.768057 20411 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.801380 18738 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.798328 19486 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:29.741994 20361 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:23:29.806222 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.808032 18772 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:29.817713 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.539s (SENT)
I20260709 12:23:29.790333 20398 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:29.819661 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:29.802129 20472 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 12:23:29.826553 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70688.9us
I20260709 12:23:29.829137 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.829427 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.829813 18839 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.829926 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.830053 18843 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:29.832252 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.833109 18844 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:29.835638 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.835800 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.836362 18842 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:29.836441 18847 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:29.837055 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.802228 20498 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:29.839255 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.839854 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:29.805116 20360 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.774943 20542 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:23:29.843676 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:29.841038 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.882165 18848 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:29.839896 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.883677 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.884672 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.885062 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.885548 18844 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:29.885984 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.886351 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.824477 20499 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:29.877614 18839 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:29.849917 20486 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:29.801407 20516 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.881071 18843 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:29.827220 20411 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:29.887523 18844 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:29.887917 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.819084 20439 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:29.817781 20512 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:29.889976 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.876114 20537 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:29.902583 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.841704 20519 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:29.799603 20532 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.862072 20469 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:23:29.900887 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.821228 20504 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:29.862071 20539 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:23:29.875716 20530 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:29.904537 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.897039 20499 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:29.893419 20550 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.895175 18840 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.878180 20498 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.888520 20471 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.888942 20496 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:29.915557 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.963037 18839 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:29.918311 18845 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:29.920185 20504 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:29.904408 20439 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:29.898447 19484 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:29.970093 19489 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:29.931270 18848 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:29.933012 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.894219 20384 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:29.889060 20543 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:23:29.977263 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.892501 20538 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:23:29.904851 20411 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:29.964463 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.912319 20537 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:23:29.967885 19457 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.621s (SENT)
I20260709 12:23:29.904639 20512 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.964401 20528 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.988914 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:29.941028 20530 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:30.000653 18886 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.509s (SENT)
I20260709 12:23:30.001315 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:30.006116 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:29.974298 20496 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:29.971115 20471 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.021509 20560 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:29.998545 20550 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.022429 20530 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:30.022714 20471 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.022925 20550 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.024317 20537 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.025300 20550 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.026191 18839 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:30.027801 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:30.028728 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:30.029099 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:30.029496 20411 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:30.004349 18886 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.513s (SENT)
I20260709 12:23:30.029945 20561 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:30.031057 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:30.026803 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:30.039389 19485 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:30.029945 18844 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:30.042025 18886 leader_election.cc:336] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.516s (SENT)
I20260709 12:23:30.042593 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:30.036533 18846 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:30.003607 20555 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:30.136688 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:30.005656 20528 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.099903 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:30.056871 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:30.093513 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:30.016929 20413 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:30.092305 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50288.7us
W20260709 12:23:30.123176 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.091621 20539 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:30.094235 20550 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:30.022167 20560 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.141062 18915 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:30.144711 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 301140us
I20260709 12:23:30.141948 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:30.168363 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:30.038117 20499 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.137450 20469 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:30.135515 20555 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.047511 20561 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.164119 20559 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:30.154006 20384 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.090322 20439 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:30.167855 20539 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:30.160027 20528 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.161219 20556 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:30.243453 20558 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:23:30.250224 20525 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
I20260709 12:23:30.168651 20516 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.248636 20520 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:30.268481 20555 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.377115 20561 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:30.286616 20540 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:30.293944 20529 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:30.375264 20559 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:30.257606 20560 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.391685 20559 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.393151 20559 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:30.387998 20542 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:30.098651 18766 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:30.434762 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:30.436372 18766 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.100101 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:30.442859 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:30.444054 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:30.445134 18767 raft_consensus.cc:2376] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3. Re-sending same reply.
I20260709 12:23:30.099310 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:30.099468 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:30.098757 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:30.450214 18770 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:30.098089 18773 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:30.455569 20575 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:30.456669 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 350212us
I20260709 12:23:30.456621 20575 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.459684 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:30.461717 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.480454 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.472894 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.473110 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.143970 18839 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:30.488410 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:30.164323 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:30.491657 18844 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:30.138087 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:30.147358 18847 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:30.496327 18847 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:30.474728 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:30.501677 18848 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:30.478024 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.493657 18844 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:23:30.509277 18847 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:30.490103 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:30.515930 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56508.6us
I20260709 12:23:30.519383 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:30.521147 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:30.227088 19513 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9020 after lost signal to thread 17571
I20260709 12:23:30.525471 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:30.527065 19513 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9700 after lost signal to thread 18705
I20260709 12:23:30.527379 19484 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:30.528657 20300 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:30.516026 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:30.281126 20512 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:30.529239 19513 debug-util.cc:398] Leaking SignalData structure 0x7b080020b060 after lost signal to thread 18797
I20260709 12:23:30.287281 20407 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:30.564142 18916 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:30.224928 20469 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:30.570101 20472 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:30.570421 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49529.8us
I20260709 12:23:30.571641 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:30.572892 20516 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:30.572584 20431 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:30.573444 20516 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:30.573930 20516 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.576299 20551 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:30.571170 20472 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.375911 20496 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:30.279635 20498 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:30.388666 20540 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:30.598842 20560 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:30.599548 20560 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:30.600059 20560 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:30.592131 20408 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.867s	user 0.011s	sys 0.004s
I20260709 12:23:30.392028 20539 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.586259 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:30.595184 20503 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:30.595563 20384 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.597023 18765 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:30.273000 20486 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:30.386376 20522 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:30.622880 20522 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:30.624735 20522 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.386047 20520 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:30.628808 20431 raft_consensus.cc:1064] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:30.601538 20540 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.560801 20529 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:30.631999 20540 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:30.603157 20407 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:30.636204 20407 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.626111 20522 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.638847 18767 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:30.603652 20398 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.007s
I20260709 12:23:30.603014 20469 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.394447 20542 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:30.569013 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:30.609572 18766 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:30.612947 20575 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:30.612864 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.614904 19513 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7620 after lost signal to thread 18872
I20260709 12:23:30.615651 19489 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:30.657130 19486 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
W20260709 12:23:30.657922 19513 debug-util.cc:398] Leaking SignalData structure 0x7b0800319de0 after lost signal to thread 18946
W20260709 12:23:30.659775 19513 debug-util.cc:398] Leaking SignalData structure 0x7b0800219b40 after lost signal to thread 19516
W20260709 12:23:30.615810 20487 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.947s	user 0.015s	sys 0.000s
I20260709 12:23:30.586459 20563 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:30.612805 20498 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:30.664551 20498 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.616796 20499 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:30.666988 20499 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:30.669011 20499 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.618774 20503 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.664913 18669 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.673602 20503 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:30.590204 20568 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:23:30.633533 20529 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.676522 20529 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.385340 20525 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:30.628244 20520 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.651723 20469 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:30.654646 20542 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:30.655257 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 83870.8us
I20260709 12:23:30.683168 20520 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:30.685097 18764 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:30.687379 20472 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.687563 20487 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:30.688136 20487 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:30.691059 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:30.691502 20408 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.692332 20408 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.693166 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:30.693853 20528 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.694489 20575 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:30.695264 20575 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:30.647507 18887 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.865s (SENT)
I20260709 12:23:30.698990 20578 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:30.701725 20578 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:30.699290 20575 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.703099 20578 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.705564 20578 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.706746 20407 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.707562 20498 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.689539 20487 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:30.710070 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.679147 20398 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.699760 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:30.720151 20472 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:30.721045 20472 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:30.722139 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:30.725247 20398 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.729159 20560 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.706789 20542 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:30.731091 18842 raft_consensus.cc:2368] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:23:30.710835 20431 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.730543 20472 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.750873 20486 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:30.753425 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.743566 19457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.019s	sys 0.032s
W20260709 12:23:30.760622 19457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.019s	sys 0.032s
I20260709 12:23:30.761778 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:30.769701 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:30.775676 18843 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:30.778213 20552 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.778925 20552 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.781553 20552 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.782723 18768 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:30.782850 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:30.783707 20516 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:30.784775 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:30.786334 20408 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.800837 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:30.794756 20561 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:30.802141 18767 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:30.802167 20561 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:30.804682 20561 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:30.812166 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.812556 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:23:30.813895 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73969.8us
I20260709 12:23:30.816136 20398 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:30.817764 20498 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:30.818200 20498 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:30.814249 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:30.820889 20408 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:30.821375 20408 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.821794 20408 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:30.824383 20539 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:30.819453 20498 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.829231 20384 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.832600 20487 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:30.832849 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:30.833578 19492 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.835615 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:30.836334 20560 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:30.837780 18917 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:30.837706 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:30.839383 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:30.839469 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:30.840277 18913 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:30.793584 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 206723us
I20260709 12:23:30.786271 20516 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:30.864414 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:30.865538 19484 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:30.866696 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:30.867831 18765 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 2: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:30.866696 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:30.871869 19492 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
W20260709 12:23:30.872160 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.874821 18841 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:30.883929 18913 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
W20260709 12:23:30.889882 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.894069 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:30.895287 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:30.896893 20522 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:30.897552 20522 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:30.897742 20496 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:30.898717 20522 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.899864 20512 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:30.899051 20496 consensus_queue.cc:1243] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:30.903260 20512 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:30.903880 20512 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:30.905576 20512 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:30.906538 19457 leader_election.cc:336] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.728s (SENT)
I20260709 12:23:30.907377 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:30.908167 20512 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.908583 20469 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:30.919109 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 318019us
W20260709 12:23:30.920157 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.074s (SENT)
W20260709 12:23:30.921558 18887 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.075s (SENT)
I20260709 12:23:30.922113 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:30.923085 20556 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.923640 20556 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.910190 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:30.930488 20552 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:30.933136 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:30.934553 18765 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:30.937341 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.940680 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.941883 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:30.947983 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:30.949244 18765 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:30.952451 19492 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:30.950903 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:30.955010 19484 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:30.942380 20516 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.966518 20413 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:30.972051 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.979404 18765 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:30.982877 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:30.984999 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63502.2us
I20260709 12:23:30.989858 20496 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:30.990489 20496 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:30.990960 20496 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.991396 20498 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:30.991950 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81949.4us
I20260709 12:23:30.993332 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:30.994724 20469 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:30.995349 20469 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:30.997038 20556 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:30.998342 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:30.999258 20520 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:30.998692 20413 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:30.999879 20487 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:31.001210 20487 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.001600 20487 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:30.999909 20520 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:31.002624 20516 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.003970 20520 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:31.005481 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.996428 20469 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:31.008787 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.172s (SENT)
I20260709 12:23:31.010591 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:31.011855 18840 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:31.012602 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 245) took 1099 ms. Trace:
I20260709 12:23:31.014268 18840 rpcz_store.cc:276] 0709 12:23:29.913132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.998109 (+ 84977us) service_pool.cc:224] Handling call
0709 12:23:30.813936 (+815827us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66eee 000000000036eb39 00007f335feda1e0 00007f335ffa30c4 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:23:31.012531 (+198595us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15929600}
I20260709 12:23:31.013301 20487 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:31.015987 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.017443 18768 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:31.017375 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:31.012774 20556 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:31.018383 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:31.034685 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.018661 18764 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:31.019901 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:31.036700 18769 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:31.022274 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:31.024315 18772 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.024574 18773 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:31.037853 18766 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:31.025482 18770 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:31.012059 18887 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.178s (SENT)
I20260709 12:23:31.034045 18765 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:31.045442 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:31.046535 18842 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.047116 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:31.051492 20487 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:31.052961 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.054898 20537 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.057653 20520 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:31.039310 18886 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:31.002153 20413 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:31.031607 20516 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:31.070283 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 77157.9us
W20260709 12:23:31.072026 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.077921 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.087283 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.091297 18843 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:23:31.097620 20584 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:23:31.099586 20556 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:31.099642 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 167706us
I20260709 12:23:31.100400 20556 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.101794 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:31.102836 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.103507 20512 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.072876 20520 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.084591 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:31.104456 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.113667 18842 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:31.113555 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.114027 20384 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.103585 20556 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:31.104194 20512 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:31.116259 20512 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.121426 18771 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:31.086956 20413 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.119650 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.104161 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:31.107335 20520 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:31.127545 20361 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.126792 20542 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:23:31.135697 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.142040 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57841.6us
I20260709 12:23:31.133741 20522 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.107539 20408 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.146466 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:31.150763 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:31.152057 20524 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:31.152581 20556 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.153239 20556 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:31.155663 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 112373us
W20260709 12:23:31.156343 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.153923 20561 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.157426 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:31.136570 20516 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.150375 20539 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:31.162680 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50366.5us
I20260709 12:23:31.163955 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 1918) took 1064 ms. Trace:
I20260709 12:23:31.141531 20361 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.167906 18771 rpcz_store.cc:276] 0709 12:23:30.099984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.442076 (+342092us) service_pool.cc:224] Handling call
0709 12:23:31.163801 (+721725us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54001d4f54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:31.163902 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528333184}
I20260709 12:23:31.169150 20384 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:31.173239 20384 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.173527 20361 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.173662 20384 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:31.168176 20496 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.164682 18840 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:31.177029 20524 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:31.149923 20575 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:23:31.181242 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.160714 20556 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.180540 20524 consensus_queue.cc:1243] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:23:31.185978 20575 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.186249 20413 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:31.186914 20519 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.187170 20413 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:31.187311 20588 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:23:31.187417 20519 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:31.186460 20575 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:31.188823 20519 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.192931 20522 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.193184 20520 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.180505 20384 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.168027 20516 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.199313 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:31.199720 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:31.200578 20384 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.202651 20524 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.191869 18670 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 3, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.204640 18670 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:31.206174 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.200623 19489 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:31.206885 20519 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.212272 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:31.207633 18670 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:31.213786 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.214907 20471 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:31.193712 20469 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:31.214252 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:31.188519 20413 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:31.228223 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50515.7us
W20260709 12:23:31.218958 20592 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:23:31.234925 19486 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:31.234722 20591 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:23:31.239307 18840 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:31.239673 18841 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:31.240502 20524 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:31.232962 18670 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 5, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.241466 20524 consensus_queue.cc:1243] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:23:31.241979 20552 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.242234 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:31.242959 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.242636 20552 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:31.242741 18670 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.236590 20499 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:31.244415 20499 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.244585 18670 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 3, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.246076 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.236059 20539 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:23:31.243065 19489 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
W20260709 12:23:31.247951 20578 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.009s
I20260709 12:23:31.244247 20552 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.246369 18670 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 3, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.249403 20552 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.250162 20499 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.250808 20498 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.194929 20520 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:31.194723 20575 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.234884 20529 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.254586 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.269467 18922 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:31.256522 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:31.254648 20593 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:23:31.270566 18841 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:31.264801 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.275681 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:31.279561 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.241954 20542 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:23:31.282480 18922 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.282747 18842 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:31.285513 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:31.274869 20408 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:31.297483 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.305064 20300 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.312614 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.283526 20361 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:31.286935 20498 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.315486 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:31.342895 19486 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:31.317673 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:31.318480 20590 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:23:31.287338 20529 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:31.318778 19489 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:31.321309 20520 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.323323 19485 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 4 LEARNER]: Advancing to term 5
I20260709 12:23:31.346211 20529 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.324415 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:31.324682 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:31.350981 19483 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.351311 18841 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:31.325523 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:31.352820 18845 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:31.297492 20471 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:31.327632 20575 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.354242 20471 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.328460 20496 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.358225 20471 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.305009 20384 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:31.359071 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 94513.8us
I20260709 12:23:31.331614 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.273461 20469 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:31.364321 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 103991us
I20260709 12:23:31.368091 20539 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.369451 20539 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.337910 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:31.376179 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:31.377604 20499 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:31.378225 20499 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.378803 20499 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:31.384227 20560 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:31.384991 20560 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:31.333480 19457 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.074s (SENT)
I20260709 12:23:31.385488 20560 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.334143 20300 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:31.386227 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52837us
I20260709 12:23:31.388721 20300 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:31.276357 20524 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:23:31.390340 20524 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.390909 20524 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:31.391839 18921 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.392105 20524 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.393862 20524 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.338029 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:31.338739 19490 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:31.396945 18915 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:31.397475 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.340593 18922 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:31.330792 20472 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.403622 19485 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 5 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:31.406628 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.363325 20469 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.411528 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:31.412813 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 102083us
I20260709 12:23:31.341645 20361 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.415128 19490 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:31.416608 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.373383 20539 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:31.418864 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:31.420018 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54928.5us
I20260709 12:23:31.304450 20516 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:31.422756 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61652.2us
I20260709 12:23:31.426641 18915 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:31.430065 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:31.432241 18921 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:31.432461 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:31.433385 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.433336 19485 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:31.438201 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:31.443174 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.446485 18916 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:31.452672 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:31.422127 20472 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.455973 20472 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.456372 19483 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:31.456635 20472 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:31.457245 20472 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.457705 20472 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:31.462800 20516 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:31.430220 20604 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:23:31.463640 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.431295 20529 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:23:31.440897 20556 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:31.467240 20300 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:31.469177 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.472951 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.443043 20384 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:23:31.475134 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61367.9us
W20260709 12:23:31.475768 19457 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.519s (SENT)
I20260709 12:23:31.476050 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:31.466511 20552 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:31.480393 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:31.470949 20578 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:31.494954 20471 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:31.498729 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48500.4us
I20260709 12:23:31.499257 20499 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.502331 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.471107 20487 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:23:31.504694 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.505092 18919 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:31.506346 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:31.506548 20496 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.507208 18918 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:31.507653 20408 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.508311 20408 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.508785 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.509061 18918 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:31.509454 18920 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:31.480096 20552 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.510725 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.511492 20552 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.511545 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:31.511852 18914 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:31.512691 20520 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.470423 20556 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.515938 20575 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:31.516351 20556 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:31.516474 20575 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.516953 20575 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:31.520151 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44434.3us
W20260709 12:23:31.521028 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.526s (SENT)
I20260709 12:23:31.521485 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:31.521930 18918 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:31.523715 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.525756 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.526769 18918 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:31.526849 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:31.529110 20539 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.530050 20539 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.531023 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:31.531665 18917 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:31.532828 20469 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:31.534183 18919 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:31.534781 18919 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:31.535914 18919 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.545183 18919 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:31.539515 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:31.534525 20469 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:31.543310 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:31.554598 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.521029 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.495057 20578 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.569407 18920 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:31.561470 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:31.571295 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 134509us
W20260709 12:23:31.575944 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55073.7us
I20260709 12:23:31.577203 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:31.575991 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 100031us
W20260709 12:23:31.583685 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.560982 18914 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.556463 20499 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:31.587069 18917 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:31.580322 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:31.572079 20578 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:31.587477 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 109246us
I20260709 12:23:31.595702 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:31.595793 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.597949 20300 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.586125 20496 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:23:31.605172 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.608417 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.598706 20408 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.614593 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:31.616739 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:31.617624 19490 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:31.610034 20487 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.613227 20529 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:31.618737 20496 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.620532 19492 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 5 LEARNER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:31.620708 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.620769 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:31.621351 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.631438 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.635564 20300 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:31.635365 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:31.612479 20413 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.613437 20512 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.636631 19490 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:31.635447 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:31.611063 20606 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:31.604794 20499 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:23:31.640508 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.627122 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:31.602032 20605 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:23:31.633949 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.573s (SENT) [suppressed 49 similar messages]
I20260709 12:23:31.646541 20300 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.613911 20560 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.643111 20606 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.638803 20413 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:31.645661 19483 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:31.641396 20384 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:31.657792 20519 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:31.658303 20519 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:31.659426 20519 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.661199 20519 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.674815 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:31.674190 20471 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.681056 20361 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:31.681942 20361 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.686445 18920 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:31.653101 20606 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:31.715090 20487 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:31.656369 20384 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.650677 20602 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:23:31.668026 20408 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.721340 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:31.682658 20361 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.725113 20408 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.727500 20408 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:31.729399 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:31.694703 20300 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.676679 20471 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.749902 20361 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:31.739581 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.716861 20520 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:23:31.719544 20384 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:31.731781 18840 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:31.759007 18841 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.766191 18919 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:23:31.766806 18919 pending_rounds.cc:85] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
W20260709 12:23:31.767478 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 133545us
I20260709 12:23:31.750944 18842 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.770951 18843 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:31.773883 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.779313 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.779639 18887 leader_election.cc:336] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.766s (SENT)
I20260709 12:23:31.780150 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:31.782852 18914 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:31.783166 20472 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.792764 18843 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:31.784040 20560 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:31.769558 20621 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:31.807498 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120962us
I20260709 12:23:31.766911 20556 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.771996 20529 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:31.808348 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.767158 18919 pending_rounds.cc:107] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 12:23:31.816473 18919 raft_consensus.cc:2917] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 12:23:31.818578 18919 raft_consensus.cc:2889] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:31.822284 20610 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:23:31.823622 18845 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:31.765319 20413 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.827788 18918 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:31.822090 19483 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:31.812688 20575 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.836735 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:31.847901 18842 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:31.868165 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 93860.8us
W20260709 12:23:31.908960 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.914561 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.921231 18847 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.830554 20616 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:31.921066 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 325876us
I20260709 12:23:31.924645 18841 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.809046 20487 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:31.928112 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.848002 20496 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.931447 18845 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:31.933672 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 246695us
I20260709 12:23:31.919083 20516 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.935319 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:31.939491 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:31.943306 20512 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.944070 18839 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.939913 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:31.828838 20621 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:31.937608 20300 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.928532 18840 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.909008 20552 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.946610 18843 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.950762 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:31.956704 20472 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:31.957062 20617 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:31.925971 20578 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.965381 20300 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:31.972895 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.953063 20471 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:31.975350 18916 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:31.953189 20560 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.972460 18669 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 265) took 2092 ms. Trace:
I20260709 12:23:31.981380 18921 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:31.985737 20622 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:23:31.986119 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77038us
I20260709 12:23:31.987393 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:31.992987 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.007046 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:32.013466 18848 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:32.018421 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.975796 20496 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.020639 20300 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:32.024566 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.965096 20603 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:32.036252 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 73295.4us
W20260709 12:23:32.036054 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48761.1us
I20260709 12:23:32.038426 20516 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.039348 20516 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.046603 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:31.954289 20529 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:31.987795 20560 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:32.058125 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.059402 18848 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:32.057417 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:32.045302 20556 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.068827 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:32.071293 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:32.072445 20300 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.073114 20300 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.076190 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:32.078473 20614 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:32.033883 20496 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.034572 20607 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:23:32.078558 20300 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.065948 20575 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:32.109565 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70816.3us
I20260709 12:23:32.110694 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:32.069308 20615 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.071173 20627 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:32.113607 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:32.067147 20471 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:23:32.080974 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:32.051604 20603 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:32.123634 18844 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:32.129469 18848 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:32.131234 20300 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.132791 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:32.133648 19492 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
W20260709 12:23:32.144805 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.184798 18913 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:32.186244 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:32.187083 19486 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:31.978976 18669 rpcz_store.cc:276] 0709 12:23:29.880073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.880467 (+   394us) service_pool.cc:224] Handling call
0709 12:23:31.972344 (+2091877us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:30.794965 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:30.795727 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:30.795777 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:23:30.795814 (+    37us) tablet.cc:662] Decoding operations
0709 12:23:30.796316 (+   502us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:30.796430 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:30.796463 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:30.877502 (+ 81039us) tablet.cc:701] Row locks acquired
0709 12:23:30.877560 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:23:30.877769 (+   209us) write_op.cc:270] Start()
0709 12:23:30.877971 (+   202us) write_op.cc:276] Timestamp: P: 1783599810877697 usec, L: 0
0709 12:23:30.878009 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:23:30.878919 (+   910us) log.cc:844] Serialized 591 byte log entry
0709 12:23:31.592999 (+714080us) op_driver.cc:464] REPLICATION: finished
0709 12:23:31.713370 (+120371us) write_op.cc:301] APPLY: starting
0709 12:23:31.713556 (+   186us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:31.713677 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:31.713818 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:31.714207 (+   389us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:31.780406 (+ 66199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:31.800167 (+ 19761us) write_op.cc:312] APPLY: finished
0709 12:23:31.810923 (+ 10756us) log.cc:844] Serialized 23 byte log entry
0709 12:23:31.811884 (+   961us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:31.811988 (+   104us) write_op.cc:454] Released schema lock
0709 12:23:31.812045 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:31.812453 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:31.812482 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":418048,"child_traces":[["op",{"apply.queue_time_us":115277,"apply.run_cpu_time_us":2775,"apply.run_wall_time_us":99058,"num_ops":1,"prepare.queue_time_us":84518,"prepare.run_cpu_time_us":32938,"prepare.run_wall_time_us":310035,"raft.queue_time_us":322696,"raft.run_cpu_time_us":37575,"raft.run_wall_time_us":295461,"replication_time_us":692438,"spinlock_wait_cycles":1792,"thread_start_us":380172,"threads_started":4,"wal-append.queue_time_us":240381}]]}
I20260709 12:23:32.184100 20578 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.194764 20300 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.197886 18847 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:32.115697 20614 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:32.197808 18848 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:32.114504 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:32.211571 18839 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:32.212073 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 97703.3us
I20260709 12:23:32.214143 20512 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.214005 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:32.214654 18848 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:32.132208 20627 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:32.223062 18841 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:32.228016 20300 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.194346 19483 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:32.229482 18847 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:32.131699 20575 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
W20260709 12:23:32.248189 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.237043 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:32.204566 20614 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.312412 20614 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:32.307677 20520 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.194640 20522 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.314370 20520 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:32.314776 20522 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:32.316766 20520 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:32.317847 20637 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:23:32.304069 20512 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.321370 20496 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.310839 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:32.316825 20522 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:32.334024 19457 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.155s (SENT)
W20260709 12:23:32.334659 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 294561us
I20260709 12:23:32.334703 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:32.310536 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:32.297633 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.335947 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.336012 18847 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:32.329373 18841 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:32.332525 20384 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 12:23:32.222266 20471 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:32.192656 20634 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
W20260709 12:23:32.340427 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 103533us
I20260709 12:23:32.333196 20636 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.200088 20615 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:32.369103 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:32.371383 18842 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:32.346918 20560 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:32.339612 20471 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.413316 20471 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:32.342839 20512 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.415010 20512 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.415671 20512 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:32.344543 20472 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:32.343122 20384 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.346727 18919 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:32.421036 20384 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:32.428570 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.343307 20621 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:32.432916 20643 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:32.434060 20633 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 12:23:32.433002 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127785us
I20260709 12:23:32.494746 20643 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:32.496398 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.497123 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.497574 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.498013 20643 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:32.435572 20590 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:23:32.423862 20516 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.505311 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:32.480405 20607 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.430583 20560 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 12:23:32.517696 20606 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.767s	user 0.011s	sys 0.000s
I20260709 12:23:32.517443 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:32.518172 20552 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.435199 20636 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.537076 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:32.539943 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:32.521121 19483 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:32.522869 20608 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.501580 20578 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.526968 20649 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:32.527473 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.532967 20539 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.482996 20512 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:32.542281 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:32.431798 20627 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:32.546692 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.015s	sys 0.026s
W20260709 12:23:32.548640 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.549329 18914 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:32.546494 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:32.546051 20605 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.552943 18913 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:32.595971 18915 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:32.554211 18919 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:32.527727 20607 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:32.557384 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:32.562243 18920 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
W20260709 12:23:32.563009 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.016s	sys 0.026s
W20260709 12:23:32.591630 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.606745 20642 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.294s	user 0.004s	sys 0.002s
I20260709 12:23:32.606534 20605 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:32.608891 18917 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:23:32.610589 20645 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:23:32.610865 20608 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:32.611865 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1639) took 1108 ms. Trace:
I20260709 12:23:32.612318 18921 rpcz_store.cc:276] 0709 12:23:31.503880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.504372 (+   492us) service_pool.cc:224] Handling call
0709 12:23:32.611591 (+1107219us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:32.611751 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094454528}
I20260709 12:23:32.613788 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:32.609110 20605 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:32.614004 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1633) took 1141 ms. Trace:
I20260709 12:23:32.534343 20606 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.617292 18916 rpcz_store.cc:276] 0709 12:23:31.472451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.472609 (+   158us) service_pool.cc:224] Handling call
0709 12:23:32.613762 (+1141153us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540027ddd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:32.613922 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130856192}
I20260709 12:23:32.556038 20603 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:32.619005 19490 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:32.558561 20469 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:32.620523 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.635160 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:32.638881 18765 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.640443 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.642331 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.643260 18768 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:32.637943 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:32.646951 18772 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.647053 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.649013 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:32.650271 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.613418 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:32.556238 20578 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.573558 20539 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.656594 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:32.622937 20605 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.613377 20608 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:32.660392 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:32.660617 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.663637 18766 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:32.677757 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:32.678697 19490 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:32.646011 20498 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.657536 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.654264 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.677711 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:32.688489 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.684890 19489 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:32.690866 18769 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:32.707432 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.689653 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:32.714550 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:32.715602 19486 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:32.644940 20469 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:32.679472 20635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.027s	sys 0.082s
W20260709 12:23:32.697914 18840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.018s	sys 0.026s
I20260709 12:23:32.681890 20520 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:32.680181 20398 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:32.687543 20605 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:32.722162 20635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.028s	sys 0.084s
I20260709 12:23:32.725980 20522 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:32.727850 20398 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.718492 20634 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.735389 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.738356 18773 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:32.730156 18764 raft_consensus.cc:2368] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:32.687718 20498 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:32.726969 18840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.018s	sys 0.026s
I20260709 12:23:32.730805 20496 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:32.727639 20520 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.730034 20636 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:32.741052 20634 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:32.732514 20649 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:23:32.742547 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 130093us
I20260709 12:23:32.738644 20522 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:32.745954 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 346120us
I20260709 12:23:32.803999 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:32.751423 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:32.880386 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 162938us
I20260709 12:23:32.807021 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:32.861271 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:32.954838 18767 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:32.954770 18773 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:32.955590 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 94489.2us
I20260709 12:23:32.956678 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:32.867452 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:32.953575 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:32.738992 20398 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:32.960803 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 93494.4us
W20260709 12:23:32.962019 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.963142 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.963660 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.964617 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.709s (SENT)
W20260709 12:23:32.834612 20648 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:32.965173 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:32.950958 20472 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.005s
W20260709 12:23:32.973008 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.750339 20496 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:33.057158 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.965327 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 161447us
W20260709 12:23:33.041981 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 77583us
I20260709 12:23:32.755723 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:32.835178 20498 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.832577 20516 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.890429 20609 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.059208 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:33.058820 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:32.820209 20615 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:32.797959 18772 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:33.073741 18768 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:32.869539 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.075042 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.863339 20650 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:32.938051 20384 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.007961 20413 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.775321 20606 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:32.907106 20653 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:23:32.920527 18671 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 3, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 3 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.958901 20552 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:32.905296 20652 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:23:32.753196 20635 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.319s
I20260709 12:23:32.964903 20487 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.889858 20578 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.880496 20661 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:32.962735 20469 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:32.836139 20607 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:33.006142 20522 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:32.749963 20520 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:32.940326 20524 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:32.833746 20603 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:33.068713 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 379119us
I20260709 12:23:32.967214 20636 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:23:32.762418 20646 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:32.770342 20608 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:32.863575 20605 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:32.936110 20612 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:32.834612 20656 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:33.071782 18773 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:32.964634 20641 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:33.070688 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:32.879894 20539 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.059508 20496 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:33.063112 20472 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:33.106842 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.749240 20614 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.069702 20498 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:33.007090 20621 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.091337 20644 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:33.127022 20654 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:33.111653 20469 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:33.079713 20575 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:23:33.106426 20552 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.089468 20384 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.152783 20384 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.153429 20384 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:33.109488 20487 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:33.138612 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68059us
W20260709 12:23:33.139788 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.162097 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.110841 20666 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:33.077423 20516 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.155701 18769 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:33.092077 18671 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 3, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 3 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.142213 20656 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.171712 20656 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.172462 20657 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:33.149536 20469 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.173739 20469 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:33.176481 20634 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.111215 20650 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.146873 20498 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.178819 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1621) took 1222 ms. Trace:
I20260709 12:23:33.179533 20650 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:33.180452 18764 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.180658 20498 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:33.181286 20614 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:33.162851 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:33.131242 20612 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.186935 20644 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.187866 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:33.188010 20643 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:33.188516 19486 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:33.090740 20609 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:33.190232 20487 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.192188 20673 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.192509 20609 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.160508 18766 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:33.134024 20539 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:33.147104 20529 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:33.136485 20662 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.117144 20524 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.187604 20644 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.188476 20643 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:33.111946 20661 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.219048 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:33.219895 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 263325us
I20260709 12:23:33.110646 20578 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:33.160550 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 101830us
W20260709 12:23:33.158682 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 194099us
I20260709 12:23:33.134305 20603 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.134181 20608 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.166733 20666 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:33.193389 20539 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.220956 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:33.223987 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:33.219902 20614 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:33.208063 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45301.3us
I20260709 12:23:33.224109 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:33.225503 20609 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:33.227887 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.198443 20529 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.198552 20635 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.132131 20646 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.173660 20654 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.181310 20498 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:33.241804 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:33.192785 20673 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.222172 20472 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.219147 20487 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:33.188550 20612 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.227259 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:33.252213 19492 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:33.258479 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 505) took 1143 ms. Trace:
I20260709 12:23:33.258714 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:33.234648 20666 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.242390 20614 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.228353 20636 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:23:33.229496 20578 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.257584 19484 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.256147 20529 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.278796 18771 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:33.215121 20662 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:33.271025 20471 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.002s
I20260709 12:23:33.274029 19485 rpcz_store.cc:276] 0709 12:23:32.111046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.111556 (+   510us) service_pool.cc:224] Handling call
0709 12:23:32.130800 (+ 19244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:32.230095 (+ 99295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.230146 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:32.247866 (+ 17720us) log.cc:844] Serialized 26 byte log entry
0709 12:23:32.635371 (+387505us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:32.656481 (+ 21110us) log.cc:844] Serialized 14 byte log entry
0709 12:23:32.692903 (+ 36422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.693015 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:33.254482 (+561467us) raft_consensus.cc:1685] finished
0709 12:23:33.254506 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.254650 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30320,"prepare.queue_time_us":23092,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":44,"raft.queue_time_us":158740,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":26722,"spinlock_wait_cycles":3328,"thread_start_us":317257,"threads_started":1,"wal-append.queue_time_us":415614}
I20260709 12:23:33.287065 20614 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:33.284883 20612 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:33.303133 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:33.307534 20676 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:23:33.297946 20660 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:33.261567 20609 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.272866 20498 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.322438 20675 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:33.323731 20539 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:33.310931 19491 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:33.326960 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:33.259547 20643 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.278980 20487 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.348062 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:33.349355 18771 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:33.333453 18767 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:33.297623 20668 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:33.273787 20472 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.351220 18772 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:33.358566 20644 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:33.358196 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 131010us
I20260709 12:23:33.359407 20644 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.360203 20644 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.361663 20682 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:33.363271 20644 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:33.364069 20644 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:33.364521 20644 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.364967 20644 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.367385 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:33.368821 20522 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.369231 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:33.179407 18840 rpcz_store.cc:276] 0709 12:23:31.961221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.973617 (+ 12396us) service_pool.cc:224] Handling call
0709 12:23:32.041632 (+ 68015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:32.086441 (+ 44809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.086499 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:32.087132 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 12:23:32.748551 (+661419us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:32.758019 (+  9468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.771145 (+ 13126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:33.166564 (+395419us) raft_consensus.cc:1685] finished
0709 12:23:33.166583 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.178669 (+ 12086us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8270,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":11906,"thread_start_us":656617,"threads_started":1,"wal-append.queue_time_us":670754}
I20260709 12:23:33.372864 20668 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.391124 20498 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:33.391866 20498 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.392395 20498 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.306167 20471 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.370059 19483 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:33.272673 20635 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.406733 19492 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:33.401229 19486 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:33.373334 20662 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:33.326381 20612 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.411407 20661 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:33.412904 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47093.9us
I20260709 12:23:33.346277 20669 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:33.374817 20643 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:33.431979 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:33.356040 20670 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.437343 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:33.441812 19486 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:33.400300 20668 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:33.443749 20498 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:33.437542 20662 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.450793 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:33.454015 20654 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:33.394237 20469 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.452205 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:33.467161 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:33.457149 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:33.464196 20398 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:33.439652 20552 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.449841 20608 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.455173 20524 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.457310 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:33.476754 18843 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.542233 18844 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:33.573719 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.578805 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:33.671857 19489 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:33.552585 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:33.672176 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.530012 19485 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:33.826959 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:34.035183 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:34.036778 18918 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:23:34.037854 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.814914 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:33.797355 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:33.817448 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.046298 18920 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:33.808789 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:34.049095 18917 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:33.845841 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.027s
W20260709 12:23:34.050621 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.003s	sys 0.029s
W20260709 12:23:34.051997 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 810219us
I20260709 12:23:34.054520 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:33.775875 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:33.677562 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:34.055487 18914 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:34.067157 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.071271 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:33.936497 20529 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
I20260709 12:23:33.953949 20686 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.766616 20498 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.072077 18919 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:34.054876 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:33.630636 20679 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:23:33.669529 20471 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:33.766892 20636 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.126963 20636 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:33.458496 20669 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:33.904945 20666 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.000s
I20260709 12:23:33.574214 20398 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:33.473244 20627 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:33.663015 19484 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:33.473595 20361 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:33.775619 20661 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.105394 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50619us
I20260709 12:23:33.578357 20621 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:33.984153 20690 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.106436 18914 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:34.044948 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:33.474263 20646 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.664289 20612 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:33.579365 20609 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:33.468504 20662 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.113180 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:33.592957 20578 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.950732 20688 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:34.105954 20498 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.616878 20469 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:33.705116 20676 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:33.865561 20644 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.114884 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:33.664912 20487 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:33.856815 20413 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.770s	user 0.006s	sys 0.006s
I20260709 12:23:33.466988 20670 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.069504 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:34.328073 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 285) took 1066 ms. Trace:
I20260709 12:23:34.328709 18771 rpcz_store.cc:276] 0709 12:23:33.261364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.072862 (+811498us) service_pool.cc:224] Handling call
0709 12:23:34.327962 (+255100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:33.623742 20520 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.574966 20673 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:34.130488 19489 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:34.138557 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.222055 18765 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:34.134233 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 277) took 1453 ms. Trace:
W20260709 12:23:34.265843 18738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.016s	sys 0.044s
I20260709 12:23:34.177640 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:34.284631 20682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.031s	sys 0.029s
I20260709 12:23:34.282439 20361 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.283874 18913 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:34.140692 18839 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:34.280580 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.280055 18918 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:33.869405 20635 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:34.284952 20300 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:34.285799 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:34.373673 18843 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:34.374915 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:34.317283 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 472) took 1072 ms. Trace:
I20260709 12:23:34.348995 20471 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.103771 20529 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:33.556257 20522 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:34.288405 19456 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.002s	sys 0.031s
W20260709 12:23:34.393872 19456 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.003s	sys 0.031s
W20260709 12:23:34.393896 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.008s	sys 0.008s
W20260709 12:23:34.252345 20614 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.927s	user 0.012s	sys 0.000s
I20260709 12:23:34.329229 18846 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
W20260709 12:23:34.341435 18738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.020s	sys 0.044s
W20260709 12:23:34.394518 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.008s	sys 0.008s
W20260709 12:23:34.394332 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 1.16788e+06us
W20260709 12:23:34.394821 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 690179us
I20260709 12:23:34.396618 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:23:34.387646 20643 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.937s	user 0.006s	sys 0.005s
W20260709 12:23:34.341778 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.401564 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.402007 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.342682 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1937) took 1689 ms. Trace:
I20260709 12:23:34.282222 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:34.282223 18916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.014s	sys 0.016s
W20260709 12:23:34.405079 18916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.014s	sys 0.016s
I20260709 12:23:34.343152 18772 rpcz_store.cc:276] 0709 12:23:32.680765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.088606 (+407841us) service_pool.cc:224] Handling call
0709 12:23:33.350958 (+262352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.356202 (+  5244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.133866 (+777664us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54001c2350. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:34.134096 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555408128}
I20260709 12:23:34.403230 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:34.402992 18765 rpcz_store.cc:276] 0709 12:23:32.653587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.653763 (+   176us) service_pool.cc:224] Handling call
0709 12:23:34.221236 (+1567473us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:34.221588 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.342181 (+120593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.342578 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3561344}
I20260709 12:23:34.408454 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.408756 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:34.214413 20472 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:34.344508 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 406) took 1094 ms. Trace:
I20260709 12:23:34.409516 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 287) took 1142 ms. Trace:
I20260709 12:23:34.288938 20690 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.375664 18843 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:34.319087 20676 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.415516 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:34.289875 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.418359 18914 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:34.372119 20300 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.419296 20300 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:34.365739 18813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.015s	sys 0.031s
W20260709 12:23:34.420439 18813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.015s	sys 0.031s
I20260709 12:23:34.379256 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 276) took 1699 ms. Trace:
I20260709 12:23:34.382637 18920 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:34.296489 20609 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.359644 20682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.032s	sys 0.029s
I20260709 12:23:34.384584 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:33.769469 20608 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:34.385020 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.427575 20608 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:34.427659 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:34.386348 19487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.022s	sys 0.029s
W20260709 12:23:34.428397 19487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.022s	sys 0.030s
I20260709 12:23:34.428579 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 1941) took 1179 ms. Trace:
I20260709 12:23:34.428985 18772 rpcz_store.cc:276] 0709 12:23:33.249089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.413324 (+1164235us) service_pool.cc:224] Handling call
0709 12:23:34.428507 (+ 15183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:34.428709 20608 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.386859 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:34.383837 19484 rpcz_store.cc:276] 0709 12:23:33.216123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.223722 (+  7599us) service_pool.cc:224] Handling call
0709 12:23:34.288122 (+1064400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816}
I20260709 12:23:34.383289 20361 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:34.334484 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.024s	sys 0.031s
W20260709 12:23:34.431070 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.026s	sys 0.031s
W20260709 12:23:34.431432 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 982291us
I20260709 12:23:33.567569 20496 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.398454 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:34.289317 20666 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.435998 18844 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:34.130626 20686 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.286201 20627 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.364676 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 470) took 1178 ms. Trace:
W20260709 12:23:34.411803 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.393982 19483 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:34.410065 18765 rpcz_store.cc:276] 0709 12:23:33.266819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.408163 (+1141344us) service_pool.cc:224] Handling call
0709 12:23:34.409425 (+  1262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:34.393167 20471 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.376128 18919 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:34.315068 20661 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.409929 19489 rpcz_store.cc:276] 0709 12:23:33.249545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.112738 (+863193us) service_pool.cc:224] Handling call
0709 12:23:34.129965 (+ 17227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.344080 (+214115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.344417 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:34.416042 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 133914us
I20260709 12:23:34.396375 20673 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.424258 18918 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:34.422159 18766 rpcz_store.cc:276] 0709 12:23:32.680398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.691348 (+ 10950us) service_pool.cc:224] Handling call
0709 12:23:32.691830 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.193221 (+501391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.378740 (+1185519us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54002a1054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:34.379165 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077242240}
I20260709 12:23:34.425675 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 230) took 1221 ms. Trace:
W20260709 12:23:34.410949 20668 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.940s	user 0.014s	sys 0.000s
I20260709 12:23:34.427860 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 284) took 1169 ms. Trace:
I20260709 12:23:34.529695 18771 rpcz_store.cc:276] 0709 12:23:33.258150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.359821 (+1101671us) service_pool.cc:224] Handling call
0709 12:23:34.427785 (+ 67964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:34.140676 18770 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:34.436522 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.531805 18914 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:34.402900 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.430199 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.532730 18765 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.533516 18772 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:34.438499 18913 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:34.435590 20496 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:34.441306 19490 rpcz_store.cc:276] 0709 12:23:33.196276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.196412 (+   136us) service_pool.cc:224] Handling call
0709 12:23:33.196747 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.282291 (+ 85544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.282325 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:33.282375 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:33.282445 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.364287 (+1081842us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b54006743d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:34.364361 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.364564 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196168448}
I20260709 12:23:34.412972 20635 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:34.399811 20614 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.500578 18844 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:34.509653 20300 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.390789 20636 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:34.511408 18842 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:34.488909 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 280) took 1765 ms. Trace:
I20260709 12:23:34.541312 20300 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:34.539906 18773 rpcz_store.cc:276] 0709 12:23:32.723435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.146987 (+423552us) service_pool.cc:224] Handling call
0709 12:23:33.163690 (+ 16703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.245751 (+ 82061us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:33.330483 (+ 84732us) log.cc:844] Serialized 14 byte log entry
0709 12:23:33.529596 (+199113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:33.529676 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:33.529747 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.457869 (+928122us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b5400179dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:34.488633 (+ 30764us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.488828 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97325,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":63,"raft.queue_time_us":12210,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12197,"spinlock_wait_cycles":188137856,"thread_start_us":270826,"threads_started":2,"wal-append.queue_time_us":620397}
I20260709 12:23:34.543340 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1931) took 1919 ms. Trace:
I20260709 12:23:34.544859 18917 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:34.441030 20398 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:34.515008 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 106323us
I20260709 12:23:34.328433 20688 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.531239 20384 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.417202 20699 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 12:23:34.560038 20669 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:34.559835 20384 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.555516 20612 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:34.415448 20667 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:34.484927 20670 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:34.417670 20643 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:34.536995 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 1943) took 1283 ms. Trace:
I20260709 12:23:34.567399 18843 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:34.571823 18772 rpcz_store.cc:276] 0709 12:23:33.254825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.429805 (+1174980us) service_pool.cc:224] Handling call
0709 12:23:34.536919 (+107114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:34.523319 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 120332us
I20260709 12:23:34.573393 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:34.547065 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:34.574585 18914 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:34.548454 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1942) took 1299 ms. Trace:
W20260709 12:23:34.514463 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 116051us
I20260709 12:23:34.543840 18770 rpcz_store.cc:276] 0709 12:23:32.623745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.625855 (+  2110us) service_pool.cc:224] Handling call
0709 12:23:34.140146 (+1514291us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:34.140428 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.543061 (+402633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.543276 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7761280}
W20260709 12:23:34.455677 19488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.027s	sys 0.038s
I20260709 12:23:34.538275 20635 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.557186 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 408) took 1300 ms. Trace:
I20260709 12:23:34.582054 19489 rpcz_store.cc:276] 0709 12:23:33.256436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.521399 (+1264963us) service_pool.cc:224] Handling call
0709 12:23:34.556679 (+ 35280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.556863 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.556889 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.556929 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:34.556963 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.557016 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.557126 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:34.483352 20520 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:34.487865 20627 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:34.522042 20472 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:34.482491 20666 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:34.611749 18769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1320) took 1905 ms (client timeout 1579 ms). Trace:
I20260709 12:23:34.421244 20607 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 12:23:34.523355 18916 rpcz_store.cc:276] 0709 12:23:33.196747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.196871 (+   124us) service_pool.cc:224] Handling call
0709 12:23:33.197154 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.197400 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:33.256451 (+ 59051us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.415019 (+1158568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.415183 (+   164us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:34.415271 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.415611 (+   340us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.418007 (+  2396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9265,"prepare.queue_time_us":66707,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":7734,"raft.queue_time_us":10767,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":17793,"thread_start_us":1188549,"threads_started":2,"wal-append.queue_time_us":1132748}
I20260709 12:23:34.530938 20413 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.554352 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:34.575588 18765 rpcz_store.cc:276] 0709 12:23:33.249320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.531940 (+1282620us) service_pool.cc:224] Handling call
0709 12:23:34.532374 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.533241 (+   867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.548361 (+ 15120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:34.437726 20609 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.523595 20668 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.547757 20694 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:34.546530 20487 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:34.554199 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 404) took 1294 ms. Trace:
W20260709 12:23:34.577895 19488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.028s	sys 0.039s
I20260709 12:23:34.483816 20361 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:34.596614 20693 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:23:34.599380 20498 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:34.600737 19489 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:23:34.608287 20695 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:34.594702 20472 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.561146 20612 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.554914 20673 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.578649 20667 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.691816 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.747620 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 412) took 1474 ms. Trace:
I20260709 12:23:34.748297 19489 rpcz_store.cc:276] 0709 12:23:33.273050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.583076 (+1310026us) service_pool.cc:224] Handling call
0709 12:23:34.600302 (+ 17226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.747292 (+146990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.747550 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:34.747831 18917 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:34.619515 18913 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
W20260709 12:23:34.656345 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72011.2us
W20260709 12:23:34.750450 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 205841us
W20260709 12:23:34.745975 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 132449us
I20260709 12:23:34.631915 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:23:34.752951 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 179674us
W20260709 12:23:34.612282 18769 rpcz_store.cc:269] 0709 12:23:32.706613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.707114 (+   501us) service_pool.cc:224] Handling call
0709 12:23:34.611495 (+1904381us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540017a2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:34.611642 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028918144}
I20260709 12:23:34.575722 20702 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.759750 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:34.674513 20700 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:23:34.763309 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.578131 20636 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.586501 20635 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:34.765908 18914 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:34.765339 18839 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:34.771301 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.771468 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.772380 18913 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:34.769398 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.772804 18916 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:34.767926 20703 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:34.779951 20703 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.780360 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.780548 20703 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:34.780982 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1638) took 1267 ms. Trace:
I20260709 12:23:34.776225 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.778527 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.778782 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.782473 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.779279 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.779412 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.779974 20609 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:34.780619 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1637) took 1294 ms. Trace:
I20260709 12:23:34.734797 20516 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:34.755529 20472 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:34.692224 20471 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:34.781252 18922 raft_consensus.cc:2410] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:34.760319 20413 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.779789 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1938) took 2120 ms. Trace:
I20260709 12:23:34.781363 18842 rpcz_store.cc:276] 0709 12:23:33.513678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.514004 (+   326us) service_pool.cc:224] Handling call
0709 12:23:34.780826 (+1266822us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54003269d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:34.780927 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930527616}
I20260709 12:23:34.797224 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.762663 20522 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:34.785269 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.785610 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:34.782945 18770 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:34.759676 20644 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:34.796850 18768 rpcz_store.cc:276] 0709 12:23:32.659549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.659728 (+   179us) service_pool.cc:224] Handling call
0709 12:23:33.073514 (+413786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.074242 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.779564 (+1705322us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54001d5950. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:34.779697 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950799616}
I20260709 12:23:34.790033 18764 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:34.786862 18846 rpcz_store.cc:276] 0709 12:23:33.486107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.486258 (+   151us) service_pool.cc:224] Handling call
0709 12:23:34.780428 (+1294170us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54003bdb54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:34.780538 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765164928}
I20260709 12:23:34.790282 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.807124 18772 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:34.807617 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.808032 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:34.792199 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.808614 18769 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:34.803103 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.808677 18772 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:34.762842 20670 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:23:34.809625 18773 raft_consensus.cc:2410] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:34.810701 20708 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:34.810726 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.772359 20662 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:34.802017 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:34.747202 19483 rpcz_store.cc:276] 0709 12:23:33.249089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.610931 (+361842us) service_pool.cc:224] Handling call
0709 12:23:34.543670 (+932739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:34.789239 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:34.765483 20682 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:23:34.843247 18916 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:23:34.808665 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.762992 20537 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:34.840348 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:34.760591 20487 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.847872 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.841570 18917 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:34.844141 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.849924 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.795542 20706 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:34.846089 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.847028 18768 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:34.775826 20702 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:34.800323 20522 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:34.862350 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:34.864389 18842 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:34.805706 20529 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:34.840171 20498 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:34.784739 20636 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.811378 20708 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.768846 20694 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.861548 20706 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:34.885391 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.987231 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:34.933183 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.989755 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.991004 18772 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:23:34.992919 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 149221us
W20260709 12:23:34.997335 19485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 409) took 1725 ms (client timeout 1517 ms). Trace:
I20260709 12:23:34.997735 20361 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:34.997814 19485 rpcz_store.cc:269] 0709 12:23:33.260379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.303425 (+ 43046us) service_pool.cc:224] Handling call
0709 12:23:34.985782 (+1682357us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540051cf54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:34.986026 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442559744}
I20260709 12:23:35.001432 18768 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:35.003351 18771 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:35.003424 18917 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:35.004643 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.002646 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:34.867871 20522 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.007494 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.010375 18914 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.010550 18768 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:35.005406 18772 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:35.009066 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.017571 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.017894 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:35.018615 18771 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.020246 18768 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:34.885722 20614 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.024497 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:35.024634 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:35.012871 20709 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.282s	user 0.000s	sys 0.002s
I20260709 12:23:35.027261 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:34.991465 20661 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.029209 18773 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:35.030139 18772 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:35.004885 20702 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.009999 20361 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.034109 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.013419 20609 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:35.028733 19484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.009s	sys 0.012s
I20260709 12:23:35.040287 20361 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.027334 20668 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.052498 20667 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:35.053357 20712 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:23:35.053917 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1650) took 1476 ms. Trace:
I20260709 12:23:35.057624 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.073031 18773 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:35.072078 18843 rpcz_store.cc:276] 0709 12:23:33.577730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.415156 (+837426us) service_pool.cc:224] Handling call
0709 12:23:35.053719 (+638563us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003bd154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.053847 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343256320}
I20260709 12:23:35.074585 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:35.075225 18843 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:35.042567 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.058856 20487 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:35.060251 20361 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.061756 20552 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.012513 20669 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:23:35.032778 20673 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.067469 18914 raft_consensus.cc:2410] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:35.003109 20498 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:35.055012 19484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.010s	sys 0.012s
I20260709 12:23:35.051267 20708 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.050622 20609 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.086130 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:35.106525 18843 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:35.107002 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1644) took 1530 ms. Trace:
I20260709 12:23:35.104096 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:35.107321 18843 rpcz_store.cc:276] 0709 12:23:33.576189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.085755 (+1509566us) service_pool.cc:224] Handling call
0709 12:23:35.106931 (+ 21176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.105494 18771 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:35.108325 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:35.108547 18772 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:35.108975 18843 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.112905 18773 raft_consensus.cc:2368] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:35.090112 20552 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.117314 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1641) took 1542 ms. Trace:
I20260709 12:23:35.076464 20627 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.118929 18847 rpcz_store.cc:276] 0709 12:23:33.575148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.575303 (+   155us) service_pool.cc:224] Handling call
0709 12:23:35.035783 (+1460480us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:35.036016 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.036249 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:35.056609 (+ 20360us) log.cc:844] Serialized 14 byte log entry
0709 12:23:35.116914 (+ 60305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.116973 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:35.117029 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.117095 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.117238 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20553,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":738,"spinlock_wait_cycles":8280448,"thread_start_us":59870,"threads_started":1}
I20260709 12:23:35.113955 20609 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.138465 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:35.178807 18847 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:35.142113 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.142144 20654 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.147926 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:35.181296 18846 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:23:35.149757 18764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 286) took 1885 ms (client timeout 1673 ms). Trace:
I20260709 12:23:35.150956 20676 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.152508 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1460) took 1066 ms. Trace:
I20260709 12:23:35.153322 18921 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.163972 20498 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.167645 20542 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.168247 20705 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.121237 20552 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.173018 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:35.190997 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:23:35.191399 18739 leader_election.cc:336] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.874s (SENT)
I20260709 12:23:35.130725 20669 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.133232 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:35.183158 18919 rpcz_store.cc:276] 0709 12:23:34.086341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.104681 (+ 18340us) service_pool.cc:224] Handling call
0709 12:23:35.152291 (+1047610us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b5400100754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.152435 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79439744}
I20260709 12:23:35.094965 20472 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.182461 20537 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:35.203289 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:35.204026 18842 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:35.209265 18843 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:35.173907 20706 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.213526 19491 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:35.213270 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:35.197978 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 64866.3us
I20260709 12:23:35.215603 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.187464 20539 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:35.221210 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.217722 18771 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:35.198912 20575 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.199545 20560 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:35.182786 18764 rpcz_store.cc:269] 0709 12:23:33.264557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.403060 (+138503us) service_pool.cc:224] Handling call
0709 12:23:35.149280 (+1746220us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54002a1554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.149643 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775883520}
I20260709 12:23:35.180365 20670 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:23:35.223627 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.196043 20669 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:35.202136 20667 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:35.236337 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.245704 19485 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:35.206987 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 407) took 1950 ms. Trace:
I20260709 12:23:35.244504 18766 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:35.187997 20654 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.230597 20575 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.199342 20705 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.201061 20542 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.252079 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.266914 18773 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:35.254446 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:35.254930 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.269240 19485 raft_consensus.cc:2368] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:35.260926 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:35.256304 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.269918 18842 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.270184 19491 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:35.250010 18919 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:35.231014 20560 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:35.230777 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.215260 20703 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.205930 20537 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.272176 18919 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:35.229084 20539 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.300498 18919 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:35.258591 20575 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.243317 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:35.277105 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.264843 20694 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.274528 20726 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.313215 20537 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:35.313539 20721 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:35.281036 20560 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.319958 20669 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.321588 20669 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.300098 19483 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:35.323885 20703 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.301532 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.324968 20726 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.327522 20726 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.251165 19484 rpcz_store.cc:276] 0709 12:23:33.249703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.431260 (+1181557us) service_pool.cc:224] Handling call
0709 12:23:34.431703 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:34.432105 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.432135 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.432735 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.932723 (+499988us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b
0709 12:23:35.119107 (+186384us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:35.122441 (+  3334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.126608 (+  4167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.175283 (+ 48675us) raft_consensus.cc:1685] finished
0709 12:23:35.175310 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.195697 (+ 20387us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50059,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":60206976,"thread_start_us":671781,"threads_started":1,"wal-append.queue_time_us":582324}
I20260709 12:23:35.328181 18765 raft_consensus.cc:2368] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:23:35.328780 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.330211 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.331014 19483 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
W20260709 12:23:35.331416 20691 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.850s	user 0.002s	sys 0.003s
I20260709 12:23:35.326649 19485 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.332892 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.333572 19486 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:35.337460 18847 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:35.332190 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.348774 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:35.303973 20670 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:35.351016 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:35.332320 18840 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.354804 18847 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
W20260709 12:23:35.355829 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 163389us
W20260709 12:23:35.342630 18887 connection.cc:256] RPC call timeout handler was delayed by -1.2900229669999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260709 12:23:35.357846 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:35.361312 20612 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.365156 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:35.367265 19491 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
W20260709 12:23:35.366737 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 357737us
I20260709 12:23:35.369486 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.375370 19485 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:35.377063 18842 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:35.355914 20641 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:35.352196 19483 raft_consensus.cc:2376] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
W20260709 12:23:35.371551 20719 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:23:35.391690 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.354697 20627 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.400311 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.401335 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:35.402700 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.400929 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.368402 20636 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.353979 20361 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:23:35.371459 20708 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:35.429077 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.433147 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.451611 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1643) took 1875 ms. Trace:
I20260709 12:23:35.376435 20612 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:35.452278 18848 rpcz_store.cc:276] 0709 12:23:33.575887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.578519 (+  2632us) service_pool.cc:224] Handling call
0709 12:23:35.450512 (+1871993us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:35.450811 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.451082 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.451123 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.451194 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:35.451272 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.451358 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.451522 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21588864}
I20260709 12:23:35.376158 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:35.461836 19486 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:35.367077 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 400) took 2131 ms. Trace:
W20260709 12:23:35.462118 18887 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.573s (SENT)
I20260709 12:23:35.465830 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:35.460029 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 59203.8us
I20260709 12:23:35.465703 19488 rpcz_store.cc:276] 0709 12:23:33.222822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.250952 (+ 28130us) service_pool.cc:224] Handling call
0709 12:23:33.305818 (+ 54866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.375041 (+ 69223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.386682 (+ 11641us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.398443 (+ 11761us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.767246 (+1368803us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:35.032580 (+265334us) log.cc:844] Serialized 14 byte log entry
0709 12:23:35.055975 (+ 23395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.057599 (+  1624us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.330784 (+273185us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:35.340098 (+  9314us) raft_consensus.cc:1685] finished
0709 12:23:35.345733 (+  5635us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.354147 (+  8414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2820,"prepare.queue_time_us":261067,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":25592,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":26298,"spinlock_wait_cycles":37562752,"thread_start_us":1538869,"threads_started":2,"wal-append.queue_time_us":1002402}
I20260709 12:23:35.468225 20675 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:35.467674 20682 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.469924 20682 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:35.470361 20682 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.391184 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.393976 20667 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.484756 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1672) took 1111 ms. Trace:
I20260709 12:23:35.426683 20696 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:35.392370 20529 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.397516 20487 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:35.394976 20641 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:35.497871 19492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 471) took 2293 ms (client timeout 2527 ms). Trace:
I20260709 12:23:35.485406 18922 rpcz_store.cc:276] 0709 12:23:34.373831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.848743 (+474912us) service_pool.cc:224] Handling call
0709 12:23:34.875611 (+ 26868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:34.876193 (+   582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.876239 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.987706 (+111467us) log.cc:844] Serialized 26 byte log entry
0709 12:23:35.092088 (+104382us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:35.092129 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.092213 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.484403 (+392190us) raft_consensus.cc:1685] finished
0709 12:23:35.484436 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.484638 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9018,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":26491,"thread_start_us":84602,"threads_started":1,"wal-append.queue_time_us":143886}
W20260709 12:23:35.493191 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 103771us
I20260709 12:23:35.487488 20706 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:35.471680 20612 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.495957 19490 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:35.495428 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:35.482944 20469 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:35.490474 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:35.500170 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1651) took 1103 ms. Trace:
W20260709 12:23:35.498369 19492 rpcz_store.cc:269] 0709 12:23:33.208091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.218571 (+ 10480us) service_pool.cc:224] Handling call
0709 12:23:35.495596 (+2277025us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400720454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.495766 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30686976}
I20260709 12:23:35.491598 20696 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.505719 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.499541 20641 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:35.502923 20635 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.005s
I20260709 12:23:35.496155 20529 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.506603 18848 rpcz_store.cc:276] 0709 12:23:34.396983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.492299 (+1095316us) service_pool.cc:224] Handling call
0709 12:23:35.499578 (+  7279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.499813 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.499840 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.499889 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:35.499925 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.499986 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.500106 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.492772 19484 raft_consensus.cc:2376] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3. Re-sending same reply.
W20260709 12:23:35.511358 20722 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:23:35.504351 20469 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:35.510035 20542 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.508294 20539 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.506596 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.510103 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:35.508561 20694 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:35.531396 20694 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:35.532546 20688 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.532761 20694 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.501678 20654 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.501540 20706 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:35.535883 20706 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:35.537055 20727 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:23:35.537611 20384 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:35.504312 20612 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:35.539088 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1645) took 1962 ms (client timeout 1826 ms). Trace:
W20260709 12:23:35.539541 18839 rpcz_store.cc:269] 0709 12:23:33.576457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.368838 (+792381us) service_pool.cc:224] Handling call
0709 12:23:35.538871 (+1170033us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54000f0fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.539003 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769416960}
I20260709 12:23:35.540177 20609 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.541383 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1655) took 1125 ms. Trace:
I20260709 12:23:35.510493 20696 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.513899 20635 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.513510 20698 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:35.515413 20734 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:23:35.526026 20469 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.529882 18845 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:35.512125 18846 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:35.494066 20667 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:35.526983 18887 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.117s (SENT)
I20260709 12:23:35.580578 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:35.541769 18839 rpcz_store.cc:276] 0709 12:23:34.416360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.540454 (+1124094us) service_pool.cc:224] Handling call
0709 12:23:35.540839 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.541040 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.541063 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.541107 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:35.541141 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.541209 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.541321 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.524313 20614 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:23:35.499105 20487 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.585983 20487 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.571828 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1656) took 1152 ms. Trace:
I20260709 12:23:35.587127 18843 rpcz_store.cc:276] 0709 12:23:34.419607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.543445 (+1123838us) service_pool.cc:224] Handling call
0709 12:23:35.571079 (+ 27634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.571347 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.571389 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.571452 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:35.571507 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.571591 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.571737 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.572494 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 238) took 1125 ms. Trace:
I20260709 12:23:35.527853 18922 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 1.
I20260709 12:23:35.537896 20706 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.571444 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1654) took 1157 ms. Trace:
I20260709 12:23:35.592022 18913 rpcz_store.cc:276] 0709 12:23:34.446722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.759453 (+312731us) service_pool.cc:224] Handling call
0709 12:23:35.542772 (+783319us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54000343d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.572431 (+ 29659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24825088}
W20260709 12:23:35.578518 18845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1640) took 2011 ms (client timeout 2190 ms). Trace:
W20260709 12:23:35.524729 20522 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.005s
I20260709 12:23:35.598006 20522 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.601337 20522 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.527626 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1653) took 1121 ms. Trace:
I20260709 12:23:35.526110 20552 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.602239 18842 rpcz_store.cc:276] 0709 12:23:34.406332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.512114 (+1105782us) service_pool.cc:224] Handling call
0709 12:23:35.526881 (+ 14767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.527089 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.527113 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.527156 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:35.527210 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.527275 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.527534 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.603996 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.604578 20552 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:35.526834 20529 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.593190 18848 rpcz_store.cc:276] 0709 12:23:34.414830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.513689 (+1098859us) service_pool.cc:224] Handling call
0709 12:23:35.570517 (+ 56828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.570926 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.570973 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.571037 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:35.571091 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.571177 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.571347 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:35.605502 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78557.1us
W20260709 12:23:35.594378 18845 rpcz_store.cc:269] 0709 12:23:33.567385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.591524 (+ 24139us) service_pool.cc:224] Handling call
0709 12:23:35.509914 (+1918390us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:23:35.578429 (+ 68515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26598656}
I20260709 12:23:35.597122 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.608012 18922 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:35.613600 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.615144 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.616072 18922 raft_consensus.cc:2410] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:35.616936 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.617713 18922 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:35.580475 20698 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:35.582693 20469 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.627909 20735 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:35.591395 20609 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:35.522329 20560 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:35.611617 20730 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.074s	user 0.003s	sys 0.001s
I20260709 12:23:35.611325 20487 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.639654 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:35.646109 18922 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:35.649513 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 401) took 2420 ms. Trace:
I20260709 12:23:35.650171 19487 rpcz_store.cc:276] 0709 12:23:33.229257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.254088 (+ 24831us) service_pool.cc:224] Handling call
0709 12:23:33.405609 (+151521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.408653 (+  3044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.431200 (+ 22547us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.567487 (+136287us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.428904 (+861417us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:34.428958 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.429047 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.868038 (+438991us) raft_consensus.cc:1685] finished
0709 12:23:34.874528 (+  6490us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.649086 (+774558us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54005b40d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.649415 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3153,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":9902,"spinlock_wait_cycles":291849984,"thread_start_us":825892,"threads_started":1,"wal-append.queue_time_us":839173}
I20260709 12:23:35.655879 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.656771 18915 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:35.655336 18671 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:35.662714 18915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1461) took 1557 ms (client timeout 1604 ms). Trace:
I20260709 12:23:35.665519 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.666496 18913 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:35.661327 18671 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 3, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 3 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.670253 18671 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 3, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 3 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:35.663376 18915 rpcz_store.cc:269] 0709 12:23:34.105148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.655595 (+1550447us) service_pool.cc:224] Handling call
0709 12:23:35.662605 (+  7010us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.673293 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:35.676853 18737 connection.cc:256] RPC call timeout handler was delayed by -1.1534468569998353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2719s for a response
I20260709 12:23:35.677392 18772 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:35.679157 20617 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:35.679738 20617 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.680644 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:35.681360 18922 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.682062 20617 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:35.689792 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2543473620003169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 12:23:35.690953 18920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1664) took 1716 ms (client timeout 2093 ms). Trace:
W20260709 12:23:35.732584 18920 rpcz_store.cc:269] 0709 12:23:33.974208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.070937 (+ 96729us) service_pool.cc:224] Handling call
0709 12:23:35.690717 (+1619780us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54003543d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.690874 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713744640}
I20260709 12:23:35.733822 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.658205 20575 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:35.735994 18812 connection.cc:256] RPC call timeout handler was delayed by -1.0023473620003642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 12:23:35.736645 20575 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.736836 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:35.737355 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:35.738618 20522 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:35.739445 20522 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.742663 20498 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:35.745294 20703 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:35.747283 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 237317us
I20260709 12:23:35.692977 20705 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:35.693410 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1485e54f9795416785f4baf244599201 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:35.693728 20690 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.696051 18840 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:35.629859 20612 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:35.700376 18844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1646) took 2123 ms (client timeout 1517 ms). Trace:
W20260709 12:23:35.700795 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.700275 20698 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:35.701550 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.761626 18918 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:35.762132 18918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 235) took 1348 ms (client timeout 1770 ms). Trace:
I20260709 12:23:35.702769 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 410) took 2439 ms. Trace:
I20260709 12:23:35.763433 19490 rpcz_store.cc:276] 0709 12:23:33.263721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.535134 (+1271413us) service_pool.cc:224] Handling call
0709 12:23:35.495738 (+960604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.504932 (+  9194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.702312 (+197380us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b5400720450. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.702666 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160014592}
W20260709 12:23:35.706002 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.689877 18670 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 285) took 4586 ms. Trace:
I20260709 12:23:35.708191 20621 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:35.709302 20603 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:35.713444 20704 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.232s	user 0.003s	sys 0.003s
I20260709 12:23:35.715202 20635 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:35.715858 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1649) took 2138 ms. Trace:
I20260709 12:23:35.716512 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.717602 20667 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.719261 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1682) took 1165 ms. Trace:
I20260709 12:23:35.718917 20641 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.719415 18917 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:35.719743 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1678) took 1313 ms. Trace:
I20260709 12:23:35.789903 18921 rpcz_store.cc:276] 0709 12:23:34.406830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.049850 (+643020us) service_pool.cc:224] Handling call
0709 12:23:35.152946 (+103096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.183828 (+ 30882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.719490 (+535662us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b5400100750. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.719665 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221969664}
I20260709 12:23:35.791411 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.792856 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.793569 18921 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:35.786374 18914 rpcz_store.cc:276] 0709 12:23:34.554051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.784976 (+230925us) service_pool.cc:224] Handling call
0709 12:23:35.719011 (+934035us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003b4554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.719196 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482050944}
I20260709 12:23:35.796293 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:35.784955 18919 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:35.797048 18914 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:35.797886 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:35.798493 18919 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.718664 20682 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.721782 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.802132 18915 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:35.679538 20560 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.746150 20703 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:35.664237 20487 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.752102 18922 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:35.724263 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:35.808645 18770 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:35.757054 19457 connection.cc:256] RPC call timeout handler was delayed by -1.0539519059998383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:23:35.748991 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:35.782979 18840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1632) took 2288 ms (client timeout 2143 ms). Trace:
W20260709 12:23:35.810294 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61619.7us
I20260709 12:23:35.738256 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:35.760280 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:35.815927 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 77753.7us
W20260709 12:23:35.816238 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56091.5us
W20260709 12:23:35.759019 18844 rpcz_store.cc:269] 0709 12:23:33.576708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.808503 (+231795us) service_pool.cc:224] Handling call
0709 12:23:35.700173 (+1891670us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540041bed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.700291 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892408192}
W20260709 12:23:35.762687 18918 rpcz_store.cc:269] 0709 12:23:34.413746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.701249 (+1287503us) service_pool.cc:224] Handling call
0709 12:23:35.762044 (+ 60795us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:35.817260 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:35.777478 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.779024 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:35.782212 18656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 89039.2us
I20260709 12:23:35.783018 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:35.781885 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1639) took 2217 ms. Trace:
I20260709 12:23:35.784642 18847 rpcz_store.cc:276] 0709 12:23:33.577491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.367321 (+1789830us) service_pool.cc:224] Handling call
0709 12:23:35.367669 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.376700 (+  9031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.376732 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.399118 (+ 22386us) log.cc:844] Serialized 26 byte log entry
0709 12:23:35.503450 (+104332us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:35.503500 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.503573 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.715616 (+212043us) raft_consensus.cc:1685] finished
0709 12:23:35.715638 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.715786 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":17786,"thread_start_us":31055,"threads_started":1,"wal-append.queue_time_us":178877}
I20260709 12:23:35.732179 20688 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.747721 20696 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:35.825744 18812 leader_election.cc:400] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:35.756699 20715 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:23:35.826758 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:35.828575 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45646.9us
W20260709 12:23:35.811853 20608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.327s	user 0.009s	sys 0.009s
I20260709 12:23:35.818598 18841 rpcz_store.cc:276] 0709 12:23:33.564460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.564650 (+   190us) service_pool.cc:224] Handling call
0709 12:23:34.216382 (+651732us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:34.216672 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:34.217182 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.217223 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:34.219731 (+  2508us) log.cc:844] Serialized 52 byte log entry
0709 12:23:35.140537 (+920806us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b18003bc320. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1
0709 12:23:35.140835 (+   298us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:35.140897 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.141043 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.712509 (+571466us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:35.781565 (+ 69056us) raft_consensus.cc:1685] finished
0709 12:23:35.781592 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.781785 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":152564,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":19441,"spinlock_wait_cycles":79004160,"thread_start_us":152051,"threads_started":1,"wal-append.queue_time_us":233841}
I20260709 12:23:35.808013 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.755564 19458 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.833353 18915 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:35.809825 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.818240 19491 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:35.816668 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:23:35.823850 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44934us
I20260709 12:23:35.786875 20522 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.824965 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.843415 18918 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:35.843694 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.844393 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:35.844357 18922 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:35.845443 18921 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:35.764935 18670 rpcz_store.cc:276] 0709 12:23:31.103572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.103805 (+   233us) service_pool.cc:224] Handling call
0709 12:23:35.689771 (+4585966us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:31.319107 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:31.319941 (+   834us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:31.319990 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:23:31.320017 (+    27us) tablet.cc:662] Decoding operations
0709 12:23:31.321239 (+  1222us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:31.321332 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:31.321385 (+    53us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:23:31.322236 (+   851us) tablet.cc:701] Row locks acquired
0709 12:23:31.322265 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:23:31.362561 (+ 40296us) write_op.cc:270] Start()
0709 12:23:31.362808 (+   247us) write_op.cc:276] Timestamp: P: 1783599811362474 usec, L: 0
0709 12:23:31.362856 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 12:23:31.443967 (+ 81111us) log.cc:844] Serialized 2864 byte log entry
0709 12:23:31.713487 (+269520us) op_driver.cc:464] REPLICATION: finished
0709 12:23:31.790797 (+ 77310us) write_op.cc:301] APPLY: starting
0709 12:23:31.801802 (+ 11005us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:31.812981 (+ 11179us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:31.839038 (+ 26057us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:32.185560 (+346522us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:32.236350 (+ 50790us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:23:32.246376 (+ 10026us) write_op.cc:312] APPLY: finished
0709 12:23:32.338010 (+ 91634us) log.cc:844] Serialized 59 byte log entry
0709 12:23:32.395647 (+ 57637us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:32.428422 (+ 32775us) write_op.cc:454] Released schema lock
0709 12:23:32.430577 (+  2155us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:32.546496 (+115919us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:32.551585 (+  5089us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36681,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":61762,"apply.run_cpu_time_us":24750,"apply.run_wall_time_us":736551,"num_ops":7,"prepare.queue_time_us":2685,"prepare.run_cpu_time_us":5536,"prepare.run_wall_time_us":129051,"replication_time_us":350465,"thread_start_us":61379,"threads_started":1}]]}
I20260709 12:23:35.846947 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:35.844383 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:35.786103 20617 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:23:35.826803 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:35.881865 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55142.3us
I20260709 12:23:35.878551 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.852160 18914 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:35.883061 19486 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:35.884122 20627 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.884375 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.884737 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.885347 19487 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.885700 20627 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:35.884375 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.887617 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.888810 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.889810 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:35.890188 20522 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.891436 18922 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:35.892139 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:35.892496 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.892807 18920 raft_consensus.cc:2376] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3. Re-sending same reply.
I20260709 12:23:35.893641 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.893692 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:35.894539 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.894663 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.911233 18920 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:35.911741 19489 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:35.895277 20686 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.896340 20472 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:35.899812 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.912611 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.913231 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:35.913947 18921 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.824692 20575 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:35.828680 20603 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:35.832681 20608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.010s	sys 0.010s
W20260709 12:23:35.848733 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 93245.5us
I20260709 12:23:35.825682 20629 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.815326 20690 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:35.915727 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:35.916236 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.848093 18918 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:35.881628 20733 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:35.881872 20731 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.958073 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.927901 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:35.948513 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:35.950680 18914 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.949941 19486 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:35.914968 20635 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.927129 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.828080 20688 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:35.815256 18840 rpcz_store.cc:269] 0709 12:23:33.473060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.528728 (+ 55668us) service_pool.cc:224] Handling call
0709 12:23:35.227548 (+1698820us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:23:35.759082 (+531534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25224960}
I20260709 12:23:35.926806 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:35.969389 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 119196us
I20260709 12:23:35.859876 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:35.971941 18919 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:35.962615 18920 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:35.954788 18921 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:35.964725 19491 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.965541 19490 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:35.902328 19487 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:35.833647 20560 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:35.959163 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 112309us
W20260709 12:23:35.966580 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 119406us
I20260709 12:23:35.972311 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:35.928951 20629 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:35.988400 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 234) took 1583 ms. Trace:
I20260709 12:23:35.993343 18918 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:35.828202 20667 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:35.982813 19491 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:35.984222 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.962049 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.988914 18917 rpcz_store.cc:276] 0709 12:23:34.404871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.005403 (+600532us) service_pool.cc:224] Handling call
0709 12:23:35.719195 (+713792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.789548 (+ 70353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.988178 (+198630us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54003b4550. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:35.988321 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640619776}
W20260709 12:23:35.969636 19457 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.189s (SENT)
I20260709 12:23:35.926268 20686 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:23:35.967692 20469 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:35.969022 20603 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.036561 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:36.036875 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74901.8us
I20260709 12:23:35.849511 20706 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.843525 20729 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:36.039484 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1659) took 1277 ms. Trace:
W20260709 12:23:36.040588 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 68365.1us
W20260709 12:23:36.041121 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 181411us
I20260709 12:23:36.042747 18914 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:36.038126 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.976315 20635 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.044785 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.045015 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:35.972549 20733 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:36.042694 18846 rpcz_store.cc:276] 0709 12:23:34.762165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.578042 (+815877us) service_pool.cc:224] Handling call
0709 12:23:35.578385 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.579062 (+   677us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:35.750226 (+171164us) log.cc:844] Serialized 14 byte log entry
0709 12:23:36.039117 (+288891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:36.039179 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:36.039225 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.039294 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.039416 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106382,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":5369,"thread_start_us":430209,"threads_started":2}
W20260709 12:23:36.045281 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 162535us
I20260709 12:23:35.995204 20629 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:36.051381 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81777.5us
W20260709 12:23:36.047937 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63780.5us
I20260709 12:23:36.056562 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:36.058362 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:36.060945 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:36.065433 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:36.066414 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:35.971319 20522 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:35.995919 20605 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:36.044670 20706 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.990188 20641 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:35.935071 18922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
I20260709 12:23:36.092481 18922 raft_consensus.cc:606] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:36.093007 18922 raft_consensus.cc:614] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:36.044270 20654 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:36.046551 20635 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.045997 20705 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.082358 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.101730 18917 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:36.084226 20612 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:36.055373 20627 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:36.057862 20636 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:36.052335 20617 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.055181 20715 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:36.124929 20575 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.100566 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.131466 18918 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:36.111200 20745 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:23:36.102530 20654 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.973120 20703 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.075745 20729 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:36.080376 20469 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:36.044046 20529 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:36.044529 20667 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:36.138646 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:36.082145 20498 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:36.092012 20706 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.127707 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.069078 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:23:36.146225 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 77233.1us
W20260709 12:23:36.146679 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.147089 18812 leader_election.cc:400] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:36.147419 18812 leader_election.cc:403] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:23:36.143877 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68719.1us
I20260709 12:23:36.055675 20603 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.149943 20751 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:36.131305 20606 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.135411 20654 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:36.136221 20487 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:36.181828 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1665) took 1172 ms. Trace:
I20260709 12:23:36.181924 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.182754 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.183574 18841 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:36.183754 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.184216 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.116524 20636 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.123368 20682 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:36.077600 20690 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:36.127666 20627 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:36.135027 20715 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:36.166330 20522 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:36.168394 20529 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:36.168941 20688 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:36.178893 20743 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:23:36.179126 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.181054 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:36.136407 20469 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.184594 18917 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:36.253536 20469 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:36.256373 18916 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:36.258229 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 233) took 1855 ms. Trace:
I20260709 12:23:36.258760 18916 rpcz_store.cc:276] 0709 12:23:34.402734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.001125 (+598391us) service_pool.cc:224] Handling call
0709 12:23:35.028288 (+ 27163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:36.257048 (+1228760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.257842 (+   794us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400335c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:36.258135 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2823587584}
W20260709 12:23:36.164304 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107824us
I20260709 12:23:36.280216 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:36.282788 20605 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:36.283564 20605 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:36.187660 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:36.287768 20742 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.339s	user 0.001s	sys 0.001s
I20260709 12:23:36.189301 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.190591 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.182241 18839 rpcz_store.cc:276] 0709 12:23:35.009933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.591612 (+581679us) service_pool.cc:224] Handling call
0709 12:23:35.611483 (+ 19871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.611850 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.611880 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.634422 (+ 22542us) log.cc:844] Serialized 26 byte log entry
0709 12:23:35.804630 (+170208us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:35.804674 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.805489 (+   815us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:36.181565 (+376076us) raft_consensus.cc:1685] finished
0709 12:23:36.181590 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.181762 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7423,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":7682,"thread_start_us":65895,"threads_started":1,"wal-append.queue_time_us":202122}
I20260709 12:23:36.292292 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:36.196575 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.197932 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:36.293394 18847 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
W20260709 12:23:36.133394 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 87841.6us
I20260709 12:23:36.202771 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:36.294669 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.294831 18914 raft_consensus.cc:2376] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5. Re-sending same reply.
I20260709 12:23:36.206032 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.295936 18841 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:36.295807 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.296741 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:36.209654 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.297556 18845 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:36.298483 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:36.299194 18845 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:36.299989 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.209836 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.293407 18918 raft_consensus.cc:2376] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4. Re-sending same reply.
I20260709 12:23:36.300823 18913 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
W20260709 12:23:36.216005 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.189440 20636 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:36.168411 20667 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:36.184696 20752 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:36.218287 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:36.220427 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56592us
I20260709 12:23:36.226449 18921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:49592
W20260709 12:23:36.246167 20744 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.190s	user 0.000s	sys 0.004s
I20260709 12:23:36.181948 20729 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.247490 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:36.135025 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 76744.6us
I20260709 12:23:36.346364 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:36.284754 20605 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:36.302762 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.354864 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.355237 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:36.309245 18845 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:36.357008 18843 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:36.313395 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:36.368992 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:36.371629 20756 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.371994 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.373242 18846 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:36.318946 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.322028 18921 raft_consensus.cc:606] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:36.138782 20733 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:36.325286 20751 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:36.349691 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:36.352061 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:36.408193 18847 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:36.410983 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:36.412549 18846 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:36.403371 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.417622 18845 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:36.421267 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:36.421947 18846 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.419085 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:36.423971 18847 raft_consensus.cc:2376] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2. Re-sending same reply.
I20260709 12:23:36.424192 18846 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.429127 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:36.429780 18914 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.439932 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.439361 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:36.426878 20749 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:36.456866 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:36.444269 20654 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.466004 18914 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:36.438539 20617 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:36.419021 20690 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:36.440608 20498 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:36.480443 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.456408 20765 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:36.491250 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.401507 20627 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:36.476658 20617 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.490156 20756 raft_consensus.cc:1064] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:23:36.476944 20749 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:36.405653 20715 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.490029 20755 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.491873 20765 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:36.511615 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.469812 20752 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:23:36.515734 18847 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:36.505481 20617 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.510733 19483 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:23:36.556838 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:36.552603 20760 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:23:36.559474 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.554919 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.509445 20768 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:36.563627 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.561687 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.568601 18846 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:36.522855 20765 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.590881 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:36.634117 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 90689us
I20260709 12:23:36.635279 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:36.646028 18846 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:36.647571 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.509109 20751 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:36.513582 20635 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:36.651739 20767 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
W20260709 12:23:36.651762 20759 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:23:36.556221 20755 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.670254 18814 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:36.688395 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.699365 18846 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:36.690793 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:36.649255 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.564431 20498 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:36.669600 20768 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:36.732860 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 245247us
I20260709 12:23:36.726770 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.703168 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:36.721803 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.697347 20766 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:36.742980 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.743357 18843 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:36.702790 20764 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:36.759264 18846 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:23:36.757582 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54508.3us
I20260709 12:23:36.761905 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:36.590343 20690 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:36.766930 20756 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.768278 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.770499 20755 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:36.771756 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:36.709383 20749 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.764364 20654 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:36.873078 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:36.845394 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.867977 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:36.833804 19489 pending_rounds.cc:85] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 5
I20260709 12:23:36.863318 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:36.779898 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:36.833946 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:36.889082 18847 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:36.894209 18843 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.889671 19489 pending_rounds.cc:107] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:23:36.737159 20762 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:36.892089 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:36.934774 18771 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:36.864114 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:36.890097 18772 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
W20260709 12:23:36.928103 18886 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.546s (SENT) [suppressed 47 similar messages]
I20260709 12:23:36.897565 19489 raft_consensus.cc:2889] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:36.856498 20575 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.002s
I20260709 12:23:36.789402 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:36.938422 20575 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.789968 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:23:36.859382 20770 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
W20260709 12:23:36.853622 20636 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.506s	user 0.004s	sys 0.004s
I20260709 12:23:36.855142 20763 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.943090 20763 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.944625 20635 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:36.763883 20413 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:36.946694 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:36.843242 20696 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:36.772987 20603 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:36.952062 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:36.954823 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.955746 20758 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.956346 20758 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.958755 20575 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:36.959082 20774 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:23:36.959441 20575 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.960708 20762 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.961243 20762 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.962805 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:36.936563 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.673s (SENT)
W20260709 12:23:36.967350 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.941758 20636 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:36.976293 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:36.977546 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:36.981349 18843 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:36.983614 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:36.987802 18843 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:36.839601 19488 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:36.990373 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:36.962812 18812 connection.cc:256] RPC call timeout handler was delayed by -1.433157804000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33530000000000004s for a response
I20260709 12:23:37.005185 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:36.965391 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:36.971668 20560 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.024420 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:37.031077 19486 raft_consensus.cc:2368] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:23:36.989264 20755 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.991707 20705 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.043969 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.046732 18767 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:37.044507 18765 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:37.040122 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:37.048504 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.018016 20758 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:37.050025 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:36.991979 20413 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:23:37.048609 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:37.023379 20686 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:37.061753 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.063786 18768 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.064917 18812 leader_election.cc:400] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:37.043238 18840 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:37.065963 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.035233 20779 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:37.043444 20575 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:36.999202 20617 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.082276 20763 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:23:37.096089 20763 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.096864 20763 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.097033 18840 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:37.097648 20763 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:37.098109 20763 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.066366 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.085942 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.105222 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:37.089787 20731 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.119s	user 0.009s	sys 0.002s
W20260709 12:23:37.089866 20706 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.927s	user 0.008s	sys 0.001s
I20260709 12:23:37.081574 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:23:37.082468 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 320619us
I20260709 12:23:37.094034 20617 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:37.064723 20705 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.127480 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.128784 18768 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:37.108104 18848 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.009s	sys 0.009s
I20260709 12:23:37.042783 20560 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:37.084282 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:37.065526 20686 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:37.123814 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.100281 20667 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:37.081954 20779 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:36.997927 20768 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.151610 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.223999 18773 raft_consensus.cc:2368] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:23:37.063208 20765 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:37.173664 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.106469 20763 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.109011 20635 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:37.140506 20629 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.055s	user 0.014s	sys 0.000s
I20260709 12:23:37.244896 20629 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:37.245779 20772 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.618s	user 0.004s	sys 0.008s
I20260709 12:23:37.247444 20629 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:37.249202 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:37.174651 19458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.005s	sys 0.023s
W20260709 12:23:37.250630 19458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.006s	sys 0.023s
W20260709 12:23:37.251000 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 755732us
I20260709 12:23:37.109365 20731 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.196382 20667 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:37.257411 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:37.259024 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.200066 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.260924 18843 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.260203 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:37.176162 18848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.012s	sys 0.011s
I20260709 12:23:37.128350 20706 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:37.218120 20779 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.263231 18769 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.262027 18913 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.267771 20706 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:37.271322 20469 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.017s	user 0.010s	sys 0.003s
I20260709 12:23:37.271907 20469 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.273162 19485 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:37.273885 20636 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:37.196570 20686 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:37.275856 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:37.276813 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.276757 18919 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:37.175071 20751 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:37.279239 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:37.236930 20498 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.283339 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.258930 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:37.218051 20766 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:37.196799 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 73092.2us
I20260709 12:23:37.149452 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.300107 20413 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.318882 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 1882) took 1058 ms. Trace:
I20260709 12:23:37.379972 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.313095 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.392367 18839 rpcz_store.cc:276] 0709 12:23:36.260899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.291900 (+ 31001us) service_pool.cc:224] Handling call
0709 12:23:37.318524 (+1026624us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003bd654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:37.318761 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878469888}
W20260709 12:23:37.308555 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1485e54f9795416785f4baf244599201 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:37.304992 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.343410 18764 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:37.349539 18773 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:37.350337 18913 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
W20260709 12:23:37.303939 20775 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 12:23:37.396656 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.398913 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.399322 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:37.400008 18773 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:37.401405 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.401794 18846 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.402849 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.403748 18846 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:37.404886 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.354571 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:37.408540 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1706) took 1102 ms. Trace:
I20260709 12:23:37.274314 20469 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:37.378626 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:37.303583 20765 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:37.383162 20706 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:37.383533 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:37.384864 19483 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 5 LEARNER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:37.385202 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.419241 19490 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:37.386349 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 429) took 1319 ms. Trace:
I20260709 12:23:37.419793 19485 rpcz_store.cc:276] 0709 12:23:36.067204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.067366 (+   162us) service_pool.cc:224] Handling call
0709 12:23:36.088332 (+ 20966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:37.273646 (+1185314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.386064 (+112418us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54006739d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:37.386269 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724169984}
I20260709 12:23:37.280140 20667 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:37.389882 20801 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:23:37.391088 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.280973 20560 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:37.350875 20729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.004s	sys 0.011s
W20260709 12:23:37.393666 18656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 85186us
I20260709 12:23:37.393929 18770 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.348141 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 275) took 1147 ms. Trace:
I20260709 12:23:37.394161 18914 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:37.338821 20751 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:37.346174 20764 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:37.237527 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 269245us
I20260709 12:23:37.306282 20762 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:37.391378 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:37.408180 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.278738 20635 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.353240 18768 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.396533 18886 leader_election.cc:400] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:23:37.410480 19491 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:37.446909 18886 leader_election.cc:403] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:37.307410 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:37.414045 20798 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:23:37.410656 18915 rpcz_store.cc:276] 0709 12:23:36.305771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.305923 (+   152us) service_pool.cc:224] Handling call
0709 12:23:36.306380 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.306691 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:36.809603 (+502912us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.408035 (+598432us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.408116 (+    81us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:37.408194 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.408289 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.408458 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215258,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":47034,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":1031300,"threads_started":3,"wal-append.queue_time_us":490255}
I20260709 12:23:37.414851 19486 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:37.324740 20779 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:37.458266 20800 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:37.461350 20696 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:37.463413 20779 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:37.465281 20612 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
W20260709 12:23:37.473915 20790 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.192s	user 0.001s	sys 0.001s
I20260709 12:23:37.476688 18769 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:37.420866 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:37.388154 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.478978 18766 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:23:37.480700 18766 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:37.404213 20641 raft_consensus.cc:1027] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: attempt to promote peer 43b520eabb65493abe84f4cf06806cba: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:23:37.423700 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.396982 20413 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:37.426155 20729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.004s	sys 0.011s
I20260709 12:23:37.483942 18772 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:37.425050 18848 rpcz_store.cc:276] 0709 12:23:36.201082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.201235 (+   153us) service_pool.cc:224] Handling call
0709 12:23:36.219392 (+ 18157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:36.227637 (+  8245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:36.227668 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:36.345997 (+118329us) log.cc:844] Serialized 26 byte log entry
0709 12:23:36.488340 (+142343us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:36.947530 (+459190us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b48000030d8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:23:37.140123 (+192593us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:37.264551 (+124428us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.347745 (+ 83194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.347832 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:37.347880 (+    48us) raft_consensus.cc:1685] finished
0709 12:23:37.347891 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.348073 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93395,"prepare.queue_time_us":510467,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":14162,"raft.queue_time_us":281871,"raft.run_cpu_time_us":8630,"raft.run_wall_time_us":535151,"spinlock_wait_cycles":81348864,"thread_start_us":811695,"threads_started":2,"wal-append.queue_time_us":180652}
I20260709 12:23:37.484277 18840 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.430745 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.485167 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:37.436985 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.440745 18773 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:37.411382 18846 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 1.
I20260709 12:23:37.486526 20636 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:37.423323 20809 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:37.421775 20805 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.487612 20636 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:37.488088 20636 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:37.487613 20809 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:37.489162 20636 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.490561 20809 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:37.490682 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 69933.5us
I20260709 12:23:37.486550 18842 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:37.492386 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.494808 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.486598 20779 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:37.496433 20779 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:37.496755 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.496995 20779 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.504441 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.505427 18767 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.512162 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 1883) took 1250 ms. Trace:
I20260709 12:23:37.512653 18841 rpcz_store.cc:276] 0709 12:23:36.261267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.296483 (+ 35216us) service_pool.cc:224] Handling call
0709 12:23:37.511916 (+1215433us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b540041b4d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:37.512087 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160685824}
I20260709 12:23:37.518556 20765 raft_consensus.cc:2764] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:23:37.524554 18842 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:37.441957 20751 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:37.529939 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.530702 18765 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:37.531980 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:37.532822 19492 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:37.532827 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.534240 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:37.535080 19491 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.534917 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:37.536005 19486 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.535928 20764 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.547956 20749 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:37.549260 20641 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:37.550655 20641 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:37.417608 20766 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.456238 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.484529 20413 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:37.485395 18770 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:37.435526 20810 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.553416 20810 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:23:37.483943 20807 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:37.556087 20810 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:37.446698 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.556695 20469 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.556927 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:37.557255 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 110631us
I20260709 12:23:37.557775 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 1899) took 1004 ms. Trace:
I20260709 12:23:37.557430 20469 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.558168 20805 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.558115 18845 rpcz_store.cc:276] 0709 12:23:36.553290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.561208 (+  7918us) service_pool.cc:224] Handling call
0709 12:23:36.948540 (+387332us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:23:37.556776 (+608236us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66e9c 00007f3357e66a5b 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:23:37.557701 (+   925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66853120}
I20260709 12:23:37.558728 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.558815 20805 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:37.559440 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.559974 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.560604 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.560801 20755 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:37.452040 20763 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:37.562027 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.546098 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:37.562363 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:37.579581 18915 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:37.551118 20641 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:37.565402 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.498116 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.570653 19492 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:37.575853 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.580969 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:37.597548 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 99503.5us
I20260709 12:23:37.597553 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:37.598526 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.602559 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.609705 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.611615 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.612226 18768 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
W20260709 12:23:37.617128 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 71094.6us
I20260709 12:23:37.610973 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:37.561239 20755 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:37.518385 20498 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.560511 20469 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:37.624449 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.625227 18839 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:37.542075 20686 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:37.628273 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 215433us
I20260709 12:23:37.629823 18771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:37.630916 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.631177 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.595249 20787 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:37.561209 20805 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:37.633843 18771 raft_consensus.cc:606] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.606840 20705 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.642712 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:37.614943 20522 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.613987 20688 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.650086 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.623580 20755 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:37.652057 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.628412 20636 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.657791 19491 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:37.657936 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.658754 18843 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:37.626546 20706 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:37.661139 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:37.632185 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.646811 20469 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:37.633464 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:37.644467 20614 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:37.644091 20605 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.675348 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.648773 20612 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.679816 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.681150 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.681747 18839 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:37.655105 20787 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.684587 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.685233 18842 raft_consensus.cc:2376] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3. Re-sending same reply.
I20260709 12:23:37.686676 20635 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:37.688884 20763 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:37.691468 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.692184 18840 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:37.694559 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.673354 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 276453us
I20260709 12:23:37.696000 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.696856 18841 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:37.697747 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.698729 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.699376 18765 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:37.699591 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.654636 20413 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.704555 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.705371 18848 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:37.708173 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.683320 20575 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:37.710569 20575 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:37.710208 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.712283 18769 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:37.686188 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.713949 18842 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.714556 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.706300 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.716518 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.717733 18839 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.654489 20733 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:37.722604 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:37.665017 20654 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:37.658116 20809 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.740132 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.667665 20706 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.721902 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.741460 18769 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:37.730895 18922 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:37.723273 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:37.732005 18915 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:37.742952 19492 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:37.743626 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.745386 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.746352 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:37.747373 18914 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:37.733947 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:37.744256 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.754333 19486 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 2 LEARNER]: Advancing to term 4
I20260709 12:23:37.674062 20469 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.650595 20810 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:23:37.757817 18915 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:37.740944 18770 raft_consensus.cc:2376] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3. Re-sending same reply.
I20260709 12:23:37.733866 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:37.654944 20813 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:23:37.705956 20751 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:37.794243 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60461.5us
I20260709 12:23:37.792936 18842 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:37.731714 20729 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.760017 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.799422 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.799641 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.804636 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.805399 18842 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:37.806293 18848 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:23:37.801522 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57336.9us
W20260709 12:23:37.807358 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 226475us
I20260709 12:23:37.834024 19486 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 4 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:23:37.825955 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 223466us
I20260709 12:23:37.759065 20413 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.741916 20752 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.849941 19486 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:37.848865 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.808475 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:37.849567 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 89686.1us
I20260709 12:23:37.730453 20819 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:37.861209 18839 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:37.810304 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:37.899600 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:37.894017 18842 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:37.904229 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.792738 20696 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.796588 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 430) took 1444 ms. Trace:
I20260709 12:23:37.792502 20612 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.804286 20469 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:37.808609 20698 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.739145 20654 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:37.913530 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61160.5us
I20260709 12:23:37.754678 20733 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:37.760300 20706 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:37.956539 18847 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:37.955025 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.959529 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.961791 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:37.970898 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.940570 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:37.975587 18848 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:37.801127 19483 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:37.958220 20654 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:37.951845 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 143459us
W20260709 12:23:37.937631 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 372282us
I20260709 12:23:37.938220 20614 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.800938 20690 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.153s
I20260709 12:23:37.965307 20737 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.944967 20729 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.937486 18842 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:37.951160 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.957587 20413 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.797328 20799 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.178s
I20260709 12:23:37.986414 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.987418 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:37.989188 18848 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:23:37.989801 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 192802us
W20260709 12:23:37.993044 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 324314us
W20260709 12:23:37.994894 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 95976.6us
I20260709 12:23:38.004482 18887 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:37.995561 18839 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:38.001344 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:38.009599 18886 leader_election.cc:400] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:23:38.009997 18848 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:38.010102 18886 leader_election.cc:403] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:23:37.974681 20819 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:37.902557 20815 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.804929 20789 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.221s
I20260709 12:23:37.807773 20788 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.007196 20629 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.995895 20614 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.020040 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:38.023993 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:38.032863 18772 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:38.027432 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:38.027966 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:38.081244 18770 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:38.081986 18765 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:38.031816 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:38.082468 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.081419 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:38.083123 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51389.9us
W20260709 12:23:38.083755 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63817.1us
I20260709 12:23:38.084283 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:38.085491 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:38.028239 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:38.029879 18839 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:38.035553 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:38.090904 18772 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:38.030332 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:38.025758 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:38.089632 20705 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.025223 20810 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:23:38.106774 18772 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:38.107100 20810 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:38.107576 20810 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:38.108493 20810 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:38.028571 20816 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:38.113435 20667 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.116947 20636 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.119551 20641 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.120932 20641 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.054193 20635 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:38.045147 20779 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.002s
I20260709 12:23:38.093140 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:37.990741 20820 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:38.123874 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 98198.4us
I20260709 12:23:38.020098 20698 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:38.120244 20818 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:23:38.026928 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:38.127182 20635 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.127449 20627 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.133030 18769 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:38.023780 20696 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:38.150744 20627 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.151327 20696 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:38.152062 20696 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:38.153409 20627 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:38.153256 20696 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.031610 20813 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.092912 20792 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:38.020195 20686 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:38.044864 20614 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:38.139024 18770 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:38.105324 20799 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:38.131079 20751 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:38.057222 20819 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.149065 18764 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:38.118167 20809 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:38.023723 20824 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 12:23:38.025053 20612 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:23:38.018878 20821 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:38.163903 20755 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.172574 18848 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:38.223115 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:38.224013 20755 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:38.223352 20469 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.182173 18915 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:38.186851 20690 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:38.026031 20815 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.229017 20469 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:38.206964 20627 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.229460 20413 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.229910 20627 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.230661 20815 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:38.156592 20635 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.156112 20813 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:38.237074 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:38.039924 20733 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.156157 18840 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:38.220988 20654 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.136407 20820 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:38.244801 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:38.255369 18843 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:38.255525 18915 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:38.199805 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 399823us
I20260709 12:23:37.938709 19484 rpcz_store.cc:276] 0709 12:23:36.348373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.353407 (+  5034us) service_pool.cc:224] Handling call
0709 12:23:36.440184 (+ 86777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.469220 (+ 29036us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:36.505616 (+ 36396us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.455023 (+949407us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b180035db20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:23:37.667044 (+212021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.718056 (+ 51012us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:37.720025 (+  1969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.739625 (+ 19600us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.792595 (+ 52970us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13372,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":11202,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":66361728,"thread_start_us":203136,"threads_started":1,"wal-append.queue_time_us":1463740}
I20260709 12:23:38.251401 20819 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:38.256595 18848 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:38.137584 20779 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.280611 19485 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:38.281811 20779 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:38.257304 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:38.284580 18848 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:38.290071 18915 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:38.206597 20799 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:38.291838 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:38.138665 20698 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:38.303191 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 46162.1us
I20260709 12:23:38.304282 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:38.273262 20813 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:38.257668 20820 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.255026 20809 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:38.301160 18848 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:38.320811 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:38.322162 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:38.309154 20751 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:38.307245 20779 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:38.331033 19486 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:38.318461 20752 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:38.336357 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:38.338491 19492 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:38.338652 19486 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:38.323436 20764 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.323698 20498 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:38.333047 19488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.007s	sys 0.015s
I20260709 12:23:38.343713 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:38.345041 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:23:38.343914 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.757s (SENT)
I20260709 12:23:38.312367 20635 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.346498 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:38.313737 20826 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:23:38.351280 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:38.323186 20789 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:23:38.355631 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:38.334034 20779 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:23:38.347214 19488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.008s	sys 0.015s
I20260709 12:23:38.364405 19492 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:23:38.373572 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 236892us
I20260709 12:23:38.382892 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:38.359936 20715 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:38.387394 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:38.392923 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.450646 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 434) took 1152 ms. Trace:
I20260709 12:23:38.396031 20752 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:23:38.379316 20809 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.391746 20715 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.525743 20715 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:38.455127 19487 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:38.456498 20779 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.359645 20737 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:23:38.332224 20799 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.462105 20820 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.358896 20827 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
W20260709 12:23:38.471113 20706 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.003s
I20260709 12:23:38.551143 20706 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.553073 20575 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.554328 20575 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:38.357117 20813 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.388069 20792 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:38.395900 20823 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:38.377130 18764 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:38.402350 20789 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:38.566056 18847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.018s	sys 0.017s
I20260709 12:23:38.492277 20635 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:38.387296 19484 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:23:38.501717 20522 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.847s	user 0.005s	sys 0.007s
I20260709 12:23:38.367460 20764 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.531194 18669 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 1 to 2, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 2 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:38.535153 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.376612 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:38.546797 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 461377us
W20260709 12:23:38.569466 18847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.019s	sys 0.017s
I20260709 12:23:38.548429 20840 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.586658 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:38.583807 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 292) took 1200 ms. Trace:
I20260709 12:23:38.597349 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:38.583377 20823 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:38.583415 20804 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:38.597397 20522 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.613567 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:38.607976 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 231481us
I20260709 12:23:38.611142 18846 rpcz_store.cc:276] 0709 12:23:37.396764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.907856 (+511092us) service_pool.cc:224] Handling call
0709 12:23:37.908289 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.908578 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:38.136120 (+227542us) log.cc:844] Serialized 14 byte log entry
0709 12:23:38.583167 (+447047us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:38.583226 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:38.583286 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.583474 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.583733 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":316977,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3442,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4660,"thread_start_us":619594,"threads_started":2}
I20260709 12:23:38.623117 18845 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:38.627683 20804 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.600939 20840 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.631842 20840 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:38.615952 20737 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:23:38.606925 20768 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:38.643802 20469 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.644436 20469 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.606074 20837 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:38.647802 20469 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:38.614684 20729 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:38.654007 20715 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.657827 19483 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:23:38.659572 20840 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.659889 20654 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:38.666836 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:38.668053 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:38.669735 18669 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 2 to 3, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 3 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.673910 18671 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 161) took 7409 ms. Trace:
W20260709 12:23:38.676936 18844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 1901) took 2123 ms (client timeout 2131 ms). Trace:
W20260709 12:23:38.677397 18844 rpcz_store.cc:269] 0709 12:23:36.553845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.757104 (+203259us) service_pool.cc:224] Handling call
0709 12:23:38.676663 (+1919559us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400326ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:38.676868 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3312357632}
I20260709 12:23:38.674355 18671 rpcz_store.cc:276] 0709 12:23:31.264651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.267075 (+  2424us) service_pool.cc:224] Handling call
0709 12:23:38.673827 (+7406752us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:36.124299 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:36.124960 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:36.124999 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:23:36.125023 (+    24us) tablet.cc:662] Decoding operations
0709 12:23:36.173092 (+ 48069us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:36.173162 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:36.173197 (+    35us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:23:36.173761 (+   564us) tablet.cc:701] Row locks acquired
0709 12:23:36.173781 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:23:36.173948 (+   167us) write_op.cc:270] Start()
0709 12:23:36.174072 (+   124us) write_op.cc:276] Timestamp: P: 1783599816173900 usec, L: 0
0709 12:23:36.174096 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:36.246255 (+ 72159us) log.cc:844] Serialized 2039 byte log entry
0709 12:23:36.767606 (+521351us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af86e28 00007f335e9c1581 00007f335e9c0d58 00007f335e9c59f1 00007f335e9c59a9 00007f335e9c5939 00007f335e9c5901 00007f335e9c4b2d 0000000000388634 0000000000388479
0709 12:23:37.275073 (+507467us) op_driver.cc:464] REPLICATION: finished
0709 12:23:37.520469 (+245396us) write_op.cc:301] APPLY: starting
0709 12:23:37.520571 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:37.520767 (+   196us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:37.520794 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:37.521560 (+   766us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:37.521835 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:23:37.521885 (+    50us) write_op.cc:312] APPLY: finished
0709 12:23:37.522161 (+   276us) log.cc:844] Serialized 47 byte log entry
0709 12:23:37.522362 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:37.522499 (+   137us) write_op.cc:454] Released schema lock
0709 12:23:37.522548 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:37.522997 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:37.523026 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2494745,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":245092,"apply.run_cpu_time_us":2489,"apply.run_wall_time_us":2489,"num_ops":5,"prepare.queue_time_us":317583,"prepare.run_cpu_time_us":44330,"prepare.run_wall_time_us":648399,"raft.queue_time_us":516045,"raft.run_cpu_time_us":12164,"raft.run_wall_time_us":135333,"replication_time_us":1100793,"spinlock_wait_cycles":29956992,"thread_start_us":670125,"threads_started":4,"wal-append.queue_time_us":157784,"wal-append.run_cpu_time_us":23202,"wal-append.run_wall_time_us":2111772}]]}
I20260709 12:23:38.683874 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 439) took 1176 ms. Trace:
I20260709 12:23:38.684388 19485 rpcz_store.cc:276] 0709 12:23:37.507679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.507872 (+   193us) service_pool.cc:224] Handling call
0709 12:23:37.508322 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:38.281059 (+772737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.683528 (+402469us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54006c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:38.683783 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775657344}
I20260709 12:23:38.691532 20762 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:38.530722 19488 rpcz_store.cc:276] 0709 12:23:37.298591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.376443 (+ 77852us) service_pool.cc:224] Handling call
0709 12:23:37.383494 (+  7051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.383752 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:37.609482 (+225730us) log.cc:844] Serialized 14 byte log entry
0709 12:23:38.366280 (+756798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:38.376775 (+ 10495us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:38.379605 (+  2830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.396288 (+ 16683us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.450544 (+ 54256us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267445,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":54747,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"spinlock_wait_cycles":128586496,"thread_start_us":925021,"threads_started":2}
I20260709 12:23:38.696724 20715 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:38.697672 18841 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:38.698086 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 499) took 1166 ms. Trace:
W20260709 12:23:38.700073 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 60167.7us
I20260709 12:23:38.618804 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:38.711325 18921 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:38.700925 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:38.709755 18922 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:38.713775 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:38.719704 18914 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.718291 19486 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.733043 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:38.737831 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:38.608819 20838 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:38.763736 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 376388us
I20260709 12:23:38.601147 20764 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:38.715790 19489 rpcz_store.cc:276] 0709 12:23:37.531790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.543503 (+ 11713us) service_pool.cc:224] Handling call
0709 12:23:37.543867 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.960324 (+416457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.960360 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.960405 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:37.960444 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.697815 (+737371us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b54005c17d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:38.697867 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.698018 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41261,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8184,"spinlock_wait_cycles":161684736,"thread_start_us":340777,"threads_started":1}
I20260709 12:23:38.817646 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:38.881930 19486 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:38.888083 18914 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:38.818252 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:38.857069 18767 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:38.812618 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:39.005650 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 386907us
I20260709 12:23:38.932562 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:38.888789 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 1913) took 2119 ms. Trace:
W20260709 12:23:38.786010 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46182.9us
I20260709 12:23:38.847443 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1683) took 1231 ms. Trace:
I20260709 12:23:38.879729 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:39.065384 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:39.067113 18839 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:38.999789 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 266820us
I20260709 12:23:39.079380 18913 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:39.073444 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:39.078115 18919 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:39.071031 18920 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:39.066381 18922 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:39.067597 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:39.083094 18845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1674) took 1655 ms (client timeout 2093 ms). Trace:
W20260709 12:23:39.083527 18845 rpcz_store.cc:269] 0709 12:23:37.427877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.560333 (+132456us) service_pool.cc:224] Handling call
0709 12:23:39.082915 (+1522582us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003bdb54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:39.083036 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441694464}
I20260709 12:23:39.075021 18843 rpcz_store.cc:276] 0709 12:23:36.769783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.852091 (+1082308us) service_pool.cc:224] Handling call
0709 12:23:38.255186 (+403095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:38.255803 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.888494 (+632691us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54003db150. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:38.888700 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925895424}
I20260709 12:23:39.076771 19485 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:39.088074 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:39.082013 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:39.076085 18841 rpcz_store.cc:276] 0709 12:23:37.615757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.697462 (+ 81705us) service_pool.cc:224] Handling call
0709 12:23:38.847218 (+1149756us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b54003bd154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:38.847374 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2157438720}
W20260709 12:23:39.054917 20842 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
I20260709 12:23:39.097874 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:39.097925 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:39.099393 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:39.107156 18922 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:39.101267 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:39.102669 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:39.108044 18920 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:39.103639 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:39.108508 18918 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:39.108800 18913 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
W20260709 12:23:38.768679 20846 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:23:39.105108 20789 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.107878 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:39.112679 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:39.104663 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1347) took 1076 ms. Trace:
I20260709 12:23:39.113646 18921 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:39.045181 20823 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:38.847250 20706 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:39.005215 20688 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.114197 18920 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:39.113976 18771 rpcz_store.cc:276] 0709 12:23:38.028189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.030511 (+  2322us) service_pool.cc:224] Handling call
0709 12:23:38.030863 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:38.048863 (+ 18000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.048898 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:38.049388 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.315218 (+265830us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:38.559884 (+244666us) log.cc:844] Serialized 14 byte log entry
0709 12:23:38.560414 (+   530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:39.086201 (+525787us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b540029d1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:39.086275 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:39.086359 (+    84us) raft_consensus.cc:1685] finished
0709 12:23:39.104416 (+ 18057us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.104588 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":311778,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":10134,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":42391,"spinlock_wait_cycles":40376704,"thread_start_us":472080,"threads_started":2,"wal-append.queue_time_us":336986}
I20260709 12:23:39.117272 18839 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:39.003054 20605 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.119964 18913 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:39.113256 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:39.097195 20696 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:38.669739 20627 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:39.124019 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:39.125717 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:39.152216 19492 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:38.814952 20830 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:39.019117 20715 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:38.886412 20820 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:39.129958 18915 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:39.110502 20737 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:23:39.136732 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:38.914348 20575 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:39.125679 20838 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:38.640826 20768 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:39.106297 20733 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:39.098496 20469 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:39.147960 20696 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:39.142266 19458 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:39.110582 20809 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:39.159317 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:39.163093 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:39.196950 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54751.6us
W20260709 12:23:39.198426 18669 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.022s
I20260709 12:23:39.128479 20690 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.125732 20805 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:39.106107 20749 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:23:39.107394 20667 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:23:39.028281 20824 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:23:39.133688 20788 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:39.217160 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:39.133479 20522 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:23:39.107137 20612 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:23:39.170231 20765 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:23:39.200685 18669 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.010s	sys 0.022s
I20260709 12:23:39.204950 20810 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:39.211400 20833 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:39.191901 20715 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.241246 20764 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:39.169488 19483 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:39.164521 20791 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.196287 20469 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.210590 20789 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:39.198483 20852 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:23:39.120795 20837 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:23:39.196631 20696 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.154752 20605 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:39.205766 20820 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.238730 20833 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.239434 20824 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:39.195662 20575 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.227813 20768 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.144500 20688 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.232451 20810 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:39.244415 20841 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:23:39.257568 19485 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:39.213131 20805 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.204054 19492 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
W20260709 12:23:39.280954 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 171277us
I20260709 12:23:39.260960 20654 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.272287 20833 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.274880 20824 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:39.372570 20805 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:39.378655 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1349) took 1349 ms. Trace:
W20260709 12:23:39.388759 18847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.033s	sys 0.036s
W20260709 12:23:39.393728 18847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.033s	sys 0.037s
I20260709 12:23:39.323004 20810 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.363432 20837 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:39.274127 20820 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.393533 18767 rpcz_store.cc:276] 0709 12:23:38.028982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.034873 (+  5891us) service_pool.cc:224] Handling call
0709 12:23:38.035252 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:39.071742 (+1036490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:39.378256 (+306514us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54001d5954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:39.378549 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889517440}
I20260709 12:23:39.362187 20715 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:39.372570 20469 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:39.406574 20805 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:39.406068 20837 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:39.420854 20715 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:39.431823 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 331925us
I20260709 12:23:39.392030 20654 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:39.437811 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.427366 20469 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:23:39.438985 20715 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:39.458077 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:39.459611 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1485e54f9795416785f4baf244599201 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:39.459719 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 346536us
I20260709 12:23:39.422894 20605 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.444730 20779 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:39.473706 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 275766us
I20260709 12:23:39.485460 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:39.486861 20667 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:39.488603 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:39.489702 20667 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:39.458461 20698 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:39.449286 20733 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:39.435981 20824 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:39.545527 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57030.8us
W20260709 12:23:39.546356 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 383365us
I20260709 12:23:39.547631 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:39.551054 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:39.555313 19492 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:39.512025 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:39.559201 19485 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:39.561957 19492 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:23:39.470930 20575 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:39.569916 19492 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:39.491235 20765 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:39.575670 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 363074us
W20260709 12:23:39.587177 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 203188us
W20260709 12:23:39.576195 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 193495us
W20260709 12:23:39.592211 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 139183us
I20260709 12:23:39.594161 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:39.595156 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:39.595625 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:39.596561 18843 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:39.596892 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:39.597098 18841 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:39.599011 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:39.599347 18848 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:39.459260 20837 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.561728 20729 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:39.495582 20779 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.614554 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:39.618577 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 106372us
I20260709 12:23:39.618633 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:39.620038 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:39.620915 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 210752us
I20260709 12:23:39.617360 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:39.566622 20688 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:39.622825 18845 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:39.587623 20752 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.605094 20853 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.204s	user 0.001s	sys 0.001s
I20260709 12:23:39.627599 18913 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:39.591766 20667 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.607682 20848 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.634895 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:39.593621 20826 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:39.604060 20867 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:39.571323 20733 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.573515 20749 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:23:39.637423 18920 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:39.656651 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:39.620406 20469 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:39.658586 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:39.647886 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 76476.7us
I20260709 12:23:39.615439 20729 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:39.619511 20789 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:39.651062 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:39.591912 20765 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.659885 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:39.604241 20865 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.627202 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:39.637648 20820 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:39.665114 18916 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:39.644014 20837 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.657363 18920 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:39.632623 20859 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.567376 20715 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.627146 20791 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:39.668107 20690 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:39.679557 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 53539.6us
I20260709 12:23:39.664070 20729 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:39.647048 20698 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:23:39.636777 20752 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.642838 20667 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.678591 20654 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:39.750644 20875 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:23:39.691120 20820 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:39.761909 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.652880 20826 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.648653 20872 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:23:39.769912 20858 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.824044 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 190363us
W20260709 12:23:39.755738 20857 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:23:39.776087 20765 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:39.755393 20856 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:23:39.759296 20855 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:23:39.776690 20861 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:23:39.668893 19484 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:39.646989 20848 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.696177 20859 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.668520 20469 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.754547 20690 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:39.855084 20522 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:39.744388 20789 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.672194 20862 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 12:23:39.851812 18919 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:39.671554 20865 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.657389 20867 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:39.831202 20877 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:23:39.868528 20715 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:39.838300 20654 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.859438 20858 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:39.821197 20868 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
W20260709 12:23:39.858207 20696 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.000s
I20260709 12:23:39.757464 20864 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:23:39.838831 20820 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:39.942670 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 146647us
W20260709 12:23:39.944198 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 350135us
I20260709 12:23:40.015300 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:39.946641 20698 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:40.016657 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:40.017231 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:40.017864 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:39.964375 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:39.971276 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.019835 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.987690 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:39.757771 20873 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.195s
I20260709 12:23:40.026793 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:40.027539 18848 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:40.030310 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:40.030951 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.011921 20895 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:39.952167 20848 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:39.947619 20667 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.000119 19489 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:39.998910 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 366118us
I20260709 12:23:40.036604 20895 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:40.019147 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:40.035249 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 375425us
I20260709 12:23:40.037987 18843 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:39.957198 20768 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.044808 18848 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:40.048350 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:40.009428 20860 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:40.049327 18841 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.009145 20866 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.003151 20859 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:40.009063 20885 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:40.008800 20871 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.023721 20879 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:39.989400 20522 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.076093 20876 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 12:23:40.079073 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 108797us
I20260709 12:23:40.019580 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 451) took 1140 ms. Trace:
I20260709 12:23:40.049405 20813 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:23:40.088351 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 100763us
I20260709 12:23:40.068782 20866 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.002323 20654 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.111418 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:40.020110 20696 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.114320 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:40.111495 18841 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
W20260709 12:23:40.120045 20881 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:23:40.089784 20879 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:40.120321 20891 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:23:40.124845 20899 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:40.087428 20859 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.128343 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:40.125285 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:40.133668 18844 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.131557 20883 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:40.069507 20885 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.082501 20872 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.087299 20779 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.090198 20848 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:40.125285 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:40.135751 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:40.110530 20813 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:40.137565 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:40.091218 20833 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.685s	user 0.013s	sys 0.000s
I20260709 12:23:40.131816 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:40.088282 20791 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:40.142722 19491 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:40.082823 20860 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:40.090798 20698 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:23:40.144210 20872 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.139721 20899 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.037945 20895 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.147015 20848 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.169039 20889 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:40.166759 20791 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.171355 20654 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.087709 20690 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.181128 20860 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.173065 20469 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.173882 20858 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.151633 20873 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:23:40.158872 20826 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.139806 20885 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:40.186200 18844 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:40.147497 20752 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.164494 20891 consensus_queue.cc:1243] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:40.178730 20899 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.185355 19484 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:40.139986 20859 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.216400 20865 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.218932 20866 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:40.222129 20851 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.012s	user 0.004s	sys 0.000s
I20260709 12:23:40.224188 20872 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:40.242082 20830 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.051s	user 0.011s	sys 0.003s
I20260709 12:23:40.151391 20883 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.165002 20833 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:40.258536 20810 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.840s	user 0.007s	sys 0.007s
I20260709 12:23:40.216398 20867 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:40.090482 19488 rpcz_store.cc:276] 0709 12:23:38.878787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.885973 (+  7186us) service_pool.cc:224] Handling call
0709 12:23:38.886422 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:39.018938 (+132516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:39.028358 (+  9420us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:39.045930 (+ 17572us) log.cc:844] Serialized 26 byte log entry
0709 12:23:39.382523 (+336593us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:39.388251 (+  5728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:39.403029 (+ 14778us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:39.995774 (+592745us) raft_consensus.cc:1685] finished
0709 12:23:39.999392 (+  3618us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:40.013531 (+ 14139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2094,"raft.queue_time_us":61985,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":173,"thread_start_us":252521,"threads_started":1,"wal-append.queue_time_us":416383}
I20260709 12:23:40.208305 20813 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.208841 20895 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:40.283381 20883 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.263278 20805 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:40.284830 20805 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:40.285727 20805 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.199260 20879 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.263230 20820 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.286765 20805 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.287746 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1737) took 1151 ms. Trace:
I20260709 12:23:40.264382 20522 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.265897 20696 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.244601 20891 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:23:40.194770 20889 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.274870 20830 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:40.323069 20799 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.324612 18915 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:40.279084 20833 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.279673 19489 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:23:40.282200 20813 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:40.301144 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.251643 20866 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.288264 18922 rpcz_store.cc:276] 0709 12:23:39.136150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.136378 (+   228us) service_pool.cc:224] Handling call
0709 12:23:39.150344 (+ 13966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:39.208230 (+ 57886us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:39.226858 (+ 18628us) log.cc:844] Serialized 14 byte log entry
0709 12:23:39.469292 (+242434us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:39.469348 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:39.469393 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.287419 (+818026us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b5400334354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:40.287480 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:40.287668 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19468,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":829,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":3596,"spinlock_wait_cycles":132358016,"thread_start_us":241154,"threads_started":1,"wal-append.queue_time_us":516134}
I20260709 12:23:40.327571 20866 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.277170 20804 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:40.321341 20893 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:40.332043 20866 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.336058 20859 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:40.336812 20749 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:40.361660 20749 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:40.362718 20749 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.364346 20749 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.287372 20810 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.325899 20889 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.308915 20848 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:40.337529 20840 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:40.352627 20893 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.327174 20899 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.352614 20886 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:40.319610 20872 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.369639 18913 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:23:40.369058 20810 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.379093 18916 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:40.384414 18916 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:40.381109 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:40.387848 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.375317 20840 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:40.387562 20886 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:40.399490 20837 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.708s	user 0.012s	sys 0.000s
I20260709 12:23:40.410481 19487 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:23:40.402033 20872 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.408167 18916 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.418570 20863 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:40.436911 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.435566 20863 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.439265 18916 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:40.442771 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.442706 20863 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.416815 20791 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:40.416556 20840 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.454684 20737 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:40.455011 20824 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.414307 20862 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:40.460584 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:40.463685 18922 raft_consensus.cc:2410] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:40.437489 20899 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:40.474086 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.017s	sys 0.047s
W20260709 12:23:40.481488 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.017s	sys 0.047s
W20260709 12:23:40.482266 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.461501 20729 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.000s
W20260709 12:23:40.491707 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.424216 20872 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.475170 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:40.455317 20737 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:40.507540 18913 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:40.476282 20840 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:40.505746 19492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.029s	sys 0.021s
I20260709 12:23:40.462805 20862 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:40.511787 19492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.030s	sys 0.021s
I20260709 12:23:40.516470 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:40.470350 20886 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.521952 20886 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:40.527612 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.500865 20791 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.551329 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:40.552219 18913 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:23:40.507666 20875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.016s	sys 0.038s
I20260709 12:23:40.553536 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:40.563455 18921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.023s	sys 0.071s
W20260709 12:23:40.564003 18921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.023s	sys 0.071s
W20260709 12:23:40.575817 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.600538 18738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.021s	sys 0.052s
W20260709 12:23:40.528192 20688 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.022s	sys 0.054s
I20260709 12:23:40.480703 20837 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 12:23:40.602844 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84756.2us
W20260709 12:23:40.603130 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.022s
W20260709 12:23:40.607949 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.000s	sys 0.022s
W20260709 12:23:40.608304 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 569138us
I20260709 12:23:40.608773 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:40.608909 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:40.604940 18738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.021s	sys 0.052s
W20260709 12:23:40.609650 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 572624us
W20260709 12:23:40.604351 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.021s
W20260709 12:23:40.613425 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.021s
W20260709 12:23:40.613888 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 581340us
I20260709 12:23:40.615113 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:40.617059 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:40.618577 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:40.632763 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:40.557266 20875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.016s	sys 0.038s
W20260709 12:23:40.602612 20688 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.023s	sys 0.054s
I20260709 12:23:40.506491 20729 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:23:40.658581 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.665840 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.016s
W20260709 12:23:40.666220 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.016s
W20260709 12:23:40.666533 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 533190us
I20260709 12:23:40.662773 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:40.640872 20715 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.632s	user 0.013s	sys 0.000s
W20260709 12:23:40.668738 19485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.009s	sys 0.029s
W20260709 12:23:40.669155 19485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.009s	sys 0.029s
I20260709 12:23:40.625746 20635 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:40.631570 20890 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:40.672328 18842 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:40.673094 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1687) took 3045 ms. Trace:
I20260709 12:23:40.550324 20872 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:23:40.634981 20883 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:40.604254 20605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.003s	sys 0.018s
I20260709 12:23:40.634636 20882 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:40.682129 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:40.601073 20791 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:40.682785 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74065.5us
I20260709 12:23:40.695009 18914 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:40.696442 18913 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:40.605141 20885 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.693466 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:40.682247 20667 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:40.700724 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1735) took 1579 ms. Trace:
I20260709 12:23:40.687318 20890 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.721767 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:40.733385 18918 rpcz_store.cc:276] 0709 12:23:39.121547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.121755 (+   208us) service_pool.cc:224] Handling call
0709 12:23:39.122068 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:39.122307 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:39.143708 (+ 21401us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.243336 (+1099628us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b18001c0a20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:23:40.699861 (+456525us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:40.699922 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:40.699976 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.700521 (+   545us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:40.700660 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4660,"prepare.queue_time_us":21112,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":4842,"raft.queue_time_us":4777,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13532,"spinlock_wait_cycles":5885696,"thread_start_us":451542,"threads_started":1}
W20260709 12:23:40.723455 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 110240us
W20260709 12:23:40.693553 18920 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.011s
I20260709 12:23:40.682729 20820 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:40.681968 20810 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:40.696759 20605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.015s	sys 0.025s
I20260709 12:23:40.662629 20575 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:23:40.684127 20788 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:40.684551 18847 rpcz_store.cc:276] 0709 12:23:37.627284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.964517 (+337233us) service_pool.cc:224] Handling call
0709 12:23:37.967349 (+  2832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.967666 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:38.621757 (+654091us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.303318 (+1681561us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b18003eeae0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:23:40.669817 (+366499us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.671471 (+  1654us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:40.671569 (+    98us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:40.671637 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.671736 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:40.673008 (+  1272us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":259464,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":208,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":20166,"spinlock_wait_cycles":17734400,"thread_start_us":1766947,"threads_started":3,"wal-append.queue_time_us":924747}
I20260709 12:23:40.685370 20909 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:40.746636 18920 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.000s	sys 0.011s
W20260709 12:23:40.708614 18737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.033s	sys 0.084s
W20260709 12:23:40.775822 18737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.037s	sys 0.088s
I20260709 12:23:40.682700 20469 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:23:40.706911 20882 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.723578 20893 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.708089 20612 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.691319 20907 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:40.840376 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:40.747558 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:40.744505 20789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.011s	sys 0.085s
I20260709 12:23:40.732372 20883 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:40.690379 20706 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:23:40.813066 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1696) took 3129 ms. Trace:
I20260709 12:23:40.814306 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1519) took 1179 ms. Trace:
W20260709 12:23:40.726016 20877 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.010s
I20260709 12:23:40.749380 20890 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:40.826351 18916 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:40.841239 18922 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:40.845410 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:40.857375 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.870244 18914 rpcz_store.cc:276] 0709 12:23:39.635080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.635587 (+   507us) service_pool.cc:224] Handling call
0709 12:23:39.636024 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.723069 (+1087045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.813944 (+ 90875us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000f5854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:40.814217 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2434840448}
I20260709 12:23:40.873745 18913 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:40.794309 20864 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.850435 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:40.679163 20737 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.739868 20667 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.815261 20837 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:40.846897 20789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.012s	sys 0.085s
I20260709 12:23:40.811892 20882 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.794844 20909 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.839825 20907 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.841305 20893 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.797999 20876 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.079s
W20260709 12:23:40.872391 20877 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.006s	sys 0.012s
W20260709 12:23:40.889858 20860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.020s	sys 0.020s
W20260709 12:23:40.873605 20733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.014s	sys 0.025s
I20260709 12:23:40.861162 20833 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.860863 20891 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:40.795930 20810 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:40.860610 20883 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:40.869668 20830 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:40.840502 20605 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:23:40.860376 20900 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:40.932262 20733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.015s	sys 0.026s
W20260709 12:23:40.891399 20861 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 12:23:40.896776 20690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.030s	sys 0.046s
W20260709 12:23:40.985160 20690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.031s	sys 0.046s
I20260709 12:23:40.822888 20788 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:40.922437 20737 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:40.986070 20914 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:23:40.932092 20894 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.231s
I20260709 12:23:40.919078 20872 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:40.932487 20879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.001s	sys 0.014s
W20260709 12:23:40.998917 20879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.014s
I20260709 12:23:40.982753 20830 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:40.930661 20860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.021s	sys 0.020s
W20260709 12:23:40.999686 20911 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:23:41.001114 20830 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:40.890136 20805 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:23:40.975464 20903 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:40.933041 20893 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.021854 20667 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.925406 20907 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.914892 20837 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.986522 20810 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:40.914296 20789 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:40.912192 20864 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.847805 20858 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:40.971132 20883 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:40.983918 20915 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:23:40.930496 20859 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.947290 20833 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:40.942366 20876 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:41.046108 20876 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:41.047173 20876 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.048518 20876 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.051113 20833 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.037810 20903 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.056929 20903 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:41.037642 20885 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:40.968130 20891 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.039091 20858 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.005292 20872 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:41.041458 20799 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.718s	user 0.002s	sys 0.008s
W20260709 12:23:41.027660 20824 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 12:23:41.023641 20893 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:41.058256 20886 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.536s	user 0.004s	sys 0.005s
I20260709 12:23:41.059511 20858 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:41.125500 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.841347 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:23:41.127769 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 401943us
W20260709 12:23:41.127777 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 379252us
W20260709 12:23:40.864126 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.228183 20824 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:41.229836 20917 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:41.143759 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.145843 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1518) took 1511 ms. Trace:
I20260709 12:23:41.149147 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1526) took 1086 ms. Trace:
I20260709 12:23:40.919426 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:41.232651 20913 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.233560 18916 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.233739 20913 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.230881 18919 rpcz_store.cc:276] 0709 12:23:39.634678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.635956 (+  1278us) service_pool.cc:224] Handling call
0709 12:23:39.636397 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:39.851532 (+215135us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:40.042231 (+190699us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.664811 (+622580us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:40.665327 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:23:40.665465 (+   138us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:40.665500 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.665562 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:41.144836 (+479274us) raft_consensus.cc:1685] finished
0709 12:23:41.144929 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.145496 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71004,"raft.queue_time_us":204333,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":16385,"thread_start_us":669418,"threads_started":2,"wal-append.queue_time_us":617446}
I20260709 12:23:41.237017 20913 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.238517 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:41.238955 20917 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.151331 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:41.240255 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 398893us
I20260709 12:23:40.923681 18918 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:41.166603 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.171424 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.173380 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 505) took 1347 ms. Trace:
I20260709 12:23:41.149889 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:41.243690 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 94283.9us
I20260709 12:23:41.243202 19485 rpcz_store.cc:276] 0709 12:23:39.826195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.826594 (+   399us) service_pool.cc:224] Handling call
0709 12:23:39.955288 (+128694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:39.955607 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:39.955647 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:39.987200 (+ 31553us) log.cc:844] Serialized 26 byte log entry
0709 12:23:40.669562 (+682362us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:40.669602 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.669669 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:41.172546 (+502877us) raft_consensus.cc:1685] finished
0709 12:23:41.172598 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.173085 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":667112,"threads_started":1,"wal-append.queue_time_us":738741}
I20260709 12:23:41.244706 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:41.245608 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:41.247103 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.248438 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.248611 20899 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:41.170918 19486 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:41.251216 20688 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:41.251600 20858 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.251811 20688 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:41.182374 19488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.007s	sys 0.032s
W20260709 12:23:41.252823 19488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.008s	sys 0.032s
I20260709 12:23:41.253080 20912 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:41.254580 20823 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:41.255016 20912 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:41.255533 20912 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:41.255204 20823 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.003168 20627 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:41.075870 20871 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.257329 20871 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:41.082139 20889 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.713s	user 0.005s	sys 0.009s
I20260709 12:23:41.249303 20899 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.259035 20899 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.258116 20912 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:41.259299 20889 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.260787 20912 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:41.249250 20927 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:41.059514 20891 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:41.074361 20895 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.792s	user 0.013s	sys 0.000s
I20260709 12:23:41.061230 20837 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.265691 20891 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.266464 20891 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.189312 20901 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:23:41.262178 20889 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.061739 20859 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.194648 20789 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.197408 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.198624 20872 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:41.061405 20862 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.271580 20889 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:41.285549 20889 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:41.207175 20813 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.003s
I20260709 12:23:41.285989 20862 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:41.287039 20889 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.264091 20877 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:41.290802 20877 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.291260 20877 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:41.208139 20799 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:41.209649 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.209753 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.025331 20729 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:41.199411 18840 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:41.214574 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:41.227401 20749 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.862s	user 0.015s	sys 0.003s
I20260709 12:23:41.227065 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.229700 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:40.870059 18842 rpcz_store.cc:276] 0709 12:23:37.683977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.996184 (+312207us) service_pool.cc:224] Handling call
0709 12:23:40.671894 (+2675710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.683824 (+ 11930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.812821 (+128997us) spinlock_profiling.cc:243] Waited 2.68 s on lock 0x7b5400071050. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:40.812993 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6152734464}
I20260709 12:23:41.230934 18920 rpcz_store.cc:276] 0709 12:23:40.062893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.159479 (+ 96586us) service_pool.cc:224] Handling call
0709 12:23:40.159935 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.160229 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:40.754318 (+594089us) log.cc:844] Serialized 14 byte log entry
0709 12:23:41.148083 (+393765us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:41.148217 (+   134us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:41.148404 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.148587 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.148899 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":869455,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":42412,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":1983,"spinlock_wait_cycles":27710208,"thread_start_us":945865,"threads_started":2,"wal-append.queue_time_us":447811}
I20260709 12:23:41.182634 19489 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:41.270078 20891 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:41.252404 20688 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.242100 20917 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.294857 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:41.296787 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.297123 20690 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.309309 18841 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:41.309862 20690 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:41.311120 20898 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.577s	user 0.005s	sys 0.000s
I20260709 12:23:41.313215 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 539) took 1739 ms. Trace:
W20260709 12:23:41.314297 20905 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.596s	user 0.000s	sys 0.002s
I20260709 12:23:41.317036 20690 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.298950 20799 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.295428 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.318370 19490 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
W20260709 12:23:41.320075 20916 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
I20260709 12:23:41.319819 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.319952 20799 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.313709 19492 rpcz_store.cc:276] 0709 12:23:39.573899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.574047 (+   148us) service_pool.cc:224] Handling call
0709 12:23:39.574574 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:39.676554 (+101980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:39.676583 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:39.800921 (+124338us) log.cc:844] Serialized 26 byte log entry
0709 12:23:40.512520 (+711599us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:40.512582 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.512686 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:41.309956 (+797270us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:41.312597 (+  2641us) raft_consensus.cc:1685] finished
0709 12:23:41.312623 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.313019 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13881,"raft.queue_time_us":181560,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":116,"spinlock_wait_cycles":26746752,"thread_start_us":748873,"threads_started":2,"wal-append.queue_time_us":840486}
I20260709 12:23:41.331266 18844 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:23:41.334465 20928 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 12:23:41.318109 20909 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:41.340299 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55769.5us
I20260709 12:23:41.335381 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1522) took 1695 ms. Trace:
W20260709 12:23:41.349838 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 120456us
I20260709 12:23:41.351315 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:41.352852 20799 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.330094 20889 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:41.353786 20799 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.354840 20909 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:41.355830 20909 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:41.356534 20909 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:41.359071 20871 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.361560 20882 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.363224 19483 raft_consensus.cc:2368] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:41.364269 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.365134 18920 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:41.365276 20859 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.365216 20882 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:41.365854 20891 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.398837 20891 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:41.400691 20890 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.002s
I20260709 12:23:41.401327 20788 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.401924 20891 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.366385 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.356559 20799 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.402148 20887 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:41.409438 20887 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:41.373701 20920 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
I20260709 12:23:41.375032 20873 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:41.376952 20933 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 12:23:41.378607 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.383697 18919 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:41.384752 20930 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:23:41.384533 20883 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.385617 20690 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:41.344522 18921 rpcz_store.cc:276] 0709 12:23:39.639517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.676536 (+ 37019us) service_pool.cc:224] Handling call
0709 12:23:39.739974 (+ 63438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:39.941621 (+201647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:39.941651 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:39.954088 (+ 12437us) log.cc:844] Serialized 26 byte log entry
0709 12:23:40.564514 (+610426us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:40.564584 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.564690 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:41.313263 (+748573us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:41.322575 (+  9312us) raft_consensus.cc:1685] finished
0709 12:23:41.322604 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.335186 (+ 12582us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24455,"raft.queue_time_us":227846,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":12276,"spinlock_wait_cycles":11321216,"thread_start_us":742303,"threads_started":2,"wal-append.queue_time_us":657482}
W20260709 12:23:41.394966 18840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 1926) took 1798 ms (client timeout 1674 ms). Trace:
I20260709 12:23:41.397625 20688 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.401448 20890 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.369598 20823 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.403389 18841 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 12:23:41.378661 20931 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
I20260709 12:23:41.403939 18844 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:41.412814 18916 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:23:41.431583 18840 rpcz_store.cc:269] 0709 12:23:39.596533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.601549 (+  5016us) service_pool.cc:224] Handling call
0709 12:23:41.394631 (+1793082us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400380c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:41.394848 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3496140160}
W20260709 12:23:41.372017 20923 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 12:23:41.433487 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.432723 18839 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:41.438531 18841 pending_rounds.cc:85] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 1
I20260709 12:23:41.442869 18841 pending_rounds.cc:107] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:41.443207 18841 raft_consensus.cc:2889] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:41.443447 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 96435.8us
I20260709 12:23:41.443526 20791 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.357774 20909 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.412401 20887 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.452816 19489 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:41.456627 20873 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.459568 19490 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:41.460703 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.453611 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.461097 20873 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.413501 20864 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.461621 19491 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:41.443230 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.463250 19483 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:41.464162 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.465209 18914 raft_consensus.cc:2410] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:41.467062 18847 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:41.468879 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.470103 18921 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:41.470570 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.470971 18669 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 276) took 8972 ms. Trace:
I20260709 12:23:41.471452 18922 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:41.471899 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.472748 19491 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:41.473955 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.475471 19483 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:41.477097 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.461505 19485 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:41.478506 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.487274 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:41.466194 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:41.445847 20799 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:41.497467 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.496851 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.499823 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.500543 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 286) took 1153 ms. Trace:
W20260709 12:23:41.502825 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 111372us
I20260709 12:23:41.503587 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:41.493978 20791 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:41.496445 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50159.4us
I20260709 12:23:41.505661 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:41.505937 20913 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:41.478114 20840 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.951s	user 0.010s	sys 0.002s
I20260709 12:23:41.517501 20882 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:41.519281 20823 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:41.519994 20823 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:41.520977 20791 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.521502 20901 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.521271 20823 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.522140 20901 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.507359 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 509) took 1140 ms. Trace:
I20260709 12:23:41.522907 20788 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.523990 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.517046 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:41.524791 18841 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:41.532858 18922 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
W20260709 12:23:41.532680 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1485e54f9795416785f4baf244599201 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:41.523520 20788 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.511754 20872 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:41.534938 20872 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.535472 20872 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:41.537747 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.535534 18847 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:41.527633 20917 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:41.539641 20791 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.539789 20917 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.541606 20799 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.471446 18669 rpcz_store.cc:276] 0709 12:23:32.498863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.499022 (+   159us) service_pool.cc:224] Handling call
0709 12:23:41.470674 (+8971652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:39.373191 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:39.373854 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:39.373910 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:23:39.373942 (+    32us) tablet.cc:662] Decoding operations
0709 12:23:39.374634 (+   692us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:39.374714 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:39.374762 (+    48us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:39.375257 (+   495us) tablet.cc:701] Row locks acquired
0709 12:23:39.375282 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:23:39.375505 (+   223us) write_op.cc:270] Start()
0709 12:23:39.375666 (+   161us) write_op.cc:276] Timestamp: P: 1783599819375433 usec, L: 0
0709 12:23:39.375700 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:23:39.376693 (+   993us) log.cc:844] Serialized 917 byte log entry
0709 12:23:40.997228 (+1620535us) op_driver.cc:464] REPLICATION: finished
0709 12:23:41.334759 (+337531us) write_op.cc:301] APPLY: starting
0709 12:23:41.334915 (+   156us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:41.335131 (+   216us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:41.335279 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:41.403227 (+ 67948us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:41.403509 (+   282us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:23:41.403557 (+    48us) write_op.cc:312] APPLY: finished
0709 12:23:41.403974 (+   417us) log.cc:844] Serialized 29 byte log entry
0709 12:23:41.404246 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:41.404441 (+   195us) write_op.cc:454] Released schema lock
0709 12:23:41.404514 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:41.405126 (+   612us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:41.405164 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1065034,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":321728,"apply.run_cpu_time_us":3408,"apply.run_wall_time_us":70339,"num_ops":2,"prepare.queue_time_us":693910,"prepare.run_cpu_time_us":13453,"prepare.run_wall_time_us":201466,"raft.queue_time_us":951928,"raft.run_cpu_time_us":9640,"raft.run_wall_time_us":148693,"replication_time_us":1600654,"thread_start_us":1439617,"threads_started":4,"wal-append.queue_time_us":270090}]]}
I20260709 12:23:41.549891 20872 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.556136 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:41.556371 20897 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:41.556979 20897 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:41.523901 20887 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.558557 20887 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.560501 20913 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.560932 20789 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:41.564545 18919 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:41.549486 20877 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.502118 20907 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.562520 20889 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:23:41.571624 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.562366 20872 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.573098 20690 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:41.573537 20690 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:41.574637 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:41.575462 19485 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:41.531738 20882 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:41.578444 18913 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:41.580891 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.570223 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:41.582130 20864 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:41.582501 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:41.582664 20864 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:41.583107 20864 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.584074 20469 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:41.584662 20469 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:41.585180 20469 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:41.586926 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:41.588344 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:41.589690 20876 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:41.590134 20876 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.590553 20876 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:41.590721 20909 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:41.591439 20909 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.591907 20909 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:41.508394 18917 rpcz_store.cc:276] 0709 12:23:40.326815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.326976 (+   161us) service_pool.cc:224] Handling call
0709 12:23:40.327763 (+   787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:40.328141 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:40.328169 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:40.328663 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:23:40.693775 (+365112us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:40.693825 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.693896 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:41.370877 (+676981us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:41.445080 (+ 74203us) raft_consensus.cc:1685] finished
0709 12:23:41.445101 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.479584 (+ 34483us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1210,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":21577,"spinlock_wait_cycles":26678016,"thread_start_us":364779,"threads_started":1,"wal-append.queue_time_us":705381}
I20260709 12:23:41.567590 20789 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.564145 20897 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.599210 20749 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:41.599944 20897 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:41.600678 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.601668 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:41.573552 20907 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:41.603238 20840 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.608981 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:41.613462 18841 raft_consensus.cc:2410] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:23:41.601137 20789 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.620970 18767 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:41.605113 20820 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.614302 20840 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.605072 20891 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:41.619954 20883 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.637082 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.643440 20885 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.643779 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:41.644630 20840 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:41.644258 20885 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.645242 20891 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.645741 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:41.646927 20885 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.647405 18840 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:41.630786 20737 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.648447 20891 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.648736 20737 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.649616 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.651216 20737 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.652151 20877 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.651813 20690 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:41.654178 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.657172 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.658764 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:41.660169 20627 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.660821 19489 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:41.660996 20627 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.662621 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:41.664178 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:41.673633 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:41.674790 20890 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:41.675856 18771 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:23:41.698155 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.523136 19488 rpcz_store.cc:276] 0709 12:23:40.367443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.367625 (+   182us) service_pool.cc:224] Handling call
0709 12:23:40.368090 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:40.368518 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:40.368556 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:40.369127 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.253767 (+884640us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:41.253853 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.254013 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:41.376036 (+122023us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:41.506951 (+130915us) raft_consensus.cc:1685] finished
0709 12:23:41.506985 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.507285 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5733,"raft.queue_time_us":6378,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"spinlock_wait_cycles":29862784,"thread_start_us":875540,"threads_started":1,"wal-append.queue_time_us":825962}
I20260709 12:23:41.700039 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:41.702581 18922 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:41.702787 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:41.704680 18765 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:41.706058 18841 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:41.707100 18773 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:41.629470 20820 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.709342 19491 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:41.708688 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.716012 20820 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.717864 18840 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:41.702788 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.659529 20688 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.721714 19489 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
W20260709 12:23:41.731860 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.731956 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.732810 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:41.735710 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:41.737979 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.722770 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 165105us
I20260709 12:23:41.732746 18841 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:41.741910 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.745818 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:41.755424 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.758713 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.754791 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:41.762228 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.763239 18841 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:41.776779 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.777809 18917 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:41.725140 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:41.792008 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.792753 20688 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:41.792145 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:41.794266 20941 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:23:41.795183 20627 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:41.795836 20943 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:23:41.796797 18846 pending_rounds.cc:85] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 5
I20260709 12:23:41.797250 18846 pending_rounds.cc:107] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:23:41.797610 18846 raft_consensus.cc:2889] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.799439 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:41.800616 18914 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:41.790220 18844 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:41.768934 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:41.824221 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.741006 20876 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:41.786875 20939 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 12:23:41.877465 18921 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 2: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:41.941732 20901 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:42.225798 20946 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.449s	user 0.002s	sys 0.000s
W20260709 12:23:41.901552 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.399771 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:41.936208 20799 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:42.271203 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.400736 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 542) took 1238 ms. Trace:
W20260709 12:23:42.401518 18839 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.005s
I20260709 12:23:42.401669 18919 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:23:41.893203 20899 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.633s	user 0.014s	sys 0.000s
I20260709 12:23:42.402518 20899 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:42.403878 18847 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:41.938627 18670 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 3, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.404184 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.405439 20788 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:42.405295 18670 catalog_manager.cc:5697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:42.403726 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.410365 18773 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:42.410125 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.411533 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.411715 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.412329 20917 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:42.412731 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.413127 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.413499 18773 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:42.401360 19486 rpcz_store.cc:276] 0709 12:23:41.162594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.167779 (+  5185us) service_pool.cc:224] Handling call
0709 12:23:41.168691 (+   912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.170164 (+  1473us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:41.272177 (+102013us) log.cc:844] Serialized 14 byte log entry
0709 12:23:41.339436 (+ 67259us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.343624 (+  4188us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.343819 (+   195us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:41.343877 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.343975 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.400509 (+1056534us) raft_consensus.cc:1685] finished
0709 12:23:42.400535 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.400669 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25659,"raft.run_cpu_time_us":518,"raft.run_wall_time_us":43003,"thread_start_us":41890,"threads_started":1,"wal-append.queue_time_us":155070}
I20260709 12:23:42.415205 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.416062 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.416466 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.417287 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.417841 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.418506 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:41.932111 18768 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:42.406500 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:42.419850 18922 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.716s	user 0.041s	sys 0.032s
I20260709 12:23:42.420568 18922 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:42.012454 20876 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:42.289708 19485 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.710s	user 0.013s	sys 0.000s
I20260709 12:23:41.889367 20688 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:41.996630 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 204559us
I20260709 12:23:41.882241 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.402899 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.941527 20947 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:42.402099 18839 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:41.935985 20864 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:41.956629 20887 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:41.881968 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:42.137637 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.438768 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.877453 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.421372 19485 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
W20260709 12:23:41.952847 18886 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.720s (SENT) [suppressed 21 similar messages]
I20260709 12:23:42.419749 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:42.426741 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:42.202103 20949 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:23:42.441612 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:42.429530 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:42.434818 18765 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
W20260709 12:23:42.435950 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.428133 18811 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.005s	sys 0.007s
W20260709 12:23:42.443452 18811 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.006s	sys 0.007s
W20260709 12:23:42.427762 18916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.000s	sys 0.012s
I20260709 12:23:41.918669 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:42.444533 18916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.013s
W20260709 12:23:42.445470 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.446467 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.454826 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:41.951574 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.458163 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.458950 18773 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:42.461787 18771 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.434934 20947 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.465873 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.467034 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:42.430711 20627 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.463315 18844 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:42.470129 19492 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:42.457824 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.461438 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.457026 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:42.471294 18848 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:42.488240 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.486163 18845 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:23:42.498567 18768 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:42.480958 20897 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.880s	user 0.014s	sys 0.001s
I20260709 12:23:42.465320 20876 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:42.516168 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:42.468899 20947 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:42.502333 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54313.1us
I20260709 12:23:42.540293 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.541899 18844 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:42.554991 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:42.504240 20887 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:42.563354 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:42.506739 19487 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.571282 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:42.520210 20873 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.571424 19486 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 2: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:42.564134 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:42.548003 18670 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:23:42.486991 20627 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:42.556767 20950 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:23:42.589465 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.589912 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:42.583640 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.585590 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.598196 18768 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.594988 18670 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.598469 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.599063 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.565491 20887 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:42.599380 18919 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:42.611382 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:42.612108 19486 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:42.594884 20862 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.611846 18921 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:42.616983 18922 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:42.617646 18915 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:42.618858 18844 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:42.620222 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:42.608496 20887 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.622555 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.629398 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:42.587278 20873 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:42.616240 20877 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.631877 18917 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:42.617712 20876 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:42.590507 20688 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:42.663467 18921 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.667631 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.667891 18840 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:42.636382 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.669387 18845 raft_consensus.cc:2410] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:23:42.631611 20899 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:42.672520 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.673233 18917 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:42.679116 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:42.678175 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:42.681723 20469 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.096s	user 0.013s	sys 0.003s
I20260709 12:23:42.682567 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:42.682298 20469 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.678328 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 300) took 1184 ms. Trace:
I20260709 12:23:42.684705 18920 rpcz_store.cc:276] 0709 12:23:41.493777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.671803 (+1178026us) service_pool.cc:224] Handling call
0709 12:23:42.675725 (+  3922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:42.677935 (+  2210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.677968 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:42.678028 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:42.678061 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.678123 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.678237 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:42.637888 20862 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.688243 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1361) took 1032 ms. Trace:
I20260709 12:23:42.688239 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:42.713346 18812 connection.cc:256] RPC call timeout handler was delayed by -1.0902005180000742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 12:23:42.714087 18812 connection.cc:256] RPC call timeout handler was delayed by -1.0378021019996595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 12:23:42.716137 18844 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:42.726612 18768 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:23:42.727737 20959 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:23:42.722030 20862 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:42.728554 20862 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:42.729112 20862 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:42.722494 20690 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.723443 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.688962 18767 rpcz_store.cc:276] 0709 12:23:41.655933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.656101 (+   168us) service_pool.cc:224] Handling call
0709 12:23:41.657338 (+  1237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.657862 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.657892 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.660619 (+  2727us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.772407 (+111788us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:41.772445 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.772531 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.688041 (+915510us) raft_consensus.cc:1685] finished
0709 12:23:42.688057 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.688189 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":381,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":1938688,"thread_start_us":110426,"threads_started":1,"wal-append.queue_time_us":830943}
I20260709 12:23:42.662186 20877 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.738063 18921 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:42.721068 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.739501 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.741551 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.743139 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1990) took 1080 ms. Trace:
I20260709 12:23:42.743559 18770 rpcz_store.cc:276] 0709 12:23:41.663033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.675099 (+ 12066us) service_pool.cc:224] Handling call
0709 12:23:42.724263 (+1049164us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:42.730959 (+  6696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:42.742612 (+ 11653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.742647 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:42.742711 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:42.742762 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.742829 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.742948 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133,"spinlock_wait_cycles":5628288}
I20260709 12:23:42.744257 20627 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:42.743808 20862 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:42.745872 18768 raft_consensus.cc:2368] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5.
I20260709 12:23:42.748255 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.750031 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.720788 20837 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:42.754097 18917 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:42.735141 20823 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:42.756659 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:42.740082 20909 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.147s	user 0.010s	sys 0.007s
I20260709 12:23:42.763600 18921 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:42.758731 18769 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:42.739943 20864 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:42.790904 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.792225 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:42.801592 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 848726us
W20260709 12:23:42.801735 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 382059us
W20260709 12:23:42.755606 20789 consensus_meta.cc:287] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.118s	user 0.013s	sys 0.001s
I20260709 12:23:42.802838 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:42.803503 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:42.805891 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1754) took 1089 ms. Trace:
I20260709 12:23:42.806008 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.806143 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.806633 18914 rpcz_store.cc:276] 0709 12:23:41.716233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.433213 (+716980us) service_pool.cc:224] Handling call
0709 12:23:42.445758 (+ 12545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:42.805427 (+359669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.805460 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:42.805551 (+    91us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:42.805589 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.805668 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.805794 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8092,"raft.queue_time_us":94262,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":22996,"thread_start_us":348053,"threads_started":1}
I20260709 12:23:42.808444 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.809257 18767 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:42.810120 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.805907 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:42.813481 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:42.815811 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.817157 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:42.792611 20823 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:42.827407 20862 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:42.828253 20862 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.831562 20862 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:42.832808 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:42.834267 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:42.835805 20967 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:42.836344 20967 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.836449 20956 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:42.836884 20956 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:42.837392 20956 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:42.840637 20897 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:42.836159 20964 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:23:42.841686 20960 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:23:42.799355 20909 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.835681 18770 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:42.843127 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1751) took 1127 ms. Trace:
I20260709 12:23:42.758265 20837 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:42.845857 20862 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:42.846582 20862 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:42.847661 20862 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.847971 20837 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:42.836859 20967 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.845254 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.843731 18918 rpcz_store.cc:276] 0709 12:23:41.715227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.793343 (+ 78116us) service_pool.cc:224] Handling call
0709 12:23:41.793771 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.395966 (+602195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.396000 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:42.396563 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.587552 (+190989us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:42.587605 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.587698 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.842826 (+255128us) raft_consensus.cc:1685] finished
0709 12:23:42.842857 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.843044 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24689,"raft.queue_time_us":625951,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":14233,"thread_start_us":190528,"threads_started":1,"wal-append.queue_time_us":238641}
I20260709 12:23:42.852635 20837 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:42.853324 20837 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:42.855932 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.857324 20837 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:42.844604 20688 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:42.859053 20688 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.859643 20688 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:42.862920 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:42.864176 20837 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:42.864774 20837 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.865244 20837 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:42.867051 20953 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:23:42.868525 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 466) took 1403 ms. Trace:
I20260709 12:23:42.868975 19483 rpcz_store.cc:276] 0709 12:23:41.465120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.499949 (+ 34829us) service_pool.cc:224] Handling call
0709 12:23:41.500587 (+   638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.501149 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.501199 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.502168 (+   969us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.880626 (+378458us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:41.898987 (+ 18361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.919082 (+ 20095us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.868226 (+949144us) raft_consensus.cc:1685] finished
0709 12:23:42.868252 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.868453 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":280192,"threads_started":1,"wal-append.queue_time_us":1151854}
W20260709 12:23:42.873422 19456 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.629s (SENT)
I20260709 12:23:42.874475 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:42.874895 20897 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:42.875254 19491 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:42.875379 20897 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:42.876518 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:42.876461 20897 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.878089 20897 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:42.878734 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44584.7us
I20260709 12:23:42.811117 20899 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:42.868152 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:42.879628 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:42.885905 18771 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:42.882782 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:42.912180 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 346456us
I20260709 12:23:42.822656 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.913087 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1750) took 1204 ms. Trace:
I20260709 12:23:42.913244 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2000) took 1098 ms. Trace:
I20260709 12:23:42.833411 20823 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.832691 20968 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.850138 19487 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:42.932771 18771 rpcz_store.cc:276] 0709 12:23:41.788179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.811664 (+ 23485us) service_pool.cc:224] Handling call
0709 12:23:42.886795 (+1075131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:42.890709 20912 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:42.884223 20899 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:42.811431 20789 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.938269 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:42.940781 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 72729.3us
W20260709 12:23:42.942026 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.942981 18773 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.932737 18916 rpcz_store.cc:276] 0709 12:23:41.714799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.715109 (+   310us) service_pool.cc:224] Handling call
0709 12:23:41.715771 (+   662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.716374 (+   603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.716404 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.765971 (+ 49567us) log.cc:844] Serialized 548 byte log entry
0709 12:23:42.444957 (+678986us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:42.444998 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.445075 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.912846 (+467771us) raft_consensus.cc:1685] finished
0709 12:23:42.912870 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.913020 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":606575,"threads_started":1,"wal-append.queue_time_us":804541}
I20260709 12:23:42.890182 20961 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:42.935808 20889 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:42.962162 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:42.963094 19491 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:42.966543 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.970558 19486 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:42.972201 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.944526 20899 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:42.940130 20970 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:42.942559 20912 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:42.879465 20876 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.980844 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1992) took 1317 ms. Trace:
I20260709 12:23:42.982810 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:42.952549 20961 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:42.956383 20873 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:42.984467 18766 rpcz_store.cc:276] 0709 12:23:41.663837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.674269 (+ 10432us) service_pool.cc:224] Handling call
0709 12:23:42.411537 (+737268us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:42.411790 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.412094 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.412120 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:42.412662 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.612823 (+200161us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:42.967585 (+354762us) log.cc:844] Serialized 14 byte log entry
0709 12:23:42.978410 (+ 10825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.978497 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.978545 (+    48us) raft_consensus.cc:1685] finished
0709 12:23:42.978629 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.980766 (+  2137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1476,"spinlock_wait_cycles":7191424,"thread_start_us":546883,"threads_started":2,"wal-append.queue_time_us":269608}
I20260709 12:23:43.005728 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:42.984338 20912 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:43.017256 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:43.018929 19456 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.685s (SENT)
I20260709 12:23:43.022315 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:42.955251 20968 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:42.987924 20961 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.027839 18771 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:43.038543 20862 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:42.976262 20837 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:43.044301 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45880.3us
W20260709 12:23:43.051642 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.052400 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.044893 18918 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.004163 20873 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:43.097210 18918 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:43.097608 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.102473 20862 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.103894 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.104660 18767 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
W20260709 12:23:43.090220 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.629s (SENT)
I20260709 12:23:43.105340 20837 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:43.105700 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.105826 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:43.106376 20837 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:43.106805 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.107198 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.107512 18764 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:43.108081 20974 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:43.108398 20837 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.108433 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.109118 20837 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:43.109568 20966 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:23:43.110137 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.111755 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.112896 20837 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.113238 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.113694 20837 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:43.114228 18767 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:43.117697 20837 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:43.120918 20837 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.122583 20837 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:43.127512 20986 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:23:43.129416 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 1939) took 1429 ms. Trace:
I20260709 12:23:43.129966 18842 rpcz_store.cc:276] 0709 12:23:41.699751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.717160 (+ 17409us) service_pool.cc:224] Handling call
0709 12:23:41.734811 (+ 17651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.755785 (+ 20974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.755842 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.779130 (+ 23288us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.878551 (+1099421us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b18002447e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:23:42.941018 (+ 62467us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:42.941057 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.941130 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.128834 (+187704us) raft_consensus.cc:1685] finished
0709 12:23:43.128868 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.129191 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":441,"raft.queue_time_us":11124,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":115906,"spinlock_wait_cycles":4449024,"thread_start_us":62270,"threads_started":1,"wal-append.queue_time_us":1183219}
I20260709 12:23:43.137034 20968 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.137336 19486 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:43.091660 20469 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:43.143548 20947 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.001s
I20260709 12:23:43.144022 20947 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.145493 18839 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:43.146813 20909 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.148655 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:43.151064 20688 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.153510 20688 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.162292 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.163358 18767 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:43.164429 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.021682 20972 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:43.108554 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.170899 18917 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:43.165205 18767 raft_consensus.cc:2376] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3. Re-sending same reply.
I20260709 12:23:43.169646 18766 raft_consensus.cc:2368] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 4. Current term is 5.
I20260709 12:23:43.171854 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:42.995042 20970 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.174759 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.179557 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.180488 18764 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:43.161464 20913 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.174680 20972 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:43.185014 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 294369us
I20260709 12:23:43.186043 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.217125 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.217155 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.220917 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.229763 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.230728 18766 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:43.235074 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.237390 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 357828us
I20260709 12:23:43.245333 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:43.199232 20972 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:43.255029 19486 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:43.175350 20823 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.259281 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:43.259608 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:43.223637 20947 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.261811 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:43.338246 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:43.339001 20983 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:23:43.339157 18915 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:43.261317 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 208980us
I20260709 12:23:43.293723 18918 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:43.338340 19491 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:43.295087 18916 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:23:43.293761 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:43.262754 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 279985us
I20260709 12:23:43.294694 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:43.348825 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:43.238179 20897 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.349210 19485 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:43.268836 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:43.262461 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.349385 18766 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:43.352309 18767 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
W20260709 12:23:43.323380 19456 leader_election.cc:336] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.654s (SENT)
I20260709 12:23:43.355809 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.356457 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.354771 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.358469 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.359352 20970 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.360239 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.360435 20899 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.361537 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.362917 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.364112 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.365336 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.365795 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.366102 18767 raft_consensus.cc:2368] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 4. Current term is 5.
I20260709 12:23:43.348397 20968 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.368499 20961 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.368588 20968 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.369657 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.250991 20877 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.370599 20889 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.371008 20899 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.371086 20889 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:43.371748 20889 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.372473 20899 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:43.372677 20967 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 12:23:43.262799 20789 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.373116 20967 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.374230 18770 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 5. Ops: []
W20260709 12:23:43.375391 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.377635 18812 leader_election.cc:400] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:43.377998 18812 leader_election.cc:403] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:43.378865 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.379164 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:43.380005 19487 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:43.380246 20970 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.380699 20996 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.382596 20961 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.366654 20992 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:43.384284 20993 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:43.386142 20967 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.386938 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.387199 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:43.387848 19487 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:43.388249 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.389281 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.389093 20947 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:43.390733 20998 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:43.390491 20837 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.390985 20823 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:43.391186 20998 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:43.391419 20987 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:43.391798 18914 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:43.354242 20897 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:43.391973 20987 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:43.368646 18773 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:23:43.393292 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 123861us
I20260709 12:23:43.237869 20688 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.258770 20969 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:43.367051 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.241926 20873 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 12:23:43.403935 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 467) took 1792 ms. Trace:
W20260709 12:23:43.415078 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48111.7us
I20260709 12:23:43.416499 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.415239 19484 rpcz_store.cc:276] 0709 12:23:41.610632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.616366 (+  5734us) service_pool.cc:224] Handling call
0709 12:23:41.655083 (+ 38717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.698218 (+ 43135us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:41.698684 (+   466us) log.cc:844] Serialized 14 byte log entry
0709 12:23:41.881970 (+183286us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:42.403426 (+521456us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b18002b2e20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:23:43.339604 (+936178us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b2c00075be8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:23:43.340114 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:23:43.340312 (+   198us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:43.340353 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:43.340431 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.348242 (+  7811us) raft_consensus.cc:1685] finished
0709 12:23:43.348259 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.402850 (+ 54591us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14070,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":31704,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":9149,"spinlock_wait_cycles":36171776,"thread_start_us":123475,"threads_started":1,"wal-append.queue_time_us":990729}
I20260709 12:23:43.394819 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.394989 20469 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:43.390188 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.395756 20997 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.396080 18915 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:43.395850 20987 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.394877 18771 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:43.392479 20993 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:43.402324 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.402859 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.392496 20897 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.391675 20998 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.408636 18845 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:43.407408 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.406888 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:43.407778 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.259387 20989 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:43.413434 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 90100.8us
I20260709 12:23:43.414106 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:43.392640 20999 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:23:43.366632 20876 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:43.422823 18766 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:43.429072 18918 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:43.404191 20823 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.431946 18842 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:43.433350 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:43.433318 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:23:43.442903 19456 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.925s (SENT)
I20260709 12:23:43.447304 20989 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.448488 18844 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:43.450467 19487 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:43.427567 20891 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:43.458758 20968 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:43.429883 20993 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:43.412770 20862 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:43.510332 20887 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.003s
I20260709 12:23:43.475219 19456 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:43.413203 20688 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:43.422415 20909 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:43.421711 20997 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:43.480422 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:43.481173 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 86446.6us
I20260709 12:23:43.488090 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.488090 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:43.476539 20690 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.736s	user 0.013s	sys 0.000s
I20260709 12:23:43.492587 18845 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:23:43.432526 20963 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:43.493989 20992 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:43.495110 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:43.495827 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.577050 18844 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:43.488792 20823 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:43.499238 20956 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.000s
I20260709 12:23:43.499871 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.502635 20877 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:43.521986 20887 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:43.506233 20979 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.467s	user 0.002s	sys 0.000s
I20260709 12:23:43.419672 20969 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.480379 20789 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:43.506924 18921 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 1.
I20260709 12:23:43.510291 20993 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.511061 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:43.512434 20989 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:43.513936 20996 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:43.570466 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.567727 18846 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:43.572803 18848 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:23:43.584271 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:43.572834 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:43.577389 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:43.578449 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 188317us
I20260709 12:23:43.582254 20883 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.575220 18841 raft_consensus.cc:2376] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3. Re-sending same reply.
I20260709 12:23:43.583612 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.583995 18918 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:43.584872 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.586913 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:43.504439 20982 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.464s	user 0.002s	sys 0.000s
I20260709 12:23:43.589735 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.584527 18843 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:43.627511 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.627180 18887 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.566540 20968 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:43.567588 20862 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:43.563500 20891 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:43.592787 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:43.586701 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 86964.4us
I20260709 12:23:43.572309 20997 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.572559 20967 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:43.598922 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 156077us
W20260709 12:23:43.548164 20882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.047s	sys 0.027s
I20260709 12:23:43.594861 20690 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:43.608263 18769 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:43.608623 18922 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.598340 20789 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.593870 20947 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.576982 20972 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.624424 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.633145 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.602564 20469 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.645471 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.645753 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.646962 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.669951 18767 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:43.647658 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:43.646965 19456 leader_election.cc:336] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.986s (SENT)
I20260709 12:23:43.648000 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:43.649181 18886 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.659s (SENT)
I20260709 12:23:43.649511 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:43.672125 18773 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:43.590042 20956 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.650971 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:43.651432 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:43.677310 18846 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:43.677419 18769 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.657981 20876 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:43.659703 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:43.669950 18841 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:43.646778 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:43.633591 20989 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:43.636726 20968 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.640278 20862 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:43.650239 20882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.048s	sys 0.027s
I20260709 12:23:43.658878 20789 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:43.676177 21007 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:43.700961 21007 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.701378 21007 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.684185 20968 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.710528 21007 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.713366 21004 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:43.676414 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.714073 21004 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.645506 20837 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:43.681711 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:43.668861 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.653564 20690 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:43.717545 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68394.7us
I20260709 12:23:43.717705 20690 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:43.718220 18886 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.674s (SENT)
I20260709 12:23:43.684494 20876 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.717926 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:43.699088 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52151.7us
W20260709 12:23:43.722932 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 1949) took 1278 ms (client timeout 1674 ms). Trace:
I20260709 12:23:43.699601 20882 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:43.723541 18839 rpcz_store.cc:269] 0709 12:23:42.444305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.454536 (+ 10231us) service_pool.cc:224] Handling call
0709 12:23:43.722632 (+1268096us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400380c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:43.722844 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585779456}
I20260709 12:23:43.699893 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:43.725208 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.725801 20956 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.682902 20469 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.691191 20862 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:43.681255 20947 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.734687 19487 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 2: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:43.738749 21009 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:43.739411 20899 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:43.738878 21003 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.662009 20967 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.741017 20891 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:43.742733 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2005) took 1242 ms. Trace:
I20260709 12:23:43.742874 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 1993) took 2078 ms. Trace:
I20260709 12:23:43.744429 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1760) took 1347 ms. Trace:
W20260709 12:23:43.784148 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 208081us
I20260709 12:23:43.744612 20864 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:43.746824 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1722) took 1149 ms. Trace:
I20260709 12:23:43.661468 20688 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.680519 20989 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.750241 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.819250 18841 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:43.750907 20820 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:43.667006 20889 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.728808 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:43.769387 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110049us
I20260709 12:23:43.820943 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:43.776254 18846 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:43.778791 18768 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:43.820987 18844 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:43.783644 18765 rpcz_store.cc:276] 0709 12:23:42.500992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.501204 (+   212us) service_pool.cc:224] Handling call
0709 12:23:43.742500 (+1241296us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54001d5454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:43.742657 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865331072}
I20260709 12:23:43.791005 18842 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
W20260709 12:23:43.811197 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74798.3us
I20260709 12:23:43.828197 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.811458 18769 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:43.734217 20975 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:43.718066 21010 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:43.750917 21005 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:43.790737 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:43.784587 18913 rpcz_store.cc:276] 0709 12:23:42.396698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.407565 (+ 10867us) service_pool.cc:224] Handling call
0709 12:23:42.407940 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.801217 (+393277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.801255 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:42.801849 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.939053 (+137204us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:42.939100 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.939277 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.503536 (+564259us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:43.744099 (+240563us) raft_consensus.cc:1685] finished
0709 12:23:43.744123 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.744362 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52123,"raft.queue_time_us":63571,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":26013,"spinlock_wait_cycles":9753344,"thread_start_us":483537,"threads_started":2,"wal-append.queue_time_us":237681}
I20260709 12:23:43.811872 20899 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:43.825798 20912 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.807s	user 0.015s	sys 0.004s
I20260709 12:23:43.819912 20864 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:43.784516 18772 rpcz_store.cc:276] 0709 12:23:41.664215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.665406 (+  1191us) service_pool.cc:224] Handling call
0709 12:23:41.665850 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.699310 (+ 33460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.699343 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.699933 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:23:43.529048 (+1829115us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b18000acd20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:23:43.583587 (+ 54539us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:43.583646 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:43.583743 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.742285 (+158542us) raft_consensus.cc:1685] finished
0709 12:23:43.742316 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.742666 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10829,"raft.queue_time_us":22146,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":19600128,"thread_start_us":19570,"threads_started":1,"wal-append.queue_time_us":1966619}
I20260709 12:23:43.818979 18847 rpcz_store.cc:276] 0709 12:23:42.597164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.597647 (+   483us) service_pool.cc:224] Handling call
0709 12:23:42.609594 (+ 11947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.614671 (+  5077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.614704 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:42.623889 (+  9185us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.975480 (+351591us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:43.183836 (+208356us) log.cc:844] Serialized 14 byte log entry
0709 12:23:43.216928 (+ 33092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:43.217005 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.505370 (+288365us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:43.746433 (+241063us) raft_consensus.cc:1685] finished
0709 12:23:43.746559 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.746742 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":361247,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":34882,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":14040,"spinlock_wait_cycles":6828416,"thread_start_us":484917,"threads_started":2,"wal-append.queue_time_us":376391}
I20260709 12:23:43.820549 20989 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:43.848809 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 58195.2us
I20260709 12:23:43.849397 18844 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:43.862196 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 195992us
I20260709 12:23:43.863818 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:43.831562 20975 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:43.824311 21007 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:43.870965 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 193741us
I20260709 12:23:43.856999 18846 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:23:43.857853 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 250550us
I20260709 12:23:43.867301 18922 raft_consensus.cc:2410] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:23:43.847833 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 223525us
I20260709 12:23:43.842967 21010 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:43.842633 20820 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:43.875025 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:43.875530 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 228864us
I20260709 12:23:43.857287 20823 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.861527 20887 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.810811 21003 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.864080 20876 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.861955 20877 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:43.879221 21010 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:43.888450 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:43.860809 20912 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.849323 20998 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.877285 20883 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:43.878043 20956 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:43.881198 20627 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:43.895475 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:43.912439 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.912690 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 51716us
I20260709 12:23:43.919463 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:43.929209 18847 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:43.920849 18846 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:43.901103 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:43.918797 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:43.932754 18844 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:43.883919 20969 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:43.926635 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:43.891907 20917 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:43.956910 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82364.9us
I20260709 12:23:43.900370 20877 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:43.955152 18914 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:43.922976 20823 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:43.964464 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:43.930729 20627 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:43.969658 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 141585us
I20260709 12:23:43.972203 18915 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:43.886898 20973 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:23:43.963626 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:43.963047 18839 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:43.974632 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:43.977114 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:43.976219 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80862.1us
I20260709 12:23:43.978943 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.977850 18844 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:43.883888 21013 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:23:43.984915 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.934361 20956 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:43.962776 21017 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:43.994131 19456 leader_election.cc:336] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.173s (SENT)
I20260709 12:23:43.997532 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:43.899528 20864 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.975594 20627 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:43.976233 20957 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:43.975664 20820 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.980562 20749 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:23:44.037238 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:44.038738 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.040107 18847 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:44.041857 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:43.923794 21012 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.230s
I20260709 12:23:44.055187 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:44.057049 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 181393us
I20260709 12:23:44.030522 20912 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:44.064916 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 176557us
I20260709 12:23:43.990275 20873 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:43.997623 20967 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:43.996395 21005 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:44.064832 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 96223.3us
I20260709 12:23:43.939324 20899 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.066258 21013 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:44.034955 20887 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:43.972550 20917 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:43.999800 20823 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:44.072897 18917 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:43.999564 20947 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:44.079030 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 100411us
I20260709 12:23:44.079615 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:44.051100 20889 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:44.065675 20864 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.066991 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:44.036911 20973 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:23:43.980530 20975 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.097419 21025 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:44.098953 20956 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.075253 20968 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.102274 20968 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:44.035182 21017 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.102994 20998 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:44.104043 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:44.104686 18919 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:23:44.111225 20690 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.113768 20469 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.117933 20972 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:44.091923 20823 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:44.084040 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 94726.6us
I20260709 12:23:44.104724 21017 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.118955 20965 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:44.089663 20912 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:44.082772 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.093572 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:44.061086 21024 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:44.138149 21024 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.139283 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.140008 21003 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:44.131106 20823 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.140811 21024 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.139474 20917 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:44.140168 18915 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:44.133534 18846 raft_consensus.cc:2410] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:23:44.083442 21013 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:44.144381 18843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1726) took 1533 ms (client timeout 1669 ms). Trace:
I20260709 12:23:44.135275 18919 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:23:44.148353 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.133076 20912 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:44.150938 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 90279.2us
W20260709 12:23:44.144119 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50648.7us
I20260709 12:23:44.137128 18914 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:44.149655 18919 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:44.155210 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:44.149580 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 94531.5us
I20260709 12:23:44.151113 20912 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:44.147442 18843 rpcz_store.cc:269] 0709 12:23:42.612225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.661984 (+ 49759us) service_pool.cc:224] Handling call
0709 12:23:44.144185 (+1482201us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54003be554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:44.144321 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072471296}
I20260709 12:23:44.134776 20974 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:44.131945 20965 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:44.148747 20993 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.002s
W20260709 12:23:44.171525 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 88845.3us
I20260709 12:23:44.167531 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:44.167441 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.173137 18914 raft_consensus.cc:2410] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:23:44.151896 21028 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:44.152467 21025 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:44.153734 20887 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:44.095244 21011 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:23:44.063138 20877 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.207752 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.208424 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.156765 20969 raft_consensus.cc:2764] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:23:44.154621 20469 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:44.209746 20469 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.211349 21025 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.165982 20917 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:44.157526 21024 raft_consensus.cc:2764] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:23:44.176456 21028 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:44.185041 20967 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:44.213881 21028 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.215881 21028 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.191542 20749 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:44.217715 20749 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:44.191062 20690 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.196523 20862 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.174885 21003 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:44.195200 20789 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.198714 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:44.198552 21038 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:44.200095 21004 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:44.206204 20897 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.003s
I20260709 12:23:44.206955 20965 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.179495 21013 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.208530 18913 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:44.197702 20987 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.220052 18914 raft_consensus.cc:2368] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7.
I20260709 12:23:44.222190 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.229882 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.231603 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.175527 21026 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:44.241184 21026 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.242345 20989 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.238029 21038 consensus_queue.cc:1243] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:23:44.243670 21010 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.244701 18918 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 5. Ops: []
I20260709 12:23:44.245414 20989 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:44.245693 21013 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.243876 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:44.249446 21016 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.439s	user 0.002s	sys 0.000s
I20260709 12:23:44.237607 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.240041 20992 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:44.237298 18920 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:44.234875 20887 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:44.241647 20862 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:44.236377 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:44.251171 18917 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:44.252223 18845 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:44.252345 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:44.218807 20749 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.262288 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.177748 20993 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.223052 20917 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:44.236590 20967 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:44.272639 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:44.273635 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 309243us
I20260709 12:23:44.274461 20469 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:44.275142 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.275313 21038 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:44.277177 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.280226 19484 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:44.274585 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:44.281610 19492 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:44.282125 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:44.282605 20876 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:44.283051 20876 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.283396 20876 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.284726 20992 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:44.286474 21038 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.287595 21038 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.298974 21048 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:44.299436 21048 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:44.300571 21048 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.301811 21048 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.255734 21004 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:44.318902 18916 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:44.319939 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59047.3us
I20260709 12:23:44.320922 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.316730 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:44.323282 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.325320 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.326047 18917 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:44.236863 20897 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.235888 20627 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.334501 18913 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:44.243708 21033 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
W20260709 12:23:44.319552 20997 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.005s
I20260709 12:23:44.313112 20913 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:44.348315 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:44.350340 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.319223 21003 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:44.319365 21004 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:44.360088 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.336625 20899 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:44.333796 20970 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:44.368235 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84147.3us
I20260709 12:23:44.337174 20469 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:44.349896 20992 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:44.375903 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.378757 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.379519 18917 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:44.382030 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.386687 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.312507 20876 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.386230 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.391836 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.395969 18769 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:44.371915 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.367986 21004 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:44.392730 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.360610 21010 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.363438 21020 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:44.415764 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.394006 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.395037 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.417025 18847 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:44.397320 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.392501 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.391566 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.417999 18770 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:44.363724 20889 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:44.398701 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.362851 21021 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:44.400501 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.340653 21048 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:44.362424 20997 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.380251 20469 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.413184 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.418963 18769 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:44.376809 20992 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.421965 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.464300 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.418946 21033 raft_consensus.cc:2764] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:23:44.426370 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:44.339898 20967 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:23:44.423491 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:44.435690 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:44.436616 21036 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:23:44.408931 21026 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.387085 20970 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.447837 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1565) took 1183 ms. Trace:
I20260709 12:23:44.498932 18921 rpcz_store.cc:276] 0709 12:23:43.253890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.254005 (+   115us) service_pool.cc:224] Handling call
0709 12:23:44.436957 (+1182952us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540008e654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:44.437087 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567219584}
I20260709 12:23:44.447041 21027 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:44.436400 20469 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:44.437435 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.426131 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.508050 18770 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:44.470144 18917 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:44.391546 21024 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:23:44.424525 20889 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.480921 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.481345 18847 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:44.481213 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.510095 18764 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
W20260709 12:23:44.484951 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61579.3us
I20260709 12:23:44.509449 18771 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:44.506512 18769 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:23:44.415951 21020 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:44.494154 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.514719 18765 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:23:44.512645 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.513804 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.515482 18921 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:44.514976 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.416365 20917 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.519932 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:44.418192 20887 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.520581 18921 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:23:44.518989 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 210817us
W20260709 12:23:44.533257 18886 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.720s (SENT)
W20260709 12:23:44.533705 19456 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.454s (SENT)
I20260709 12:23:44.521150 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.534693 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.508374 21027 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:44.520198 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:44.528961 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.507498 20864 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:44.534981 18771 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:44.523223 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.548928 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.522112 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:44.534183 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.512584 20889 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.512197 20789 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:44.560598 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 316) took 1087 ms. Trace:
I20260709 12:23:44.561064 18842 rpcz_store.cc:276] 0709 12:23:43.472796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.485708 (+ 12912us) service_pool.cc:224] Handling call
0709 12:23:44.560369 (+1074661us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b5400381154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:44.560524 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144594304}
I20260709 12:23:44.551705 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:44.554382 21043 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:23:44.547901 21027 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:44.555390 21039 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.518244 21020 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.556789 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:44.519491 21026 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:44.563591 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.563686 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.579999 21017 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:44.582204 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.562922 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.564347 20627 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:44.566366 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.595436 18766 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:44.532488 21024 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:44.577047 18922 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:44.597769 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.593088 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.598846 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.602993 18770 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:23:44.603123 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69454.5us
I20260709 12:23:44.602162 18767 raft_consensus.cc:2368] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
I20260709 12:23:44.561417 18917 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:23:44.575383 21018 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:44.614871 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.615731 18771 raft_consensus.cc:2376] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2. Re-sending same reply.
I20260709 12:23:44.618801 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.619624 18770 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:44.620503 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.622493 18769 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:44.578227 21026 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:44.626735 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.633791 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.634307 18767 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:44.572904 21039 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:44.636823 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.646371 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:44.657763 18917 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:44.673971 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.681756 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.682750 18771 raft_consensus.cc:2376] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
I20260709 12:23:44.631695 21024 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:44.701561 18921 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:44.711169 18917 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:44.710199 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:44.713675 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.717053 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.717653 18915 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:44.730347 18771 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:44.725848 20864 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:44.734467 18916 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:44.747830 18916 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:44.704900 20997 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:44.752051 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.753541 18922 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:44.757910 18916 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:44.764210 18887 connection.cc:256] RPC call timeout handler was delayed by -1.7260250529998302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 12:23:44.765601 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.655927 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:44.772639 18767 raft_consensus.cc:606] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:44.777727 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.746322 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:44.782989 18922 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:44.783989 20864 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.789337 20967 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:44.802218 19456 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.674s (SENT)
I20260709 12:23:44.819208 18765 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:44.820436 18768 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:44.820530 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.821405 18765 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:23:44.704242 21024 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.759711 20882 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:44.854880 20882 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.856216 21024 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:44.857583 20882 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:44.860044 21013 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.005s
I20260709 12:23:44.861153 18773 raft_consensus.cc:2410] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:23:44.862464 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.826963 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.828372 20993 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:44.830335 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:44.831537 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:44.833936 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.834270 20974 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:44.839776 21039 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.828382 20967 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:44.718755 21026 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.776870 20970 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:44.894886 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:23:44.850951 20912 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.014s
I20260709 12:23:44.817638 19484 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:44.877271 20469 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.890810 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:44.854274 21028 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.009s
I20260709 12:23:44.901280 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:23:44.838290 20987 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.584s	user 0.000s	sys 0.007s
I20260709 12:23:44.895994 19491 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:23:44.896735 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 197582us
I20260709 12:23:44.902928 20469 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.918725 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:44.892997 20823 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.752s	user 0.006s	sys 0.006s
I20260709 12:23:44.929039 18765 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:23:44.901055 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:44.932524 19483 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:44.932695 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:44.888681 20967 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:44.935827 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.937294 18842 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:44.935456 19486 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:44.941447 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.934784 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:44.949750 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:44.954820 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.955945 18842 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:44.956430 19486 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:44.896049 21027 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.900154 20889 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.900812 20912 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.898579 21004 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.966264 19485 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:44.967224 21004 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.968071 21004 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:44.968968 21004 consensus_queue.cc:1243] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:44.969084 20820 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:44.971040 20967 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:44.972389 20967 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:44.976105 20912 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:44.933172 20823 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:44.980192 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.980593 18848 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:44.990923 19490 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:44.991077 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:44.991976 19486 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:44.993362 18844 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:44.995028 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:44.995879 18844 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:44.998744 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:44.999923 18765 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:44.989749 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:44.960896 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:45.013105 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:45.008369 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.014751 18842 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:45.010258 19491 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:44.981678 21021 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.019083 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:45.027938 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:45.028342 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:45.029093 18844 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 1.
I20260709 12:23:45.030119 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.031208 18844 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:45.038508 18841 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:45.039289 18765 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:45.043969 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:45.041003 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:45.152341 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1740) took 1652 ms. Trace:
I20260709 12:23:45.122970 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 1953) took 1470 ms. Trace:
I20260709 12:23:45.073992 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.157635 18670 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 266) took 8895 ms. Trace:
I20260709 12:23:45.159045 20876 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:45.070225 20947 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:45.149528 18848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 317) took 1676 ms (client timeout 2038 ms). Trace:
I20260709 12:23:45.022876 20862 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:45.165114 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:45.167115 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.203106 18847 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:45.019558 20882 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:45.023229 19483 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:45.126108 18844 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:45.040814 20992 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 12:23:45.159252 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:45.152026 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.199985 18839 rpcz_store.cc:276] 0709 12:23:43.652919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.783181 (+130262us) service_pool.cc:224] Handling call
0709 12:23:45.122687 (+1339506us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54003be054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:45.122889 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270686464}
I20260709 12:23:45.166489 20877 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:45.238001 18768 raft_consensus.cc:2376] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4. Re-sending same reply.
I20260709 12:23:45.081393 20909 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.160s
I20260709 12:23:45.048982 19486 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:23:45.206029 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.073879 18739 leader_election.cc:400] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7.
I20260709 12:23:45.435503 18739 leader_election.cc:403] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:45.436381 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 362638us
I20260709 12:23:45.144157 18842 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:45.153381 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:45.438699 20967 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7.
W20260709 12:23:45.438997 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 285706us
I20260709 12:23:45.439399 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.439728 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:45.440505 18842 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:45.147969 18913 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:45.219745 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 324577us
I20260709 12:23:45.441620 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.222007 18772 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:45.199704 18841 rpcz_store.cc:276] 0709 12:23:43.499479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.856943 (+357464us) service_pool.cc:224] Handling call
0709 12:23:43.872205 (+ 15262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.048087 (+1175882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.151250 (+103163us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54003ce4a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8ea02 00007f335af8add6 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:23:45.152115 (+   865us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001090d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:45.152285 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737281664}
I20260709 12:23:45.442719 20987 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:45.443131 20987 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:45.443361 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.443715 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1400) took 1069 ms. Trace:
I20260709 12:23:45.443969 18841 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.444118 18772 rpcz_store.cc:276] 0709 12:23:44.374468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.374661 (+   193us) service_pool.cc:224] Handling call
0709 12:23:45.443540 (+1068879us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b540002d354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:45.443646 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211706240}
I20260709 12:23:45.444921 20961 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:45.445351 20961 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:45.445463 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.445775 20961 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:45.202098 18848 rpcz_store.cc:269] 0709 12:23:43.473176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.632452 (+159276us) service_pool.cc:224] Handling call
0709 12:23:45.149364 (+1516912us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400205154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:45.149469 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870270720}
I20260709 12:23:45.446441 19483 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 4 LEARNER]: Advancing to term 5
I20260709 12:23:45.447059 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:45.447839 18848 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:45.448733 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.449756 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:45.449888 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.450449 18846 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:45.145633 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:45.453419 18915 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:45.454012 21026 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:45.454479 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.454646 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:45.455089 18915 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.451350 20862 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:23:45.455466 20961 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:45.457526 21068 raft_consensus.cc:2764] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:45.070703 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:45.458573 20862 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:45.458995 20862 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:45.459033 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 388419us
I20260709 12:23:45.459329 20961 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:45.446280 18772 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:45.461230 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:45.230316 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.462466 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.462536 18922 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:45.463656 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:45.464098 20820 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:45.465008 20820 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:45.465379 20820 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:45.230527 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:45.466478 18842 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:45.230890 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.468274 18847 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:45.469429 18847 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:45.230417 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.148624 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:45.471832 21064 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.409s	user 0.000s	sys 0.002s
W20260709 12:23:45.156047 21020 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.003s
I20260709 12:23:45.472748 21020 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:45.451434 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.102836 19490 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:45.240129 21046 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:45.241029 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.242504 18916 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:45.048131 20970 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:45.200649 18670 rpcz_store.cc:276] 0709 12:23:36.262289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.262536 (+   247us) service_pool.cc:224] Handling call
0709 12:23:36.658613 (+396077us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef5090 00007f335af93f3a 00007f3360d49e9c 00007f3360e4804e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc 00007f335f308392 00007f33592c648c 00007f33592c58c6
0709 12:23:45.157529 (+8498916us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:43.041802 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:43.067079 (+ 25277us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:43.067135 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:23:43.067154 (+    19us) tablet.cc:662] Decoding operations
0709 12:23:43.067840 (+   686us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:43.067918 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:43.067947 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:43.068447 (+   500us) tablet.cc:701] Row locks acquired
0709 12:23:43.068498 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:23:43.068667 (+   169us) write_op.cc:270] Start()
0709 12:23:43.068835 (+   168us) write_op.cc:276] Timestamp: P: 1783599823068603 usec, L: 0
0709 12:23:43.068850 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:23:43.069632 (+   782us) log.cc:844] Serialized 1672 byte log entry
0709 12:23:43.676302 (+606670us) op_driver.cc:464] REPLICATION: finished
0709 12:23:43.922501 (+246199us) write_op.cc:301] APPLY: starting
0709 12:23:43.930301 (+  7800us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:43.970327 (+ 40026us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:43.986717 (+ 16390us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:44.116897 (+130180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:44.117087 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:23:44.117132 (+    45us) write_op.cc:312] APPLY: finished
0709 12:23:44.117393 (+   261us) log.cc:844] Serialized 41 byte log entry
0709 12:23:44.117588 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.117695 (+   107us) write_op.cc:454] Released schema lock
0709 12:23:44.117744 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:44.118157 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.118186 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4982,"reported_tablets":12,"spinlock_wait_cycles":143742848,"child_traces":[["op",{"apply.queue_time_us":210329,"apply.run_cpu_time_us":3482,"apply.run_wall_time_us":219602,"num_ops":4,"prepare.queue_time_us":375265,"prepare.run_cpu_time_us":21812,"prepare.run_wall_time_us":214075,"raft.queue_time_us":197142,"raft.run_cpu_time_us":8748,"raft.run_wall_time_us":190454,"replication_time_us":607220,"thread_start_us":738175,"threads_started":4,"wal-append.queue_time_us":270901,"wal-append.run_cpu_time_us":20962,"wal-append.run_wall_time_us":1779160}]]}
I20260709 12:23:45.023414 21021 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.243512 19485 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:45.243395 20823 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:45.244158 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:45.246836 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:45.247321 21058 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.417s	user 0.002s	sys 0.002s
W20260709 12:23:45.249182 21077 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
I20260709 12:23:45.081534 21033 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 12:23:45.151157 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.064937 21027 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:45.066171 20889 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:45.151702 20965 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.144550 20969 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:45.158861 19484 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:45.486271 20970 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:45.062960 20897 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:45.152304 20975 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.119611 20974 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:45.255025 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:23:45.523319 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 270221us
I20260709 12:23:45.524303 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:45.256006 18914 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:23:45.255815 21048 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:45.251776 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:45.527189 21048 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:45.527549 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 275834us
I20260709 12:23:45.528241 20897 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:45.528174 21048 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:45.529505 21048 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:45.514917 20820 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.530442 20974 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:45.383028 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 188610us
I20260709 12:23:45.081846 20973 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.174s
I20260709 12:23:45.238996 20877 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:45.390092 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:45.534696 20973 consensus_queue.cc:1243] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:23:45.535569 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.536216 18773 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:45.392346 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:45.393967 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.394675 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 305) took 1992 ms. Trace:
W20260709 12:23:45.389592 21070 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 12:23:45.384971 20749 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:45.384640 20690 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:45.409097 20956 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:45.530592 20889 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:45.423393 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:45.551712 18843 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:45.553835 20913 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:45.426980 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:45.562713 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:45.428453 21071 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.317s	user 0.001s	sys 0.001s
I20260709 12:23:45.442058 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.443534 20987 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:45.467428 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:45.163831 21009 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.013s	sys 0.000s
I20260709 12:23:45.476070 19458 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:45.476722 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.477545 18847 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:45.460204 20862 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.478224 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:45.569339 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 91216.5us
I20260709 12:23:45.478592 18846 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.481006 18922 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:45.488473 18915 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:23:45.473814 21074 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.376s	user 0.002s	sys 0.000s
W20260709 12:23:45.494561 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.496591 18768 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:45.500962 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.488247 20909 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:45.579540 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:45.512212 18839 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:45.580471 18842 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:45.498960 21067 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.423s	user 0.000s	sys 0.003s
I20260709 12:23:45.559268 20889 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.583868 18773 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:45.069139 21013 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.204s
I20260709 12:23:45.518517 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:45.590092 18765 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:45.528739 20897 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.591244 20897 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:45.591552 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.592346 18771 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:45.593205 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.201968 20947 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:45.594558 20883 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:45.595031 19483 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 5 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:45.596170 20947 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:45.532486 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:45.597293 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64886.9us
I20260709 12:23:45.598187 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:45.512701 21068 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.602118 20864 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:45.602697 20864 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:45.603615 20864 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.582687 21026 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:45.605813 21026 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:45.531620 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1729) took 2867 ms. Trace:
I20260709 12:23:45.607532 21004 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:45.606536 18840 rpcz_store.cc:276] 0709 12:23:42.666676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.524847 (+858171us) service_pool.cc:224] Handling call
0709 12:23:43.560596 (+ 35749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:43.560989 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:43.561025 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.339013 (+777988us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b1800081220. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a
0709 12:23:45.165364 (+826351us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b2c0005b308. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:23:45.166069 (+   705us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.408533 (+242464us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:45.408582 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.408740 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.531396 (+122656us) raft_consensus.cc:1685] finished
0709 12:23:45.531416 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.531561 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489,"raft.queue_time_us":378,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5043,"spinlock_wait_cycles":39770240,"thread_start_us":241680,"threads_started":1,"wal-append.queue_time_us":338150}
I20260709 12:23:45.538341 18920 rpcz_store.cc:276] 0709 12:23:43.402511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.579715 (+177204us) service_pool.cc:224] Handling call
0709 12:23:44.228297 (+648582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.254955 (+ 26658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.394184 (+1139229us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400325ad0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:45.394548 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456952704}
I20260709 12:23:45.530540 21027 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:45.541570 18916 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:45.530951 20820 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:45.609599 21027 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:45.610109 21027 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:45.521742 20970 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.604125 18843 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:45.579712 21089 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:45.545181 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:45.520885 20969 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:45.548892 21020 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:45.424377 18845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1735) took 1927 ms (client timeout 1502 ms). Trace:
I20260709 12:23:45.557636 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1777) took 1001 ms. Trace:
W20260709 12:23:45.617991 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48044.4us
W20260709 12:23:45.556890 21069 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.442s	user 0.000s	sys 0.002s
W20260709 12:23:45.558027 21057 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.729s	user 0.000s	sys 0.003s
W20260709 12:23:45.555811 21081 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 12:23:45.555334 20690 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.543890 20963 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:45.558770 20899 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:45.561333 21066 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.498s	user 0.004s	sys 0.000s
W20260709 12:23:45.567551 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 320845us
I20260709 12:23:45.568325 18921 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:45.571398 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 95418.4us
I20260709 12:23:45.657090 20690 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:45.657375 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:45.658083 20899 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.658960 18846 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:45.659118 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:45.659787 20969 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:45.660354 18846 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:45.580801 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:45.661450 21072 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.565s	user 0.001s	sys 0.002s
I20260709 12:23:45.661586 18768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:45.581933 20862 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:45.567965 21009 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.013s	sys 0.003s
I20260709 12:23:45.588986 18847 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:45.616254 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.594269 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:45.618185 18917 rpcz_store.cc:276] 0709 12:23:44.555722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.728818 (+173096us) service_pool.cc:224] Handling call
0709 12:23:44.729112 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.729369 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.729408 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.742095 (+ 12687us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.000307 (+258212us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:45.000367 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.000464 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.261597 (+261133us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:45.557282 (+295685us) raft_consensus.cc:1685] finished
0709 12:23:45.557301 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.557549 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138296704,"thread_start_us":224425,"threads_started":1,"wal-append.queue_time_us":358432}
I20260709 12:23:45.619815 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:45.620826 18842 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:23:45.618052 18845 rpcz_store.cc:269] 0709 12:23:43.497374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.601012 (+103638us) service_pool.cc:224] Handling call
0709 12:23:45.424126 (+1823114us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54003d9ad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:45.424293 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344321280}
I20260709 12:23:45.606225 21026 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:45.579268 21046 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.579936 20909 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:45.631146 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 86048.7us
I20260709 12:23:45.587919 20889 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:45.660550 20899 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:45.662981 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2039) took 1237 ms. Trace:
I20260709 12:23:45.627991 20963 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:45.671736 18841 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
W20260709 12:23:45.678763 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59028.2us
I20260709 12:23:45.690948 18841 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:45.691136 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 250169us
I20260709 12:23:45.691342 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:45.692009 18844 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:45.693078 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:45.693346 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:45.694414 20469 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:45.685359 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:45.686156 18766 rpcz_store.cc:276] 0709 12:23:44.425417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.889686 (+464269us) service_pool.cc:224] Handling call
0709 12:23:44.901194 (+ 11508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.901552 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.901582 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.905402 (+  3820us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.060890 (+155488us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b18003b8d20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:23:45.163622 (+102732us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:45.163662 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.163730 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.555148 (+391418us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:45.662766 (+107618us) raft_consensus.cc:1685] finished
0709 12:23:45.662794 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.662924 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":780,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":14184,"spinlock_wait_cycles":153219712,"thread_start_us":102544,"threads_started":1,"wal-append.queue_time_us":231288}
I20260709 12:23:45.663848 18921 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:45.662154 21020 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:45.703768 18839 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:45.705468 18845 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:45.706566 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:45.675980 20823 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:45.674841 21017 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:45.699093 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:45.708914 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2033) took 1291 ms. Trace:
I20260709 12:23:45.709293 18767 rpcz_store.cc:276] 0709 12:23:44.417027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.783835 (+366808us) service_pool.cc:224] Handling call
0709 12:23:44.784226 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.791327 (+  7101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.791362 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.791827 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.008426 (+216599us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:45.008471 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.008542 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.466910 (+458368us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:45.708621 (+241711us) raft_consensus.cc:1685] finished
0709 12:23:45.708644 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.708851 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6656,"raft.queue_time_us":7739,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":215807360,"thread_start_us":216169,"threads_started":1,"wal-append.queue_time_us":279207}
I20260709 12:23:45.713096 18771 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:23:45.713616 18771 pending_rounds.cc:85] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 1
I20260709 12:23:45.714013 18771 pending_rounds.cc:107] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:23:45.712914 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:45.717499 18841 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:45.716507 18771 raft_consensus.cc:2889] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:45.711191 20690 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:45.687188 21024 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:45.621805 20877 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.682968 20969 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:45.711187 20970 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.760653 18847 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:45.766153 18841 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:45.707193 21018 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:45.735684 18764 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:45.769421 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:45.739187 21086 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:45.767772 18916 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:45.734838 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 486) took 1027 ms. Trace:
I20260709 12:23:45.737147 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:45.829391 21089 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:45.760586 20970 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:45.779085 20969 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:45.988682 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.990278 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.990875 18913 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:45.786211 20963 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:45.938151 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 164746us
I20260709 12:23:45.840588 20823 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:45.686252 21046 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:45.726184 20947 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:45.940814 20965 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.941165 20974 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:45.859681 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107847us
I20260709 12:23:45.942598 18921 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:45.943684 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:45.933166 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.770128 18768 raft_consensus.cc:606] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:46.110551 18768 raft_consensus.cc:614] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:45.947163 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 193579us
I20260709 12:23:45.947975 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.112205 18917 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:45.953608 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:45.949999 19492 rpcz_store.cc:276] 0709 12:23:44.707460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.707707 (+   247us) service_pool.cc:224] Handling call
0709 12:23:44.716510 (+  8803us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:44.759191 (+ 42681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.759253 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:44.773583 (+ 14330us) log.cc:844] Serialized 52 byte log entry
0709 12:23:45.018414 (+244831us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:45.018482 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.018593 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.585250 (+566657us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:45.734496 (+149246us) raft_consensus.cc:1685] finished
0709 12:23:45.734518 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.734765 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20614,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":16153,"spinlock_wait_cycles":158804352,"thread_start_us":192795,"threads_started":1,"wal-append.queue_time_us":302649}
I20260709 12:23:45.958865 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:46.020226 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:45.955082 21065 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.889s	user 0.005s	sys 0.007s
I20260709 12:23:46.101874 18922 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:46.112116 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:46.115658 18918 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:46.100796 21024 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:23:46.128014 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1744) took 1083 ms. Trace:
I20260709 12:23:46.128830 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:46.128896 20823 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.129963 19491 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:46.131373 20965 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.131860 20969 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:46.131927 18920 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:46.133512 20969 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:46.133644 20965 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:45.973400 20899 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:45.994143 20897 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.137068 20897 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:46.137771 20897 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:46.142819 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:46.143522 18921 raft_consensus.cc:2376] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5. Re-sending same reply.
I20260709 12:23:46.144858 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:46.145771 18921 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:45.957895 21020 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:46.189044 18920 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:46.153710 18918 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:46.128460 18848 rpcz_store.cc:276] 0709 12:23:45.044194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.556775 (+512581us) service_pool.cc:224] Handling call
0709 12:23:45.557130 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.622468 (+ 65338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.622502 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.622549 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:45.622580 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.127761 (+505181us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b54003282d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:46.127810 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.127944 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136554752}
I20260709 12:23:46.152290 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:46.196004 18915 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:46.146272 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:46.089457 20820 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:46.213932 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 67715.6us
I20260709 12:23:46.226822 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:46.138284 20897 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:46.098734 20970 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:46.158313 20963 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:46.208660 21017 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:23:46.257798 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 129039us
W20260709 12:23:46.258150 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 521027us
I20260709 12:23:46.285888 18918 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.288443 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:46.297300 20974 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:46.302469 20876 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:46.305830 18917 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:46.223660 20969 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:46.249766 20882 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.306550 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:46.314601 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:46.251659 20970 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:46.291070 20889 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 12:23:46.255184 20947 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:46.210177 21091 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 12:23:46.246573 20820 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.146693 21089 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:46.406988 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 291010us
W20260709 12:23:46.401327 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 174620us
I20260709 12:23:46.427103 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:46.320983 21087 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.382s	user 0.000s	sys 0.004s
I20260709 12:23:46.438418 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1758) took 1286 ms. Trace:
W20260709 12:23:46.439056 21093 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:23:46.438949 18842 rpcz_store.cc:276] 0709 12:23:45.152103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.677306 (+525203us) service_pool.cc:224] Handling call
0709 12:23:45.689649 (+ 12343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:45.690123 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.690149 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:45.708500 (+ 18351us) log.cc:844] Serialized 52 byte log entry
0709 12:23:45.957636 (+249136us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:45.957679 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.957758 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.438142 (+480384us) raft_consensus.cc:1685] finished
0709 12:23:46.438163 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.438325 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23068,"raft.queue_time_us":8144,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":10814,"thread_start_us":210833,"threads_started":1,"wal-append.queue_time_us":585169}
I20260709 12:23:46.440521 21107 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:46.444790 21026 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.005s
I20260709 12:23:46.445398 21026 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.447777 21017 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:46.448853 20862 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.772s	user 0.006s	sys 0.003s
I20260709 12:23:46.449198 18768 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:46.316771 20876 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:46.426662 20975 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.898s	user 0.009s	sys 0.008s
W20260709 12:23:46.424862 20987 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.007s
I20260709 12:23:46.365973 21100 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:46.452222 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:46.418052 21094 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 12:23:46.315256 21020 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.455958 18768 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:23:46.430833 21068 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.830s	user 0.014s	sys 0.000s
W20260709 12:23:46.431176 21027 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.816s	user 0.006s	sys 0.011s
W20260709 12:23:46.431084 21048 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.901s	user 0.012s	sys 0.007s
I20260709 12:23:46.317466 20969 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:46.370612 21105 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:46.367851 21104 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:46.428366 20970 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.468480 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:46.490890 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.435357 21091 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:46.475737 21092 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:23:46.471303 20987 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.367640 20882 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.435086 21024 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:46.482411 18919 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:46.485148 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.498999 18915 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:46.489194 18766 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:46.486778 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.471225 18770 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:46.464053 21107 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:46.467779 20862 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:46.470535 21046 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:46.494235 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 67221.1us
I20260709 12:23:46.432396 20889 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.479943 21068 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:46.414947 20897 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.514319 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:46.514281 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:46.491357 20969 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:46.495332 21088 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:23:46.491823 20823 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:46.519323 18843 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:46.492074 21106 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:46.497721 21114 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.492313 21112 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:46.480909 21027 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.510380 20967 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.494714 21104 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:46.511601 20862 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:46.537310 21108 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.537600 20864 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.533838 21114 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.509335 20947 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.516940 21101 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.538460 21096 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.543809 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:46.541332 21106 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:46.521674 20876 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.531666 20823 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.511078 21024 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.543145 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:46.538040 21105 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:46.559325 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:23:46.548316 18913 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.557s	user 0.001s	sys 0.009s
I20260709 12:23:46.562994 18839 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:23:46.609378 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:46.564313 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1485e54f9795416785f4baf244599201 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:46.612332 18913 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:23:46.612619 18656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48402.1us
W20260709 12:23:46.565428 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.535086 21068 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:46.556033 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 358) took 1407 ms. Trace:
I20260709 12:23:46.560086 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 339) took 1308 ms. Trace:
I20260709 12:23:46.618445 18841 rpcz_store.cc:276] 0709 12:23:45.251998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.718424 (+466426us) service_pool.cc:224] Handling call
0709 12:23:45.765973 (+ 47549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.766722 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.559874 (+793152us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b5400205150. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:46.560002 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96674176}
I20260709 12:23:46.619426 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.620074 18913 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
W20260709 12:23:46.613682 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:46.620890 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.613484 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.613368 18846 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:46.637459 18918 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:46.550179 21119 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:46.616312 18772 rpcz_store.cc:276] 0709 12:23:45.149061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.464527 (+315466us) service_pool.cc:224] Handling call
0709 12:23:45.464917 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:45.465349 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.465379 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:45.466034 (+   655us) log.cc:844] Serialized 52 byte log entry
0709 12:23:45.566651 (+100617us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:45.870087 (+303436us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.956526 (+ 86439us) log.cc:844] Serialized 14 byte log entry
0709 12:23:46.555385 (+598859us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b18003c87a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:23:46.555598 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.555673 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.555803 (+   130us) raft_consensus.cc:1685] finished
0709 12:23:46.555820 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.555964 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":600222,"prepare.queue_time_us":384588,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":621557,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":22153,"spinlock_wait_cycles":36779264,"thread_start_us":367175,"threads_started":2,"wal-append.queue_time_us":719193}
I20260709 12:23:46.560448 21033 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.567483 21112 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:46.559631 21091 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.556346 21104 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.556031 21027 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:46.569280 21012 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.552670 21021 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:46.609038 21038 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:46.556327 20967 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.567523 20965 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:46.649333 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 180909us
I20260709 12:23:46.683197 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:46.685254 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:46.559832 21114 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:46.655171 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 95930.7us
W20260709 12:23:46.687896 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.619056 21068 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:46.567348 20876 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:46.679581 18840 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.007s	sys 0.009s
W20260709 12:23:46.692926 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 404599us
I20260709 12:23:46.558037 20864 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.560316 21101 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.557413 20862 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.696864 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1751) took 1546 ms. Trace:
W20260709 12:23:46.691069 20913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.021s	sys 0.015s
W20260709 12:23:46.717555 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76824.4us
I20260709 12:23:46.715744 18840 rpcz_store.cc:276] 0709 12:23:45.150035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.608233 (+458198us) service_pool.cc:224] Handling call
0709 12:23:45.608611 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.620486 (+ 11875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.620518 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:45.625920 (+  5402us) log.cc:844] Serialized 26 byte log entry
0709 12:23:46.083010 (+457090us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:46.692302 (+609292us) log.cc:844] Serialized 14 byte log entry
0709 12:23:46.696348 (+  4046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.696497 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.696564 (+    67us) raft_consensus.cc:1685] finished
0709 12:23:46.696583 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.696774 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45517,"prepare.queue_time_us":87530,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":15477,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":15684,"thread_start_us":925430,"threads_started":2,"wal-append.queue_time_us":583855}
I20260709 12:23:46.560578 21096 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.693535 21105 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.695751 21068 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:46.693874 20973 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.693567 21048 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.557787 21108 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:23:46.717331 20913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.021s	sys 0.016s
I20260709 12:23:46.693742 21103 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:46.701020 20820 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.734781 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:46.746031 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:46.698669 20961 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:46.700076 21021 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:46.733100 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:46.720438 20992 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.693646 20975 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:46.679175 21012 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.552026 21107 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.762871 18842 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:23:46.567334 21106 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:46.763891 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56611.8us
I20260709 12:23:46.698280 20965 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.645252 21119 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.672791 21091 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.770349 21127 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:46.772593 20947 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:46.773000 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:46.772819 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:46.780890 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:46.783171 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:46.688760 21038 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.764292 20992 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.786336 21046 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:46.787175 20889 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:46.787562 20909 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.789685 21101 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.769337 20987 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.796847 21009 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.797137 20963 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.814100 19486 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:46.759292 20862 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:46.748438 21048 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.656936 21033 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.763275 21026 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.829495 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:46.800511 21110 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.751389 21021 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.832204 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.796756 20882 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:46.800803 21113 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.207s
W20260709 12:23:46.834048 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51774.9us
I20260709 12:23:46.884245 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:46.831617 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 85812.5us
I20260709 12:23:46.835819 20909 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:46.838668 21133 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:46.836308 21009 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.843591 21132 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:46.844584 21121 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:23:46.852655 21091 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:46.819370 19483 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:46.767903 21112 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.743991 20973 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.800617 21098 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.221s
I20260709 12:23:46.820525 21123 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:46.799536 20975 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.870779 18918 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:46.926434 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.927227 18918 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:46.872283 19487 raft_consensus.cc:2410] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:23:46.890205 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 73581.1us
I20260709 12:23:46.928328 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.930644 18918 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:46.877175 21021 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:46.933919 20864 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.898205 18922 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:23:46.855149 20963 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.895385 21137 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.937079 21137 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.889140 21100 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:46.939652 20882 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:46.940377 21137 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:46.942822 21009 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.897528 21132 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.894994 21128 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:46.901014 21133 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:46.946738 21128 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.947645 21133 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.949312 21128 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.928745 21131 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:46.889739 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:46.950951 21131 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:46.951253 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61592.9us
I20260709 12:23:46.951429 21131 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:46.952373 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 324) took 1287 ms. Trace:
I20260709 12:23:46.952762 18916 rpcz_store.cc:276] 0709 12:23:45.665152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.665301 (+   149us) service_pool.cc:224] Handling call
0709 12:23:45.665593 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.949666 (+284073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.952114 (+1002448us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540011fdd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:46.952307 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234326272}
I20260709 12:23:46.940294 20882 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.943028 20877 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:46.917037 21122 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 12:23:46.923396 18919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 321) took 1716 ms (client timeout 1555 ms). Trace:
I20260709 12:23:46.896174 21024 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.959764 20947 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:46.951483 21096 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:46.979112 20947 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.981472 21068 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.983314 21012 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.952153 21108 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:46.877441 21110 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:46.984333 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:46.978193 18919 rpcz_store.cc:269] 0709 12:23:45.206900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.207059 (+   159us) service_pool.cc:224] Handling call
0709 12:23:46.923155 (+1716096us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400336154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:46.923299 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251023360}
I20260709 12:23:46.910416 20823 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.008256 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.008392 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:46.997988 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 252009us
W20260709 12:23:47.011689 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 127544us
I20260709 12:23:47.012126 18922 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:47.013098 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.014225 18886 leader_election.cc:400] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
I20260709 12:23:47.014637 18886 leader_election.cc:403] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:23:46.937071 20963 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.014256 18846 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
W20260709 12:23:47.016225 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 85921.1us
I20260709 12:23:47.017913 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:46.978057 21040 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.959969 21089 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:47.026527 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.026865 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:46.976779 21103 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:47.027643 18919 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:23:47.031314 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:46.960753 20975 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.009634 21024 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.022527 21108 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.040374 21048 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.040490 21024 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.040947 21108 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:46.957013 21123 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.045226 21123 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:47.045863 21123 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:46.990114 21132 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.046725 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:47.036710 18886 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:47.047948 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.048417 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:47.037007 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:47.049255 19486 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:46.984681 21091 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:23:46.960469 21100 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:23:47.027038 21128 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:47.056911 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1586) took 2008 ms. Trace:
I20260709 12:23:47.023078 21040 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:47.057754 18914 rpcz_store.cc:276] 0709 12:23:45.048492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.048671 (+   179us) service_pool.cc:224] Handling call
0709 12:23:45.070809 (+ 22138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.526592 (+455783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.056675 (+1530083us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400334d54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:47.056851 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424889088}
W20260709 12:23:47.058615 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46091.7us
I20260709 12:23:47.060783 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:47.026291 20823 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:47.046264 21123 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:47.019729 21013 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:23:47.070175 20823 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.070448 21141 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:47.070912 21013 consensus_queue.cc:1243] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:23:47.071518 21013 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.071707 21141 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:47.071929 21013 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:47.072223 21141 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:47.072088 21012 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:47.072981 21013 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:47.073549 21097 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.735s	user 0.003s	sys 0.000s
I20260709 12:23:47.073295 21141 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.074904 21141 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.046578 21126 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
W20260709 12:23:47.076591 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.076470 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.018888 21134 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:23:47.052577 21024 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.051324 21046 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:23:47.076327 21123 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.063669 21128 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:47.078619 20883 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:47.108091 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:47.112701 18764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2048) took 2657 ms (client timeout 1788 ms). Trace:
I20260709 12:23:47.076033 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:47.115386 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.113173 18845 raft_consensus.cc:2376] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
I20260709 12:23:47.122610 21024 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.093101 20992 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:47.113148 18764 rpcz_store.cc:269] 0709 12:23:44.447755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.513497 (+ 65742us) service_pool.cc:224] Handling call
0709 12:23:47.098433 (+2584936us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540002d854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:47.105233 (+  6800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805181824}
I20260709 12:23:47.092242 20963 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:47.123539 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.098555 21013 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:47.152496 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.124552 21103 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.097373 21116 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.112385 20973 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.116390 20883 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.108554 21119 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.143574 19487 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.143739 21009 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.175076 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:47.179644 18845 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.176091 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:47.180861 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 95257us
I20260709 12:23:47.181682 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:47.151538 21089 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:47.181699 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.187083 18916 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:47.124661 21038 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.147331 21040 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.194515 21138 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:47.194850 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.123394 21024 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.197794 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:47.204972 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 97964.1us
I20260709 12:23:47.191893 20882 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:47.192875 20963 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.174165 21110 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.217375 18739 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:47.204298 20823 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.222471 20909 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:47.210618 21142 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.206171 21138 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:47.256168 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 207839us
I20260709 12:23:47.213963 19483 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:23:47.257581 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.258684 18764 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:47.259641 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:47.260265 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.188650 21128 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.262166 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.262830 18764 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:47.229382 21033 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.266233 19487 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:23:47.267302 21147 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 12:23:47.270934 20876 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.000s
I20260709 12:23:47.272913 21024 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.274070 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:47.274945 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.275206 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:47.276577 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.277544 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.280886 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:47.282811 18764 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:47.283209 18845 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:47.285319 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:47.219545 21137 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.188975 21009 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.291934 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.229295 21127 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:47.302349 21127 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.211392 21048 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:23:47.304956 21127 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.222052 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:47.287214 21119 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:47.306023 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.307734 21119 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:47.291963 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.309111 18765 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:47.308768 21119 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.292797 18772 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 2.
I20260709 12:23:47.290027 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:47.293695 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.311764 20882 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:23:47.295985 20969 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.004s
W20260709 12:23:47.282816 20970 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.771s	user 0.006s	sys 0.006s
I20260709 12:23:47.313113 20970 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:47.306586 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 84640.5us
I20260709 12:23:47.293282 21024 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:23:47.314261 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:47.315408 20970 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:47.315502 21137 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:47.316136 21137 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.316308 18913 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:47.316601 21137 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.312018 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:47.289743 21100 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:47.320693 21024 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:47.321130 21024 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.321472 21024 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:47.321866 21068 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:47.323383 20969 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.325814 20969 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.327044 20690 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.330770 21136 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:47.352196 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:47.333081 18915 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:47.332923 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.354096 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.354861 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.276276 20864 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.297005 21149 raft_consensus.cc:2764] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:47.295073 21152 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.296413 18839 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:47.336778 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.338339 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.362690 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.362926 18920 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.339609 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.286361 21110 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:47.363714 18916 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:47.344100 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:47.350870 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60895.7us
I20260709 12:23:47.365099 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:47.361409 18917 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:47.365818 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.366725 18922 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:23:47.367125 18918 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:47.367511 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.368131 18919 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:47.369232 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.377866 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.378665 18767 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.379191 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.382704 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:47.307337 21048 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:47.345430 21128 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.307180 21009 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.385099 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 489) took 2201 ms. Trace:
I20260709 12:23:47.283687 21131 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.357795 21127 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.406069 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:47.411679 18839 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.408725 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:47.416692 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:47.417593 18841 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:47.401886 18915 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:23:47.403147 19491 rpcz_store.cc:276] 0709 12:23:45.161213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.161387 (+   174us) service_pool.cc:224] Handling call
0709 12:23:45.161763 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.130425 (+968662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.362032 (+1231607us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b540051cf54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:47.362184 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226158336}
I20260709 12:23:47.255857 21089 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.391606 20882 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.436232 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58037.8us
I20260709 12:23:47.398834 21048 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.438882 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:47.394767 21152 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.399508 21110 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:47.358958 20690 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.407856 21026 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:47.408032 20823 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.372022 20864 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.384290 21136 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.459916 18845 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:47.457916 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:47.451058 21021 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:23:47.463418 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:47.466113 18839 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:47.476317 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.477849 18839 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:47.466797 18841 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:47.447511 21048 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.479416 18839 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.483865 18839 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:47.484587 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.479348 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.485774 18845 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:23:47.485949 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.482508 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:47.483024 21162 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.485270 18841 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:47.488906 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:47.489681 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1416) took 2002 ms. Trace:
I20260709 12:23:47.483887 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:47.490350 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1752) took 2340 ms. Trace:
I20260709 12:23:47.490793 18843 rpcz_store.cc:276] 0709 12:23:45.150364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.614769 (+464405us) service_pool.cc:224] Handling call
0709 12:23:45.615110 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.526015 (+910905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.490121 (+964106us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400108bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:47.490274 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079014784}
I20260709 12:23:47.434692 21127 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.455711 21149 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.480832 21152 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:47.490103 18766 rpcz_store.cc:276] 0709 12:23:45.487249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.718960 (+231711us) service_pool.cc:224] Handling call
0709 12:23:45.767709 (+ 48749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.499385 (+731676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.489443 (+990058us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540029e0d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:47.489624 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644214016}
I20260709 12:23:47.494529 18739 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:47.484818 18839 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.526798 18839 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.496779 21091 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.503669 21133 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:47.543529 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49150us
I20260709 12:23:47.506448 20967 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:47.555287 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 72888.2us
I20260709 12:23:47.557449 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.559859 19492 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:47.484568 21021 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:47.508301 21156 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:47.567534 19491 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.567747 21156 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.567955 18767 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:47.568203 21156 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.474844 21068 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:23:47.462177 21026 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:47.519294 21150 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:23:47.520366 21108 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.521863 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:47.589634 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 77757.8us
I20260709 12:23:47.528638 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:47.530040 21159 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:47.533141 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:47.601269 19486 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:47.520838 21155 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:47.534723 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.534818 21012 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.602617 18848 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:47.461206 21112 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:23:47.565550 18839 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:23:47.611901 18839 pending_rounds.cc:85] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 4
I20260709 12:23:47.612206 18839 pending_rounds.cc:107] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:23:47.612495 18839 raft_consensus.cc:2889] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:47.492120 20969 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:23:47.569093 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.613174 18767 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
W20260709 12:23:47.566157 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.569259 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:47.571543 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.577065 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 86026.6us
I20260709 12:23:47.614218 18766 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.447463 20882 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.544296 21133 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:47.608386 18846 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:23:47.567297 21149 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.465631 20823 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.522406 20820 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:23:47.620180 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 101476us
I20260709 12:23:47.565622 20909 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:47.628100 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.595824 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:47.524267 21162 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.644392 18918 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:47.690268 21123 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
I20260709 12:23:47.645251 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:47.079686 21143 consensus_queue.cc:1175] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:47.610952 21012 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:47.729260 21038 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:47.731206 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.745883 18922 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:47.611325 21013 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.611470 21155 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.746783 21155 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.746724 21013 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.611915 21152 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 12:23:47.691977 20883 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.001s
I20260709 12:23:47.653191 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.696834 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.652316 20823 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:47.699661 21104 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.024s	user 0.008s	sys 0.004s
I20260709 12:23:47.702808 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.704877 21127 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.705245 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.706516 21021 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.707383 21131 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.686180 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1599) took 1196 ms. Trace:
W20260709 12:23:47.620750 21106 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:23:47.683086 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.774472 18915 rpcz_store.cc:276] 0709 12:23:46.490103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.513917 (+ 23814us) service_pool.cc:224] Handling call
0709 12:23:47.685996 (+1172079us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400032ad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:47.686113 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878983936}
I20260709 12:23:47.784067 18772 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
W20260709 12:23:47.715950 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.785210 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:47.786329 18915 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:47.786424 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:47.606534 21110 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.719316 18916 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:47.754726 20970 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:47.688205 21163 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.210s	user 0.003s	sys 0.000s
I20260709 12:23:47.726756 21123 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.666445 20876 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.731563 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.821254 18765 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:47.821367 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.711171 20690 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.672115 21026 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.734870 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:47.736508 21132 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.737039 19484 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:47.738739 21162 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:47.740155 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:47.740708 18913 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:47.741346 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:47.741235 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:47.742755 18767 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:47.730064 21012 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.743328 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:47.743937 20965 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.615217 20967 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:23:47.645795 21091 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:23:47.658517 19487 raft_consensus.cc:2410] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:47.851166 21123 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:47.755481 18764 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:47.658241 21117 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.975s	user 0.003s	sys 0.000s
I20260709 12:23:47.817324 21024 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.687276 20882 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.651655 21116 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:47.856444 21116 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:47.857414 21116 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.651396 20862 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.858695 20862 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.861166 20862 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.623328 21108 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 12:23:47.827325 20876 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.653537 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:47.763278 20883 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:47.864462 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 210994us
I20260709 12:23:47.865355 21091 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.789914 20961 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.866674 20961 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.867224 20961 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.796720 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1759) took 1254 ms. Trace:
I20260709 12:23:47.797796 20823 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:47.801558 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2041) took 3375 ms. Trace:
I20260709 12:23:47.879446 18770 rpcz_store.cc:276] 0709 12:23:44.425828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.626519 (+200691us) service_pool.cc:224] Handling call
0709 12:23:47.801280 (+3174761us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:47.801479 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4171719424}
I20260709 12:23:47.801445 21107 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:23:47.773453 21104 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.884536 21104 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:47.825050 21132 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:47.802524 18769 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:23:47.886559 18769 pending_rounds.cc:85] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 1
I20260709 12:23:47.886809 18769 pending_rounds.cc:107] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:23:47.886240 21132 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.887038 18769 raft_consensus.cc:2889] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:47.887444 21132 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.887809 20862 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:47.888779 20862 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:47.889127 20862 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:47.803233 21040 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.803838 21165 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.808663 21160 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.341s	user 0.001s	sys 0.002s
I20260709 12:23:47.898324 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.811112 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:47.899096 18765 raft_consensus.cc:2376] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7. Re-sending same reply.
I20260709 12:23:47.754413 20909 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.689359 21133 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.641664 21149 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.815244 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:47.879525 20883 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.826066 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.916292 18772 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:23:47.826872 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 92073.7us
W20260709 12:23:47.917963 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 302753us
I20260709 12:23:47.752036 21141 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:23:47.827250 18914 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:47.789865 21127 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:47.836830 21156 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:47.841445 19490 raft_consensus.cc:2368] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
I20260709 12:23:47.842082 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.930299 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.930368 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:47.932196 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.817159 20992 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.863338 18915 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:47.865458 20876 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:47.866150 21091 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:47.797091 18844 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:47.595168 21142 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:47.868249 18842 rpcz_store.cc:276] 0709 12:23:46.541920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.542107 (+   187us) service_pool.cc:224] Handling call
0709 12:23:46.559428 (+ 17321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:46.768414 (+208986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.796212 (+1027798us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400071054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:47.796629 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466922240}
I20260709 12:23:47.938568 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.938719 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.912776 20909 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.892139 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.946599 18919 raft_consensus.cc:2410] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:23:47.890897 21116 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.896142 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.858105 21024 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:47.875064 18669 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:47.958178 18770 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:47.827136 21021 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:47.895516 21137 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.002s
W20260709 12:23:47.914906 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 99779.7us
I20260709 12:23:47.815963 18766 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:47.920007 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.970763 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.971537 18772 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:47.920022 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.896137 20882 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:47.976493 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:47.977747 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:47.978603 18846 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.979985 18764 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:47.922139 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:47.927768 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.980849 18913 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:47.981077 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.875972 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:47.940934 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:47.890002 20862 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:47.912331 21104 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:47.911975 21152 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:47.945703 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 320445us
I20260709 12:23:47.958984 18669 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 4, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 4 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:47.952417 18922 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:47.914026 21123 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:47.966857 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.924585 21107 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:47.935720 21133 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.932710 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:48.008200 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 75596.2us
I20260709 12:23:48.007650 18669 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 2, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 2 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:47.978695 18839 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:47.944063 21098 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:47.907011 21165 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:47.934716 21136 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:47.984025 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 108160us
I20260709 12:23:47.962890 20820 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:47.984973 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.954221 21127 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:47.995777 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:48.006289 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:48.009955 18847 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:48.013248 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:47.984895 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:48.016605 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:47.969848 21142 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:48.010995 18669 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:47.977708 20882 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:48.056447 18814 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:48.048477 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.062415 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:48.062814 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:48.020258 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:47.943655 20992 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.058713 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:48.059124 18848 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 2: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:48.058256 18917 raft_consensus.cc:2376] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5. Re-sending same reply.
I20260709 12:23:48.064600 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:48.057917 18669 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:23:48.014447 20897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.202s	user 0.001s	sys 0.030s
I20260709 12:23:48.070852 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.070571 18669 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 3 to 4, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 4 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:48.003708 21068 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:48.063256 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 78453.8us
I20260709 12:23:48.019141 18846 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:48.014412 21140 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.070219 19486 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:48.063776 18771 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:47.991463 21137 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.007254 21107 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:48.019025 18764 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.069265 21136 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:48.010581 20864 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:48.068187 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:48.090498 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:48.078619 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:47.986753 20947 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:48.019606 20987 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:48.093886 19485 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:23:48.092962 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 170956us
I20260709 12:23:48.071933 21131 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:48.061087 21024 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:48.071285 20897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.002s	sys 0.030s
I20260709 12:23:48.099237 18765 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:23:48.066035 20690 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.079039 21098 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:48.074326 21108 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:48.015020 21123 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.124238 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:48.124940 18920 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
W20260709 12:23:48.125072 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.126591 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:48.127524 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:48.054987 21152 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.095918 21140 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.136994 20820 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.093631 21107 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.139341 21140 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:48.114835 21024 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.141250 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:48.143767 21149 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:48.134464 21155 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.108141 20987 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.144842 20987 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.145740 21165 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:48.146278 21155 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:48.137575 21156 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:48.141438 21024 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:48.147732 20992 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:48.152222 21123 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:48.154825 21158 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.635s	user 0.005s	sys 0.000s
I20260709 12:23:48.156281 21127 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.010458 21104 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.111901 21091 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.160125 21104 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:48.107681 21089 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:48.122620 21108 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.135810 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:48.162534 21108 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.163319 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:48.098788 21109 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.099388 21136 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:48.165349 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1410) took 3687 ms. Trace:
I20260709 12:23:48.081326 21068 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:48.169487 18769 rpcz_store.cc:276] 0709 12:23:44.468418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.889085 (+420667us) service_pool.cc:224] Handling call
0709 12:23:47.802091 (+2913006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.887574 (+ 85483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.155495 (+267921us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b540036bfd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:48.155654 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6698231680}
I20260709 12:23:48.168404 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.107939 21168 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:48.074499 21119 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:23:48.207302 18764 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:48.209656 18771 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:23:48.211112 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.212270 18771 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:23:48.213387 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.216723 21026 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:48.218284 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.219724 18769 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:48.169543 19487 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:48.245607 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.251240 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.251888 18772 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:48.114722 21131 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.252852 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.253466 18772 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:48.254098 21046 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:48.254487 21131 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:48.254683 21046 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:48.173578 21068 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.254777 21175 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:48.171017 21136 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.256764 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.253921 20961 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.257452 18917 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.257721 18772 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:48.258472 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:48.281172 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 138343us
I20260709 12:23:48.281549 18769 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:48.247017 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.282440 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:48.271013 18771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:48.131335 21098 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.240602 21026 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:48.244858 20864 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:48.288703 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 152969us
I20260709 12:23:48.300621 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:48.097456 21142 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.303825 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:48.299655 18917 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:48.295322 18772 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:23:48.287361 18769 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:23:48.310607 18769 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:48.312449 18769 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:48.293730 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:48.305562 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:23:48.303823 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 241098us
I20260709 12:23:48.318962 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:48.315032 19458 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:23:48.321833 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.323349 18886 leader_election.cc:400] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
I20260709 12:23:48.324450 18886 leader_election.cc:403] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:23:48.299399 21026 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.324970 21131 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:48.300536 20823 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:48.290519 21168 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:48.320979 21162 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:48.349866 21048 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.856s	user 0.005s	sys 0.007s
I20260709 12:23:48.350363 21048 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.352653 21048 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:48.336835 18768 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.302626 20864 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:48.353937 20864 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.304893 21175 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:48.316234 20883 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:23:48.335323 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.290382 21024 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:23:48.361788 20883 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.361882 18772 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:48.287182 21165 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:23:48.335538 21089 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
I20260709 12:23:48.369154 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.379318 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1425) took 1022 ms. Trace:
I20260709 12:23:48.377808 18772 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:48.379274 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.381029 18764 rpcz_store.cc:276] 0709 12:23:47.357019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.287435 (+930416us) service_pool.cc:224] Handling call
0709 12:23:48.288981 (+  1546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.289196 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:48.307002 (+ 17806us) log.cc:844] Serialized 14 byte log entry
0709 12:23:48.378963 (+ 71961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:48.379019 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:48.379058 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.379119 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.379248 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7850,"prepare.queue_time_us":17483,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2424,"thread_start_us":63355,"threads_started":1}
W20260709 12:23:48.391310 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.398586 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.348856 21162 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.359624 20823 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:48.411235 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 105748us
I20260709 12:23:48.414266 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.414285 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.415623 19489 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:48.413123 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:48.419155 18842 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:48.370435 20883 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:48.377224 21128 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.976s	user 0.013s	sys 0.000s
I20260709 12:23:48.362383 21152 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:48.429607 18772 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:23:48.412206 21162 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.433599 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.371485 21175 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:48.398074 21169 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:48.439395 18767 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:48.405563 21182 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:23:48.448645 19488 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:48.449175 21098 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:48.323259 21046 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.412447 21137 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:48.422122 21165 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:48.455452 18772 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:48.639883 21165 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:48.456862 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:48.430932 20975 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.642056 20975 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.641314 21165 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.459259 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:48.644554 18916 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:48.462815 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:48.464934 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:48.647456 18921 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.444787 21169 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.649791 21169 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:48.465209 21174 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:23:48.641306 18913 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.455619 21048 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.457207 20823 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:48.654382 20823 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:48.655704 20823 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.657218 20823 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.465072 21168 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.656224 21048 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:48.484040 21185 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:23:48.484442 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:48.662940 18914 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.485397 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 340) took 1467 ms. Trace:
I20260709 12:23:48.464884 21110 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.664585 18844 rpcz_store.cc:276] 0709 12:23:47.018455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.018628 (+   173us) service_pool.cc:224] Handling call
0709 12:23:47.796592 (+777964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.934081 (+137489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.485139 (+551058us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400071050. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:48.485331 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788115328}
I20260709 12:23:48.664827 21110 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:48.501062 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.468498 21141 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:48.666893 21141 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:48.668159 21141 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.669656 21141 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:48.477083 21178 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:23:48.519384 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.506847 20961 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:48.517859 21181 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:23:48.526034 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:48.672350 18915 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.529368 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1421) took 1173 ms. Trace:
I20260709 12:23:48.673949 18768 rpcz_store.cc:276] 0709 12:23:47.355882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.358147 (+  2265us) service_pool.cc:224] Handling call
0709 12:23:47.358576 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.336475 (+977899us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540016e7a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8d1c0 00007f335af8e231 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c
0709 12:23:48.353605 (+ 17130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.528961 (+175356us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540029c2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:48.529267 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870752384}
I20260709 12:23:48.676378 18768 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:48.677978 18768 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:23:48.402884 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 305230us
I20260709 12:23:48.552981 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:48.680116 18766 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.680644 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:48.555528 18917 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:48.682078 20961 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:48.683669 20961 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.684129 20961 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.558342 19486 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:48.472509 21192 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:23:48.685261 21127 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:48.686340 21127 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:48.686982 21127 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:48.688202 21127 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.693431 21127 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.508715 21175 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.610678 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.612596 19490 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:48.612798 21012 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.620556 20882 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:48.704454 20882 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.707623 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:48.708899 21189 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:48.709465 21189 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.709928 21189 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.603801 20862 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:48.375164 18886 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 4.718s (SENT) [suppressed 42 similar messages]
W20260709 12:23:48.601830 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 620243us
I20260709 12:23:48.723477 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:48.686384 18768 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.742336 20899 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:48.801769 20899 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.802551 20899 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:48.804668 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.829341 21046 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.836731 21192 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.837598 21192 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:48.861398 21109 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.691s	user 0.022s	sys 0.005s
I20260709 12:23:48.862161 21109 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:48.863377 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:48.861662 21116 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.897s	user 0.011s	sys 0.008s
W20260709 12:23:48.867233 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.867537 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.869725 21068 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.614s	user 0.003s	sys 0.023s
I20260709 12:23:48.871526 20899 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:48.874100 21132 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.986s	user 0.010s	sys 0.010s
I20260709 12:23:48.875152 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:48.433832 20820 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Committing config change with OpId 5.7: config changed from index 3 to 7, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:23:48.881193 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.882141 21110 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:48.883565 18772 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:48.884750 20987 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.739s	user 0.013s	sys 0.016s
I20260709 12:23:48.978751 20987 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.979197 21176 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.979736 21176 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:48.980196 21176 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.981367 20987 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:48.885665 20975 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:48.885900 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.959417 21137 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.984747 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.984860 21137 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:48.985628 19483 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:23:48.987054 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.887106 21048 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:48.889437 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.890316 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:49.002530 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.891641 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:48.892833 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:48.893373 20909 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.927s	user 0.011s	sys 0.009s
W20260709 12:23:48.893792 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 170445us
W20260709 12:23:48.897665 19458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.011s	sys 0.028s
W20260709 12:23:48.902575 19492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.003s	sys 0.012s
I20260709 12:23:48.906697 21013 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:48.907366 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 184194us
I20260709 12:23:48.925000 19490 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:48.926187 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1442) took 1274 ms. Trace:
I20260709 12:23:48.865124 18914 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:48.939874 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:49.021665 18917 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
W20260709 12:23:48.967983 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 92920us
I20260709 12:23:48.982797 21192 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:48.991799 18922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.009s
I20260709 12:23:48.996366 18764 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
W20260709 12:23:49.007802 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.034260 18922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.012s	sys 0.009s
W20260709 12:23:49.034683 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.009544 19458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.011s	sys 0.029s
W20260709 12:23:49.009637 19492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.004s	sys 0.012s
W20260709 12:23:49.025897 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.026437 18767 rpcz_store.cc:276] 0709 12:23:47.652025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.940652 (+288627us) service_pool.cc:224] Handling call
0709 12:23:48.925926 (+985274us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b540017acd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:48.926104 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050767104}
W20260709 12:23:49.029086 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.054358 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.025619 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:49.083902 21182 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:49.095747 21182 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.098340 19488 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:49.100878 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 547) took 1033 ms. Trace:
I20260709 12:23:49.022663 20909 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.104803 18769 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:49.109467 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.000455 21142 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.126134 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1439) took 1496 ms. Trace:
I20260709 12:23:49.126917 18769 rpcz_store.cc:276] 0709 12:23:47.643176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.313363 (+670187us) service_pool.cc:224] Handling call
0709 12:23:48.313745 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.105268 (+791523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.107945 (+  2677us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54001ca2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:49.126041 (+ 18096us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818788736}
I20260709 12:23:48.967813 21068 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.022307 21116 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.135912 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 126746us
W20260709 12:23:49.131367 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 418300us
W20260709 12:23:49.132994 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 818003us
I20260709 12:23:49.134443 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:49.137074 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.137472 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.139257 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.140762 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:48.959713 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:49.141796 18918 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:23:49.142958 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:49.143909 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 118410us
I20260709 12:23:49.138919 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:49.145781 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 109351us
I20260709 12:23:49.148070 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.101367 19492 rpcz_store.cc:276] 0709 12:23:48.067746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.067912 (+   166us) service_pool.cc:224] Handling call
0709 12:23:48.070667 (+  2755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:48.106878 (+ 36211us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:48.299371 (+192493us) log.cc:844] Serialized 14 byte log entry
0709 12:23:49.035697 (+736326us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.036205 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.036377 (+   172us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:49.036415 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.036485 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:49.100643 (+ 64158us) raft_consensus.cc:1685] finished
0709 12:23:49.100669 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.100811 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144586,"prepare.queue_time_us":319417,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":52343,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":16690,"thread_start_us":884177,"threads_started":2,"wal-append.queue_time_us":588909}
I20260709 12:23:49.150343 18766 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:49.151158 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1444) took 1392 ms. Trace:
I20260709 12:23:49.151537 18766 rpcz_store.cc:276] 0709 12:23:47.759234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.968464 (+209230us) service_pool.cc:224] Handling call
0709 12:23:48.552792 (+584328us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:23:49.151094 (+598302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6964992}
W20260709 12:23:49.158982 18921 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.014s
I20260709 12:23:49.159912 18921 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:49.088534 20987 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.164815 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:49.165758 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:49.165998 18764 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:49.140947 18913 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:49.173926 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.177821 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.179273 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.181126 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:49.192667 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.192807 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.183573 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.165304 21192 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:49.144248 21048 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.236522 18848 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:49.248471 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.237901 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:49.237993 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70736.8us
W20260709 12:23:49.201545 20876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.004s	sys 0.021s
I20260709 12:23:49.252143 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.189997 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.244223 21165 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:49.176997 21098 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.250617 18842 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:49.193360 18769 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 3 to 7, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:49.274276 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.255285 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.194482 21137 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:49.130740 21142 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.163570 21021 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:23:49.163950 21110 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
W20260709 12:23:49.260946 18915 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.021s
I20260709 12:23:49.170413 21132 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:23:49.223505 20975 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 12:23:49.251971 21038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.005s	sys 0.021s
I20260709 12:23:49.194442 21103 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:23:49.196873 21013 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:23:49.184226 20987 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.197373 21171 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:23:49.293288 18848 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.293789 18842 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:49.254035 20876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.004s	sys 0.021s
I20260709 12:23:49.296156 18915 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:49.165762 21116 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:49.249013 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:49.250919 19483 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:49.257577 21109 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:49.301558 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.325498 18844 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:49.273913 21175 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:49.305539 18841 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:49.265930 21192 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:49.329155 18846 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:49.248303 20899 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:23:49.297863 21098 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:49.288492 21180 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:49.293952 20909 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:49.299615 21137 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:23:49.303854 21038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.005s	sys 0.022s
I20260709 12:23:49.321691 18842 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.253101 21048 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.312279 21132 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:49.333452 18886 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.014s	sys 0.045s
I20260709 12:23:49.333967 18847 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
W20260709 12:23:49.325079 21012 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.020s
I20260709 12:23:49.341881 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:49.345193 18886 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.015s	sys 0.045s
W20260709 12:23:49.349817 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 974635us
W20260709 12:23:49.353852 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.347999 18846 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:49.355432 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.362512 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:49.367419 18767 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [4.4-5.5]
W20260709 12:23:49.334471 21141 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.664s	user 0.016s	sys 0.013s
I20260709 12:23:49.376423 18764 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:23:49.343688 21026 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.996s	user 0.009s	sys 0.019s
I20260709 12:23:49.387763 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:49.333081 21182 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:49.358693 21040 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.460s	user 0.024s	sys 0.007s
W20260709 12:23:49.402688 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 178260us
W20260709 12:23:49.358321 20882 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.653s	user 0.016s	sys 0.006s
I20260709 12:23:49.345114 21132 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.407837 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:49.359400 20864 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.005s	user 0.032s	sys 0.020s
W20260709 12:23:49.408658 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 234803us
I20260709 12:23:49.338613 21103 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:23:49.379254 20961 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.688s	user 0.018s	sys 0.004s
W20260709 12:23:49.378964 20823 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.721s	user 0.014s	sys 0.018s
W20260709 12:23:49.380124 21108 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.217s	user 0.024s	sys 0.016s
I20260709 12:23:49.416152 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:49.389290 21107 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.250s	user 0.018s	sys 0.013s
I20260709 12:23:49.379590 19487 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:49.343353 21180 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.430199 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.431599 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:49.420866 18773 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:49.409996 20909 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:49.436331 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.412155 21136 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.135s	user 0.028s	sys 0.003s
W20260709 12:23:49.440840 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 259958us
I20260709 12:23:49.420598 21109 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.441849 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:49.437209 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.424535 21132 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:49.458957 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:49.461163 18771 raft_consensus.cc:606] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:49.427829 21103 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:49.479692 18915 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:49.463560 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:49.466719 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.419878 21068 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:49.474295 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:49.477144 18771 raft_consensus.cc:614] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:49.447073 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.481164 18922 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:49.425455 21165 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:49.482342 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:49.441505 21040 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.480962 18844 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:49.408658 21026 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:49.512401 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.463568 20975 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.463181 21013 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:49.505971 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:49.530875 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:49.561733 18847 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:49.562146 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 187918us
W20260709 12:23:49.507957 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.473901 21133 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.460s	user 0.018s	sys 0.013s
I20260709 12:23:49.429703 20864 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:49.476507 20823 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:49.465719 20909 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:49.429385 20961 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.556871 18842 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:49.597016 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:49.508612 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:49.475689 21142 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:49.558817 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:49.459172 21107 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:49.494726 21141 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:49.502108 20967 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.461635 21108 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:49.613322 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.472045 21136 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.588140 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.563796 21230 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:49.606823 18919 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 3 to 7, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:49.618455 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:49.600718 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 99206.6us
W20260709 12:23:49.603576 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.604259 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:49.558912 21227 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:49.588433 21182 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.477948 21109 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.563566 21194 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:49.612692 18773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1422) took 2256 ms (client timeout 1909 ms). Trace:
I20260709 12:23:49.595727 21133 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:49.563243 20975 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:49.616973 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 342773us
I20260709 12:23:49.538012 21040 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.658586 18921 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:49.621855 18848 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:49.586817 20823 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.561054 21013 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.672094 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:49.623212 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:49.626482 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 436567us
W20260709 12:23:49.612074 20862 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.901s	user 0.011s	sys 0.005s
I20260709 12:23:49.630714 18839 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:49.678354 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:49.630254 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.563251 21168 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:23:49.615123 19485 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.641019 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:49.693244 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52347.2us
I20260709 12:23:49.694691 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:49.695943 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:49.598722 21116 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:49.627660 21208 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 12:23:49.652069 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:49.504326 21192 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:49.719655 18918 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:49.719623 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:49.639393 18773 rpcz_store.cc:269] 0709 12:23:47.356178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.704921 (+348743us) service_pool.cc:224] Handling call
0709 12:23:49.612483 (+1907562us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:49.612613 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3803699968}
I20260709 12:23:49.593242 18847 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:49.653869 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:49.721002 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:49.721441 18915 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:49.654974 18917 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:23:49.613467 20876 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:49.611706 21141 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.657205 18840 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:49.611330 20987 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:49.657732 21226 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:49.612684 21137 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:49.676442 18737 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.621697 21230 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:49.677582 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 171730us
W20260709 12:23:49.680500 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.755894 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:23:49.651968 21217 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:23:49.582784 21229 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:23:49.716207 21040 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:49.678067 21013 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:49.716972 20862 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:49.717578 21116 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.719588 18846 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:49.664860 21142 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.616460 20967 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.724545 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:49.820294 18915 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.700459 21100 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.670035 20823 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.663770 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:49.682415 21068 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.639436 21182 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:49.757704 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 81357.4us
I20260709 12:23:49.831974 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.832422 18737 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:49.670272 21021 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:23:49.597401 21103 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:49.783406 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:49.665891 21133 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:49.725744 21228 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:49.747284 21214 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.322s	user 0.001s	sys 0.001s
W20260709 12:23:49.743068 21189 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.032s	user 0.018s	sys 0.006s
I20260709 12:23:49.737793 21141 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:49.746213 21226 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.789444 21098 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:23:49.781088 21048 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:49.761332 21230 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.835152 18770 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:49.838344 18766 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:49.839172 18916 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:49.841485 18915 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:49.843438 21116 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:49.821565 21198 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:49.881659 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:49.884189 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.829689 21219 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:23:50.003912 21048 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:50.004142 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:49.748046 20987 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.005390 20987 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:49.951095 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 288756us
I20260709 12:23:49.704193 21165 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:49.952318 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 120449us
W20260709 12:23:49.847095 21046 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.017s	user 0.012s	sys 0.008s
I20260709 12:23:49.842669 21040 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:49.824200 21180 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:49.824641 21216 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.363s	user 0.002s	sys 0.003s
I20260709 12:23:49.990337 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:50.023872 18915 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:50.024634 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 143065us
I20260709 12:23:50.025741 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:50.001791 21162 consensus_meta.cc:287] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.551s	user 0.014s	sys 0.028s
I20260709 12:23:50.002177 20864 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:50.006018 18916 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:49.754688 20909 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.839088 21100 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:50.008360 20987 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:49.993492 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 210180us
I20260709 12:23:50.028287 18915 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.823983 21142 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:49.870319 21175 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 12:23:50.086644 21253 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:49.949754 21226 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:49.970479 21210 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
W20260709 12:23:50.091181 21242 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:23:50.092679 18921 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:49.961054 21021 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:50.094589 21021 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:50.095635 21021 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.096951 21021 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.971004 21103 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:49.972090 21012 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.968077 21241 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:49.958781 21231 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:50.067955 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.960654 21026 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:49.949070 21228 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:49.990209 21198 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.066995 21136 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:49.950603 21189 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:50.083473 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.035100 21137 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.099275 21235 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.207s
I20260709 12:23:50.054270 21162 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:49.837677 21068 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:50.397524 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.018s
W20260709 12:23:50.398037 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.018s
W20260709 12:23:50.398793 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56588.8us
I20260709 12:23:49.965981 21227 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:50.101019 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93837.2us
I20260709 12:23:50.045233 21040 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:50.049377 21046 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:50.034356 21238 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:50.269703 21243 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.463s	user 0.001s	sys 0.001s
I20260709 12:23:50.039392 21116 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:50.095824 21182 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:50.064976 21038 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.055796 21237 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.182875 18922 raft_consensus.cc:2410] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:23:50.199111 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 119920us
I20260709 12:23:50.046613 20862 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.078258 18916 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:50.072518 21109 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:50.105579 21234 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.439s	user 0.000s	sys 0.001s
I20260709 12:23:50.222016 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47220 (request call id 18) took 2718 ms. Trace:
I20260709 12:23:50.086285 21142 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:50.311256 18919 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.045s	sys 0.097s
W20260709 12:23:50.564869 18919 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.049s	sys 0.100s
W20260709 12:23:50.405678 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.005s	sys 0.014s
W20260709 12:23:50.271595 20883 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.820s	user 0.026s	sys 0.006s
W20260709 12:23:50.427788 18913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.036s	sys 0.040s
W20260709 12:23:50.565474 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.005s	sys 0.015s
W20260709 12:23:50.565714 18913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.036s	sys 0.040s
W20260709 12:23:50.565892 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 942717us
W20260709 12:23:50.439157 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.045913 20961 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:50.563961 18771 rpcz_store.cc:276] 0709 12:23:47.462700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.270792 (+808092us) service_pool.cc:224] Handling call
0709 12:23:50.112138 (+1841346us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af85853 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:50.180509 (+ 68371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2708179840}
W20260709 12:23:50.233049 21127 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.536s	user 0.005s	sys 0.014s
W20260709 12:23:50.337020 21176 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.356s	user 0.011s	sys 0.014s
W20260709 12:23:50.454207 18918 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.018s	sys 0.089s
W20260709 12:23:50.594956 18918 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.019s	sys 0.089s
I20260709 12:23:50.107930 21012 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:50.403239 20820 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.088s	user 0.011s	sys 0.002s
W20260709 12:23:50.604460 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.016s	sys 0.033s
W20260709 12:23:50.605798 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.016s	sys 0.034s
I20260709 12:23:50.222344 21198 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:50.203780 21107 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:50.447002 20987 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260709 12:23:50.203670 21251 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:50.400635 21098 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:50.483143 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.225216 20876 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:50.203459 20975 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:50.557088 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:50.273654 21013 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:50.449110 19491 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:50.203280 21180 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.276s
I20260709 12:23:50.604038 21142 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.453763 21108 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:50.830314 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 402283us
I20260709 12:23:50.257315 21241 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.308s
I20260709 12:23:50.447289 21238 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:50.606438 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 884099us
I20260709 12:23:50.307039 21229 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.666270 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 354) took 1082 ms. Trace:
W20260709 12:23:50.692132 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 292377us
I20260709 12:23:50.690197 21248 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:50.695992 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 129409us
I20260709 12:23:50.594228 21109 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.199s
I20260709 12:23:50.569608 20862 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.575129 20883 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:50.604604 20961 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.201s
W20260709 12:23:50.813755 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 256785us
W20260709 12:23:50.881655 21250 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:23:50.405961 21246 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.159s
W20260709 12:23:50.808383 21169 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 2.158s	user 0.016s	sys 0.007s
I20260709 12:23:50.666988 21245 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:50.859767 18812 connection.cc:256] RPC call timeout handler was delayed by -2.3598443769997175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 12:23:50.695955 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.953617 18812 connection.cc:256] RPC call timeout handler was delayed by -1.5453815129999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 12:23:50.954053 18812 connection.cc:256] RPC call timeout handler was delayed by -1.4807757759999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:23:50.954411 18812 connection.cc:256] RPC call timeout handler was delayed by -1.4015757759998451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260709 12:23:50.864806 18919 rpcz_store.cc:276] 0709 12:23:49.583384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.587020 (+  3636us) service_pool.cc:224] Handling call
0709 12:23:49.606384 (+ 19364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.606682 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:49.712305 (+105623us) log.cc:844] Serialized 14 byte log entry
0709 12:23:50.665462 (+953157us) log.cc:844] Serialized 14 byte log entry
0709 12:23:50.665761 (+   299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.665830 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:50.665897 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.665998 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.666179 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":124051,"prepare.run_wall_time_us":57,"raft.queue_time_us":327498,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":41710,"spinlock_wait_cycles":107254400,"thread_start_us":852418,"threads_started":2,"wal-append.queue_time_us":570140}
I20260709 12:23:50.956216 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:50.956926 18846 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:50.807700 21133 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:50.877182 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:50.878162 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.958777 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:50.878701 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:50.847581 21218 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.544s	user 0.007s	sys 0.013s
I20260709 12:23:50.802479 21040 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.604764 21176 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:50.829000 20987 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:50.864871 21132 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.356s	user 0.007s	sys 0.007s
I20260709 12:23:50.829195 21252 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:50.291581 21226 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:50.908057 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1783) took 1579 ms. Trace:
I20260709 12:23:50.905840 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:50.865814 21238 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:50.818285 21098 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:50.923836 19489 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:50.928711 20883 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:50.929311 21013 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:50.979748 21038 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:50.929805 21258 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.463s	user 0.000s	sys 0.001s
I20260709 12:23:50.930757 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 553) took 1362 ms. Trace:
I20260709 12:23:50.931341 20862 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:50.932072 21162 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:50.812788 21251 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.868625 21142 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:50.873441 21116 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:50.933404 20967 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:50.925019 21241 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:23:50.303098 21228 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.934849 21268 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:50.917317 21235 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:23:50.884604 21229 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.938725 21012 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:50.939028 20876 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:50.941136 19491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 549) took 2572 ms (client timeout 1578 ms). Trace:
I20260709 12:23:51.004702 21256 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 12:23:50.951116 18840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1772) took 1808 ms (client timeout 1734 ms). Trace:
W20260709 12:23:51.058951 18840 rpcz_store.cc:269] 0709 12:23:49.143131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.143638 (+   507us) service_pool.cc:224] Handling call
0709 12:23:50.950826 (+1807188us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400327dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:50.951014 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085026560}
W20260709 12:23:50.952657 21230 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.934s	user 0.006s	sys 0.004s
I20260709 12:23:50.962517 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:50.967005 18771 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:51.062284 18845 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:51.063424 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:50.967885 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:50.970865 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:51.132337 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:50.975416 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:50.894336 21182 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:50.977125 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:51.135809 18916 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.980453 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.137238 18847 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:51.139118 18847 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:50.982372 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:50.986557 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:51.141160 18769 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:50.990126 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:50.991164 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:50.991312 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:50.994871 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:50.667829 21227 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.993464 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:50.998826 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:51.000166 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 94451.6us
I20260709 12:23:51.144194 18773 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.963166 21237 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.977967 21046 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.999410 18841 rpcz_store.cc:276] 0709 12:23:49.328963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.329692 (+   729us) service_pool.cc:224] Handling call
0709 12:23:49.330066 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:49.330599 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.330626 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:49.346208 (+ 15582us) log.cc:844] Serialized 52 byte log entry
0709 12:23:49.430789 (+ 84581us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180039be60. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:23:49.609177 (+178388us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:49.609239 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.609330 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.221568 (+612238us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:50.907677 (+686109us) raft_consensus.cc:1685] finished
0709 12:23:50.907713 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.907958 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3394,"raft.queue_time_us":6269,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":9510,"spinlock_wait_cycles":36448000,"thread_start_us":178112,"threads_started":1,"wal-append.queue_time_us":313393}
I20260709 12:23:50.929195 21169 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:50.990213 21231 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.984855 20975 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.984745 21253 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.997525 21255 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:51.033166 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 150296us
I20260709 12:23:51.011686 21263 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.996033 20987 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.975299 21245 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.027391 21252 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.996354 21132 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.044203 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 348) took 1571 ms. Trace:
I20260709 12:23:51.034112 21068 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:51.037623 21013 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:51.054889 19491 rpcz_store.cc:269] 0709 12:23:48.368670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.368825 (+   155us) service_pool.cc:224] Handling call
0709 12:23:50.940722 (+2571897us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540044d754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:50.940939 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4759642880}
I20260709 12:23:50.948921 21236 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:51.025391 21038 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:50.969165 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:51.064075 18771 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:51.134141 18846 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:51.226075 19483 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:51.144605 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 151560us
I20260709 12:23:51.053642 21189 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.151139 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:51.162472 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:51.232733 21098 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.194015 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:51.204097 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:51.271067 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67048.1us
I20260709 12:23:51.173679 21046 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.194701 18919 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:51.170655 21237 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.209793 18773 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:51.225317 18916 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:51.133309 21133 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:23:51.050267 21268 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.230581 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:51.230159 18920 rpcz_store.cc:276] 0709 12:23:49.475771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.475906 (+   135us) service_pool.cc:224] Handling call
0709 12:23:49.482058 (+  6152us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:49.513205 (+ 31147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.513251 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:49.536170 (+ 22919us) log.cc:844] Serialized 78 byte log entry
0709 12:23:49.669603 (+133433us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:49.745160 (+ 75557us) log.cc:844] Serialized 14 byte log entry
0709 12:23:50.942504 (+1197344us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b1800435100. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:23:50.976107 (+ 33603us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b1800435100. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:23:51.042019 (+ 65912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.043556 (+  1537us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.043680 (+   124us) raft_consensus.cc:1685] finished
0709 12:23:51.043699 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.044073 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46992,"prepare.queue_time_us":73487,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":4666,"raft.queue_time_us":474208,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":10742,"spinlock_wait_cycles":32934528,"thread_start_us":145426,"threads_started":2,"wal-append.queue_time_us":181753}
I20260709 12:23:51.133956 21230 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:51.220063 21103 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.112s	user 0.014s	sys 0.000s
I20260709 12:23:51.179603 20862 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:51.193717 21231 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.045085 21267 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:51.194136 21162 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:23:51.264679 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:51.171540 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.260200 20883 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:51.336133 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 71547.5us
I20260709 12:23:51.278147 21241 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:51.275774 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 124789us
I20260709 12:23:51.351382 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:51.221905 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.278034 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:51.354064 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76118.4us
W20260709 12:23:51.354904 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.356441 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.212044 20975 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.392608 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:51.174582 21198 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.308593 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:51.252254 21236 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:51.260576 21278 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:23:51.315274 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:51.315711 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43973.7us
I20260709 12:23:51.403028 18916 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:51.315948 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:51.403894 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.156960 21182 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.326638 18764 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:51.229012 21253 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.419700 21180 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:51.420531 21180 consensus_queue.cc:1243] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:23:51.153533 20961 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:51.422868 21277 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:23:51.304117 21068 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:51.425913 21068 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:51.426422 21068 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:51.426867 21276 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.292s	user 0.000s	sys 0.000s
W20260709 12:23:51.428399 21273 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:23:51.428985 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2089) took 2067 ms. Trace:
I20260709 12:23:51.347823 18771 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:23:51.429711 21220 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.971s	user 0.004s	sys 0.017s
I20260709 12:23:51.430495 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:51.431614 18771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:51.432224 18771 raft_consensus.cc:606] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:51.432600 18771 raft_consensus.cc:614] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:51.432935 18922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1623) took 1779 ms (client timeout 1919 ms). Trace:
W20260709 12:23:51.433343 18922 rpcz_store.cc:269] 0709 12:23:49.653366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.653498 (+   132us) service_pool.cc:224] Handling call
0709 12:23:51.432717 (+1779219us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54000f5854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:51.432876 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157872000}
I20260709 12:23:51.333859 21267 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.357764 18846 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.429738 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1639) took 1684 ms. Trace:
I20260709 12:23:51.407722 21137 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:51.437331 21137 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:51.437908 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:51.439087 21275 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:23:51.439405 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.440937 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.441393 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.429754 18766 rpcz_store.cc:276] 0709 12:23:49.361535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.361651 (+   116us) service_pool.cc:224] Handling call
0709 12:23:49.612792 (+251141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.967793 (+355001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.427122 (+1459329us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54001c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:51.428586 (+  1464us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001c1e50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:51.428855 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094617728}
I20260709 12:23:51.275506 21176 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:51.314452 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 139849us
W20260709 12:23:51.354801 21269 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 12:23:51.461760 18843 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:51.405540 18847 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:51.407689 21252 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:51.417742 21285 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:23:51.392467 21261 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:51.412137 21240 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 12:23:51.252157 21013 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.399282 21103 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:51.418840 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:51.419608 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.419282 21236 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.334576 19485 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:51.310789 21133 consensus_queue.cc:1243] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:23:51.435964 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.487036 18841 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:51.487478 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.488306 18846 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:51.489449 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:51.221109 21255 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.435446 18915 rpcz_store.cc:276] 0709 12:23:49.745787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.080602 (+334815us) service_pool.cc:224] Handling call
0709 12:23:50.081358 (+   756us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:50.399481 (+318123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.399516 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:50.428004 (+ 28488us) log.cc:844] Serialized 52 byte log entry
0709 12:23:50.985545 (+557541us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:50.985609 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.985711 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.429489 (+443778us) raft_consensus.cc:1685] finished
0709 12:23:51.429509 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.429667 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":514417,"spinlock_wait_cycles":55078272,"thread_start_us":657580,"threads_started":2,"wal-append.queue_time_us":679895}
I20260709 12:23:51.232102 21263 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:51.399331 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.441717 18848 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:51.317129 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:51.491444 18920 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:51.445259 21142 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.441071 21109 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:23:51.450255 20967 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:23:51.452584 21284 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:23:51.457162 20823 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.614s	user 0.011s	sys 0.000s
I20260709 12:23:51.024384 19488 rpcz_store.cc:276] 0709 12:23:49.580997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.611765 (+ 30768us) service_pool.cc:224] Handling call
0709 12:23:49.718472 (+106707us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:49.780852 (+ 62380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.789178 (+  8326us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:49.993617 (+204439us) log.cc:844] Serialized 52 byte log entry
0709 12:23:50.595245 (+601628us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:50.680322 (+ 85077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.791898 (+111576us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.930483 (+138585us) raft_consensus.cc:1685] finished
0709 12:23:50.930506 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.930680 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1249,"raft.queue_time_us":39456,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":34292,"thread_start_us":438309,"threads_started":1,"wal-append.queue_time_us":891153}
I20260709 12:23:51.525625 21237 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.479811 21103 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:51.401696 21141 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.433s	user 0.006s	sys 0.007s
I20260709 12:23:51.329897 20862 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.476109 19458 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:51.418993 21274 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:23:51.358309 20883 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.480266 18919 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:51.422247 21253 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.446586 18917 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:51.274890 21280 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.212s
I20260709 12:23:51.456871 21068 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.470005 21110 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.508432 20967 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:51.522771 21230 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:51.522926 21198 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:51.467438 21267 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.474506 21251 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.527227 21278 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:51.469214 21162 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:23:51.439652 21137 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.542491 21236 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:51.572456 21245 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:51.558221 20883 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.558820 21226 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.484246 21176 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:23:51.550994 21132 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.560225 20820 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:51.444799 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.703977 20820 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:51.704962 21040 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.706086 21040 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.644786 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:51.456851 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:51.647548 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:51.647209 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.516433 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.512929 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.765319 18848 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:23:51.766619 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 122419us
W20260709 12:23:51.649008 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 178212us
I20260709 12:23:51.480329 18842 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:51.481179 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:51.534142 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 130740us
I20260709 12:23:51.500620 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.464412 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.531765 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:51.781333 21040 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.782639 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:51.784364 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:51.535805 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 357) took 1615 ms. Trace:
I20260709 12:23:51.655284 18922 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:23:51.655578 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:51.786372 18919 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:51.706156 20820 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.787547 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:51.788017 21107 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:51.658775 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:51.659193 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:51.788594 21107 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:51.789662 18915 raft_consensus.cc:2410] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:23:51.789973 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 144232us
I20260709 12:23:51.770982 21251 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:51.791010 18764 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:51.791144 21251 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.791342 21109 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:51.791831 21251 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.791937 21109 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:51.792699 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.550765 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 491) took 3135 ms. Trace:
W20260709 12:23:51.794059 21302 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 12:23:51.793717 19487 rpcz_store.cc:276] 0709 12:23:48.415302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.447987 (+ 32685us) service_pool.cc:224] Handling call
0709 12:23:48.448275 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.461319 (+1013044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.545618 (+2084299us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54005c0dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:51.550683 (+  5065us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058797440}
I20260709 12:23:51.796053 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:51.549206 21021 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.452s	user 0.014s	sys 0.001s
I20260709 12:23:51.797358 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:51.540624 21103 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:51.563108 21110 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.809010 21110 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.809245 21100 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:51.785717 18922 pending_rounds.cc:85] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 6
I20260709 12:23:51.767284 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.571696 21169 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.527561 21261 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:23:51.810882 18766 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.812111 21098 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:51.813119 21261 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.593235 21263 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.576644 21278 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.558327 20862 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.790172 21107 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.815909 21107 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.817516 21278 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:51.689968 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.531306 20823 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.818617 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:51.820796 20823 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:51.821206 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:51.695245 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:51.821768 21182 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.822151 19492 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:51.595336 21231 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.696552 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:51.823086 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.823951 19486 raft_consensus.cc:2368] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6.
I20260709 12:23:51.824126 20899 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:23:51.696309 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1770) took 2553 ms (client timeout 2191 ms). Trace:
I20260709 12:23:51.697757 21198 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:51.825196 18839 rpcz_store.cc:269] 0709 12:23:49.142518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.142646 (+   128us) service_pool.cc:224] Handling call
0709 12:23:51.695676 (+2553030us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400238554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:51.695990 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119244544}
I20260709 12:23:51.824532 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.644055 18765 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.696828 20987 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.698132 21226 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:51.827327 21226 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.694051 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.769430 18844 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:51.677330 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 555) took 1911 ms. Trace:
W20260709 12:23:51.543712 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 67711.1us
I20260709 12:23:51.548841 21141 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.785686 18921 rpcz_store.cc:276] 0709 12:23:49.920756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.093506 (+172750us) service_pool.cc:224] Handling call
0709 12:23:50.093802 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:50.094121 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.094150 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:50.100081 (+  5931us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.567222 (+467141us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:50.567259 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.567324 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.535505 (+968181us) raft_consensus.cc:1685] finished
0709 12:23:51.535537 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.535721 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":502205,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":67702,"thread_start_us":466558,"threads_started":1,"wal-append.queue_time_us":896267}
I20260709 12:23:51.793646 21109 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.813777 21261 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.810667 18922 pending_rounds.cc:107] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:23:51.810913 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:51.692260 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.824841 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.825614 21198 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.693989 21068 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:51.780405 18772 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:51.801345 18920 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:51.788415 18919 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:51.836943 19491 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:23:51.843708 21241 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:51.824564 20899 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.838937 18845 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:51.847224 18917 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:51.772995 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:51.838667 18771 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:23:51.851368 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:51.852975 18922 raft_consensus.cc:2889] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:51.851337 20899 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:51.843600 21040 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:51.869123 21040 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.869720 21198 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.871486 21040 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.847900 21021 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:23:51.846797 20987 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:51.873694 20987 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:51.874950 20987 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:51.879408 21110 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:51.880362 18773 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.868408 19486 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:51.848071 21012 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.840301 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.891634 18764 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:23:51.878129 18886 connection.cc:256] RPC call timeout handler was delayed by -2.1122431450003205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 12:23:51.849860 21226 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.900360 21261 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:51.900988 21141 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:51.901836 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.851333 21241 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.905354 21241 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:51.906015 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:51.910987 18920 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:51.920715 18766 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:51.922770 18765 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:51.924420 21261 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:51.924906 21261 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.924961 21252 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:51.925431 21261 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.929806 20909 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.933813 21132 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:51.833837 19483 rpcz_store.cc:276] 0709 12:23:49.654498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.663026 (+  8528us) service_pool.cc:224] Handling call
0709 12:23:50.928756 (+1265730us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b5800106598. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:50.928999 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.272483 (+343484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.547553 (+275070us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54006ffc54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:51.564514 (+ 16961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643963008}
I20260709 12:23:51.915376 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:51.913305 21109 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.941357 18843 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:23:51.940209 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 106889us
I20260709 12:23:51.940623 21012 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:51.945550 21012 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:51.953969 18886 connection.cc:256] RPC call timeout handler was delayed by -1.986807348000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:23:51.968804 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:51.989253 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:51.996953 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:51.998071 19487 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:51.998872 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:51.999995 20899 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.000700 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:52.001592 18919 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:52.021595 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:52.026140 18773 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:52.039027 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:52.046257 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70170.2us
I20260709 12:23:52.055853 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:52.057341 19487 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:23:52.058408 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.062058 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.002496 21012 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.991894 21132 consensus_queue.cc:1243] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:23:52.068001 18738 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.734s (SENT)
W20260709 12:23:52.069710 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 174364us
I20260709 12:23:52.071345 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:52.079612 18738 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.736s (SENT)
I20260709 12:23:52.082517 18920 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.083737 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:52.083889 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.084741 18841 raft_consensus.cc:2376] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5. Re-sending same reply.
I20260709 12:23:52.086100 21226 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:52.085889 21012 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.086545 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.086743 21226 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.087275 21226 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.087826 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:52.088419 21012 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.089087 21012 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.089247 18919 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
W20260709 12:23:52.089352 18738 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.766s (SENT)
W20260709 12:23:52.092131 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 54059.4us
I20260709 12:23:52.094903 21292 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:52.096596 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:52.095083 18738 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.767s (SENT)
I20260709 12:23:52.098134 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:52.099164 19490 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:23:52.102046 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 492) took 3661 ms. Trace:
W20260709 12:23:52.102525 21304 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:52.108608 21038 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.116892 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.117247 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.118577 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.118731 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.118940 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.119544 18844 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 2.
I20260709 12:23:52.120024 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.120714 18842 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:52.119539 18839 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:52.118124 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.124383 18846 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:23:52.126848 21238 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.110s	user 0.008s	sys 0.013s
I20260709 12:23:52.127558 21238 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.129319 18767 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:52.118139 18848 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:23:52.132208 21261 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.098136 21292 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.138243 21251 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.139555 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:52.076460 20899 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.142474 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.078037 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:52.144311 21180 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:52.139667 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:52.102586 19489 rpcz_store.cc:276] 0709 12:23:48.441414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.451443 (+ 10029us) service_pool.cc:224] Handling call
0709 12:23:48.451747 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.007001 (+2555254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.101489 (+1094488us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b5400555fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:52.101833 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5684634368}
I20260709 12:23:52.150029 21292 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:52.077493 21103 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.156365 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:52.169898 20820 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:52.170248 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.170518 20987 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.171079 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.171154 21180 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.172323 21133 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:52.188261 18841 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:52.130288 21238 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.182425 20820 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:52.190434 21132 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:52.192373 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1459) took 1213 ms. Trace:
I20260709 12:23:52.200397 20961 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:23:52.196971 18772 rpcz_store.cc:276] 0709 12:23:50.973109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.132079 (+158970us) service_pool.cc:224] Handling call
0709 12:23:52.174533 (+1042454us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540002e254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:52.186896 (+ 12363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177821952}
I20260709 12:23:52.202575 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.203487 18772 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:52.204882 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.206560 20987 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.206733 20899 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:52.209344 20987 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.210534 19483 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:52.211825 21103 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.214951 18845 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:52.206229 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.196568 20820 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.216831 21132 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.222373 21109 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:52.261508 21261 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:52.262326 18770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2080) took 4246 ms (client timeout 1831 ms). Trace:
W20260709 12:23:52.262952 18770 rpcz_store.cc:269] 0709 12:23:48.015561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.077027 (+ 61466us) service_pool.cc:224] Handling call
0709 12:23:52.261771 (+4184744us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540002e754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:52.262017 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2974299904}
I20260709 12:23:52.264446 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.268580 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.235461 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:52.244649 21132 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:52.283113 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.286753 21292 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.287604 21238 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:52.290359 21180 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:52.293983 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:23:52.295455 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60094.5us
I20260709 12:23:52.296303 21261 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.307456 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.334970 18839 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:52.307984 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.308111 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.254652 21109 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:52.323237 21103 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.323680 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.324522 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1451) took 1357 ms. Trace:
I20260709 12:23:52.325680 21251 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.326825 21226 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.328619 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.329033 18772 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:52.339471 18767 rpcz_store.cc:276] 0709 12:23:50.967057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.967547 (+   490us) service_pool.cc:224] Handling call
0709 12:23:52.324221 (+1356674us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400179dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:52.324449 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285201280}
I20260709 12:23:52.344408 18920 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:52.346103 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.355115 18843 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:52.361202 21292 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.368067 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.377907 18767 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:52.385221 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:52.387763 18770 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:52.387977 18842 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:52.367303 21238 consensus_queue.cc:1243] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:52.394583 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:52.394799 21262 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.316s	user 0.000s	sys 0.004s
I20260709 12:23:52.397926 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.398633 18844 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:52.399147 18841 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:52.399775 21226 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.401571 18847 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:52.401772 21264 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:52.382692 21103 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.403182 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.404488 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:52.422719 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.427161 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.428890 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.429190 18846 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:52.428905 18767 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:52.430732 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.434947 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.434863 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.454789 18839 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:52.455632 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.462163 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.466041 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.461498 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:52.472729 18767 raft_consensus.cc:2368] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:23:52.472586 18841 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.472649 18921 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:52.460619 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:52.481463 18920 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:52.438014 21109 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.482438 18845 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:52.538585 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1455) took 1567 ms. Trace:
I20260709 12:23:52.539100 18768 rpcz_store.cc:276] 0709 12:23:50.970761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.970974 (+   213us) service_pool.cc:224] Handling call
0709 12:23:50.971432 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.020375 (+ 48943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.020408 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.027199 (+  6791us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.250805 (+223606us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:51.313761 (+ 62956us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.314100 (+   339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.537815 (+1223715us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:52.537887 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.537958 (+    71us) raft_consensus.cc:1685] finished
0709 12:23:52.538055 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.538266 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4672,"prepare.queue_time_us":62827,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":15905,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":11168,"spinlock_wait_cycles":104519296,"thread_start_us":256111,"threads_started":2,"wal-append.queue_time_us":222310}
I20260709 12:23:52.541710 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:52.545135 21268 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:52.514506 20909 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.008s
I20260709 12:23:52.546281 18764 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:52.488843 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.512270 18847 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:52.511956 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:52.482875 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:52.554558 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.487612 18843 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.555513 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.555652 18766 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:52.508910 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1632) took 2841 ms. Trace:
I20260709 12:23:52.557250 18846 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:23:52.559149 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1453) took 1590 ms. Trace:
W20260709 12:23:52.559530 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 133738us
I20260709 12:23:52.559615 18765 rpcz_store.cc:276] 0709 12:23:50.968588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.968819 (+   231us) service_pool.cc:224] Handling call
0709 12:23:52.546941 (+1578122us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54000af0d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:52.559068 (+ 12127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891879808}
I20260709 12:23:52.560995 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:52.561004 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.564426 21251 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.569133 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.569928 18767 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:52.571069 20820 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.571926 21251 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:52.572638 21251 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.573920 20820 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.509927 21046 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.574839 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 353) took 3087 ms. Trace:
I20260709 12:23:52.512677 19483 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:52.575975 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.576763 18842 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 3.
I20260709 12:23:52.576931 21103 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.577893 21109 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.577749 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.564489 18765 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:52.569190 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 361) took 1622 ms. Trace:
I20260709 12:23:52.556555 18772 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:52.580435 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:52.594385 18847 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
W20260709 12:23:52.596413 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 174177us
I20260709 12:23:52.601456 18843 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:52.604610 18841 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:52.604748 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:52.570993 21141 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:52.607671 21141 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:52.607849 18767 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:52.610031 18767 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:52.610769 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1470) took 1152 ms. Trace:
I20260709 12:23:52.611181 18767 rpcz_store.cc:276] 0709 12:23:51.458595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.609397 (+1150802us) service_pool.cc:224] Handling call
0709 12:23:52.609829 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.610480 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.610673 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:52.611996 21251 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.612587 18767 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:52.613598 18848 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:52.615206 18848 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:52.496186 21264 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.618613 21295 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:52.619318 21295 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:52.620544 18766 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:23:52.620500 21295 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.581477 18916 rpcz_store.cc:276] 0709 12:23:50.946864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.423684 (+476820us) service_pool.cc:224] Handling call
0709 12:23:51.424043 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.650997 (+226954us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:51.651056 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.653031 (+  1975us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.682343 (+ 29312us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:51.682385 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.568633 (+886248us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400032fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:52.568678 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.568724 (+    46us) raft_consensus.cc:1685] finished
0709 12:23:52.568735 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.569003 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118712,"raft.queue_time_us":152746,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":273,"spinlock_wait_cycles":246479360,"thread_start_us":28584,"threads_started":1,"wal-append.queue_time_us":29221}
I20260709 12:23:52.622243 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:52.557776 18918 rpcz_store.cc:276] 0709 12:23:49.667807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.720660 (+ 52853us) service_pool.cc:224] Handling call
0709 12:23:49.725517 (+  4857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.824323 (+ 98806us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:50.595376 (+771053us) log.cc:844] Serialized 14 byte log entry
0709 12:23:50.840379 (+245003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.840452 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:50.840500 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.508295 (+1667795us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b54000320d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:52.508390 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.508639 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":190505,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":6008,"raft.queue_time_us":8497,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":14919,"spinlock_wait_cycles":226608512,"thread_start_us":968549,"threads_started":2,"wal-append.queue_time_us":535486}
I20260709 12:23:52.625214 18768 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:52.625649 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:52.626108 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:52.618618 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56245.9us
I20260709 12:23:52.633710 18839 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:52.629662 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:52.634595 18768 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:52.634913 18846 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.627025 18921 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:52.635020 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1468) took 1175 ms. Trace:
I20260709 12:23:52.575305 18913 rpcz_store.cc:276] 0709 12:23:49.488068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.488999 (+   931us) service_pool.cc:224] Handling call
0709 12:23:49.489648 (+   649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.638656 (+149008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.638724 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.668529 (+ 29805us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.566149 (+897620us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:50.566190 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.566263 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.327771 (+1761508us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:52.551139 (+223368us) raft_consensus.cc:1685] finished
0709 12:23:52.551162 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.574658 (+ 23496us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36743,"raft.queue_time_us":150115,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":40026,"spinlock_wait_cycles":9028352,"thread_start_us":953300,"threads_started":2,"wal-append.queue_time_us":1339514}
I20260709 12:23:52.622215 21264 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.635910 18766 rpcz_store.cc:276] 0709 12:23:51.450010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.605189 (+1155179us) service_pool.cc:224] Handling call
0709 12:23:52.620195 (+ 15006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.624854 (+  4659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.625100 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:52.639077 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:52.640303 18919 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:52.641397 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:52.642000 18916 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.650224 21110 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:52.650996 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:52.651046 21110 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.653622 21110 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.654719 21261 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:52.655351 21261 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.655848 21261 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.654222 21110 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:52.657238 21110 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.658578 21110 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.664408 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:52.664220 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:52.666203 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:52.677870 18840 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 3 to 7, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:52.680289 18768 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:23:52.703634 18913 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:52.636818 21292 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:52.773998 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.774537 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.775579 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 135351us
I20260709 12:23:52.777242 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:52.778082 20909 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.782383 18916 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:52.784273 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 393) took 1059 ms. Trace:
I20260709 12:23:52.784819 18768 rpcz_store.cc:276] 0709 12:23:51.705972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.637549 (+931577us) service_pool.cc:224] Handling call
0709 12:23:52.679942 (+ 42393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.765437 (+ 85495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.765740 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:52.702703 21282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.012s	sys 0.012s
W20260709 12:23:52.712833 21318 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.247s	user 0.000s	sys 0.002s
I20260709 12:23:52.693329 20899 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:52.714457 20961 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:52.695518 21103 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:52.798547 21282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.013s	sys 0.013s
I20260709 12:23:52.802953 20909 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:52.812750 18766 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:52.814706 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:52.817306 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 395) took 1049 ms. Trace:
I20260709 12:23:52.817766 18766 rpcz_store.cc:276] 0709 12:23:51.778978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.639221 (+860243us) service_pool.cc:224] Handling call
0709 12:23:52.796325 (+157104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.813387 (+ 17062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.813692 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:52.803159 20899 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.807790 20961 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.845371 18846 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:52.798261 21292 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.779959 21132 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.811162 21103 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:52.853564 18887 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.578s (SENT)
I20260709 12:23:52.833482 20899 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.856106 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:52.862946 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 559) took 1054 ms. Trace:
I20260709 12:23:52.860251 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:52.865418 21261 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.867666 21264 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.869575 21261 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:52.869802 18766 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:52.871515 18766 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:52.872927 18766 pending_rounds.cc:85] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 1
I20260709 12:23:52.873200 18766 pending_rounds.cc:107] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:23:52.873430 18766 raft_consensus.cc:2889] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:52.835049 20961 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:52.874503 21256 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.875092 21256 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.877434 21256 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.865415 21013 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.863416 19486 rpcz_store.cc:276] 0709 12:23:51.808198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.824482 (+ 16284us) service_pool.cc:224] Handling call
0709 12:23:52.862741 (+1038259us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b540021cfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:52.862878 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28378880}
I20260709 12:23:52.861150 21103 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.850868 20909 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.711249 21141 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:52.900493 21264 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.901192 21264 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.903903 21251 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.905985 21264 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:52.906656 21141 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:52.914796 21256 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:52.918856 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 62806.1us
I20260709 12:23:52.919245 21256 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.920073 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:52.921780 21256 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:52.922374 21251 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.886381 20909 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:52.922299 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:52.948304 20909 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:52.914978 21110 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.951303 21292 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:52.984344 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:52.969492 20909 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.954932 20899 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:52.954653 20961 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:52.993280 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 348841us
I20260709 12:23:52.981787 21109 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:52.985903 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 287173us
I20260709 12:23:52.993360 20876 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:23:52.999328 20961 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.001638 21229 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:53.003507 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1631) took 3343 ms. Trace:
I20260709 12:23:53.003969 18914 rpcz_store.cc:276] 0709 12:23:49.659941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.701358 (+ 41417us) service_pool.cc:224] Handling call
0709 12:23:49.715048 (+ 13690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.715289 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:49.842089 (+126800us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.002685 (+3160596us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b1800038f80. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287
0709 12:23:53.002869 (+   184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:53.002959 (+    90us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:53.003034 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.003143 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.003322 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27948,"prepare.queue_time_us":160805,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":487916,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":23662,"spinlock_wait_cycles":2659712,"thread_start_us":789657,"threads_started":3,"wal-append.queue_time_us":555158,"wal-append.run_cpu_time_us":2612,"wal-append.run_wall_time_us":1673029}
I20260709 12:23:52.991220 21251 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:52.990897 20909 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.988771 21292 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.016983 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1465) took 1573 ms. Trace:
I20260709 12:23:53.012691 21251 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.033514 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:53.040913 18839 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:23:53.041512 18839 pending_rounds.cc:85] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 2
I20260709 12:23:53.041822 18839 pending_rounds.cc:107] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:23:53.042136 18839 raft_consensus.cc:2889] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:53.020215 18770 rpcz_store.cc:276] 0709 12:23:51.443499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.605100 (+1161601us) service_pool.cc:224] Handling call
0709 12:23:52.619461 (+ 14361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.622852 (+  3391us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:52.623234 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.016484 (+393250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:53.016559 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:53.016635 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.016723 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.016904 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":3110,"thread_start_us":389705,"threads_started":1}
I20260709 12:23:53.007012 21109 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:53.046702 18914 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:53.046557 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:53.047778 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:53.048730 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:53.055361 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:53.037689 21251 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:53.023411 21292 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.076112 18769 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:23:53.079417 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:53.055528 18848 raft_consensus.cc:2376] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5. Re-sending same reply.
I20260709 12:23:53.042971 21132 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:53.086824 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.087152 20961 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.090615 18842 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
W20260709 12:23:53.092147 21323 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:53.093132 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:53.097554 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:53.101727 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:53.112015 18844 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.103454 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:53.104116 21292 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:53.107177 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:53.121503 18839 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.124226 18845 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:53.120767 18914 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:23:53.126605 18887 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.812s (SENT)
I20260709 12:23:53.128085 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:53.134685 18918 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 3: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:53.133579 19485 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:53.136411 18846 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:53.138307 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.132978 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:53.139447 18769 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:53.146836 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:53.119922 21282 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:53.151098 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:53.145632 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52576.9us
I20260709 12:23:53.152137 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:53.158492 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:53.159226 18918 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:53.160141 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:53.160972 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:53.162140 21282 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.168663 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1464) took 1725 ms. Trace:
I20260709 12:23:53.168975 21282 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.170166 20975 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.170428 21264 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:53.170600 21256 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:53.171047 21256 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.170199 18886 leader_election.cc:400] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:23:53.171468 21256 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:53.171639 18886 leader_election.cc:403] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:53.172462 21264 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.162513 21229 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:53.169126 18772 rpcz_store.cc:276] 0709 12:23:51.442838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.595256 (+1152418us) service_pool.cc:224] Handling call
0709 12:23:52.649673 (+ 54417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.701723 (+ 52050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.701768 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.772095 (+ 70327us) log.cc:844] Serialized 26 byte log entry
0709 12:23:53.044156 (+272061us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:53.045879 (+  1723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.045971 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.168393 (+122422us) raft_consensus.cc:1685] finished
0709 12:23:53.168416 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.168565 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":247264,"threads_started":1,"wal-append.queue_time_us":363753}
I20260709 12:23:53.174289 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:53.119753 20961 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.184935 18918 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:53.142374 21110 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.185503 18848 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:53.157505 21292 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:53.207422 21292 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.207911 21292 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.153209 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:53.211148 19483 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:53.191008 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:53.212441 18914 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:23:53.192384 21327 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:23:53.213372 19457 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.740s (SENT)
I20260709 12:23:53.214520 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1467) took 1765 ms. Trace:
I20260709 12:23:53.214959 18765 rpcz_store.cc:276] 0709 12:23:51.449389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.600497 (+1151108us) service_pool.cc:224] Handling call
0709 12:23:52.616162 (+ 15665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.616818 (+   656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.616860 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.617546 (+   686us) log.cc:844] Serialized 26 byte log entry
0709 12:23:52.970926 (+353380us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:52.970976 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.971053 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.214150 (+243097us) raft_consensus.cc:1685] finished
0709 12:23:53.214174 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.214328 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":632,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":132,"thread_start_us":352826,"threads_started":1,"wal-append.queue_time_us":443863}
I20260709 12:23:53.176195 21109 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:53.217777 18848 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:53.219344 21230 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:53.220068 21230 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:53.199854 21103 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.222450 21103 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.200420 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:53.223202 19484 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:53.176203 21229 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:53.227905 21229 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.202631 20961 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.259900 18770 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:53.222137 21230 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.233960 20909 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.468523 18839 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:53.468392 18846 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:23:53.384385 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:53.453325 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:53.383155 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:53.487457 18772 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
W20260709 12:23:53.488179 19457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.549s (SENT) [suppressed 43 similar messages]
W20260709 12:23:53.490249 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 363686us
I20260709 12:23:53.490015 21282 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:23:53.497318 20909 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.498893 21282 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.501566 21282 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:53.471477 19484 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:23:53.498921 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:53.504438 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 377) took 1074 ms. Trace:
I20260709 12:23:53.486104 21230 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:53.504894 18841 rpcz_store.cc:276] 0709 12:23:52.429666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.605679 (+176013us) service_pool.cc:224] Handling call
0709 12:23:52.637456 (+ 31777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.049566 (+412110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.049597 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:53.087395 (+ 37798us) log.cc:844] Serialized 26 byte log entry
0709 12:23:53.149579 (+ 62184us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:53.149622 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.149690 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.504152 (+354462us) raft_consensus.cc:1685] finished
0709 12:23:53.504177 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.504362 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3085,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":405699,"threads_started":2,"wal-append.queue_time_us":366043}
I20260709 12:23:53.506671 18844 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:53.506621 21230 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:53.506811 18843 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:53.508176 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:53.509068 21230 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.357784 21268 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:53.323895 21103 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.509702 21268 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:53.510142 21268 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.510174 21103 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.512244 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1651) took 1156 ms. Trace:
I20260709 12:23:53.512696 18921 rpcz_store.cc:276] 0709 12:23:52.355781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.697884 (+342103us) service_pool.cc:224] Handling call
0709 12:23:52.698233 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.793691 (+ 95458us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:52.793740 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.851967 (+ 58227us) log.cc:844] Serialized 26 byte log entry
0709 12:23:53.136093 (+284126us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:53.136362 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.136427 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.512000 (+375573us) raft_consensus.cc:1685] finished
0709 12:23:53.512025 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.512177 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5864,"raft.queue_time_us":22990,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":12248,"thread_start_us":233655,"threads_started":1,"wal-append.queue_time_us":570439}
I20260709 12:23:53.354897 21256 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:53.516758 21256 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:23:53.517242 21264 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
I20260709 12:23:53.518424 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:53.531431 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.531883 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.532615 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 355599us
W20260709 12:23:53.533000 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50768.4us
I20260709 12:23:53.533849 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:53.535745 19487 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
W20260709 12:23:53.535941 18917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1842) took 2541 ms (client timeout 1696 ms). Trace:
W20260709 12:23:53.536330 18917 rpcz_store.cc:269] 0709 12:23:50.994711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.193921 (+199210us) service_pool.cc:224] Handling call
0709 12:23:53.528859 (+2334938us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54003e6554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:53.535859 (+  7000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311107328}
I20260709 12:23:53.536873 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 366) took 2006 ms. Trace:
I20260709 12:23:53.542549 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:53.543282 18917 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:23:53.567422 18915 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:53.567732 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:53.539561 18922 rpcz_store.cc:276] 0709 12:23:51.530417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.530545 (+   128us) service_pool.cc:224] Handling call
0709 12:23:51.545514 (+ 14969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.906674 (+361160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.530295 (+1623621us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400335c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:53.536813 (+  6518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249375616}
I20260709 12:23:53.539280 21021 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:53.572319 21021 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:53.573455 21021 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.582157 21021 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.574307 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1462) took 2565 ms. Trace:
W20260709 12:23:53.594044 18773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 392) took 1888 ms (client timeout 1976 ms). Trace:
I20260709 12:23:53.525528 21282 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:53.595412 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62028.6us
I20260709 12:23:53.583201 18771 rpcz_store.cc:276] 0709 12:23:50.974082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.434277 (+460195us) service_pool.cc:224] Handling call
0709 12:23:51.441788 (+  7511us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:51.892720 (+450932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.525257 (+1632537us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540017a2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:53.539884 (+ 14627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911362304}
I20260709 12:23:53.595723 18768 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:53.599893 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:53.595752 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:53.594709 18773 rpcz_store.cc:269] 0709 12:23:51.705487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.850907 (+145420us) service_pool.cc:224] Handling call
0709 12:23:53.593847 (+1742940us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b54001793d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:53.593976 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37290752}
I20260709 12:23:53.600613 18844 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.602233 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:53.602983 18846 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:23:53.604575 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.539449 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:53.575141 21344 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.621438 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:53.622038 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:53.622687 18921 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:53.616956 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:53.623690 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.626372 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:53.596325 21295 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:53.601835 21264 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:53.599534 20961 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.644313 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1471) took 2178 ms. Trace:
W20260709 12:23:53.644703 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.582041 21229 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.644735 18764 rpcz_store.cc:276] 0709 12:23:51.466174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.924195 (+458021us) service_pool.cc:224] Handling call
0709 12:23:53.644133 (+1719938us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54002107d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:53.644246 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278240128}
I20260709 12:23:53.649592 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:53.652937 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:53.654356 18773 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.653716 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:53.659359 18769 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:53.643628 21264 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:53.665825 18844 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:53.670244 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:53.639532 21103 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.671499 18764 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:53.668227 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:53.676045 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 104501us
I20260709 12:23:53.677827 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:53.620962 21292 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.683665 18918 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:53.640267 21344 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:53.670296 21264 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.692958 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:53.652878 20961 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:53.692961 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:53.708737 18769 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:23:53.695883 19456 connection.cc:256] RPC call timeout handler was delayed by -1.9976323459995911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 12:23:53.714359 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2115) took 1314 ms. Trace:
I20260709 12:23:53.713967 18764 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.719769 18770 rpcz_store.cc:276] 0709 12:23:52.400286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.061110 (+660824us) service_pool.cc:224] Handling call
0709 12:23:53.075973 (+ 14863us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.260566 (+184593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.714074 (+453508us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:53.714294 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391220096}
W20260709 12:23:53.719043 19456 connection.cc:256] RPC call timeout handler was delayed by -1.7087323459995787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
I20260709 12:23:53.715061 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:53.721360 19456 connection.cc:256] RPC call timeout handler was delayed by -1.1413474589999169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 12:23:53.651304 21295 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:53.692446 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:53.740195 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:53.741235 19490 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:23:53.750283 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 133672us
W20260709 12:23:53.836364 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 103388us
I20260709 12:23:53.857388 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2099) took 1732 ms. Trace:
I20260709 12:23:53.859380 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 370) took 1862 ms. Trace:
I20260709 12:23:53.858059 18768 rpcz_store.cc:276] 0709 12:23:52.124722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.799290 (+674568us) service_pool.cc:224] Handling call
0709 12:23:53.595464 (+796174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.600156 (+  4692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.857115 (+256959us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54001793d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:53.857297 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828403072}
I20260709 12:23:53.859975 18915 rpcz_store.cc:276] 0709 12:23:51.997212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.001347 (+  4135us) service_pool.cc:224] Handling call
0709 12:23:53.567233 (+1565886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.567952 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.859078 (+291126us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54003e6550. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:53.859284 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3535063936}
I20260709 12:23:53.877642 20967 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:53.878372 21345 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:53.878942 20967 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:53.884452 21343 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:23:53.888374 20975 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.889320 20975 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:53.890763 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 233366us
I20260709 12:23:53.891631 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:53.892578 18767 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:53.893641 21180 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:53.894382 21180 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:53.895627 21180 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.897680 21068 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:53.898605 21182 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:53.899441 21256 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.901098 21259 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:53.907089 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:53.869854 21329 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:54.051383 21329 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:54.052444 21329 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:53.981041 18764 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:23:53.960464 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 123167us
I20260709 12:23:54.055315 21227 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.055825 21227 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:54.056216 21227 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.057021 21348 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:53.915603 21141 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.058976 21141 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.061416 21292 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:53.917271 21344 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:54.065335 21295 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:54.066262 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:54.067472 19484 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:54.069160 19484 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:54.073024 21229 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:54.073740 21229 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:54.074086 21229 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:53.875295 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:23:54.075928 18772 raft_consensus.cc:606] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:54.076292 18772 raft_consensus.cc:614] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:53.942288 18773 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:23:54.008225 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.025235 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.014058 20975 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:53.870685 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:54.045733 18921 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:23:53.929428 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 232762us
W20260709 12:23:54.131290 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.869475 19488 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:23:54.112782 21251 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.028s	user 0.008s	sys 0.003s
I20260709 12:23:54.143618 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:54.146091 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:23:54.150223 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 249351us
I20260709 12:23:54.152714 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:54.153646 19486 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:54.156647 19492 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:54.162086 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 389) took 2457 ms. Trace:
I20260709 12:23:54.162672 18767 rpcz_store.cc:276] 0709 12:23:51.704218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.613470 (+909252us) service_pool.cc:224] Handling call
0709 12:23:52.613786 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.893016 (+1279230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.161722 (+268706us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002a1554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:54.161995 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2940193152}
I20260709 12:23:54.122242 21256 consensus_queue.cc:1243] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:23:54.173708 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 99152.1us
W20260709 12:23:54.175561 19457 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.240s (SENT)
I20260709 12:23:54.197618 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:54.197916 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44354.3us
W20260709 12:23:54.211025 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 304068us
I20260709 12:23:54.212188 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:54.210841 21355 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:54.199297 21343 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.314s	user 0.000s	sys 0.008s
W20260709 12:23:54.232460 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56932us
I20260709 12:23:54.232962 20961 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:54.197211 21251 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.197973 19483 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:54.233953 21347 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:54.249303 20961 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:54.251494 20961 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:54.250262 21347 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:54.253060 21347 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:54.257370 21021 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.000s
I20260709 12:23:54.258350 19488 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:54.176071 21229 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.226086 21355 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:54.456152 21264 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.745s	user 0.005s	sys 0.005s
I20260709 12:23:54.229422 21182 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.297s
I20260709 12:23:54.526784 21355 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:54.366798 20967 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.260728 21268 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.001s
I20260709 12:23:54.529024 20967 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.388537 21346 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:54.530072 21346 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:54.443817 21251 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:54.392148 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:54.527384 21353 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:54.493768 21351 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:23:54.527518 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.277s (SENT)
I20260709 12:23:54.292897 18765 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:54.525744 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1834) took 1445 ms. Trace:
W20260709 12:23:54.404240 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 206712us
I20260709 12:23:54.288887 21282 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.529158 21268 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:54.553628 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 161635us
W20260709 12:23:54.541199 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 306162us
I20260709 12:23:54.552340 18840 rpcz_store.cc:276] 0709 12:23:53.080259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.200015 (+119756us) service_pool.cc:224] Handling call
0709 12:23:53.200488 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:53.200964 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.200996 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:53.201731 (+   735us) log.cc:844] Serialized 52 byte log entry
0709 12:23:53.470021 (+268290us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:53.526145 (+ 56124us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.530807 (+  4662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.530881 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.418795 (+887914us) raft_consensus.cc:1685] finished
0709 12:23:54.418821 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.525614 (+106793us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62351,"prepare.queue_time_us":21738,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":5998,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":246,"thread_start_us":267832,"threads_started":1,"wal-append.queue_time_us":325667}
I20260709 12:23:54.280345 21344 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:54.563150 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.563397 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:54.564181 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.564936 18921 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:54.355436 21345 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:54.532943 21353 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:54.552189 21351 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:54.567497 21256 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:23:54.575361 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.583657 18919 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 2.
I20260709 12:23:54.526917 21264 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.568005 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.560094 21182 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:54.578064 21229 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:54.601982 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:54.589077 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:54.590157 18842 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:23:54.602003 18917 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.521246 20961 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.590770 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:54.592392 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 64907.5us
I20260709 12:23:54.591540 18922 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:54.601372 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.608309 18921 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:23:54.558280 21282 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.558252 21227 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.636613 18839 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:54.568563 21344 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:54.562575 20967 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:54.603199 18845 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:54.615628 21353 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.649386 21068 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:23:54.616618 21352 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 12:23:54.617375 21362 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:54.617702 21351 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.657908 21230 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:54.659958 21230 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:54.593053 21345 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.531281 21346 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:54.620424 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.663122 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.623584 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.621865 21359 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:54.629981 20899 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:54.632570 21292 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:54.635283 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:54.635689 18919 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:54.604722 18913 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:54.650435 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 532) took 1026 ms. Trace:
I20260709 12:23:54.654049 21353 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.623215 21357 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.653789 21068 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:54.671367 21264 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:54.672194 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:54.737581 18917 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:54.655989 21182 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.677783 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.681805 19489 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:54.682241 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.691187 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.695650 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:54.696564 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.689386 19492 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:54.742693 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1859) took 1043 ms. Trace:
I20260709 12:23:54.743073 18916 rpcz_store.cc:276] 0709 12:23:53.699495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.677506 (+978011us) service_pool.cc:224] Handling call
0709 12:23:54.742622 (+ 65116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:54.744148 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 567) took 1218 ms. Trace:
I20260709 12:23:54.744585 19489 rpcz_store.cc:276] 0709 12:23:53.525632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.530328 (+  4696us) service_pool.cc:224] Handling call
0709 12:23:54.681411 (+1151083us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800106598. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:23:54.681617 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.743890 (+ 62273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.744088 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26838400}
I20260709 12:23:54.689072 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.675158 21292 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:54.691936 21255 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:54.677103 20899 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:54.687485 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.705088 21345 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:54.690469 21068 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.698858 21344 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.691011 21351 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:54.707090 18887 connection.cc:256] RPC call timeout handler was delayed by -1.5676135870003236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:23:54.772132 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.773618 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.676903 21346 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.691334 19483 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:54.675920 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:54.777149 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 101328us
I20260709 12:23:54.684485 21227 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:54.678000 19491 rpcz_store.cc:276] 0709 12:23:53.623778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.855099 (+231321us) service_pool.cc:224] Handling call
0709 12:23:54.140178 (+285079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.140381 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.140409 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:54.140451 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:54.140487 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.140541 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.650075 (+509534us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54004812d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:54.650295 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602393344}
W20260709 12:23:54.680333 21354 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:23:54.718772 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.680653 21357 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.704425 21230 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.721206 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.783665 18913 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:54.722856 21355 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.728785 18669 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 162) took 9895 ms. Trace:
I20260709 12:23:54.732327 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:54.734858 19487 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:54.657352 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:54.673969 21282 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:54.748668 21046 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:54.737380 21109 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.019s	sys 0.027s
I20260709 12:23:54.681741 21268 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:54.749238 18918 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:54.707756 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:54.742355 21182 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.779276 21255 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.781237 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:54.782207 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.748781 20909 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:54.792059 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:54.818478 18839 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:54.792550 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:54.782572 21021 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.019s	sys 0.030s
I20260709 12:23:54.789825 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:54.748736 20899 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:54.753089 21264 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:54.752686 18914 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:54.798659 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:54.798791 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.752409 21252 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:54.771438 21256 consensus_queue.cc:1243] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:23:54.808015 21109 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.020s	sys 0.027s
I20260709 12:23:54.803500 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:54.832582 18840 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:23:54.767851 19484 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:23:54.817083 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.789474 21348 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:54.841960 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.784914 20967 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.807899 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 237739us
W20260709 12:23:54.822213 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 258877us
I20260709 12:23:54.816664 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:54.830446 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.802614 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:54.821127 21021 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.019s	sys 0.031s
I20260709 12:23:54.852231 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:54.853518 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:54.854777 21141 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:54.855540 21141 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.859304 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1664) took 1257 ms. Trace:
I20260709 12:23:54.846241 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:54.802649 21251 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:54.861281 18765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 399) took 1235 ms (client timeout 1603 ms). Trace:
W20260709 12:23:54.861778 18765 rpcz_store.cc:269] 0709 12:23:53.625910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.626064 (+   154us) service_pool.cc:224] Handling call
0709 12:23:54.861048 (+1234984us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540002e254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:54.861211 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530029312}
I20260709 12:23:54.835386 19488 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:23:54.864177 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1485e54f9795416785f4baf244599201 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:54.865171 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.865520 21355 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:54.865635 21229 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:54.827221 20876 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:54.804904 21227 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.841640 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:54.819998 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 112318us
W20260709 12:23:54.795385 21259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.027s	sys 0.020s
I20260709 12:23:54.844904 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:54.797554 21345 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:23:54.842280 21348 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:54.882869 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:54.848721 21252 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.841425 21264 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.849663 20967 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.822822 21255 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.892836 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.851198 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:54.850921 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.859803 18917 rpcz_store.cc:276] 0709 12:23:53.603323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.603443 (+   120us) service_pool.cc:224] Handling call
0709 12:23:54.859102 (+1255659us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54000e4554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:54.859234 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253529984}
I20260709 12:23:54.894480 21255 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:54.894833 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:54.895251 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.895988 18917 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:54.896543 21369 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:54.896868 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.894215 20967 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:54.861045 21251 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.827356 21282 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:54.825538 21182 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:54.805025 21226 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:23:54.903429 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.866225 21229 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:54.877568 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:54.878947 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.909746 18919 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:54.823939 20899 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.882177 19486 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:54.818893 21046 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:54.889137 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 113520us
I20260709 12:23:54.889258 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:54.845379 21230 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:54.915696 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 117170us
I20260709 12:23:54.821615 21362 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:23:54.892921 21361 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.894294 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:54.851649 18913 raft_consensus.cc:2410] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:54.838244 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.828027 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:54.876530 21259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.028s	sys 0.021s
I20260709 12:23:54.898593 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:54.981859 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 83397.4us
W20260709 12:23:54.982854 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.982666 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.896111 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:54.866526 20876 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:54.887476 21295 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:23:54.830022 20909 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.887109 21348 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:54.819069 21292 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:54.899516 21355 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:54.897123 21369 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:54.974299 18738 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:54.974805 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:54.789935 18669 rpcz_store.cc:276] 0709 12:23:44.833456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.833935 (+   479us) service_pool.cc:224] Handling call
0709 12:23:54.728545 (+9894610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:48.403379 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:48.436962 (+ 33583us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:48.437010 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:23:48.437025 (+    15us) tablet.cc:662] Decoding operations
0709 12:23:48.519477 (+ 82452us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:48.519545 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:48.519581 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:48.520228 (+   647us) tablet.cc:701] Row locks acquired
0709 12:23:48.520246 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:48.520429 (+   183us) write_op.cc:270] Start()
0709 12:23:48.520570 (+   141us) write_op.cc:276] Timestamp: P: 1783599828520369 usec, L: 0
0709 12:23:48.520592 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:48.521440 (+   848us) log.cc:844] Serialized 2473 byte log entry
0709 12:23:49.034082 (+512642us) op_driver.cc:464] REPLICATION: finished
0709 12:23:49.593010 (+558928us) write_op.cc:301] APPLY: starting
0709 12:23:49.605727 (+ 12717us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:49.651194 (+ 45467us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:49.692244 (+ 41050us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:50.181787 (+489543us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:50.290661 (+108874us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:23:50.290741 (+    80us) write_op.cc:312] APPLY: finished
0709 12:23:50.291138 (+   397us) log.cc:844] Serialized 53 byte log entry
0709 12:23:50.836505 (+545367us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:50.867159 (+ 30654us) write_op.cc:454] Released schema lock
0709 12:23:50.874343 (+  7184us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:50.930151 (+ 55808us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:50.930184 (+    33us) write_op.cc:454] Released schema lock
0709 12:23:51.457912 (+527728us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8832a 00007f335af0df14 00007f335af0dec3 00007f335af0de38 00007f335af0ddf3 00007f335af0d0dc 00007f335af36e16 00007f335af1ecbb 00007f335af0939d 00007f335af0cd75
Metrics: {"mutex_wait_us":339429,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":452223,"apply.run_cpu_time_us":109832,"apply.run_wall_time_us":1331432,"num_ops":6,"prepare.queue_time_us":271260,"prepare.run_cpu_time_us":17159,"prepare.run_wall_time_us":517130,"raft.queue_time_us":14133,"raft.run_cpu_time_us":32788,"raft.run_wall_time_us":2554793,"replication_time_us":468032,"spinlock_wait_cycles":50767616,"thread_start_us":1340518,"threads_started":5,"wal-append.queue_time_us":1063882,"wal-append.run_cpu_time_us":5059,"wal-append.run_wall_time_us":2204898}]]}
I20260709 12:23:54.916029 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.921167 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:54.902897 21347 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:54.979439 18918 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:54.885268 21110 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:23:54.904946 21329 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.983366 18922 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:23:54.906638 21282 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:54.914149 21358 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.915169 21255 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:54.970548 21252 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:55.003850 21367 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:55.019326 18914 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:23:55.021189 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 148680us
I20260709 12:23:55.003568 20876 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:55.038064 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63402us
I20260709 12:23:55.038856 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:55.022843 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 133660us
I20260709 12:23:54.891819 21227 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.008579 21021 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:55.018190 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43966.7us
I20260709 12:23:55.009953 21371 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:55.034369 18887 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.579s (SENT)
I20260709 12:23:55.034837 18845 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:55.035791 20967 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:55.036545 21357 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:55.040975 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:55.042647 18922 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:55.045775 18914 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:55.025899 21256 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:55.055183 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:55.030536 21255 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.037128 21046 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:55.042819 21252 raft_consensus.cc:2764] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:55.069787 18918 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:23:55.091156 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56799.1us
I20260709 12:23:55.037092 21229 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.008796 21361 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.053247 21292 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.053431 21256 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:55.134927 21256 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.060855 21255 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.138639 21346 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:55.139357 21346 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:55.060039 21021 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:55.140726 21346 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.141142 21021 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.037647 21358 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.145152 21351 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:55.145706 21358 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:55.145875 21227 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:55.047871 21226 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:23:55.147229 21264 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:55.148963 21229 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.149410 21361 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:55.115883 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.116317 21372 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:55.116737 21376 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:55.109964 21268 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:55.075527 20967 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 12:23:55.119236 21378 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:23:55.056388 21371 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.125870 21109 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:23:55.126617 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.236124 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.126789 21251 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:55.126936 21369 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:55.032708 21329 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.111325 21046 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:55.241952 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 414029us
W20260709 12:23:55.216174 18887 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.597s (SENT)
I20260709 12:23:55.217697 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:23:55.238294 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.239535 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:55.245177 18921 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:55.243456 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:55.248342 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:55.242563 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:55.250301 18918 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:55.252604 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 355177us
W20260709 12:23:55.259778 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43661.6us
W20260709 12:23:55.260815 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.677s (SENT)
I20260709 12:23:55.261341 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:55.267199 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:55.271452 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.273451 18915 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.001s
I20260709 12:23:55.274297 18915 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:23:55.230113 21347 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:55.277330 18913 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:55.234946 21109 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:55.280969 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.266026 21362 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:23:55.299736 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 258862us
W20260709 12:23:55.302359 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 260289us
I20260709 12:23:55.315828 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:55.316401 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:55.303866 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:55.264063 21268 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:55.306514 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.263521 21141 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.308027 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:55.308511 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:55.268978 21264 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:23:55.299284 21378 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:23:55.311046 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 414984us
I20260709 12:23:55.339756 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:55.341043 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:55.341302 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:55.331647 21046 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:55.338590 21264 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:55.368930 21264 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.370415 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:55.370872 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:55.373054 21362 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:55.373947 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55530.9us
W20260709 12:23:55.359426 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 55640.7us
I20260709 12:23:55.374782 21374 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:55.375288 18812 leader_election.cc:400] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6.
I20260709 12:23:55.375687 18812 leader_election.cc:403] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:23:55.376415 21390 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6.
I20260709 12:23:55.377699 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:55.364816 21356 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:55.342739 21251 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:55.365217 21376 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:55.365672 21380 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.342326 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:55.293409 21353 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:23:55.364430 21369 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:55.297813 21180 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:23:55.431885 21329 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:55.433372 21359 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:55.433905 21359 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:55.435153 21359 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.378886 21109 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.439499 21109 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.381175 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:55.443161 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 62062us
I20260709 12:23:55.445262 20961 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:55.445729 20961 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.446098 20961 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.327486 18739 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:55.447453 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120050us
I20260709 12:23:55.448225 21141 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:55.449082 21141 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.451237 21371 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:55.323333 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:55.265604 21282 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.454768 20909 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:55.388696 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.380590 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:55.406888 21362 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:55.407997 21357 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:55.398931 21356 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:55.409417 20899 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.465912 20899 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:55.411608 21358 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:23:55.475016 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 94496.3us
I20260709 12:23:55.475287 21358 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:55.475886 21358 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:55.412348 21390 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:55.367193 21182 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:55.414537 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72264.2us
I20260709 12:23:55.416083 21046 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:55.420208 21251 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:55.421425 21376 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:55.497711 21046 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:55.451417 21369 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:55.400985 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:55.459549 20961 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.461957 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:55.467132 21353 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:55.411036 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:55.468534 21180 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:55.471311 21348 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.486413 18914 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:23:55.560556 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.488044 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:55.449524 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:55.562454 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 301662us
I20260709 12:23:55.387825 21367 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:55.421952 21380 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:55.572098 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 161125us
I20260709 12:23:55.499246 21068 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:55.505342 18917 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:55.493126 21379 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.452s	user 0.004s	sys 0.000s
I20260709 12:23:55.506628 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:55.551359 18913 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:55.557828 21252 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:55.556226 21353 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:55.551532 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 150635us
W20260709 12:23:55.575435 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.729s (SENT)
I20260709 12:23:55.507092 21361 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:55.575492 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 126068us
W20260709 12:23:55.578627 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 203875us
I20260709 12:23:55.477072 21358 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.504733 21141 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.594076 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:55.494225 20876 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.573956 21367 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:55.562214 21295 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:55.598793 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 92265.4us
I20260709 12:23:55.572984 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:55.560309 21180 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:23:55.582360 21259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.005s
W20260709 12:23:55.591782 21230 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 12:23:55.626196 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:55.599964 21252 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:55.626294 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 62898.3us
I20260709 12:23:55.623776 21229 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:55.571473 20899 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:23:55.651304 21387 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:55.651829 21387 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.652168 21387 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:55.619185 18887 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.797s (SENT)
W20260709 12:23:55.653899 18887 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.831s (SENT)
I20260709 12:23:55.654712 18670 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 5, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:55.656701 21292 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.000s
I20260709 12:23:55.657020 21386 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:55.657284 18887 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.916s (SENT)
I20260709 12:23:55.654765 21388 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
W20260709 12:23:55.646319 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73443us
I20260709 12:23:55.659194 21359 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.654803 21385 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:55.660312 21385 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:55.661408 21385 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.624687 21282 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:23:55.663592 21356 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.664723 21356 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.665444 20961 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:55.623793 21259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.006s	sys 0.005s
I20260709 12:23:55.666460 21389 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:55.598727 21361 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:55.651350 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:55.658354 18887 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.918s (SENT)
I20260709 12:23:55.672359 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:55.595383 21110 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:55.659633 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:55.695647 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.650620 21252 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:55.695765 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44597.3us
W20260709 12:23:55.712836 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 53284.1us
I20260709 12:23:55.713940 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:55.717119 18917 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:23:55.616156 21226 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:23:55.721850 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.611238 21141 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.725076 18913 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:55.720270 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:55.720956 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.725886 18916 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.624009 21369 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:23:55.721943 20967 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:55.733016 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1671) took 1170 ms. Trace:
I20260709 12:23:55.695176 21358 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:55.731993 21264 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.803777 21264 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:55.722360 18670 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 4, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 4 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.805186 18670 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 3, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.807324 18670 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 4, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 4 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.719476 21357 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.738444 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:55.774519 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 224810us
I20260709 12:23:55.717391 21292 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.797405 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:55.847295 19490 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:55.625855 21295 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.798403 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.797413 21390 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:55.801349 21405 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.738126 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.870586 18844 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:55.809206 18670 catalog_manager.cc:5697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.739101 18920 rpcz_store.cc:276] 0709 12:23:54.562301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.562462 (+   161us) service_pool.cc:224] Handling call
0709 12:23:54.583843 (+ 21381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.791372 (+207529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.791420 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.821002 (+ 29582us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.888186 (+ 67184us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:54.888246 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.888345 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.377701 (+489356us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:55.724017 (+346316us) raft_consensus.cc:1685] finished
0709 12:23:55.724040 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.732945 (+  8905us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136040,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"spinlock_wait_cycles":3700096,"thread_start_us":218702,"threads_started":2,"wal-append.queue_time_us":62953}
I20260709 12:23:55.839072 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:55.720046 21371 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:55.734163 21355 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
W20260709 12:23:55.843254 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 217135us
I20260709 12:23:55.855753 18839 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:55.899515 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:55.857136 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 198806us
W20260709 12:23:55.858202 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 239587us
I20260709 12:23:55.732952 20961 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:55.620208 21251 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.873629 18845 raft_consensus.cc:2368] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 2. Current term is 3.
W20260709 12:23:55.850646 21255 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.000s
W20260709 12:23:55.875337 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.883217 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:55.883515 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.919849 18843 raft_consensus.cc:2368] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:23:55.884011 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:55.607177 21376 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.670186 21046 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:55.860877 21390 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.716137 21329 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.134s
W20260709 12:23:55.901046 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.955s (SENT)
I20260709 12:23:55.934738 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:55.869786 21388 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.907418 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.911060 18670 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.888159 21370 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.917797 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:55.855696 21362 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:55.849912 21357 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.723798 21353 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.945180 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.943199 18916 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:55.915287 21355 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:55.951529 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.861246 21292 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.966499 19486 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:55.967720 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66723.5us
W20260709 12:23:55.971370 18887 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.986s (SENT)
I20260709 12:23:55.954440 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:55.966892 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.973387 18839 raft_consensus.cc:2368] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:23:55.973690 18845 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:55.936551 19488 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:55.991321 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 91901.7us
I20260709 12:23:55.945137 21357 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.936774 21390 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:55.991648 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:55.809562 21347 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.942843 21389 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:56.026803 21389 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:56.029337 21380 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:56.012611 19484 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:56.023084 18670 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 3, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.931850 21255 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.020103 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:56.020750 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.014279 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:55.967979 21229 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:55.947367 21370 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.913237 21405 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:55.937602 21361 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.019070 21227 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:56.035207 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.065538 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.036495 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.063657 18839 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:56.035701 18841 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:56.044739 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:56.071329 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57164.7us
I20260709 12:23:56.089123 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:56.071509 18840 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:23:56.071980 18670 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 4, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 4 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:23:56.091928 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.091277 18670 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 3, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.962661 21348 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:56.030640 20876 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:56.038776 21355 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.093346 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.108775 18839 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:56.091125 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.034372 21408 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.075476 21391 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:23:56.111126 18845 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:56.111783 18848 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:56.113502 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.114347 18841 raft_consensus.cc:2368] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6.
I20260709 12:23:56.115240 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.116744 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:56.117348 18847 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:56.117735 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:56.119076 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:56.115370 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.120748 18839 raft_consensus.cc:2410] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:23:56.126324 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 208632us
I20260709 12:23:56.127693 21292 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:56.128103 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.128890 18840 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:56.129958 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.130965 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:56.127205 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:56.098846 21386 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.108980 20967 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.141021 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:56.153360 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:55.949862 21388 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.111790 21408 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.156612 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:55.947623 21362 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.132334 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:23:56.145743 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 174411us
W20260709 12:23:56.165802 18887 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.105s (SENT)
I20260709 12:23:56.166311 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:56.149808 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:56.144646 18840 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:56.154659 18841 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:56.030573 21416 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 12:23:56.160632 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.125571 21361 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.131412 21141 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:56.175596 18839 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:56.144035 20876 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:56.185735 18887 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.136s (SENT)
I20260709 12:23:56.168179 21292 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.193153 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:56.195796 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.169317 20967 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.161564 21408 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:56.185411 21387 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.533s	user 0.014s	sys 0.000s
I20260709 12:23:56.209950 18847 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:23:56.212308 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.186496 21141 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.217456 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:56.219898 18839 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:56.200711 21295 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:56.159358 21386 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.205502 21264 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:56.413825 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 294806us
W20260709 12:23:56.235836 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66048.8us
W20260709 12:23:56.412849 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.197s (SENT)
I20260709 12:23:56.228480 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:56.421010 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.427098 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.535792 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:56.536456 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120255us
I20260709 12:23:56.537177 18839 raft_consensus.cc:2410] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:23:56.416342 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.547676 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:56.550209 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:56.219014 21387 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.552134 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:56.553514 21387 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:56.554768 20909 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.555027 21387 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.555531 20909 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.559613 18773 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:56.559469 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:56.388473 21422 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:23:56.575510 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.576056 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.576215 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:56.559878 21256 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.424s	user 0.013s	sys 0.000s
W20260709 12:23:56.389492 21402 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:23:56.561039 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:56.582063 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 169292us
I20260709 12:23:56.582325 18764 raft_consensus.cc:2368] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:23:56.568492 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:56.563913 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:56.560566 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.415386 21255 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:56.565610 18770 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:56.565536 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.576834 18768 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:56.576900 18765 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:56.218742 21424 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.579526 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.388414 21421 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:56.289494 21227 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.295s
I20260709 12:23:56.585544 18841 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:56.588800 18771 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.591334 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:56.591532 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.398s (SENT)
I20260709 12:23:56.564075 21370 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:56.596967 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.599479 18844 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:56.599648 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:56.577342 21387 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:56.601089 18764 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
I20260709 12:23:56.615715 18768 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
W20260709 12:23:56.560050 21389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.033s	sys 0.075s
I20260709 12:23:56.591102 21424 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.619547 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.628894 18765 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:56.630697 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.631543 18770 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:56.638500 21389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.033s	sys 0.076s
I20260709 12:23:56.640623 18771 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:23:56.643421 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51920.2us
I20260709 12:23:56.644866 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:56.645605 18922 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:56.647274 18771 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:56.627282 21370 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:56.645057 21424 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.586652 21256 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:56.621071 21359 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.961s	user 0.009s	sys 0.004s
W20260709 12:23:56.663582 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.972s (SENT)
I20260709 12:23:56.664160 18887 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:56.650827 21367 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.009s	user 0.010s	sys 0.002s
I20260709 12:23:56.671550 18765 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:56.672899 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.647770 21362 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:56.670198 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.673834 18764 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:56.675216 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.684587 18886 leader_election.cc:400] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:23:56.685230 18886 leader_election.cc:403] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:23:56.685789 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.681803 18770 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:56.645242 21255 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:23:56.665048 21227 consensus_queue.cc:1243] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:23:56.695899 21423 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:23:56.697732 18773 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:56.719856 21256 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:56.720638 21256 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.721110 21256 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:56.679690 20967 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:23:56.686136 21370 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:56.727484 21370 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.728029 21370 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.731221 18770 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:56.672925 21346 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:56.742072 18771 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:23:56.790887 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127325us
W20260709 12:23:56.795387 19488 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.002s
I20260709 12:23:56.796053 19488 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
W20260709 12:23:56.722297 21356 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.057s	user 0.011s	sys 0.006s
I20260709 12:23:56.681000 21405 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:56.703339 21371 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:23:56.804558 18842 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:56.702327 21182 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:56.673789 21367 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:56.807328 21252 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.076s	user 0.012s	sys 0.000s
I20260709 12:23:56.740907 21346 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:23:56.810882 21141 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 12:23:56.730319 21370 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:56.812449 21408 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.000s
W20260709 12:23:56.816716 20876 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
I20260709 12:23:56.819234 21180 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.688536 21229 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.111s
I20260709 12:23:56.808646 21256 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:56.800482 21109 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.360s	user 0.013s	sys 0.001s
I20260709 12:23:56.706562 21389 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:23:56.854708 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:56.862284 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 177851us
W20260709 12:23:56.870373 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.834298 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:56.878659 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2015) took 1151 ms. Trace:
I20260709 12:23:56.925043 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.925762 18773 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6. Re-sending same reply.
I20260709 12:23:56.926486 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:56.924476 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.932492 18768 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:56.828289 21252 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:56.873291 20876 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.926169 18842 rpcz_store.cc:276] 0709 12:23:55.720050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.720205 (+   155us) service_pool.cc:224] Handling call
0709 12:23:56.861821 (+1141616us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54003264d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:56.870033 (+  8212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212870528}
I20260709 12:23:56.837848 21408 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:56.937389 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:56.928731 18771 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:56.837586 21182 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
W20260709 12:23:56.874136 21068 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.291s	user 0.004s	sys 0.011s
I20260709 12:23:56.932920 18846 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:23:56.858381 21432 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 12:23:56.834839 21141 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:56.874619 21358 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.065s	user 0.009s	sys 0.006s
I20260709 12:23:56.878192 21386 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:56.940153 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 105981us
I20260709 12:23:56.953677 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 541) took 1096 ms. Trace:
I20260709 12:23:56.929837 21388 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:56.944799 18919 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:56.945361 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:56.947597 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:56.969018 18914 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.948338 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:56.969874 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.949971 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:56.941252 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:56.942819 21385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.012s	sys 0.014s
I20260709 12:23:56.939879 21229 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:56.960479 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 595) took 2236 ms. Trace:
I20260709 12:23:56.960875 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:56.960664 19487 rpcz_store.cc:276] 0709 12:23:55.857065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.857186 (+   121us) service_pool.cc:224] Handling call
0709 12:23:55.894915 (+ 37729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.183453 (+288538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:56.183504 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:56.183581 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:56.183635 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.953431 (+769796us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54005b36d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:56.953478 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.953613 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662770560}
I20260709 12:23:56.964123 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.982012 18765 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:23:56.961519 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 301786us
I20260709 12:23:56.959702 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:56.970198 18918 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:56.980261 19490 rpcz_store.cc:276] 0709 12:23:54.724298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.724478 (+   180us) service_pool.cc:224] Handling call
0709 12:23:54.724862 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.855209 (+1130347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.960231 (+1105022us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54005b40d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:56.960413 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566705536}
I20260709 12:23:56.931517 21180 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.970688 18771 raft_consensus.cc:2368] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7.
I20260709 12:23:56.970713 18921 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:56.972738 18772 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.972879 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:56.959762 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.991830 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.992244 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.977768 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:56.943310 21295 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.944242 21256 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:56.942278 21371 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:56.977614 18913 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:56.951988 21442 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.953687 21068 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.024814 18765 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:56.974933 21385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.013s	sys 0.015s
I20260709 12:23:57.031019 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.031236 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:57.035851 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:57.038947 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55005.9us
I20260709 12:23:56.975696 21348 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.975894 21292 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.041255 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:57.051400 18812 connection.cc:256] RPC call timeout handler was delayed by -3.805207929000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 12:23:57.051735 18913 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
W20260709 12:23:57.052088 18812 connection.cc:256] RPC call timeout handler was delayed by -3.7881079290000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 12:23:57.052409 18812 connection.cc:256] RPC call timeout handler was delayed by -3.6819079289998626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2278s for a response
I20260709 12:23:56.957080 21396 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:23:57.042634 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:57.041244 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:57.043756 19457 leader_election.cc:336] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.549s (SENT)
W20260709 12:23:57.052764 18812 connection.cc:256] RPC call timeout handler was delayed by -3.6693079289998423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2292s for a response
W20260709 12:23:57.086632 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 113829us
I20260709 12:23:57.038545 21399 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:57.085162 18766 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:57.026863 21440 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:56.992555 21229 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.056030 18773 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:57.101141 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57434us
I20260709 12:23:57.099902 18768 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:57.100636 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.103670 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62523.1us
I20260709 12:23:57.103663 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:57.104768 18765 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:57.047794 21109 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.054922 21371 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.120460 21109 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.040972 21110 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:57.121513 21110 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:57.114699 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.122514 21110 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.123842 21110 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:57.124159 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.125489 21408 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:57.125648 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:57.116101 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 394) took 1043 ms. Trace:
I20260709 12:23:57.070659 21068 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.126542 18916 rpcz_store.cc:276] 0709 12:23:56.072718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.073483 (+   765us) service_pool.cc:224] Handling call
0709 12:23:56.073808 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.074179 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:56.109223 (+ 35044us) log.cc:844] Serialized 14 byte log entry
0709 12:23:56.573958 (+464735us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:56.574567 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 12:23:56.574757 (+   190us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:56.574797 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.574876 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.857619 (+282743us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:23:57.115728 (+258109us) raft_consensus.cc:1685] finished
0709 12:23:57.115844 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:57.116013 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31897,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":8123,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":9910,"spinlock_wait_cycles":6568192,"thread_start_us":417984,"threads_started":1,"wal-append.queue_time_us":485684}
I20260709 12:23:57.128298 18915 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:23:57.057307 21388 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:23:57.129441 21388 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:57.129806 21388 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:23:57.130053 18919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1876) took 2280 ms (client timeout 2461 ms). Trace:
W20260709 12:23:57.123018 18812 connection.cc:256] RPC call timeout handler was delayed by -3.6117079290002039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2356s for a response
I20260709 12:23:57.093990 21182 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:57.143405 18812 connection.cc:256] RPC call timeout handler was delayed by -3.3653544099997816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 12:23:57.144058 18812 connection.cc:256] RPC call timeout handler was delayed by -3.2184079290000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27930000000000005s for a response
W20260709 12:23:57.144443 18812 connection.cc:256] RPC call timeout handler was delayed by -2.6549718559999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 12:23:56.961840 21346 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.040737 21226 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.135573 21416 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:57.113788 21399 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:23:57.114691 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.585s (SENT)
I20260709 12:23:57.165277 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:57.085843 21292 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:57.144745 18812 connection.cc:256] RPC call timeout handler was delayed by -2.5658718559998306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 12:23:57.168320 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 207519us
I20260709 12:23:57.119467 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:57.143260 18919 rpcz_store.cc:269] 0709 12:23:54.849849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.910627 (+ 60778us) service_pool.cc:224] Handling call
0709 12:23:57.129848 (+2219221us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54003548d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:57.130000 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4430462720}
I20260709 12:23:57.135648 21109 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:57.145709 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:57.112344 21440 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:57.122155 21371 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:57.107936 21385 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:57.040202 21295 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.100489 21442 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:57.088274 21409 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:23:57.163075 21182 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.164364 18768 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:23:57.130730 21388 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.168315 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:57.168920 18812 connection.cc:256] RPC call timeout handler was delayed by -2.5389079289998335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3548s for a response
W20260709 12:23:57.198547 18812 connection.cc:256] RPC call timeout handler was delayed by -2.4938718559997142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:23:57.198930 18812 connection.cc:256] RPC call timeout handler was delayed by -2.4695718559996749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 12:23:57.199247 18812 connection.cc:256] RPC call timeout handler was delayed by -2.3132544099998995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3149s for a response
W20260709 12:23:57.199638 18812 connection.cc:256] RPC call timeout handler was delayed by -2.2994718559998546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 12:23:57.199946 18812 connection.cc:256] RPC call timeout handler was delayed by -2.2985718559998531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 12:23:57.199831 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:57.200379 18812 connection.cc:256] RPC call timeout handler was delayed by -2.2913718559998415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 12:23:57.200678 18773 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:23:57.166487 21386 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:23:57.183295 21256 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:57.208171 21256 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:23:57.094332 21348 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.170871 18913 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
W20260709 12:23:57.174985 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 60360.4us
W20260709 12:23:57.216089 19457 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.603s (SENT)
W20260709 12:23:57.216779 19457 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.641s (SENT)
I20260709 12:23:57.182547 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:57.168098 21399 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:57.165378 21367 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:57.173272 21440 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:57.200778 18812 connection.cc:256] RPC call timeout handler was delayed by -2.2868718559998342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 12:23:57.224102 18812 connection.cc:256] RPC call timeout handler was delayed by -2.2823718559998269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:23:57.224503 18812 connection.cc:256] RPC call timeout handler was delayed by -2.1899544100001549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3286s for a response
I20260709 12:23:57.188377 21347 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:57.173980 21370 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.219466 21252 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:57.186094 21358 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:57.161365 21416 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:23:57.224922 18812 connection.cc:256] RPC call timeout handler was delayed by -1.7972718559999521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24580000000000002s for a response
W20260709 12:23:57.231961 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49549.5us
W20260709 12:23:57.232394 18812 connection.cc:256] RPC call timeout handler was delayed by -1.5767718560000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2703s for a response
W20260709 12:23:57.232841 18812 connection.cc:256] RPC call timeout handler was delayed by -1.4921718559999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2797s for a response
I20260709 12:23:57.232995 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:57.110946 21396 consensus_queue.cc:1243] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:57.164661 21226 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:57.224802 21424 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.002s
W20260709 12:23:57.233330 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2743718560000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30390000000000006s for a response
I20260709 12:23:57.192682 21371 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.230492 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:57.242162 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2536718559999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3062s for a response
I20260709 12:23:57.243149 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:57.243458 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.225184 18914 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:57.236073 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:57.242144 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 116584us
I20260709 12:23:57.221728 21362 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.230301 21370 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.196557 21398 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:23:57.232900 21385 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.240358 21367 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.254663 21362 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.254894 21370 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:57.276124 21390 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.230s	user 0.013s	sys 0.000s
I20260709 12:23:57.253607 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:57.277671 19488 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:23:57.228410 21393 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:57.231350 21388 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.257133 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:57.257853 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:57.258477 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:57.258734 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:57.287925 19490 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:57.260470 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:57.288610 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:57.289206 18766 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:57.290537 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.290858 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:57.291164 18766 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:23:57.261296 18765 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.291870 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:57.292474 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:23:57.292757 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.293386 21347 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:23:57.261549 21439 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:23:57.264945 21405 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.266938 21226 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:57.267192 21450 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.250617 21371 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.267608 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:57.297199 21450 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:57.297689 21450 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.267807 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:57.298640 19486 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:57.299005 21371 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:57.268711 21446 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:23:57.268585 21385 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.301201 21347 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:57.301746 21347 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.301911 21385 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:23:57.269444 21438 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:23:57.302232 21347 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:57.249971 21448 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:57.269879 21229 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:57.247488 21424 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:57.270794 20909 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.001s
I20260709 12:23:57.296271 21405 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.276726 21390 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.244231 18768 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:57.244079 21442 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:57.304106 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:57.305337 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:57.282868 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.239944 21358 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:23:57.322841 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77685.2us
I20260709 12:23:57.310820 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:57.311062 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52732.8us
I20260709 12:23:57.312033 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:57.345186 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:57.293407 18766 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:23:57.315187 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:57.352021 18768 raft_consensus.cc:2376] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
I20260709 12:23:57.353611 18767 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.355140 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:57.358047 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:57.358834 19488 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:57.358764 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:23:57.309409 21357 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.271s	user 0.009s	sys 0.004s
I20260709 12:23:57.303646 21180 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.365556 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:23:57.366550 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.367592 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:57.367960 18764 raft_consensus.cc:2376] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7. Re-sending same reply.
I20260709 12:23:57.309649 20909 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.345335 21371 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.309365 21424 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:57.270084 21416 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.312680 21453 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.398990 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:57.408560 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:23:57.424032 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.312076 21405 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:57.411458 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:57.411618 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54787.6us
I20260709 12:23:57.355960 21390 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:57.370484 21361 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.190s	user 0.015s	sys 0.000s
I20260709 12:23:57.305881 21448 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.344589 21393 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:57.421139 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.421355 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.424113 18913 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:57.428537 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:23:57.436853 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.437899 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:23:57.436981 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:57.440207 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:57.435190 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:57.441516 19490 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:57.442862 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:57.444321 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:57.439286 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:57.446916 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:57.371069 21357 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:57.448733 19457 leader_election.cc:336] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.798s (SENT)
I20260709 12:23:57.450565 21458 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:57.452950 19491 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:57.453562 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.453413 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:57.454648 18913 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:57.464282 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:57.465066 18764 raft_consensus.cc:2376] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
I20260709 12:23:57.465559 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:57.467108 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:57.467653 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:57.466145 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.469401 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.470749 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.472193 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.473081 18764 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:57.474213 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.475067 18764 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:57.476063 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.477735 21359 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.409938 21180 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.479964 19490 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:23:57.480185 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.479754 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:57.445580 21448 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.484138 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:57.442427 21369 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.446542 21229 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:23:57.503894 18846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2032) took 1467 ms (client timeout 1579 ms). Trace:
I20260709 12:23:57.504118 18843 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
W20260709 12:23:57.504142 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 147101us
I20260709 12:23:57.457698 21386 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:57.456252 21442 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:57.511713 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 101931us
W20260709 12:23:57.506784 18846 rpcz_store.cc:269] 0709 12:23:56.036072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.036204 (+   132us) service_pool.cc:224] Handling call
0709 12:23:57.503650 (+1467446us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b5400284e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:57.503821 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1944961280}
I20260709 12:23:57.459045 21458 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:23:57.516377 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46948.4us
I20260709 12:23:57.493880 19484 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.493646 21459 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.512410 21369 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.497004 21390 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:57.497282 21416 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.524784 18916 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.524792 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:57.532130 21393 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:57.533537 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.535041 21180 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:57.536170 21448 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:57.534288 18764 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:23:57.514567 21442 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.538133 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.538332 21442 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:57.540144 21357 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:57.540958 21229 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:57.542096 21229 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.542773 18764 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:57.428647 21371 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.543928 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.545202 21371 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:57.545480 18764 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:57.487922 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:57.431779 21358 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.546368 19483 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:23:57.547802 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.456241 19457 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.135s (SENT)
I20260709 12:23:57.550940 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:57.461530 21362 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:57.505388 21452 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:57.515252 21458 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:57.507185 21396 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:58.099246 21396 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.099716 21396 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:57.599496 21457 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:23:58.105108 19484 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.004s
I20260709 12:23:57.623862 21450 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.664819 21458 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:57.691059 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:57.716001 21459 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.107091 21459 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:57.801147 21347 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.107731 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:58.108489 18920 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:58.109289 21459 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:57.517508 18771 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:23:58.109504 21347 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:57.868436 21452 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:23:57.869259 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:57.817350 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.110257 21452 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:58.111025 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.112537 21452 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:57.868949 21461 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:58.113117 21450 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:58.113385 21461 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.115731 21461 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:57.554817 18916 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:58.118983 21396 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:57.932809 21370 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.004s
I20260709 12:23:58.120285 21370 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.121488 18922 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:23:57.898528 21367 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.005s
W20260709 12:23:57.915342 18767 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.002s
I20260709 12:23:58.122723 18919 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:58.122975 18767 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:58.124136 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.125430 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:57.997532 21357 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:58.133208 21357 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:58.133682 21357 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:58.134832 21357 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.137845 18918 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:57.999146 21110 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:58.139169 21110 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:58.139552 21110 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:58.002199 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:58.019948 18843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2026) took 2049 ms (client timeout 1955 ms). Trace:
W20260709 12:23:58.141296 18843 rpcz_store.cc:269] 0709 12:23:55.971076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.971298 (+   222us) service_pool.cc:224] Handling call
0709 12:23:58.019617 (+2048319us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400205654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:58.019831 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3354589440}
W20260709 12:23:58.141717 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 139632us
I20260709 12:23:57.514781 21361 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:58.142647 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:58.142891 21361 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:58.143682 21361 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:58.143970 18812 leader_election.cc:400] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7.
W20260709 12:23:58.039250 21442 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.003s
W20260709 12:23:58.040710 21109 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.021s	sys 0.036s
I20260709 12:23:58.041438 21359 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:58.045977 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.144347 18812 leader_election.cc:403] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:23:58.055333 21182 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:58.069548 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 613304us
W20260709 12:23:58.149757 19457 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.142s (SENT)
I20260709 12:23:58.150063 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:58.070225 21455 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:58.075769 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 410) took 1389 ms. Trace:
I20260709 12:23:58.082430 21425 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:58.145102 21109 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.021s	sys 0.037s
I20260709 12:23:58.144002 21068 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:58.150662 19490 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:58.145363 21359 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.152742 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2131) took 1727 ms. Trace:
I20260709 12:23:58.153136 18772 rpcz_store.cc:276] 0709 12:23:56.425736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.559309 (+133573us) service_pool.cc:224] Handling call
0709 12:23:56.576037 (+ 16728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.990890 (+414853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.152477 (+1161587us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54001d6854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:58.152663 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911898496}
I20260709 12:23:58.154480 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.144744 21442 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.155233 18772 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:58.155350 21450 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7.
W20260709 12:23:58.155903 19457 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.233s (SENT)
I20260709 12:23:58.156242 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.156737 21442 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:58.156862 18772 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:58.149286 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:58.157819 19483 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:58.151297 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:58.096529 21346 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:58.107440 21458 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:58.109404 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:57.513569 21386 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.546911 21440 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.122728 21367 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.950151 21264 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:57.983438 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 402) took 1009 ms. Trace:
I20260709 12:23:58.127314 21370 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:58.140460 21110 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:58.147346 18767 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:58.146590 18918 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:23:58.145152 21357 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.160254 18920 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:58.105544 19484 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:58.171996 18914 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:58.156870 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:58.160580 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:58.163582 18915 rpcz_store.cc:276] 0709 12:23:56.974581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.986129 (+ 11548us) service_pool.cc:224] Handling call
0709 12:23:57.983166 (+997037us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b54003e6554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:57.983345 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178318592}
I20260709 12:23:58.168711 18918 pending_rounds.cc:85] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 2
I20260709 12:23:58.150640 18769 rpcz_store.cc:276] 0709 12:23:56.686739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.687144 (+   405us) service_pool.cc:224] Handling call
0709 12:23:56.730915 (+ 43771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.731308 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:56.731344 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:56.782224 (+ 50880us) log.cc:844] Serialized 26 byte log entry
0709 12:23:56.945151 (+162927us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:56.983036 (+ 37885us) log.cc:844] Serialized 14 byte log entry
0709 12:23:57.021640 (+ 38604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.021737 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:57.957941 (+936204us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b180003dd20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1
0709 12:23:58.059110 (+101169us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b180003dd20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:23:58.073265 (+ 14155us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b180003dd20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:23:58.075519 (+  2254us) raft_consensus.cc:1685] finished
0709 12:23:58.075544 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.075695 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6,"prepare.queue_time_us":38169,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":47303,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":57594,"spinlock_wait_cycles":45679104,"thread_start_us":102387,"threads_started":1,"wal-append.queue_time_us":171827}
I20260709 12:23:58.154378 21359 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:58.173655 18918 pending_rounds.cc:107] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:23:58.164577 21386 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:58.166432 21419 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.177527 18918 raft_consensus.cc:2889] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:58.151346 21425 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.165555 21264 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:58.177273 21367 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:58.197043 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:58.197235 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.198057 19490 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:23:58.184293 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.165403 21442 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:23:58.190881 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.179445 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.197134 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.203394 18769 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.203613 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:23:58.151474 21182 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:58.197997 18840 raft_consensus.cc:2376] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6. Re-sending same reply.
I20260709 12:23:58.178196 18918 pending_rounds.cc:107] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:23:58.196007 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:58.205708 19492 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:58.198599 18848 raft_consensus.cc:2376] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5. Re-sending same reply.
I20260709 12:23:58.206743 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:58.202461 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:58.202607 18772 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:23:58.207600 19485 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:58.178821 21458 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.208339 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.208401 18918 raft_consensus.cc:2889] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:58.204710 18767 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:58.191417 21110 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:58.210745 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:58.189018 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:58.228329 19483 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:58.229143 21356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.014s	sys 0.030s
W20260709 12:23:58.229509 21356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.014s	sys 0.030s
I20260709 12:23:58.205390 21461 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.216872 21396 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:58.224007 21425 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:58.230841 21461 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.213554 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:58.232697 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:58.233085 21461 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:58.227541 21440 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:58.202018 21367 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.233801 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:58.249337 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1481) took 1460 ms. Trace:
I20260709 12:23:58.249483 21367 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:58.244341 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.009s	sys 0.040s
W20260709 12:23:58.250349 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.010s	sys 0.041s
I20260709 12:23:58.246564 21353 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:58.248147 21458 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:23:58.250862 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.252373 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.252115 21458 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:58.253021 18839 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:23:58.253893 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.206538 21370 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:58.254932 21370 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:58.255324 21370 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.249831 18765 rpcz_store.cc:276] 0709 12:23:56.788710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.117754 (+329044us) service_pool.cc:224] Handling call
0709 12:23:57.261104 (+143350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.292075 (+ 30971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.249088 (+957013us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400210cd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:58.249264 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328754560}
I20260709 12:23:58.257150 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.257385 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.257861 18765 raft_consensus.cc:2368] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:23:58.258062 18842 raft_consensus.cc:2376] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6. Re-sending same reply.
I20260709 12:23:58.262144 18913 raft_consensus.cc:2410] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:58.263351 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.263351 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.264662 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.264187 18846 raft_consensus.cc:2368] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7.
I20260709 12:23:58.249833 19490 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:58.266772 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.267899 18765 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.274088 18772 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:58.213106 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.277989 18840 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:58.222620 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.282234 18848 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:58.282116 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:58.290704 18848 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:58.291415 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 87958.9us
I20260709 12:23:58.293823 21389 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:58.294590 21387 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.294811 21389 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:58.293799 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:58.295747 18919 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.301712 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.308835 18922 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:23:58.228055 21295 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:58.214340 21182 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:58.313952 18769 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:58.321595 18840 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:58.315438 18843 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:58.309324 18922 pending_rounds.cc:85] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 2
I20260709 12:23:58.323422 18922 pending_rounds.cc:107] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:23:58.319805 19483 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:23:58.323848 18922 raft_consensus.cc:2889] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:58.264133 21447 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.321516 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.325265 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:58.327384 18769 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.324993 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.328725 18767 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:58.326452 21109 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.330184 21109 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:58.330713 18843 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:58.332572 21109 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:58.332422 21389 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:58.333770 21329 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:58.334664 21447 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.336243 21182 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:58.336869 21182 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:58.338304 18769 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:23:58.339015 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:58.341710 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:58.344957 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.349119 18769 raft_consensus.cc:2376] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6. Re-sending same reply.
W20260709 12:23:58.354745 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 806529us
I20260709 12:23:58.356638 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.359424 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.360780 18765 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:58.362135 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:58.374784 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 129276us
I20260709 12:23:58.364810 21386 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.358860 21370 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.369560 19486 raft_consensus.cc:2410] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:23:58.341456 21329 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.370824 21358 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:58.371438 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:58.359697 18919 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:58.394537 18843 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:58.376793 18847 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:58.379750 19490 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:23:58.395483 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.384250 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:58.396081 18843 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.392057 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.399730 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:58.400485 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:58.400859 18772 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:23:58.401080 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:58.337888 21182 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.402523 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.404440 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:58.406195 18847 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.405941 18772 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:58.403522 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107621us
I20260709 12:23:58.412652 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:58.413311 18767 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:58.405900 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:23:58.419435 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.420406 18772 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:58.427598 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.429047 18843 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:58.430576 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.431488 18843 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:58.434604 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.435300 18765 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:23:58.436231 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.436813 18765 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:23:58.438303 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:58.438349 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.439411 18843 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:58.440356 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.398800 21109 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.404325 21346 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.441367 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:58.411753 21440 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:58.418242 21295 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:58.411835 21021 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:58.439438 18772 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:58.439071 21356 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:58.447253 21387 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:23:58.491560 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.657446 18848 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:23:58.653697 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 399) took 1695 ms. Trace:
W20260709 12:23:59.087502 21399 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.856s	user 0.015s	sys 0.000s
I20260709 12:23:59.089072 18917 rpcz_store.cc:276] 0709 12:23:56.958156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.959206 (+  1050us) service_pool.cc:224] Handling call
0709 12:23:56.978761 (+ 19555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.126610 (+147849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.126643 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:57.126687 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:57.126734 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.653406 (+1526672us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54000f6254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:58.653459 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.653620 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339510144}
I20260709 12:23:59.090085 21399 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:59.091123 21389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.002s	sys 0.023s
I20260709 12:23:59.091650 19488 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:58.454236 21346 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.477535 21482 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:59.093972 21346 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.094738 21346 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.451823 21353 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:58.452085 21295 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:59.095672 18767 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.015s
I20260709 12:23:59.115849 18767 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:23:58.699587 18814 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.575s (SENT) [suppressed 30 similar messages]
W20260709 12:23:59.096194 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 696522us
I20260709 12:23:58.452085 21396 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:23:59.071604 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.014s
I20260709 12:23:58.517467 21361 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:59.096990 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.123988 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:59.125450 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:59.121562 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.000s	sys 0.015s
W20260709 12:23:59.127133 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 710150us
W20260709 12:23:59.098908 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.656944 21367 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:58.452469 21109 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:58.640111 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:58.611160 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4640 after lost signal to thread 17571
I20260709 12:23:58.497707 21440 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:23:59.102809 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:58.519258 18847 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:59.103406 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:59.103551 21292 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:59.103789 21389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.002s	sys 0.023s
I20260709 12:23:59.120390 21481 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:58.506731 21329 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.123234 21353 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.143486 21353 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:59.106282 18839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.013s	sys 0.025s
W20260709 12:23:59.146610 18839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.014s	sys 0.025s
I20260709 12:23:59.147987 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.149127 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.151404 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 416) took 2004 ms. Trace:
I20260709 12:23:59.151829 18767 rpcz_store.cc:276] 0709 12:23:57.147386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.136604 (+1989218us) service_pool.cc:224] Handling call
0709 12:23:59.136977 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.150967 (+ 13990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.150996 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.151057 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:59.151119 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.151218 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.151349 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13629}
I20260709 12:23:59.153175 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:59.155539 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.119925 21346 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.156322 18847 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:59.157094 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.157655 18847 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:59.150101 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:59.111263 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 413) took 1965 ms. Trace:
I20260709 12:23:59.094836 21399 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:58.477298 21356 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.136262 19487 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:59.171000 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 588) took 1022 ms. Trace:
I20260709 12:23:59.171473 19487 rpcz_store.cc:276] 0709 12:23:58.148400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.102497 (+954097us) service_pool.cc:224] Handling call
0709 12:23:59.170912 (+ 68415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.105183 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.160957 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.173089 18767 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:23:59.161543 18765 rpcz_store.cc:276] 0709 12:23:57.145451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.441462 (+1296011us) service_pool.cc:224] Handling call
0709 12:23:59.088426 (+646964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.110732 (+ 22306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.110774 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.110842 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:59.110901 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.110989 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.111154 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.158818 21346 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:58.490310 21386 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.164664 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.177109 18765 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:59.177958 18767 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:59.178757 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 421) took 1861 ms. Trace:
I20260709 12:23:59.177198 18847 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:59.169414 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:58.774199 21370 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.120632 21295 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.179327 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 419) took 2017 ms. Trace:
I20260709 12:23:59.182000 18767 rpcz_store.cc:276] 0709 12:23:57.161743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.173786 (+2012043us) service_pool.cc:224] Handling call
0709 12:23:59.177715 (+  3929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.179010 (+  1295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.179244 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:59.168954 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 159391us
I20260709 12:23:59.180691 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:59.182247 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.137633 21396 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.179168 18765 rpcz_store.cc:276] 0709 12:23:57.317704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.176343 (+1858639us) service_pool.cc:224] Handling call
0709 12:23:59.176907 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.178526 (+  1619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.178702 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.180689 21353 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.243707 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.243513 21353 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.239095 21408 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:23:59.245023 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.245645 18765 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:23:59.246762 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 605) took 1895 ms. Trace:
W20260709 12:23:59.247170 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 116154us
I20260709 12:23:59.249010 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.247318 19489 rpcz_store.cc:276] 0709 12:23:57.351498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.351656 (+   158us) service_pool.cc:224] Handling call
0709 12:23:57.352064 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:57.352524 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.352554 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:57.367369 (+ 14815us) log.cc:844] Serialized 52 byte log entry
0709 12:23:57.784448 (+417079us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:57.785106 (+   658us) log.cc:844] Serialized 14 byte log entry
0709 12:23:58.043741 (+258635us) log.cc:844] Serialized 14 byte log entry
0709 12:23:58.043972 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.044050 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.243619 (+1199569us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001f4b20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af00dbe 00007f335af0b930 00007f335af0b8d8 00007f335af0b858 00007f335af0b813 00007f335af0aa9c 00007f3360df62f6 00007f3360df0aa8 00007f335af477cb 00007f335af4a2c0
0709 12:23:59.246542 (+  2923us) raft_consensus.cc:1685] finished
0709 12:23:59.246564 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.246701 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257007,"prepare.queue_time_us":1095,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":75,"raft.queue_time_us":257554,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":9221,"spinlock_wait_cycles":372700416,"thread_start_us":120446,"threads_started":1,"wal-append.queue_time_us":199659}
I20260709 12:23:59.232882 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.231452 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 543) took 1811 ms. Trace:
I20260709 12:23:59.252777 19486 rpcz_store.cc:276] 0709 12:23:57.419669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.420288 (+   619us) service_pool.cc:224] Handling call
0709 12:23:59.231107 (+1810819us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b5400720bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:59.231328 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134698368}
W20260709 12:23:59.184594 19457 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.093s (SENT)
W20260709 12:23:59.255934 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 556359us
I20260709 12:23:59.256035 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:59.173913 21356 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:59.258241 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:59.192632 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.285861 18767 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:23:59.290580 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.193034 21370 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.245975 21353 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.265925 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:59.312589 18839 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.277933 18844 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 4: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:23:59.313892 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.314751 18844 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:59.315377 18767 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:23:59.316092 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2147) took 1892 ms. Trace:
I20260709 12:23:59.316390 18767 rpcz_store.cc:276] 0709 12:23:57.423464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.292658 (+1869194us) service_pool.cc:224] Handling call
0709 12:23:59.315146 (+ 22488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.315772 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.315994 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.246950 21109 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.225869 21348 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.263701 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.277585 21292 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.322321 18765 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
W20260709 12:23:59.259701 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75182.9us
W20260709 12:23:59.308275 18886 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.775s (SENT)
I20260709 12:23:59.324807 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:59.311048 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:23:59.328192 18886 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.791s (SENT)
W20260709 12:23:59.329118 18886 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.873s (SENT)
I20260709 12:23:59.329502 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:59.329942 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 71815.2us
I20260709 12:23:59.277714 21182 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.324144 18765 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:59.301959 18768 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:59.290794 21492 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.334977 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 426) took 1144 ms. Trace:
I20260709 12:23:59.333462 21499 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.335361 18765 rpcz_store.cc:276] 0709 12:23:58.190768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.323085 (+1132317us) service_pool.cc:224] Handling call
0709 12:23:59.323977 (+   892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.334729 (+ 10752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.334919 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.336227 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2146) took 1925 ms. Trace:
I20260709 12:23:59.333564 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:59.371075 18765 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:59.371564 21182 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.374070 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1503) took 1095 ms. Trace:
I20260709 12:23:59.374569 18765 rpcz_store.cc:276] 0709 12:23:58.279035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.336322 (+1057287us) service_pool.cc:224] Handling call
0709 12:23:59.370714 (+ 34392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.373487 (+  2773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.374005 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.375057 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 408) took 2099 ms. Trace:
W20260709 12:23:59.336761 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.376308 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1508) took 1096 ms. Trace:
I20260709 12:23:59.376672 18765 rpcz_store.cc:276] 0709 12:23:58.280246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.375393 (+1095147us) service_pool.cc:224] Handling call
0709 12:23:59.375713 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.375963 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.375990 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.376032 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:59.376075 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.376131 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.376234 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.377255 21182 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:23:59.337006 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 157992us
I20260709 12:23:59.378140 21386 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:59.378984 21348 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.379683 21348 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.381436 21428 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.334543 21353 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.382002 21428 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.393085 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 547) took 1947 ms. Trace:
I20260709 12:23:59.394197 21428 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.397308 18920 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:59.394369 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 60909.9us
I20260709 12:23:59.400385 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:59.401678 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:59.393078 21510 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:59.404421 21510 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.405049 21510 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.405537 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.405479 21510 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.407570 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.408674 18846 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:23:59.336642 18768 rpcz_store.cc:276] 0709 12:23:57.410894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.252080 (+1841186us) service_pool.cc:224] Handling call
0709 12:23:59.301707 (+ 49627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.335968 (+ 34261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.336169 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.398175 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1896) took 2088 ms. Trace:
I20260709 12:23:59.416821 18920 rpcz_store.cc:276] 0709 12:23:57.309614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.171538 (+861924us) service_pool.cc:224] Handling call
0709 12:23:58.177278 (+  5740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.397114 (+1219836us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b540024f2a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8d1c0 00007f335af8e231 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c
0709 12:23:59.397856 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.398083 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65144064}
I20260709 12:23:59.418241 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1854) took 1047 ms. Trace:
I20260709 12:23:59.418828 18843 rpcz_store.cc:276] 0709 12:23:58.359449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.160624 (+801175us) service_pool.cc:224] Handling call
0709 12:23:59.405368 (+244744us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:23:59.406349 (+   981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9779456}
I20260709 12:23:59.375516 18914 rpcz_store.cc:276] 0709 12:23:57.275798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.278853 (+  3055us) service_pool.cc:224] Handling call
0709 12:23:57.279173 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:58.172437 (+893264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.374811 (+1202374us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400181854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:59.374992 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052871424}
I20260709 12:23:59.393702 19488 rpcz_store.cc:276] 0709 12:23:57.446255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.448760 (+  2505us) service_pool.cc:224] Handling call
0709 12:23:57.449180 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.092078 (+1642898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.392836 (+300758us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54005b36d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:23:59.393026 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3776937728}
I20260709 12:23:59.423087 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.424360 18917 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:59.431468 18917 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:59.432953 18839 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:59.433759 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1868) took 1068 ms. Trace:
I20260709 12:23:59.434160 18839 rpcz_store.cc:276] 0709 12:23:58.365206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.265540 (+900334us) service_pool.cc:224] Handling call
0709 12:23:59.433681 (+168141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.437414 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:23:59.447769 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:23:59.448565 18843 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:59.213070 21440 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.447836 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:59.327946 21292 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.423139 21496 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.455693 18917 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:59.456911 21389 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.457368 21292 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:59.320303 21370 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.449028 21499 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.460566 21499 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.461143 21499 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.463434 21356 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.465651 21356 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.468796 21370 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:59.451598 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.470570 18914 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:23:59.451305 18839 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:59.471818 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1861) took 1108 ms. Trace:
I20260709 12:23:59.468870 18917 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:23:59.473140 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.472229 18839 rpcz_store.cc:276] 0709 12:23:58.363193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.450631 (+1087438us) service_pool.cc:224] Handling call
0709 12:23:59.451094 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.471567 (+ 20473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.471759 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.473850 18919 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:23:59.474817 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:59.473276 21408 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.476691 21408 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.478480 21492 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:59.478996 21408 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.479707 21492 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:59.480780 21492 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:59.481194 21492 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:59.482605 21386 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:59.483145 21386 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:59.484246 21386 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.472313 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:59.488853 18921 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:23:59.484824 21369 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.494899 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.495270 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:23:59.495375 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 93772.4us
I20260709 12:23:59.502133 18920 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:23:59.485874 21386 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.448436 21348 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.500921 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:23:59.450305 21490 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.310s	user 0.000s	sys 0.003s
I20260709 12:23:59.508006 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.530794 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1860) took 1167 ms. Trace:
I20260709 12:23:59.530982 18919 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:23:59.512691 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:59.534211 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.529490 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:59.448225 21399 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.531559 18847 rpcz_store.cc:276] 0709 12:23:58.362890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.326240 (+963350us) service_pool.cc:224] Handling call
0709 12:23:59.326664 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.326898 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:59.327172 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 12:23:59.530359 (+203187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.530445 (+    86us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:59.530502 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.530572 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.530707 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7608,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"thread_start_us":202787,"threads_started":1}
I20260709 12:23:59.449956 21367 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.544121 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:59.548666 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:23:59.545783 18843 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:23:59.504029 18914 raft_consensus.cc:2410] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:23:59.559419 18843 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:59.559696 18921 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:23:59.535358 21370 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.563792 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1864) took 1199 ms. Trace:
I20260709 12:23:59.570431 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.572041 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1866) took 1198 ms. Trace:
I20260709 12:23:59.572175 18768 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:23:59.572609 18847 rpcz_store.cc:276] 0709 12:23:58.364643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.559867 (+1195224us) service_pool.cc:224] Handling call
0709 12:23:59.562100 (+  2233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.562418 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.562460 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.562531 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:59.562594 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.562685 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.562847 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.573616 18843 rpcz_store.cc:276] 0709 12:23:58.364074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.558740 (+1194666us) service_pool.cc:224] Handling call
0709 12:23:59.559060 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.560032 (+   972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.563686 (+  3654us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.575690 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:23:59.576607 18765 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.587414 18847 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:59.588559 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2060) took 1171 ms. Trace:
I20260709 12:23:59.589025 18847 rpcz_store.cc:276] 0709 12:23:58.416812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.579860 (+1163048us) service_pool.cc:224] Handling call
0709 12:23:59.586007 (+  6147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.588161 (+  2154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.588475 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:59.582043 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:23:59.594733 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 65339.8us
I20260709 12:23:59.596655 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:59.551270 21399 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.561262 21511 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:59.577637 21487 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:23:59.606141 19486 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:59.579416 21346 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:59.555413 21506 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:23:59.482303 21492 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.579567 21494 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:59.615737 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:23:59.599612 21508 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:59.580763 21370 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.579784 21514 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:23:59.634215 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.635394 18768 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:23:59.627502 18765 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:23:59.638716 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.639652 18765 raft_consensus.cc:2376] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9. Re-sending same reply.
I20260709 12:23:59.609875 21346 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.642621 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.612381 21494 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.650753 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:23:59.652479 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.630630 21508 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.642289 21492 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:59.661903 21507 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:59.609367 21515 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:23:59.641816 21501 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:59.611071 21487 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:59.671983 18887 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.616s (SENT)
W20260709 12:23:59.675091 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.645089 21346 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:59.648475 21494 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.686959 21528 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:59.688889 21512 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:59.690466 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72610.7us
I20260709 12:23:59.654593 21514 consensus_queue.cc:1243] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:23:59.693064 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 86379.8us
I20260709 12:23:59.694334 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:23:59.701185 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.168s (SENT)
I20260709 12:23:59.701916 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:59.649235 21467 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:23:59.695940 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 151932us
I20260709 12:23:59.698220 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2154) took 1540 ms. Trace:
I20260709 12:23:59.707212 18767 rpcz_store.cc:276] 0709 12:23:58.157604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.317160 (+1159556us) service_pool.cc:224] Handling call
0709 12:23:59.317466 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.317651 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:59.574593 (+256942us) log.cc:844] Serialized 14 byte log entry
0709 12:23:59.697869 (+123276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.697921 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:59.697963 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.698028 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.698157 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22913,"prepare.queue_time_us":55694,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"thread_start_us":356296,"threads_started":2,"wal-append.queue_time_us":114492}
I20260709 12:23:59.659363 21510 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.659893 21508 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:59.693235 21396 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:59.728030 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.244s (SENT)
W20260709 12:23:59.732537 18887 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.255s (SENT)
I20260709 12:23:59.699946 21501 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.712863 21398 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:59.712520 21442 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:59.699399 21500 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:23:59.712335 21367 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:59.749773 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49582.9us
W20260709 12:23:59.754722 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 158136us
I20260709 12:23:59.729688 21292 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.723742 21511 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:23:59.758566 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.742702 21529 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:23:59.761642 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.779064 18921 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:23:59.781106 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1857) took 1419 ms. Trace:
I20260709 12:23:59.781661 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.784293 18919 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:59.784456 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.781584 18844 rpcz_store.cc:276] 0709 12:23:58.361976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.315307 (+953331us) service_pool.cc:224] Handling call
0709 12:23:59.315649 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:59.316023 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.316060 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:59.316642 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 12:23:59.451956 (+135314us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:59.451995 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.452067 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.780879 (+328812us) raft_consensus.cc:1685] finished
0709 12:23:59.780902 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.781041 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1892,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":134900,"threads_started":1,"wal-append.queue_time_us":233876}
W20260709 12:23:59.791635 18887 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.543s (SENT)
I20260709 12:23:59.792115 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:59.794054 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:23:59.794965 18767 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:23:59.758082 21398 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:23:59.776511 21506 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.776983 21529 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:59.786449 21399 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.788008 21367 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:23:59.751091 21501 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:23:59.802652 21517 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:23:59.757411 21442 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:59.823905 21523 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:23:59.757125 21500 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.846725 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.820051 21515 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:23:59.848803 21398 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.804316 21521 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:23:59.855023 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1863) took 1491 ms. Trace:
I20260709 12:23:59.856159 21348 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:23:59.856841 21348 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.859405 21348 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.855599 18839 rpcz_store.cc:276] 0709 12:23:58.363769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.474381 (+1110612us) service_pool.cc:224] Handling call
0709 12:23:59.474778 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:59.475428 (+   650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.475455 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:59.476031 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 12:23:59.568019 (+ 91988us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:59.568083 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.568210 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.854645 (+286435us) raft_consensus.cc:1685] finished
0709 12:23:59.854674 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.854925 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":84089,"threads_started":1,"wal-append.queue_time_us":177633}
W20260709 12:23:59.862347 21527 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:23:59.864172 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2070) took 1440 ms. Trace:
I20260709 12:23:59.864696 18843 rpcz_store.cc:276] 0709 12:23:58.423405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.581334 (+1157929us) service_pool.cc:224] Handling call
0709 12:23:59.582643 (+  1309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.598862 (+ 16219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.598892 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.602453 (+  3561us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.698713 (+ 96260us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:59.698760 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.698832 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.863850 (+165018us) raft_consensus.cc:1685] finished
0709 12:23:59.863880 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:59.864085 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":667,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"thread_start_us":63303,"threads_started":1,"wal-append.queue_time_us":139098}
I20260709 12:23:59.866751 21487 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.866896 21529 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:23:59.868255 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.868933 21529 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:59.869410 21518 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 12:23:59.872468 21416 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 2.348s	user 0.017s	sys 0.004s
I20260709 12:23:59.873594 18773 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:23:59.874228 21408 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.824651 21506 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.874789 21408 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.877044 21506 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.832084 21367 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.880614 21367 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:23:59.882756 18887 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.633s (SENT)
W20260709 12:23:59.888149 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 176394us
I20260709 12:23:59.831882 21528 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:59.900424 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:59.885500 21370 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:23:59.832218 21511 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.914741 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.915547 18918 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:23:59.916632 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.917567 18918 raft_consensus.cc:2410] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:23:59.921130 21346 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.904601 21524 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.940820 21524 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.941259 21524 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.943837 21494 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.945240 18768 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:23:59.946686 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0be0 after lost signal to thread 18705
W20260709 12:23:59.947222 21295 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.005s
W20260709 12:23:59.906054 21523 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:23:59.930251 21533 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:59.947681 21295 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:23:59.948120 21533 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:23:59.949011 18841 raft_consensus.cc:2368] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6.
I20260709 12:23:59.935530 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:59.949739 19492 raft_consensus.cc:2376] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7. Re-sending same reply.
I20260709 12:23:59.936372 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:23:59.950549 21389 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:59.936820 18913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 410) took 2479 ms (client timeout 1674 ms). Trace:
I20260709 12:23:59.951112 19485 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:23:59.951238 18913 rpcz_store.cc:269] 0709 12:23:57.457912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.467222 (+  9310us) service_pool.cc:224] Handling call
0709 12:23:59.936553 (+2469331us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54003b4554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:23:59.936733 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824523136}
I20260709 12:23:59.939494 21501 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.940124 18915 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:23:59.952889 18915 pending_rounds.cc:85] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 7
I20260709 12:23:59.953192 18915 pending_rounds.cc:107] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:23:59.953471 18915 raft_consensus.cc:2889] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:59.909750 21264 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.951932 21528 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:23:59.954942 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:23:59.970587 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.976281 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:23:59.977476 18913 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:23:59.979848 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:23:59.980365 18917 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.982649 18914 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:59.954331 21494 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.976325 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:23:59.985180 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:23:59.984324 21292 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:59.967653 21264 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.971608 21295 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:23:59.988637 21529 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:00.000304 18917 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
W20260709 12:24:00.001236 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08003f22e0 after lost signal to thread 18797
W20260709 12:24:00.001619 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2440 after lost signal to thread 18798
W20260709 12:24:00.011490 21478 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.521s	user 0.005s	sys 0.008s
I20260709 12:24:00.012264 21346 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:23:59.988323 21508 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:00.017796 21485 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.511s	user 0.006s	sys 0.007s
I20260709 12:24:00.019790 21540 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:00.020094 21408 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:00.022143 19489 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:00.021986 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 396) took 1837 ms. Trace:
I20260709 12:24:00.028951 19489 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:00.023842 18845 rpcz_store.cc:276] 0709 12:23:58.184247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.265227 (+ 80980us) service_pool.cc:224] Handling call
0709 12:23:58.300505 (+ 35278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.340048 (+ 39543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.340086 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:58.340711 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:23:58.434505 (+ 93794us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:58.515980 (+ 81475us) log.cc:844] Serialized 14 byte log entry
0709 12:23:58.516198 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.516278 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.535714 (+1019436us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18003a6300. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1
0709 12:24:00.013877 (+478163us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:00.021663 (+  7786us) raft_consensus.cc:1685] finished
0709 12:24:00.021697 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.021885 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129217,"prepare.queue_time_us":84897,"raft.queue_time_us":40492,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":6820,"spinlock_wait_cycles":92282496,"thread_start_us":93296,"threads_started":1,"wal-append.queue_time_us":165922}
I20260709 12:24:00.034346 21508 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:00.040048 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63825us
I20260709 12:24:00.043774 21525 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:00.044247 21525 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:00.044587 21525 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.028359 21529 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:00.048228 21529 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:00.050782 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800406060 after lost signal to thread 18872
W20260709 12:24:00.051192 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800406040 after lost signal to thread 18873
I20260709 12:24:00.052467 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.062100 21408 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:00.063441 21141 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:00.067116 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.068054 18769 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:00.077381 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:00.083588 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.084457 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:00.087047 18772 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:00.099953 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.087716 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.101284 18913 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:00.102932 21545 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:24:00.102229 18812 connection.cc:256] RPC call timeout handler was delayed by -1.1866528870004913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 12:24:00.103444 18812 connection.cc:256] RPC call timeout handler was delayed by -1.183952887000487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:24:00.104516 21525 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:00.105440 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.106160 21295 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:00.106568 21367 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.106870 21295 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.107141 21367 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.108860 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.109519 18917 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.106843 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.111989 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.113164 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:00.113875 19484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 581) took 2861 ms (client timeout 1664 ms). Trace:
W20260709 12:24:00.114382 19484 rpcz_store.cc:269] 0709 12:23:57.252807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.255042 (+  2235us) service_pool.cc:224] Handling call
0709 12:24:00.113623 (+2858581us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54006739d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:00.113751 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414452096}
W20260709 12:24:00.116122 21433 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 3.321s	user 0.008s	sys 0.010s
I20260709 12:24:00.117060 19488 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:00.118299 18917 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:00.118974 21525 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:00.114262 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.087131 21386 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:24:00.120680 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:00.122099 18769 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:00.094866 21068 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.131122 21068 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.068630 21346 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:00.133939 18913 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:00.123327 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.139227 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:00.139585 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.140020 18846 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.126421 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:00.140355 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.140815 19485 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.141646 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.094869 21440 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:00.142894 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.143527 18767 raft_consensus.cc:2376] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
I20260709 12:24:00.128685 19490 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:00.144810 18914 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 12:24:00.144886 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.145865 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.094739 21398 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:24:00.127386 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:00.135018 21357 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.094861 21521 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:24:00.147302 19487 raft_consensus.cc:2376] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6. Re-sending same reply.
I20260709 12:24:00.158545 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.159334 18772 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:00.136247 21295 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.136926 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.094703 21408 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:00.137944 21348 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.078356 21361 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.138765 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:00.170248 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.122489 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:00.171743 18840 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:00.087066 20909 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:24:00.129915 19483 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:00.148192 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:00.178113 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75918.8us
I20260709 12:24:00.149780 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.150017 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.146317 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:00.161063 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.166301 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:00.171041 18845 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:00.190505 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:00.190634 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.172204 18767 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:00.172122 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.174675 18846 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:00.178213 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:00.175287 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.140267 19484 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:00.210790 18913 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.156255 21068 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.193595 19490 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.212765 18772 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:00.213734 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64048.8us
W20260709 12:24:00.202277 18840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1867) took 1837 ms (client timeout 1913 ms). Trace:
W20260709 12:24:00.214371 18840 rpcz_store.cc:269] 0709 12:23:58.364923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.122149 (+1757226us) service_pool.cc:224] Handling call
0709 12:24:00.202209 (+ 80060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:00.211858 19488 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:24:00.218288 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.192895 18839 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:24:00.201611 21408 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:00.250123 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:00.251155 19483 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:00.253252 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:00.254155 18767 raft_consensus.cc:2376] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3. Re-sending same reply.
I20260709 12:24:00.210158 21396 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:00.190742 21361 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.210474 21512 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.260398 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:00.242533 21539 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:24:00.170589 21440 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:24:00.232734 21481 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:00.180147 21264 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:24:00.165365 21357 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:24:00.272112 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.177793 21348 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.228178 21295 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:00.283568 18767 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:00.289096 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.290079 19484 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:00.257529 21487 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:00.305174 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08003353e0 after lost signal to thread 18946
I20260709 12:24:00.226083 21528 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:24:00.307286 18702 debug-util.cc:398] Leaking SignalData structure 0x7b080005cd60 after lost signal to thread 19516
W20260709 12:24:00.308286 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3920 after lost signal to thread 21046
W20260709 12:24:00.309500 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac200 after lost signal to thread 21376
W20260709 12:24:00.310709 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800344ee0 after lost signal to thread 21379
W20260709 12:24:00.311625 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08003052a0 after lost signal to thread 21407
W20260709 12:24:00.311478 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 95505.8us
I20260709 12:24:00.317682 19483 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:00.319238 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.322077 19483 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:00.309643 19485 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:00.329973 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.331197 19485 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:00.328325 19490 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:00.338930 18772 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:00.345218 18913 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:00.309260 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.349005 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:00.368253 18767 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:00.370771 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.373658 21396 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:00.375347 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.306143 21481 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:00.376792 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:00.377409 18767 raft_consensus.cc:606] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.378445 19483 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:00.381206 18913 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:00.381299 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.382419 18916 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:24:00.320721 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.271044 21512 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:00.375742 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53031.5us
I20260709 12:24:00.383817 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.385681 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.389519 18812 leader_election.cc:400] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:24:00.389634 18916 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.389955 18812 leader_election.cc:403] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:00.376643 20909 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:00.394470 18917 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:00.320050 21487 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.308270 21292 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:24:00.401146 18772 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:00.400287 20909 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:00.402808 21396 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.403080 20909 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:00.408785 21550 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:24:00.371183 21295 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:24:00.431962 18770 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:00.441293 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.442332 18917 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:00.450691 21481 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.456684 21500 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:00.467170 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.495720 21369 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4.
I20260709 12:24:00.497076 21369 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:00.498227 21361 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.499114 21361 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:00.499629 21361 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:00.400960 21561 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:00.374260 21408 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.503623 21386 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:00.504299 21386 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:00.490980 21554 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:24:00.510257 18771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1482) took 3721 ms (client timeout 2703 ms). Trace:
W20260709 12:24:00.510802 18771 rpcz_store.cc:269] 0709 12:23:56.789139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.987056 (+197917us) service_pool.cc:224] Handling call
0709 12:24:00.510008 (+3522952us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54002107d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:00.510163 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919324416}
I20260709 12:24:00.422183 21292 consensus_queue.cc:1243] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:00.513815 21351 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:00.514190 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:00.499150 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.515376 18919 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:00.515269 18770 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:00.513190 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1490) took 3418 ms. Trace:
I20260709 12:24:00.515416 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1900) took 2238 ms. Trace:
W20260709 12:24:00.516762 18841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 390) took 2335 ms (client timeout 1549 ms). Trace:
I20260709 12:24:00.514264 21351 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:00.516932 18915 rpcz_store.cc:276] 0709 12:23:58.277412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.277589 (+   177us) service_pool.cc:224] Handling call
0709 12:23:59.938110 (+1660521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.953984 (+ 15874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.515198 (+561214us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54003b4550. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:00.515349 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3817916800}
W20260709 12:24:00.517493 18841 rpcz_store.cc:269] 0709 12:23:58.181307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.104811 (+923504us) service_pool.cc:224] Handling call
0709 12:24:00.516554 (+1411743us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400283f54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:00.516689 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784361728}
I20260709 12:24:00.518368 21351 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.519030 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.516400 18764 rpcz_store.cc:276] 0709 12:23:57.096070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.671826 (+575756us) service_pool.cc:224] Handling call
0709 12:24:00.510161 (+2838335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.510594 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.510626 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:00.510675 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:00.510717 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.510799 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.512972 (+  2173us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b54002107d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:00.513115 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":387,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":6526776064}
I20260709 12:24:00.526665 18769 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:00.527166 21398 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.505538 21386 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.527799 21398 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.529058 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.534435 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.540388 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.543936 21534 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:00.467476 18842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2064) took 2046 ms (client timeout 1739 ms). Trace:
W20260709 12:24:00.565229 18842 rpcz_store.cc:269] 0709 12:23:58.421441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.467180 (+2045739us) service_pool.cc:211] Skipping call since client already timed out
0709 12:24:00.467354 (+   174us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:24:00.563635 18917 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:00.563894 18919 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:00.552667 21295 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.571482 18916 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:00.592200 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:00.592967 18770 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:00.596900 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.598258 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.564605 21386 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.600478 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.572666 21440 consensus_queue.cc:1243] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:00.572250 21351 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.564996 21534 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:00.603611 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.600140 21521 raft_consensus.cc:2764] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:00.606994 18919 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:00.425560 21524 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.609256 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:00.596122 21424 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:00.611435 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 204242us
I20260709 12:24:00.602631 21555 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:00.606038 21357 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:00.612534 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.501519 21361 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.615262 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.604230 21487 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.620838 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 401) took 2430 ms. Trace:
I20260709 12:24:00.589323 21295 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:00.621181 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.612274 21348 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:00.606156 21511 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:00.621405 18919 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:00.612531 21424 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:00.623399 18848 rpcz_store.cc:276] 0709 12:23:58.185418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.314153 (+128735us) service_pool.cc:224] Handling call
0709 12:23:58.314746 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.088933 (+774187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.615181 (+1526248us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b540041c8d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:00.615382 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786865408}
I20260709 12:24:00.627542 21512 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.628683 21555 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:00.614817 21521 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:00.622081 18765 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:00.630659 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:00.633718 19486 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:00.618058 21398 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:00.636953 19490 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:00.641746 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.644685 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.645295 18919 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:00.646921 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 225954us
I20260709 12:24:00.648471 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.635031 21367 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:00.653565 18919 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:00.636139 21442 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.641230 21521 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.641026 21348 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.658733 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.659454 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.665534 18919 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:00.667263 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.686170 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.687685 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.684583 18842 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:00.669121 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.689607 18848 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:00.690685 18915 raft_consensus.cc:2376] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6. Re-sending same reply.
I20260709 12:24:00.691694 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.692371 18915 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:00.693259 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.694463 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.693756 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.695937 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.697183 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.663763 21521 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.667804 21346 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:00.665278 21357 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:00.713478 21357 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.714826 18920 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:00.716471 21357 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.699687 19486 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:00.717298 21346 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.717691 21346 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.718205 18840 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:00.682567 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 293178us
I20260709 12:24:00.703217 18841 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:00.671059 21348 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.705113 21492 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:00.722723 21492 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:00.723189 21492 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.722123 21348 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.731921 21492 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.735625 21492 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:00.733224 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:00.732683 21346 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.736919 21524 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:00.705055 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.739390 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.740419 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.741061 18840 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:00.742079 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.742795 18921 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:00.743213 18842 raft_consensus.cc:2410] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:00.743166 18921 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:00.743675 18915 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:00.698515 21512 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.700120 21491 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:00.744086 18921 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.751807 18921 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.649834 21534 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.755869 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.754717 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:00.755312 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.746613 21348 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:00.770208 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:00.682533 21424 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.750909 21491 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:00.780848 18770 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:00.782615 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.781245 18921 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:24:00.791679 18921 pending_rounds.cc:85] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 2
I20260709 12:24:00.792019 18921 pending_rounds.cc:107] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:24:00.792308 18921 raft_consensus.cc:2889] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:00.776618 21534 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.783306 21561 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:00.777277 21568 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:00.791064 21346 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:00.754366 21512 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.793133 21558 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:00.786123 21357 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:24:00.819937 21424 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:00.785279 21569 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:00.833618 21295 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:00.836030 21512 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.831941 21558 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.826424 21561 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:00.837666 21521 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.841159 21256 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:00.843195 20909 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:00.844581 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.848929 21568 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:00.831374 21491 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.854535 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:00.869562 18839 raft_consensus.cc:2376] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5. Re-sending same reply.
I20260709 12:24:00.860951 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.820709 21348 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:00.865376 19492 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:24:00.867966 19489 raft_consensus.cc:2410] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:00.867295 21533 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.874366 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.882570 18917 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:24:00.879007 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:00.884212 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 99295.8us
I20260709 12:24:00.890512 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:00.888942 21533 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.868937 20909 consensus_queue.cc:1243] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:24:00.899776 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.897616 18839 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:00.882555 21532 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:00.901252 21532 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.869263 21568 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:00.905035 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:00.900256 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.905936 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:00.906760 18917 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:00.912070 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.915532 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.916262 18913 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 3.
I20260709 12:24:00.927492 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:00.928468 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:00.923615 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:00.869524 21256 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.911248 21389 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:00.933168 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:00.933925 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.934986 18848 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:00.910717 21532 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.891443 21506 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:24:00.924289 21491 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:00.941628 21141 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:00.942101 21141 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.942507 21141 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.943012 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.944713 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:00.945355 18842 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:00.946640 18843 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:00.946749 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:00.947618 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:00.948031 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:00.936267 21561 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:00.949131 21357 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:00.949904 21532 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:00.952198 21361 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.960850 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:00.961799 18848 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:00.931722 21367 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:00.936611 21569 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:00.985275 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50906us
I20260709 12:24:00.986831 18839 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:00.936162 21389 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.938088 21578 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:01.005568 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.990849 21367 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:00.987107 21572 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:24:01.008564 21367 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:00.940435 21348 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:00.989914 21569 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.015538 18848 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:00.992910 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:01.018060 21568 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:01.019261 21521 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:01.022722 21447 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:01.027577 18841 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:01.028559 21256 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:01.028816 21578 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:00.937480 21295 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:24:00.991017 21389 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.032029 18839 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:24:01.035763 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 88234.3us
W20260709 12:24:01.036672 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.039563 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.051556 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:01.042539 18671 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:01.035665 21569 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:01.031980 21141 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.066123 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.050498 21361 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.067839 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:01.069913 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.070606 19492 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:01.072578 18917 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:01.074378 18917 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:24:01.074872 18915 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:01.075374 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.076176 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.078637 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.079309 18770 raft_consensus.cc:2376] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4. Re-sending same reply.
I20260709 12:24:01.079427 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.074795 18917 pending_rounds.cc:85] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 1
I20260709 12:24:01.088716 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:01.089066 18917 pending_rounds.cc:107] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:01.081048 19492 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:24:01.089435 18772 raft_consensus.cc:2376] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6. Re-sending same reply.
I20260709 12:24:01.091878 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.092617 18766 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:01.089576 18917 raft_consensus.cc:2889] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:01.092907 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.068861 21361 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.087878 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.093619 18770 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:01.098114 18848 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:01.098627 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.099128 18770 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:01.093760 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.097175 18814 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.077607 21568 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.112006 21141 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:01.122915 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.124294 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.125162 18772 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:01.083789 21506 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.078277 21512 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:01.083751 21521 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:01.113006 21361 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.146363 18766 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:01.164717 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:01.165366 19490 pending_rounds.cc:85] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 4
I20260709 12:24:01.165802 19490 pending_rounds.cc:107] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:24:01.166077 19490 raft_consensus.cc:2889] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:01.166424 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 69311.3us
I20260709 12:24:01.168129 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:01.137667 21521 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:01.145691 21580 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:24:01.186265 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1514) took 1087 ms. Trace:
I20260709 12:24:01.191622 18765 rpcz_store.cc:276] 0709 12:24:00.099059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.099194 (+   135us) service_pool.cc:224] Handling call
0709 12:24:00.099498 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.638080 (+538582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.185984 (+547904us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400211bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:01.186196 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201197952}
W20260709 12:24:01.187354 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:01.193584 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.195986 18917 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:24:01.153976 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55932.5us
I20260709 12:24:01.189934 18814 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.135583 21487 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:24:01.190951 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:01.139756 21424 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:01.137907 21506 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.213474 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1918) took 1114 ms. Trace:
I20260709 12:24:01.214455 21506 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:01.134141 21578 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.215926 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.216611 19486 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:01.217873 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:01.218245 21582 raft_consensus.cc:2764] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:01.221823 18671 catalog_manager.cc:5697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 2, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 2 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:01.224339 18671 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 3, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:01.225709 21506 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.230211 21585 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:01.190272 21586 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:01.230743 21585 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.231212 21585 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:01.190217 21295 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:24:01.232265 21295 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:01.232614 21295 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:01.233474 21295 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.233641 21361 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:01.235301 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44417.6us
I20260709 12:24:01.213882 18914 rpcz_store.cc:276] 0709 12:24:00.099060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.099692 (+   632us) service_pool.cc:224] Handling call
0709 12:24:01.213242 (+1113550us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b5400334d54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:01.213397 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100574976}
I20260709 12:24:01.237697 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:01.242913 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:01.226130 18671 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 3, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 3 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:01.255688 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 65821.5us
I20260709 12:24:01.256907 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.257778 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:01.258378 18920 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.260624 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:01.266170 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.267650 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:01.267535 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:01.183998 21521 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:01.271457 18914 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:01.275698 21568 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:01.277129 18839 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:01.283218 18920 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:01.284652 18844 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:01.285164 18844 pending_rounds.cc:85] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 3
I20260709 12:24:01.285445 18844 pending_rounds.cc:107] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:01.285745 18844 raft_consensus.cc:2889] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:01.295884 18914 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:01.259516 21557 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:01.268980 21357 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:01.302457 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47220 (request call id 21) took 1134 ms. Trace:
I20260709 12:24:01.319489 18767 rpcz_store.cc:276] 0709 12:24:00.154658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.375056 (+220398us) service_pool.cc:224] Handling call
0709 12:24:01.282030 (+906974us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540012e920. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af08520 00007f335af85652 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6
0709 12:24:01.288755 (+  6725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236268416}
I20260709 12:24:01.277884 21582 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:01.305495 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:01.280586 21586 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:01.310806 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 237151us
I20260709 12:24:01.304834 21568 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:01.338416 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:01.349969 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.306197 21351 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:24:01.362372 18848 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:01.340371 21532 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:01.338866 21491 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.365185 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.367009 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.337973 21557 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:01.368932 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.371251 18843 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:01.379536 18842 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:01.379782 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.380750 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.381366 18842 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:01.381232 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:01.382334 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.344113 21582 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:01.386740 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.386924 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.390676 18840 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:01.391721 18842 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:01.358732 21357 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:01.358297 21568 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:01.407109 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.367938 21586 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.398909 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.410782 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:01.372714 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.407308 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.420493 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.421734 18840 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 3: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:01.417925 18842 raft_consensus.cc:2376] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7. Re-sending same reply.
W20260709 12:24:01.423026 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.423147 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.423781 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.424603 18848 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:24:01.423807 18842 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:01.427618 18842 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:01.434437 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1485e54f9795416785f4baf244599201"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:01.435384 18767 raft_consensus.cc:606] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.435878 18767 raft_consensus.cc:614] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:01.436172 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.437098 18840 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
W20260709 12:24:01.438273 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.442373 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.444299 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.445719 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:01.447294 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 179707us
I20260709 12:24:01.447319 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.448293 18848 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:01.443396 18845 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:01.446300 18846 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:01.448287 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:01.470678 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.397989 21532 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:01.472422 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.474133 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:01.389184 21491 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.474694 21348 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:01.484800 18845 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:01.486677 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.447103 21361 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:01.489704 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.516518 18845 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:01.490676 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:01.482002 21389 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.508618 21595 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.509450 21532 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.474200 21357 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:01.517011 18767 raft_consensus.cc:606] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:01.522823 18767 raft_consensus.cc:614] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:01.509371 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:01.513321 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:01.520433 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:01.524499 18847 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:01.524513 18772 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.477344 21578 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:01.525189 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:01.555179 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.526005 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:01.536464 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:01.557301 18846 raft_consensus.cc:2376] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7. Re-sending same reply.
I20260709 12:24:01.558279 19486 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.570431 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:01.571381 18846 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:01.560894 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:01.584637 18772 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:01.585054 18846 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:01.587898 19486 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:01.586124 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:01.589614 18847 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:01.526083 21357 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.518842 21595 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.480746 21557 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.589813 18846 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:01.591959 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:01.599052 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:01.631453 18772 raft_consensus.cc:606] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:01.626873 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1494) took 4496 ms. Trace:
I20260709 12:24:01.631985 18773 rpcz_store.cc:276] 0709 12:23:57.130500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.078329 (+947829us) service_pool.cc:224] Handling call
0709 12:23:58.078721 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.874076 (+1795355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.626571 (+1752495us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54001d5954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:01.626801 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4126807936}
I20260709 12:24:01.519451 21582 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:01.603075 21593 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:24:01.592221 21591 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:24:01.601007 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:01.640693 19490 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.624320 21534 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:01.633876 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 145392us
I20260709 12:24:01.515388 21568 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:01.655709 19486 pending_rounds.cc:85] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 5
I20260709 12:24:01.656181 19486 pending_rounds.cc:107] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:01.656576 19486 raft_consensus.cc:2889] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:01.603997 21578 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:01.599604 21389 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:01.661535 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.662189 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:01.662529 21578 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:01.663030 21578 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:01.663378 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.663709 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.664901 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.622936 21357 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:01.637871 21361 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:01.653220 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.670162 18767 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:01.621680 21595 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.633203 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:01.650878 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.602094 21521 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.658548 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.661212 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.662267 19487 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:24:01.668708 21586 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:01.669198 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.682219 18769 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:01.631588 18847 pending_rounds.cc:85] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 5
I20260709 12:24:01.654482 18768 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:01.685550 21609 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:01.686111 21609 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.688745 19490 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:24:01.669575 21361 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.691632 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:01.692173 18847 pending_rounds.cc:107] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:01.692518 18847 raft_consensus.cc:2889] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:01.701882 18773 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:01.707393 19492 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:01.708069 21584 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.524s	user 0.003s	sys 0.001s
I20260709 12:24:01.701076 21609 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:01.709465 21569 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.001s
I20260709 12:24:01.658660 21534 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.701584 21487 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.701210 21361 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:01.739363 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.706740 21532 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.709785 21500 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:01.781044 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:01.745790 19490 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:01.722221 21386 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.745426 21569 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:01.749621 21521 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:01.753809 21558 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:01.766199 21534 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:01.770882 18671 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 3 to 4, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:01.746117 21487 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:01.777618 21559 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:24:01.790622 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.781472 18841 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:01.739758 21491 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:01.787776 21500 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:01.785216 21532 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:01.825295 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 192160us
I20260709 12:24:01.786830 21386 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.864558 18840 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:01.871922 21487 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:01.875916 18766 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:01.877238 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.879208 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:01.879876 18771 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:01.884179 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:01.884879 18769 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:01.885900 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:01.887976 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:01.888937 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.890964 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:01.891649 18767 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:01.839184 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:01.893517 18920 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:01.870086 21585 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.003s
I20260709 12:24:01.829594 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:01.895313 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:01.896623 18765 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:01.899286 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69776.3us
I20260709 12:24:01.829069 21582 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:24:01.845036 21532 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:01.845230 21295 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:01.835115 21386 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:01.832638 21609 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:24:01.843519 21569 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:01.906844 21585 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.936514 21595 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.903465 21578 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:01.944162 21582 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:01.907538 21615 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:01.912904 21357 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:01.907866 21568 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:24:01.835527 21500 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:01.962145 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 441787us
W20260709 12:24:01.965952 18886 connection.cc:256] RPC call timeout handler was delayed by -1.0185985019998043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 12:24:01.980633 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:01.984025 19492 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:01.985754 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:01.969000 21609 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:01.973767 21589 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.486s	user 0.004s	sys 0.001s
I20260709 12:24:01.968314 21582 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:01.972630 21447 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:01.977461 21568 consensus_queue.cc:1243] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:01.986685 21615 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:01.997916 21447 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:02.002486 21447 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.003468 21578 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:02.005092 21595 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:02.004908 21361 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.004451 21615 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.007087 21585 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:02.008275 21357 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.011025 21582 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.017998 21582 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.019440 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 562) took 1378 ms. Trace:
I20260709 12:24:02.020044 21361 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.019953 19489 rpcz_store.cc:276] 0709 12:24:00.641309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.641453 (+   144us) service_pool.cc:224] Handling call
0709 12:24:02.019180 (+1377727us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400562a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:02.019364 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517910784}
I20260709 12:24:02.077715 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:02.088841 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:02.100031 18671 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 4, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.104897 18671 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.111270 18671 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.113978 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1938) took 1041 ms. Trace:
I20260709 12:24:02.105829 18771 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:02.126834 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1721) took 1742 ms. Trace:
I20260709 12:24:02.127382 18919 rpcz_store.cc:276] 0709 12:24:00.384222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.700854 (+316632us) service_pool.cc:224] Handling call
0709 12:24:01.226496 (+525642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.226718 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:01.227035 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.378258 (+151223us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.950219 (+571961us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b1800148840. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:24:01.950473 (+   254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:01.950550 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:01.950623 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.950717 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.126298 (+175581us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400334d50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:02.126595 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":597017,"prepare.queue_time_us":10934,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":2534,"raft.queue_time_us":586771,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":20098,"spinlock_wait_cycles":1223085696,"thread_start_us":131863,"threads_started":1,"wal-append.queue_time_us":283136}
I20260709 12:24:02.134303 18767 raft_consensus.cc:606] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:02.118842 18918 rpcz_store.cc:276] 0709 12:24:01.073152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.074999 (+  1847us) service_pool.cc:224] Handling call
0709 12:24:01.085898 (+ 10899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.086287 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.086317 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.086842 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.307135 (+220293us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:01.336043 (+ 28908us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.337339 (+  1296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.337452 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.953964 (+616512us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:02.113054 (+159090us) raft_consensus.cc:1685] finished
0709 12:24:02.113261 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.113671 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":717,"prepare.queue_time_us":13153,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":8316,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":12982,"spinlock_wait_cycles":63195904,"thread_start_us":183982,"threads_started":1,"wal-append.queue_time_us":322709}
I20260709 12:24:02.137260 21568 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.138155 21568 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.141391 21568 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.142915 18846 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:02.144078 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1902) took 1047 ms. Trace:
I20260709 12:24:02.144567 18844 rpcz_store.cc:276] 0709 12:24:01.096768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.097719 (+   951us) service_pool.cc:224] Handling call
0709 12:24:01.284181 (+186462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.286278 (+  2097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.143525 (+857247us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54003be050. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:02.143795 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362782080}
W20260709 12:24:02.165808 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.174122 18769 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
W20260709 12:24:02.180209 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.181602 19487 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:24:02.179867 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 102644us
I20260709 12:24:02.188853 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:02.190778 21351 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:02.192966 18670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 286) took 15066 ms (client timeout 15000 ms). Trace:
I20260709 12:24:02.193229 21351 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.195957 21494 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:02.196954 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:02.183703 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 94851.1us
I20260709 12:24:02.201853 21625 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:02.202116 21532 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:02.204820 21532 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:02.205406 21506 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.206497 21506 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.206609 21532 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.208496 21532 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.209777 21506 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.210925 21487 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:02.211493 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:02.214986 21622 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:02.215550 21622 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:02.216058 21622 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:02.181620 18671 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.216677 21264 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:02.217499 21264 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.214982 21494 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:02.218930 18671 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 4, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.219583 21494 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.220609 21264 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:02.211580 21487 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.222618 21487 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:02.211683 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 225903us
I20260709 12:24:02.227238 18919 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:02.185772 21529 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.228724 21529 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.229115 21529 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.232487 21494 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:02.238657 21264 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:02.239594 21264 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.243060 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:02.242695 18671 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 4, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.245517 18671 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 3 to 4, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.256651 21264 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:02.257395 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:02.258448 21627 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:02.259049 18887 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.529s (SENT)
W20260709 12:24:02.260023 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 600677us
W20260709 12:24:02.193537 18670 rpcz_store.cc:269] 0709 12:23:47.126069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.146711 (+ 20642us) service_pool.cc:224] Handling call
0709 12:23:47.497046 (+350335us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5400030890. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e67640 00007f3360d3e846 00007f3360e4890e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc 00007f335f308392 00007f33592c648c 00007f33592c58c6
0709 12:24:02.192687 (+14695641us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:57.170465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:57.200483 (+ 30018us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:57.200535 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:23:57.200553 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:57.201651 (+  1098us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:57.201743 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:57.201778 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:23:57.266717 (+ 64939us) tablet.cc:701] Row locks acquired
0709 12:23:57.266763 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:23:57.266952 (+   189us) write_op.cc:270] Start()
0709 12:23:57.267123 (+   171us) write_op.cc:276] Timestamp: P: 1783599837266886 usec, L: 0
0709 12:23:57.267149 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:23:57.408426 (+141277us) log.cc:844] Serialized 3577 byte log entry
0709 12:23:57.659207 (+250781us) op_driver.cc:464] REPLICATION: finished
0709 12:23:57.660894 (+  1687us) write_op.cc:301] APPLY: starting
0709 12:23:57.661002 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:57.661262 (+   260us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:57.661467 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:57.666099 (+  4632us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:57.666520 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:23:57.666584 (+    64us) write_op.cc:312] APPLY: finished
0709 12:23:57.666969 (+   385us) log.cc:844] Serialized 71 byte log entry
0709 12:23:57.667219 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:57.667370 (+   151us) write_op.cc:454] Released schema lock
0709 12:23:57.667417 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:58.241097 (+573680us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af86e28 00007f335e9c1581 00007f335e9c0d58 00007f335e9c59f1 00007f335e9c59a9 00007f335e9c5939 00007f335e9c5901 00007f335e9c4b2d 0000000000388634 0000000000388479
0709 12:23:58.241309 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:58.241336 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8254,"reported_tablets":26,"spinlock_wait_cycles":2950784,"child_traces":[["op",{"apply.queue_time_us":1335,"apply.run_cpu_time_us":3933,"apply.run_wall_time_us":6972,"num_ops":9,"prepare.queue_time_us":697604,"prepare.run_cpu_time_us":17462,"prepare.run_wall_time_us":1096959,"raft.queue_time_us":41678,"raft.run_cpu_time_us":1135,"raft.run_wall_time_us":2998,"replication_time_us":391927,"spinlock_wait_cycles":23201664,"thread_start_us":458155,"threads_started":4,"wal-append.queue_time_us":183842,"wal-append.run_cpu_time_us":38372,"wal-append.run_wall_time_us":1067683}]]}
I20260709 12:24:02.202625 21625 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.264463 21625 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:02.269484 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:02.323105 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 137761us
I20260709 12:24:02.324052 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:02.325174 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:02.270150 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:02.326437 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56448us
I20260709 12:24:02.327227 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:02.328266 21565 raft_consensus.cc:2764] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:02.329340 21565 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:02.329865 18770 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:02.270624 21264 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.271344 21487 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.276024 18769 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:02.276469 21615 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:02.284497 21521 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:02.287886 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:02.293184 21351 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:02.330219 21386 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:02.297633 18798 heartbeater.cc:646] Failed to heartbeat to 127.17.40.62:43633 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.40.62:43633 timed out after 15.000s (SENT)
I20260709 12:24:02.297860 18767 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:02.298048 21622 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.264523 18671 catalog_manager.cc:5697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 4, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.311801 21627 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.312980 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:02.340087 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61777.7us
I20260709 12:24:02.295853 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:02.332523 21264 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:02.360390 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 117436us
I20260709 12:24:02.366545 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:02.368033 18846 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.346340 21565 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:02.385061 21351 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:02.385393 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 207928us
I20260709 12:24:02.385607 21357 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:24:02.386009 18765 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:02.386986 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:02.387516 21487 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:02.355331 21264 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:02.388608 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63607.7us
I20260709 12:24:02.390239 21447 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.391225 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:02.394436 21627 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.399031 21557 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:02.402770 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:02.404937 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:02.405813 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:02.385145 21558 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:02.406860 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:02.425067 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50463.2us
W20260709 12:24:02.433416 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 89086.9us
I20260709 12:24:02.435232 21386 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:02.439113 18767 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.433277 21557 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:02.437355 21622 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.440752 21386 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.445900 18844 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:02.426597 21351 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:02.458818 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:02.459026 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:02.460315 18738 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.522s (SENT)
I20260709 12:24:02.461009 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:02.462200 21557 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.469816 21585 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.470677 21585 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.472443 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:02.484474 21367 raft_consensus.cc:2764] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:02.486048 21447 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:02.491696 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.579s (SENT)
I20260709 12:24:02.494577 21534 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:02.494853 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:02.495253 21534 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:02.495553 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:02.495905 21534 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:02.498838 21487 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:02.498776 21370 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:02.501163 21370 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:02.502288 21367 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.502992 21367 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.504243 18920 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:02.504541 21585 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:02.503001 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 215371us
I20260709 12:24:02.495713 18921 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:02.505667 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:02.512280 21351 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.463986 21558 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.498862 18918 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:02.518688 21559 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:02.534816 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.536460 18922 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.521580 21370 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.556350 21357 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:02.562774 21559 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.565716 21559 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:02.565208 21565 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:02.570812 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 160848us
I20260709 12:24:02.558041 18846 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
W20260709 12:24:02.582145 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.588043 18767 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:02.609436 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:02.609624 21643 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.590986 21558 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.613343 21643 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.616185 21558 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:02.616490 21643 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.620035 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:02.554821 21529 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:02.617594 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 158771us
W20260709 12:24:02.624924 21582 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.003s
I20260709 12:24:02.635687 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:02.643261 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.637550 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:02.645431 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:02.645591 21367 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:02.645763 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:02.646128 19486 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:02.646598 19488 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:02.648675 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:02.650092 21357 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.650655 21357 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.645457 19492 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:02.651150 21357 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:02.652360 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 100979us
I20260709 12:24:02.654630 21582 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:02.656308 21646 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.657014 21646 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.645637 19487 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:24:02.658582 19487 pending_rounds.cc:85] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 5
I20260709 12:24:02.658910 19487 pending_rounds.cc:107] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:02.659194 19487 raft_consensus.cc:2889] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:02.675802 19484 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:02.675915 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:02.677920 18844 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:02.598656 21370 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.694679 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:02.695863 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:02.696754 18845 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 4: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:02.698205 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:02.699648 21625 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.684754 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:02.700887 18846 raft_consensus.cc:2376] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
I20260709 12:24:02.703823 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:02.704874 18921 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:24:02.688818 18843 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:02.692229 21646 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.707518 18919 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:02.723316 21487 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:02.724674 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:02.725490 19487 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.726853 18917 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:02.607611 21264 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.702126 21625 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:02.729677 18922 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:24:02.730698 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:02.740394 19486 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:02.724109 21487 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.742292 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:02.748855 18772 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:02.749104 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:02.751716 21506 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:02.752208 21506 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.752624 21506 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:02.746146 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:02.758749 18921 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:02.760216 21264 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:02.755548 19492 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:02.768003 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 236967us
W20260709 12:24:02.768419 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 163086us
I20260709 12:24:02.772158 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:02.772900 18918 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:24:02.739367 21529 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:02.737545 21565 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:02.788604 18772 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:02.781878 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:02.792053 18917 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:02.791626 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 91666.8us
I20260709 12:24:02.767936 21367 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:02.812564 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:02.814668 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:02.826833 18765 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:02.831279 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44866.3us
I20260709 12:24:02.832813 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:02.834156 21559 raft_consensus.cc:2764] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:24:02.841709 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:02.842873 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:02.843552 21558 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:02.843737 18768 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.844995 21370 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:02.845594 21500 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.846272 21500 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.847414 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:02.848006 18843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2098) took 1471 ms (client timeout 1913 ms). Trace:
W20260709 12:24:02.848547 18843 rpcz_store.cc:269] 0709 12:24:01.376171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.410419 (+ 34248us) service_pool.cc:224] Handling call
0709 12:24:02.847733 (+1437314us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b5400380254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:02.847895 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2261237504}
I20260709 12:24:02.849110 21500 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:02.851483 18765 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:02.852155 21622 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.852312 21558 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.853832 21370 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:02.855454 21256 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:02.856441 21447 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:02.856974 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:02.811983 19458 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:02.865111 19487 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:02.866501 18921 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:24:02.880599 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 133427us
I20260709 12:24:02.869035 21559 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:02.870913 21558 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.886929 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:02.885610 18765 pending_rounds.cc:85] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 1
I20260709 12:24:02.894163 18765 pending_rounds.cc:107] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260709 12:24:02.894629 18765 raft_consensus.cc:2889] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:02.877791 21264 raft_consensus.cc:2764] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:02.899001 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:02.899415 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:02.899947 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:02.889317 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:02.899003 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:02.922183 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:02.868427 21565 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.928544 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:02.886605 21557 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.934715 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:02.935412 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:02.874800 21622 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.880851 21646 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:24:02.903468 21558 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.922595 21582 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.946081 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:02.883049 21367 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:02.932839 21521 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:02.934434 21557 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.954345 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:02.934082 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 183450us
I20260709 12:24:02.963944 19487 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:02.965190 18921 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:02.966832 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:02.967211 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:02.968348 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:02.951848 21264 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:02.952378 21521 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.972545 21264 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.957222 21557 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.953498 21582 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:02.984292 21264 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.952250 21639 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:24:02.963340 21487 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:02.987649 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:02.988138 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:02.982626 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:02.990115 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:02.998572 18738 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.712s (SENT)
I20260709 12:24:02.980012 21521 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:03.004005 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:02.991793 21494 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:02.972419 21529 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:24:03.012089 19484 raft_consensus.cc:2376] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5. Re-sending same reply.
I20260709 12:24:03.014185 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:03.014605 21649 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 12:24:03.014915 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:03.015779 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:03.016530 21582 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:03.017055 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:03.017732 18913 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.020130 19490 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:03.023175 21534 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.527s	user 0.015s	sys 0.001s
I20260709 12:24:03.023650 21442 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:03.023659 21534 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.024282 21442 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:03.025331 21442 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.026876 21534 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:03.027650 21367 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:03.029651 21622 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:03.029956 21558 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:03.030519 18913 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:03.031721 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:03.032436 21558 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:03.014477 21295 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:03.008302 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:03.000766 21585 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:03.070197 18921 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:03.071115 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:03.044538 21654 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:03.055217 21256 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.013978 21357 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:03.088920 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 203701us
I20260709 12:24:03.063342 21582 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:03.043008 21408 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 12:24:03.098904 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:03.099586 19489 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.100375 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:03.101715 18773 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:03.101568 21557 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.095782 21559 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:03.043219 21641 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 12:24:03.075301 21494 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:03.116564 18917 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:03.106630 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 116865us
I20260709 12:24:03.034255 21506 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.091082 21500 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:03.144446 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 134037us
I20260709 12:24:03.145876 19489 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
W20260709 12:24:03.150943 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 220632us
I20260709 12:24:03.151741 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:03.094515 21585 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:03.163290 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:03.163955 18768 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:03.107462 21264 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.117910 21295 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:03.160357 21582 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:03.183485 18886 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:03.171983 21565 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:03.195403 18919 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:03.189512 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:03.200454 18916 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:03.189689 21256 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:03.195696 21662 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:03.185580 21641 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:24:03.237811 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 258301us
I20260709 12:24:03.239073 21295 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:03.239777 21295 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:03.240334 21295 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:03.241437 21660 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:24:03.243160 21506 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:03.237815 21494 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.211403 21646 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:03.211584 21367 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:03.243495 21264 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:03.218075 21256 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:03.257161 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:03.260690 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:03.263474 21625 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:03.264430 21625 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.264855 21625 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:03.265300 21625 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.268685 18921 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:03.270447 18914 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:03.222496 21662 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:03.270260 18921 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:03.278702 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53619.6us
I20260709 12:24:03.239110 21557 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:03.288898 19489 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:03.305791 18738 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.895s (SENT)
W20260709 12:24:03.306607 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 161369us
I20260709 12:24:03.307639 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:03.308583 19486 raft_consensus.cc:2368] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:03.277813 21256 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:03.311177 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 110901us
W20260709 12:24:03.311519 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74328us
I20260709 12:24:03.312448 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:03.320890 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:03.283468 21646 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:03.326560 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:03.289582 21295 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:03.322965 21357 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:03.328059 21529 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.352756 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:03.329763 21500 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:03.358187 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68673.3us
I20260709 12:24:03.366720 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:03.333587 21627 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.368086 19486 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:03.368811 19484 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 5 LEARNER]: Advancing to term 7
I20260709 12:24:03.373457 19491 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:03.376478 18913 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:03.370790 21500 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:03.380807 18886 leader_election.cc:400] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:03.381217 18886 leader_election.cc:403] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:03.381718 21665 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.381595 21500 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.382361 21665 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:03.384809 21665 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:03.356248 21663 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:03.387699 21670 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:03.384189 21668 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:24:03.391991 18738 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.913s (SENT)
W20260709 12:24:03.400483 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 95518.5us
I20260709 12:24:03.400779 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:03.401521 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:03.401528 19483 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:03.394752 21558 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:03.410626 21534 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:03.412279 19484 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 7 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:03.412477 21264 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:03.340045 21585 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.415026 21256 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.401664 21666 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:03.422595 21357 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:03.391341 21670 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:03.422063 21676 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:03.436154 19484 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:03.431939 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:03.357800 21646 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.415109 21582 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:03.441341 21661 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:24:03.445715 21666 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.393064 21627 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.436239 21670 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:03.454886 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68068.5us
I20260709 12:24:03.441942 21264 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.423228 21357 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.435344 21565 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:03.456403 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:03.431157 21447 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:24:03.389359 21662 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.425863 21663 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:03.460387 21558 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:03.452808 21256 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:03.463660 21685 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:24:03.468027 21582 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:03.492053 21558 raft_consensus.cc:2764] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:24:03.493427 21681 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:03.485989 21662 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.510031 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:03.512812 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 57842.7us
I20260709 12:24:03.469280 21370 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:03.513504 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:03.455313 21676 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.516788 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:03.529735 18767 raft_consensus.cc:2376] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7. Re-sending same reply.
W20260709 12:24:03.517434 21684 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:24:03.533236 19483 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:03.522574 21663 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:03.525632 21666 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:03.527355 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.533277 18772 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:03.527999 21625 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:03.516278 21582 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:03.504944 21487 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:03.515528 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:03.544888 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:03.477025 21256 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:03.560022 18915 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:03.559892 18773 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
W20260709 12:24:03.564287 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 141245us
I20260709 12:24:03.532994 21677 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:03.567600 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:03.577199 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.581045 18771 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:03.544742 21494 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.588028 19484 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:24:03.546427 21582 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:03.597353 18772 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:03.591686 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:03.606918 21687 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:24:03.561189 21370 consensus_queue.cc:1243] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:03.601140 18770 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:03.608214 21370 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:03.608799 21370 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:03.609086 21627 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:03.610935 21625 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:03.611927 21357 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:03.612174 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:03.612926 21680 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:24:03.589648 21677 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.609858 21370 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.615758 21677 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:03.626556 21494 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.629946 21494 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:03.604027 21670 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.605238 21682 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.543875 21367 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:24:03.605732 21582 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.659020 18921 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:03.632822 21676 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:03.636438 21521 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.002s
I20260709 12:24:03.663326 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:03.566594 21686 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.187s
W20260709 12:24:03.647094 21683 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:24:03.602561 21689 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:24:03.656164 21367 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:03.656224 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:03.657497 21670 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:03.658504 21582 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:03.685446 18920 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:03.581194 21487 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:03.700866 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 134665us
W20260709 12:24:03.703157 18739 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.604s (SENT) [suppressed 62 similar messages]
I20260709 12:24:03.683864 21367 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:03.725718 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 324984us
I20260709 12:24:03.730353 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:03.734491 21500 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:03.675761 21682 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.743083 21699 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:03.681896 21521 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.682803 21494 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 12:24:03.758937 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43933.8us
I20260709 12:24:03.761632 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:03.762459 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:03.769059 19492 raft_consensus.cc:2368] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7.
W20260709 12:24:03.770792 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 314441us
I20260709 12:24:03.772953 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:03.776712 21532 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:03.779652 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.761288 21699 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:03.790680 21686 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:03.791450 21686 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:03.792496 21521 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:03.797236 21699 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:03.801376 21367 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.802474 21666 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.802958 21367 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:03.818138 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 90606.2us
W20260709 12:24:03.818936 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.821100 21702 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:03.824258 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64358.8us
I20260709 12:24:03.825906 21692 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:03.826440 21692 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:03.827428 21692 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.828745 21692 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:03.830305 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:03.830575 21676 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:03.825989 21357 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:03.832508 21701 raft_consensus.cc:1064] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:24:03.832665 21264 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:03.833323 21264 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:03.833457 21701 raft_consensus.cc:1068] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Unable to promote non-voter 43b520eabb65493abe84f4cf06806cba: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:03.834380 21264 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.835870 21264 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:03.836282 21705 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:24:03.792572 21686 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:24:03.839351 21643 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:03.840843 21643 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:03.841310 21643 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:03.846167 21494 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:03.846911 21494 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.850419 21494 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:03.865028 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 112193us
I20260709 12:24:03.891808 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:03.892683 18843 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:03.894109 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:03.894752 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:03.877719 21357 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:03.900255 18848 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:24:03.899820 21672 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:03.861392 21643 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:03.884878 21676 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:24:03.918509 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:03.920219 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:03.923249 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:03.925529 18846 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:03.922452 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:03.914556 21442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.021s	sys 0.016s
W20260709 12:24:03.930006 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:03.933146 21442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.021s	sys 0.017s
I20260709 12:24:03.916314 21672 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:03.922286 21643 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.927299 21702 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.960740 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:03.966958 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.044070 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 136892us
I20260709 12:24:04.054926 18846 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:04.070657 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 628) took 1165 ms. Trace:
I20260709 12:24:04.070890 18841 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:24:04.072422 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 111772us
I20260709 12:24:04.071521 19487 rpcz_store.cc:276] 0709 12:24:02.901515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.924353 (+ 22838us) service_pool.cc:224] Handling call
0709 12:24:02.940059 (+ 15706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.964430 (+ 24371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.066528 (+1102098us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5400580054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:04.066831 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37485312}
I20260709 12:24:04.074678 21442 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:04.077416 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:04.078066 19487 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:04.079541 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:04.078178 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.082379 18843 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.078820 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:04.088078 19490 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.091009 19492 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:04.092005 21676 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.092321 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:04.092609 21676 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:04.093084 18772 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:04.094156 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:04.094803 21676 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:04.091114 18770 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:04.098312 19490 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:24:04.101722 21708 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:03.928201 21666 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 12:24:04.120471 18846 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:03.958949 21559 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:04.127665 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 1965) took 1285 ms. Trace:
I20260709 12:24:04.128142 18915 rpcz_store.cc:276] 0709 12:24:02.841745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.841961 (+   216us) service_pool.cc:224] Handling call
0709 12:24:03.370895 (+528934us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b58001e5198. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:24:04.127457 (+756562us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b54003b4054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:04.127566 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186577024}
I20260709 12:24:04.132181 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:04.137202 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:03.929517 21711 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.149s
W20260709 12:24:04.146904 18887 leader_election.cc:336] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.913s (SENT)
I20260709 12:24:04.148643 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:04.149055 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:04.150687 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:04.150555 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:04.158636 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:04.164053 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 242054us
I20260709 12:24:04.150673 21663 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:04.165387 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:04.179718 18768 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:04.158160 21442 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:04.150367 21558 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:04.185492 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.186429 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.188074 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.194051 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.088613 21357 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:04.195058 18917 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:04.198084 21558 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:04.200064 21712 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:24:04.200568 21714 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.179018 21663 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:04.201148 21714 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.196331 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:04.203503 21714 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:04.201912 21663 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:04.205592 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:04.205757 21663 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.206985 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.207710 18919 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:04.208705 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:04.210577 18922 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:04.211989 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.212683 18918 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
W20260709 12:24:04.213045 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.214586 19487 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:04.215521 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:04.217159 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:04.217422 21494 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:04.218243 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.221007 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:04.223688 19488 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:04.195808 21672 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:04.227281 21529 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.179761 21295 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.229079 21565 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:04.190676 18843 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:04.179422 21627 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:04.236325 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 89469.8us
I20260709 12:24:04.238621 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:04.240216 19488 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:04.167344 21686 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:04.229678 21565 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:04.229540 21295 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:04.238051 18887 connection.cc:256] RPC call timeout handler was delayed by -1.0737628259998928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 12:24:04.256263 19488 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:24:04.277464 18887 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.666s (SENT)
I20260709 12:24:04.278007 18768 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:04.282214 19488 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:04.284744 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:04.286195 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.287127 18915 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:04.289259 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:04.290208 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.246909 21646 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:04.294373 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.285648 18918 raft_consensus.cc:2376] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4. Re-sending same reply.
I20260709 12:24:04.298162 21666 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.299058 21682 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:04.298667 21565 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.299278 21699 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.304512 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.307392 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.275784 21685 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.313925 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:04.316365 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75001.8us
I20260709 12:24:04.256819 21627 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.300068 21565 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.329537 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.331164 18915 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:24:04.250682 21686 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:04.337436 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.347184 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:04.348194 18921 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:04.299079 21666 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.358937 21487 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:04.375233 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66015us
I20260709 12:24:04.300078 21699 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:04.389237 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.393201 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54018.5us
I20260709 12:24:04.355854 21494 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.322661 21685 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:04.396440 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.914s (SENT)
W20260709 12:24:04.396775 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 89768.3us
I20260709 12:24:04.400189 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:04.424080 18921 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:04.396905 21702 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:04.429297 18887 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.020s (SENT)
I20260709 12:24:04.435029 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:04.441300 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.442029 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 114939us
I20260709 12:24:04.396588 21585 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:24:04.441598 21264 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.461771 21686 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:04.444582 21295 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:04.464876 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:04.447983 21724 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:04.449167 21692 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:04.435575 21357 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:04.467361 21692 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:04.445537 21715 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:24:04.470109 21692 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:04.479629 21666 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:04.484114 21627 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:04.485379 19484 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:04.485957 21699 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:04.486999 18919 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:04.487641 21685 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:04.489162 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.489755 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:04.491472 21558 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:04.491701 21666 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:04.492597 21699 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:04.493309 21699 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:04.493592 21582 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:04.494029 21582 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:04.494436 21357 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:04.494925 21582 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:04.495432 21357 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.495997 21582 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:04.498776 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:04.499326 21692 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:04.499887 21692 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:04.413599 21494 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.500402 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:04.501344 21386 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:04.501837 21386 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:04.502170 21692 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:04.503901 21521 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:04.504580 21521 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:04.507699 21558 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:04.509119 21558 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:04.502272 21386 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.505564 21521 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.491513 18812 leader_election.cc:400] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7.
I20260709 12:24:04.500357 21646 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:04.502564 21494 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:04.516417 21625 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:04.515126 21639 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:24:04.538657 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:04.540951 21558 raft_consensus.cc:1064] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
W20260709 12:24:04.555769 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.557621 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.518080 21264 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:04.571537 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 227105us
I20260709 12:24:04.573493 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.570807 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:04.581919 18914 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:04.539534 21699 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:04.563876 21625 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:04.584492 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 119690us
W20260709 12:24:04.573495 21558 raft_consensus.cc:1068] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Unable to promote non-voter 43b520eabb65493abe84f4cf06806cba: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:24:04.588976 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 321867us
I20260709 12:24:04.571528 21686 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:04.563432 21487 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:24:04.593003 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.570158 21494 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:24:04.571024 21264 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:04.601737 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46324.2us
I20260709 12:24:04.602221 21264 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.603668 21264 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.607560 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:04.608359 19491 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:04.573292 21672 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:24:04.596411 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:04.592847 21295 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:04.571877 21732 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:24:04.592578 21702 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:04.621065 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:04.598975 21685 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.635864 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:04.612808 21686 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:04.640731 21729 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:04.616640 21295 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:04.614128 21643 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:04.671732 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.672585 18917 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:04.660648 19489 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 7 LEARNER]: Advancing to term 8
I20260709 12:24:04.618201 21646 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:04.648337 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:04.662252 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.663890 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.674839 18845 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:04.664359 18844 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:04.664477 18841 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:04.665161 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.664394 21666 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:04.669974 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.618485 21627 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:24:04.639846 21702 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:04.671265 21295 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.641839 21685 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:04.681491 21666 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:04.702767 18917 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:04.688994 21646 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:04.623607 21625 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.743680 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.679704 21643 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.744222 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.752874 18846 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:04.759891 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.693358 21487 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:24:04.762493 18844 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:24:04.752200 19489 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:04.770792 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.691555 21733 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:24:04.816252 18848 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.777590 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.817652 18917 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:04.812602 21682 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.693701 21731 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 12:24:04.828472 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 132143us
I20260709 12:24:04.828938 19489 pending_rounds.cc:85] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 4
I20260709 12:24:04.833415 19489 pending_rounds.cc:107] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:24:04.834180 19489 raft_consensus.cc:2889] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:04.834714 19489 pending_rounds.cc:107] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:24:04.835052 19489 raft_consensus.cc:2889] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:04.830982 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 141794us
W20260709 12:24:04.839272 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 150552us
I20260709 12:24:04.845321 19484 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:04.807271 21625 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.751736 21732 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:24:04.833513 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:04.847067 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.865260 18917 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:04.865137 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:04.866305 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:04.871899 21739 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 12:24:04.894922 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.932680 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.935161 21714 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.935912 21714 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:04.940430 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59859.3us
W20260709 12:24:04.948180 21741 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:24:04.879112 21666 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.951854 21666 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:04.885345 21646 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.953712 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.954473 18917 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:04.958151 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:04.959035 18922 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:04.961393 18915 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:04.961807 18915 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:04.965508 21685 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:04.966256 21643 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:04.966710 21702 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:04.806654 21686 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:04.969307 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.971060 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.971774 18839 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.972654 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.971081 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.975019 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:04.976102 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.976696 18845 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.976631 18915 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:24:04.971648 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.970950 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.984004 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.985034 18846 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:04.986270 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:04.989034 18848 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:04.832515 21682 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:04.995070 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.996212 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:05.000165 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.001108 18917 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:05.001861 18848 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 12:24:04.998060 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:04.999310 21685 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:05.007308 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.007728 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:04.938277 21714 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:05.015949 18840 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 12:24:05.045324 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:05.049516 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.067111 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.077636 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.017093 21738 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:24:05.084484 19489 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 LEARNER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:05.014528 21442 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.082522 18916 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:24:05.017452 21672 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:04.990795 21386 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.090728 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.092253 21682 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:05.094148 18845 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
W20260709 12:24:05.087538 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 222478us
I20260709 12:24:05.119181 18917 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:05.119495 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 121549us
I20260709 12:24:05.123180 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.130967 18920 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:24:05.136065 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.137722 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.141152 18814 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:05.136176 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.147029 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:05.147212 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 161100us
I20260709 12:24:05.153173 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:05.140254 21685 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.156250 21685 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.156708 21685 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.101809 21672 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.135190 21500 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:05.127146 21565 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.135309 21732 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:05.143016 21699 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:05.175154 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:05.178696 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:05.179443 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:05.179700 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.181282 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:05.143239 21714 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.170861 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:05.153029 21521 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.185010 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:05.138366 21487 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:05.157068 21666 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:24:05.186502 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:05.190686 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:05.182999 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 313858us
I20260709 12:24:05.168622 21672 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.191363 19491 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:05.166989 21500 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.143095 21442 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.168121 21747 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.195159 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:05.193984 18839 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:05.184008 21699 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.190574 21643 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:05.185045 21639 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:05.184816 21521 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.193814 21742 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:24:05.231926 21442 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:05.218160 21494 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:24:05.177578 21565 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.214586 21664 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.219708 21699 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:05.189062 21622 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:05.200304 21500 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.182853 21732 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.234354 18915 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:05.273458 21734 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:05.235251 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.275808 21442 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.222008 21264 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:05.276752 21264 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:05.277220 21264 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.219255 21714 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:05.279060 21714 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.279506 21714 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:05.221417 21745 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:05.236150 21750 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:24:05.245015 21748 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.400s	user 0.002s	sys 0.006s
W20260709 12:24:05.247043 21754 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:05.247301 21386 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.244397 21521 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.273794 21732 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:05.289183 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.291402 18844 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
W20260709 12:24:05.295728 21295 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.002s
I20260709 12:24:05.296392 21295 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.273883 21734 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:05.256075 18913 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:05.215600 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:05.259042 18671 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 267) took 12352 ms (client timeout 15000 ms). Trace:
I20260709 12:24:05.300347 18915 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:05.300848 18915 pending_rounds.cc:85] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 4
I20260709 12:24:05.301079 18915 pending_rounds.cc:107] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 5.5
W20260709 12:24:05.209797 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66971.3us
W20260709 12:24:05.301589 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 127419us
I20260709 12:24:05.303216 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:05.276739 21442 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.244174 21639 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.304826 21639 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:05.306262 21442 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:05.314443 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:05.313767 21732 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 12:24:05.299680 18671 rpcz_store.cc:269] 0709 12:23:52.906612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.918451 (+ 11839us) service_pool.cc:224] Handling call
0709 12:24:05.258931 (+12340480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:02.649075 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:02.649944 (+   869us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:02.650012 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:24:02.650040 (+    28us) tablet.cc:662] Decoding operations
0709 12:24:02.733344 (+ 83304us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:02.737032 (+  3688us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:02.739752 (+  2720us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:24:02.749489 (+  9737us) tablet.cc:701] Row locks acquired
0709 12:24:02.749549 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:24:02.749745 (+   196us) write_op.cc:270] Start()
0709 12:24:02.749934 (+   189us) write_op.cc:276] Timestamp: P: 1783599842749673 usec, L: 0
0709 12:24:02.749955 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:02.750852 (+   897us) log.cc:844] Serialized 5096 byte log entry
0709 12:24:03.388808 (+637956us) op_driver.cc:464] REPLICATION: finished
0709 12:24:03.514098 (+125290us) write_op.cc:301] APPLY: starting
0709 12:24:03.519015 (+  4917us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:03.519345 (+   330us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:03.519515 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:03.521290 (+  1775us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:03.521730 (+   440us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:24:03.521796 (+    66us) write_op.cc:312] APPLY: finished
0709 12:24:03.522256 (+   460us) log.cc:844] Serialized 95 byte log entry
0709 12:24:03.526862 (+  4606us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:03.527035 (+   173us) write_op.cc:454] Released schema lock
0709 12:24:03.527105 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:03.567694 (+ 40589us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:03.574454 (+  6760us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1817353,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":75386,"apply.run_cpu_time_us":4442,"apply.run_wall_time_us":37506,"num_ops":13,"prepare.queue_time_us":239413,"prepare.run_cpu_time_us":33659,"prepare.run_wall_time_us":301011,"raft.queue_time_us":253446,"raft.run_cpu_time_us":18862,"raft.run_wall_time_us":106733,"replication_time_us":614207,"thread_start_us":495825,"threads_started":4,"wal-append.queue_time_us":238653,"wal-append.run_cpu_time_us":35414,"wal-append.run_wall_time_us":1539144}]]}
I20260709 12:24:05.320271 21756 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:24:05.322559 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 107072us
I20260709 12:24:05.301316 18915 raft_consensus.cc:2889] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:05.324430 18915 pending_rounds.cc:107] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:24:05.326807 18915 raft_consensus.cc:2889] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:05.329620 21732 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.329865 19492 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:05.249922 21664 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:05.333488 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 162789us
I20260709 12:24:05.334316 18843 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:05.351687 18843 pending_rounds.cc:85] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 6
I20260709 12:24:05.351999 18843 pending_rounds.cc:107] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:05.352258 18843 raft_consensus.cc:2889] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:05.249505 21565 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:05.290678 18669 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 3 to 7, term changed from 5 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4), 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.324911 21529 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:05.378891 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:05.381126 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 65245.6us
W20260709 12:24:05.381525 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48902.3us
I20260709 12:24:05.382151 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:05.352125 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:05.344410 21627 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:05.400170 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 220534us
I20260709 12:24:05.392889 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:05.332818 21756 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:05.356033 21664 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.375664 18669 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 4 to 5, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:05.411259 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.411415 21565 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.411973 18669 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.417341 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.418180 18915 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:05.376082 21442 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.381388 21529 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.331694 21521 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.413916 18669 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:05.392098 21487 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:05.356161 21732 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:05.441584 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.443981 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.442037 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.407456 21756 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.342000 21639 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.379387 21357 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:24:05.448812 18669 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 3, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 3 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.441828 21529 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:05.462965 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110979us
I20260709 12:24:05.442752 21442 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.467882 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.455439 21757 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:05.472867 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:05.449133 21756 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:05.473253 21757 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.475867 21442 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:05.476467 21757 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:05.455768 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.446319 21745 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:05.482648 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.477397 18765 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:05.455440 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.454660 21731 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:05.482278 21745 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.487206 21745 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:05.446842 21733 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:05.487811 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.488175 21733 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.488852 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:05.491143 21733 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.488869 21442 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:05.496858 18771 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:05.497455 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:05.509320 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.523629 18669 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 4 to 5, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 5 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:24:05.391212 21685 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.421183 21622 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:24:05.533980 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 141198us
I20260709 12:24:05.533134 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.533828 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:05.533962 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:05.534467 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:05.538441 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 156121us
I20260709 12:24:05.411991 21565 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.540418 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.409584 21627 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.539417 18919 raft_consensus.cc:2376] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8. Re-sending same reply.
W20260709 12:24:05.545241 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 111162us
W20260709 12:24:05.546734 19456 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.871s (SENT)
I20260709 12:24:05.556015 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.559672 18770 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:05.445200 21500 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.565155 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:05.541478 21625 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.681s	user 0.012s	sys 0.000s
I20260709 12:24:05.564924 18669 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.574007 18669 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.583344 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:05.543519 21729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.008s	sys 0.034s
I20260709 12:24:05.585642 18773 raft_consensus.cc:2410] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:05.588271 19492 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:05.594807 18913 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:05.595480 18913 pending_rounds.cc:85] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
I20260709 12:24:05.595805 18913 pending_rounds.cc:107] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:05.596129 18913 raft_consensus.cc:2889] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:05.598130 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 125383us
I20260709 12:24:05.600337 19492 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:05.549851 21731 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.605225 21357 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.605931 21751 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:05.605849 21357 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.564217 21758 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.520890 21699 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:05.591009 21729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.008s	sys 0.035s
I20260709 12:24:05.408991 21734 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:05.611866 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 197203us
W20260709 12:24:05.614221 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 77787.7us
W20260709 12:24:05.614352 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74034.4us
I20260709 12:24:05.617528 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:05.618428 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:05.636826 19488 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:05.646942 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.655378 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:05.656296 19488 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
W20260709 12:24:05.631912 18886 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.165s (SENT)
I20260709 12:24:05.663038 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:05.606371 21751 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:05.665540 18770 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:05.607808 21758 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:05.610030 21699 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.619159 21734 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.609546 21685 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.608436 21357 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.664217 18669 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 5, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.611656 21500 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.610510 21729 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:05.673141 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50080us
I20260709 12:24:05.619329 21295 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:05.685688 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.647073 21487 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.688303 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.707854 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:05.689532 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.688717 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:05.690412 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58551.7us
W20260709 12:24:05.710028 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.709766 21747 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:05.712255 21747 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:05.712648 21747 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:05.713634 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.616016 21582 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:24:05.693538 18669 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 1 to 3, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 3 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.672700 21751 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.710600 21762 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.710744 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.691812 21702 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.669305 21442 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:05.715451 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.740635 18772 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:05.719751 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.707916 21487 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.736785 18669 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 4 to 5, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.698220 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.713610 21747 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.747277 21747 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.746912 21442 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.668015 21529 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.749642 21529 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.751448 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.752884 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.753682 18769 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.719053 21775 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.766215 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.728540 21685 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:05.724678 21639 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:05.750494 21758 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:05.778934 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.803934 21758 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.804349 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.804775 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.805863 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.779507 18764 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:24:05.779700 18766 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:05.804389 21758 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:05.807741 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.809044 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.809602 18764 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:05.726744 21762 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:05.810901 21762 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.787118 18772 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:05.812564 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.813253 18772 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.794960 21759 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:05.814364 21729 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.795852 21643 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:24:05.797017 21714 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 12:24:05.801441 21775 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.817164 21732 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.806211 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.816069 21714 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.820256 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.821137 21295 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.821470 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.821614 21627 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:05.821650 21714 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:05.738545 21702 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.823611 21521 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.716425 21760 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 12:24:05.825332 18773 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:05.790887 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.829042 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.841318 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.837488 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.835552 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:05.854772 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 191804us
I20260709 12:24:05.839550 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.860646 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.861495 18765 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:05.861955 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.863384 18764 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:05.863665 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:05.864396 18770 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:05.859457 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:05.867070 18772 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:05.868134 18771 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:05.874279 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.779531 21565 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:05.875430 18764 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [4.4-7.6]
I20260709 12:24:05.878517 21699 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:05.881831 18773 raft_consensus.cc:2368] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9.
I20260709 12:24:05.842374 21702 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.861327 21625 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.892535 18769 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:05.821782 21295 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:05.896173 21733 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:05.914613 19458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.013s	sys 0.014s
I20260709 12:24:05.900060 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:05.916455 19458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.013s	sys 0.014s
I20260709 12:24:05.917572 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:05.917934 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 729670us
I20260709 12:24:05.882966 21714 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.921926 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:05.939314 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 304127us
I20260709 12:24:05.937085 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.940431 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.948158 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:05.948257 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48295.2us
I20260709 12:24:05.949375 18769 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:05.907908 21672 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.002s
W20260709 12:24:05.915095 21264 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.637s	user 0.013s	sys 0.002s
I20260709 12:24:05.896446 21783 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:05.954428 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:05.959321 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 425422us
I20260709 12:24:05.962073 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:05.967536 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.964924 18919 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:05.900960 21775 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:05.966606 18918 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.975468 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.958707 18915 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:05.970072 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.900960 21487 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:05.900538 21521 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:05.951946 21699 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.011586 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:05.899968 21625 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.985574 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:05.989861 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:05.991066 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:06.012369 18773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "43b520eabb65493abe84f4cf06806cba"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:05.900839 21733 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:05.985276 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.023138 18773 raft_consensus.cc:606] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Received request to transfer leadership to TS 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:06.023623 18914 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:06.041190 18917 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:06.023545 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:06.041930 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:06.024327 18848 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:06.035169 18920 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 4: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:05.973735 21663 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.062252 18769 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:06.047037 18919 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.047902 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:05.966349 21783 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:05.984089 21769 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:24:06.050066 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.043016 21768 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:24:06.059262 21295 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:06.060062 21770 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:05.977128 21264 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:06.060297 21733 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:06.096696 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.021318 21676 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:06.061323 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2131) took 1052 ms. Trace:
I20260709 12:24:05.988430 21714 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:06.016826 21775 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:06.069867 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.072829 18764 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:05.986974 21780 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.964730 21672 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:06.013177 21521 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:06.087756 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.095340 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:06.046258 21565 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.109436 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:06.213932 19492 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:06.113186 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:06.196676 19489 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.196594 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:06.175508 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.202998 18916 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:06.113492 18848 rpcz_store.cc:276] 0709 12:24:05.008502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.008687 (+   185us) service_pool.cc:224] Handling call
0709 12:24:05.008966 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:06.042577 (+1033611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.060990 (+ 18413us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400285354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:06.061194 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2334606592}
I20260709 12:24:06.221565 18921 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:06.202899 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 226973us
I20260709 12:24:06.224866 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:06.210842 18917 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:06.233529 18767 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:24:06.169999 21756 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.005s
I20260709 12:24:06.271083 18845 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:06.272538 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.275369 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52470.1us
I20260709 12:24:06.072079 21663 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:06.197970 21780 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:06.284173 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.285878 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.212785 21714 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:06.286312 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:06.213065 21565 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:06.289898 18770 raft_consensus.cc:2410] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:06.237154 21764 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:24:06.297178 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:06.271009 21686 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.304503 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:06.302441 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:06.310563 18770 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:06.311246 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:06.323789 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 312285us
I20260709 12:24:06.289904 21666 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.289803 21714 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:06.294924 21565 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.331498 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2134) took 1185 ms. Trace:
I20260709 12:24:06.273563 21756 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:06.328274 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 304781us
W20260709 12:24:06.345729 21664 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.906s	user 0.012s	sys 0.001s
I20260709 12:24:06.345934 19490 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:06.333727 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:06.350760 18845 rpcz_store.cc:276] 0709 12:24:05.146444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.146633 (+   189us) service_pool.cc:224] Handling call
0709 12:24:06.331150 (+1184517us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:06.331406 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2580078976}
I20260709 12:24:06.287118 21622 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:24:06.353231 18887 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:06.290169 21780 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.286844 21627 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:24:06.325783 21758 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.000s
I20260709 12:24:06.355726 18767 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:06.313587 21686 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:06.532896 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.544257 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.514494 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:06.471464 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:06.514871 18844 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:24:06.513967 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 180365us
I20260709 12:24:06.519584 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:06.546944 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:06.474944 18843 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:06.547396 18769 raft_consensus.cc:2376] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10. Re-sending same reply.
W20260709 12:24:06.486548 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.481986 18842 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:06.397789 18839 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:06.385953 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:06.447912 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:06.543596 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.460376 18921 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:06.566203 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.568908 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:06.444303 21778 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.458s	user 0.001s	sys 0.000s
I20260709 12:24:06.575479 18844 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.578441 18844 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:06.578994 21686 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:06.565012 21639 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:06.580188 21639 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:06.321036 21783 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:06.583829 21783 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:06.584628 21798 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:06.585992 21772 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:06.591060 21663 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:06.591894 21806 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.592546 21806 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:06.595809 21264 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:06.603168 21639 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:06.604089 18847 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
W20260709 12:24:06.608170 21787 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
W20260709 12:24:06.608449 21793 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:24:06.559973 21758 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:06.576853 21521 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:06.614876 21758 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:06.615720 21758 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.518103 21625 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:06.616328 21758 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:06.616969 21625 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:06.619905 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.630007 18769 raft_consensus.cc:2410] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:06.621109 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:06.624392 18842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 450) took 1295 ms (client timeout 1655 ms). Trace:
I20260709 12:24:06.473462 21769 raft_consensus.cc:2764] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:06.621892 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:06.329855 21442 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:06.623433 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:06.632611 18918 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.000s
I20260709 12:24:06.652856 18918 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:06.621694 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:06.631196 18842 rpcz_store.cc:269] 0709 12:24:05.332944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.343867 (+ 10923us) service_pool.cc:224] Handling call
0709 12:24:06.624114 (+1280247us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540041bed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:06.624316 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457594752}
I20260709 12:24:06.622444 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:06.646890 18919 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 12:24:06.654894 18919 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:06.510813 21585 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:06.666703 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.672304 21788 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.606s	user 0.000s	sys 0.013s
I20260709 12:24:06.678750 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:06.361546 21666 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:06.714499 21803 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:24:06.715889 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.716542 21786 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.717294 21786 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:06.723753 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.645603 21264 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:06.384928 21664 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:07.133476 21805 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.614s	user 0.001s	sys 0.002s
I20260709 12:24:07.142895 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:07.149304 19492 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:07.149694 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:07.150866 19488 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:07.151875 21800 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:07.152354 21770 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:07.153007 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 614) took 1319 ms. Trace:
I20260709 12:24:07.153414 19488 rpcz_store.cc:276] 0709 12:24:05.833246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.833808 (+   562us) service_pool.cc:224] Handling call
0709 12:24:05.834194 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.151252 (+1317058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.152755 (+  1503us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400521054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:07.152945 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3027556096}
I20260709 12:24:06.661084 21625 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:06.889451 21797 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:07.147940 21666 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.156939 21797 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.157016 21625 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.016605 21529 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:07.159107 21529 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.174527 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:06.843839 21746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.003s	sys 0.018s
W20260709 12:24:06.877727 21646 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.024s
I20260709 12:24:07.119482 21758 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:06.724578 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 155755us
I20260709 12:24:06.721159 21442 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:07.140914 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:06.827282 21769 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:07.249825 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:06.686601 21585 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:24:06.816680 21775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.008s	sys 0.010s
I20260709 12:24:06.853881 21786 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:06.811661 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:07.147128 21672 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:07.162097 21264 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:07.251470 21818 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:24:07.167527 18841 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:06.926941 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:07.250316 21765 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:06.873538 18916 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.001s
W20260709 12:24:07.171499 18886 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 3.146s (SENT)
I20260709 12:24:07.266737 18916 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:07.267392 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1801) took 1279 ms. Trace:
I20260709 12:24:07.173051 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:07.159816 21797 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:07.169523 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 358192us
I20260709 12:24:07.267624 18916 rpcz_store.cc:276] 0709 12:24:05.988110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.070059 (+ 81949us) service_pool.cc:224] Handling call
0709 12:24:07.267321 (+1197262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:07.188125 21666 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:24:07.199312 18913 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:07.203532 19492 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:07.205075 18921 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 12:24:07.205855 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.254994 18766 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:06.879447 18768 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:24:07.199839 21746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.007s	sys 0.038s
I20260709 12:24:06.997810 21806 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.285925 18765 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.930652 21756 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.287031 21756 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:07.287562 21756 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:07.288543 21756 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:06.878880 21686 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:07.290736 21686 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.293015 21686 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.257871 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.188453 21622 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.295115 18922 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:07.258780 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 230299us
W20260709 12:24:06.876425 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 523264us
W20260709 12:24:07.302843 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:07.303367 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.304637 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:07.305222 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.305936 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:07.067200 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.172426 21796 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.850711 21804 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.265671 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:07.268282 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 95390.9us
I20260709 12:24:07.271256 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:07.168746 18888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.000s	sys 0.023s
I20260709 12:24:07.274806 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:07.255438 21775 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:07.278056 18921 pending_rounds.cc:85] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
W20260709 12:24:06.845758 21751 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.105s	user 0.009s	sys 0.006s
I20260709 12:24:07.311559 18842 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:07.256453 21769 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:07.212992 21646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.010s	sys 0.029s
W20260709 12:24:07.306212 18887 connection.cc:256] RPC call timeout handler was delayed by -1.326051274999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 12:24:07.297932 21820 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:24:07.351591 21751 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.315165 18921 pending_rounds.cc:107] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:07.364854 18921 raft_consensus.cc:2889] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:07.310376 18769 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:24:07.311769 18888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.000s	sys 0.024s
I20260709 12:24:07.353842 21625 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.366506 21442 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.311074 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:07.296890 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:07.369812 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58871.2us
I20260709 12:24:07.298231 21806 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:07.300606 21622 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.277788 21295 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:07.299284 21759 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 12:24:07.352396 21817 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:07.349642 21804 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.355870 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2201) took 1606 ms. Trace:
W20260709 12:24:07.353678 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 182296us
I20260709 12:24:07.371899 18916 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:07.397902 18916 pending_rounds.cc:85] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 6
I20260709 12:24:07.398267 18916 pending_rounds.cc:107] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 12:24:07.384133 21565 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.996s	user 0.001s	sys 0.012s
I20260709 12:24:07.270232 21765 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:07.358564 21702 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.459s	user 0.009s	sys 0.005s
I20260709 12:24:07.358089 21664 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:07.358150 21780 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.000s
W20260709 12:24:07.420423 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 278642us
I20260709 12:24:07.389246 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:07.360855 21812 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:07.308360 21811 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:07.308827 21746 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:07.390789 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.349571 21772 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.398721 18916 raft_consensus.cc:2889] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:07.461519 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:07.462847 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.463600 18916 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:07.382019 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:07.464412 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82515.9us
I20260709 12:24:07.396054 18765 rpcz_store.cc:276] 0709 12:24:05.748937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.870190 (+121253us) service_pool.cc:224] Handling call
0709 12:24:05.870626 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.286417 (+1415791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.355461 (+ 69044us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001d6854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:07.355740 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254376320}
I20260709 12:24:07.356992 21760 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:07.366243 21751 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:07.357872 21529 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:07.391707 21762 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.575s	user 0.013s	sys 0.003s
I20260709 12:24:07.383580 21770 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.411602 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.472330 18914 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:07.415164 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:07.476761 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:07.458051 18917 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
W20260709 12:24:07.458385 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 209203us
I20260709 12:24:07.459735 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.346225 21796 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.352471 21775 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.388005 21806 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.412271 21565 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:07.500624 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 203787us
I20260709 12:24:07.505897 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:07.459874 21664 raft_consensus.cc:2764] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 12:24:07.479511 21818 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:07.413219 21702 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.480899 21800 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:07.519508 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.528767 18917 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:07.529426 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:07.530334 19490 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:07.541204 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1923) took 1031 ms. Trace:
I20260709 12:24:07.541978 18845 rpcz_store.cc:276] 0709 12:24:06.509594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.560693 (+ 51099us) service_pool.cc:224] Handling call
0709 12:24:06.561131 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:06.573913 (+ 12782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:06.573958 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:06.606934 (+ 32976us) log.cc:844] Serialized 26 byte log entry
0709 12:24:06.850161 (+243227us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b48000030d8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:24:07.142106 (+291945us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:07.453092 (+310986us) log.cc:844] Serialized 14 byte log entry
0709 12:24:07.453382 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.453492 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:07.525878 (+ 72386us) raft_consensus.cc:1685] finished
0709 12:24:07.540861 (+ 14983us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:07.541103 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19140,"prepare.queue_time_us":120000,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":66329,"raft.run_cpu_time_us":1236,"raft.run_wall_time_us":227512,"spinlock_wait_cycles":50561792,"thread_start_us":519830,"threads_started":2,"wal-append.queue_time_us":561590}
I20260709 12:24:07.457126 21780 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.511507 21672 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:07.549194 18916 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:07.542795 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:07.556221 19489 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:07.558632 18840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:07.559365 18840 raft_consensus.cc:606] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:07.507599 21758 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:07.507926 21770 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:07.558800 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:07.561614 19490 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:07.562995 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1929) took 1006 ms. Trace:
I20260709 12:24:07.565740 18848 raft_consensus.cc:2368] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6.
I20260709 12:24:07.526311 21759 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.526988 21585 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:07.571100 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.572456 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:07.563474 18844 rpcz_store.cc:276] 0709 12:24:06.556553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.579210 (+ 22657us) service_pool.cc:224] Handling call
0709 12:24:06.579545 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:06.643720 (+ 64175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:06.643756 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:06.644269 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:24:06.674731 (+ 30462us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b48000030d8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:24:06.901944 (+227213us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:07.204751 (+302807us) log.cc:844] Serialized 14 byte log entry
0709 12:24:07.541232 (+336481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.541326 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:07.541386 (+    60us) raft_consensus.cc:1685] finished
0709 12:24:07.557971 (+ 16585us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:07.562846 (+  4875us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68763,"prepare.queue_time_us":360019,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":120210,"raft.run_cpu_time_us":2900,"raft.run_wall_time_us":24410,"spinlock_wait_cycles":11266944,"thread_start_us":790456,"threads_started":3,"wal-append.queue_time_us":504652}
I20260709 12:24:07.512241 21686 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:24:07.578058 21702 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:07.579340 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:07.480250 21762 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.584277 21780 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:07.585554 21714 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.201s	user 0.015s	sys 0.000s
I20260709 12:24:07.587016 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.587422 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:07.528827 21264 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.522234 21760 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:24:07.519029 21797 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:24:07.561167 21672 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:07.608258 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 185538us
I20260709 12:24:07.467526 21811 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.620141 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:07.564929 21751 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:07.592839 21823 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:24:07.605893 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 224885us
I20260709 12:24:07.685662 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:07.606329 19483 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:24:07.628505 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 123987us
I20260709 12:24:07.590703 21836 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:24:07.698017 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:07.630813 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:07.700764 18915 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.565353 21800 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:07.658632 18771 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:07.701948 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:07.614252 19489 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:07.655772 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:07.604360 21529 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:07.704823 21529 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:07.681193 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 166656us
I20260709 12:24:07.670305 19490 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:07.700033 21751 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.652848 21826 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:07.593103 21758 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.656997 21585 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.710016 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:07.727509 18770 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:07.726291 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 329009us
I20260709 12:24:07.728698 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:07.604763 21759 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.710702 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:07.731276 18769 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:07.732388 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.715893 21751 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:07.716144 21760 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:07.633062 21714 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.717628 21765 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:07.718185 21746 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.718339 21804 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.719362 21800 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.719645 21762 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.720072 21826 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.720127 21848 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 12:24:07.748092 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.747968 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.676088 21672 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:07.716921 21806 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.814131 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:07.821640 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:07.867389 18914 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:07.826709 18915 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:07.762006 21829 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:24:07.828213 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:07.715375 21769 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:07.830864 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 175221us
I20260709 12:24:07.700139 21841 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 12:24:07.845706 18839 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:07.846808 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:07.885272 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:07.781041 21666 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:07.815240 21838 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:24:07.731029 21622 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:07.712113 21529 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:07.869560 18846 raft_consensus.cc:2368] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7.
I20260709 12:24:07.834820 18922 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:24:07.886627 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:07.886642 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:07.885311 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 187080us
I20260709 12:24:07.888062 18915 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:07.891161 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:07.843966 21783 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.251s	user 0.009s	sys 0.006s
I20260709 12:24:07.820932 21702 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:07.897595 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:07.894114 18841 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:07.850956 21765 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:07.781354 21585 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:07.907378 18845 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.912894 18842 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:07.913216 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:07.914659 18914 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:07.932765 18773 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
W20260709 12:24:07.933485 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 48313.1us
I20260709 12:24:07.937294 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:07.945909 18839 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:07.949612 21850 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:07.950505 21746 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.950325 21850 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:07.951099 21746 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:07.952885 19456 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.022s (SENT)
I20260709 12:24:07.710757 21770 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:07.955329 18767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.011s	sys 0.021s
I20260709 12:24:07.991277 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:07.993120 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:08.030191 21714 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:07.963923 18922 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:08.030216 18769 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:08.031904 21529 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:08.032315 21529 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:08.033129 21529 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:08.030311 18767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.032s	sys 0.043s
I20260709 12:24:08.038316 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.042997 18842 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:08.050256 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 102922us
I20260709 12:24:08.055089 18845 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:07.996819 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:08.065474 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:07.995000 21823 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:24:07.905642 21666 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:08.022297 21829 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:24:07.952770 21702 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:08.123924 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:08.074580 18841 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
W20260709 12:24:08.278579 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.278434 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.279421 18845 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:08.283047 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:08.286091 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1925) took 1775 ms. Trace:
I20260709 12:24:08.295859 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:08.000008 21758 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:08.287097 18843 rpcz_store.cc:276] 0709 12:24:06.510430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.559092 (+ 48662us) service_pool.cc:224] Handling call
0709 12:24:06.559574 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:06.568921 (+  9347us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:06.591661 (+ 22740us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b180040cae0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:24:06.876174 (+284513us) log.cc:844] Serialized 14 byte log entry
0709 12:24:07.501685 (+625511us) log.cc:844] Serialized 14 byte log entry
0709 12:24:07.501887 (+   202us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:07.522724 (+ 20837us) log.cc:844] Serialized 26 byte log entry
0709 12:24:07.522913 (+   189us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:07.525758 (+  2845us) log.cc:844] Serialized 14 byte log entry
0709 12:24:07.555870 (+ 30112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.559261 (+  3391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.285805 (+726544us) raft_consensus.cc:1685] finished
0709 12:24:08.285825 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.286005 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257111,"prepare.queue_time_us":704181,"prepare.run_cpu_time_us":186,"prepare.run_wall_time_us":4370,"raft.queue_time_us":85024,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":30761,"spinlock_wait_cycles":71349376,"thread_start_us":623767,"threads_started":3,"wal-append.queue_time_us":354242}
W20260709 12:24:08.308962 18737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.003s	sys 0.007s
W20260709 12:24:08.309360 18737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.003s	sys 0.007s
W20260709 12:24:08.309679 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 604198us
W20260709 12:24:08.194026 21851 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
I20260709 12:24:08.316270 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.317168 18843 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:08.318434 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.320098 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:08.320394 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 433780us
I20260709 12:24:08.315279 18839 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:08.187776 21686 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.320919 18841 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:08.133462 21622 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:08.328869 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.329463 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:08.051239 21759 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:08.321759 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:08.327100 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:08.310858 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:08.341203 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.343264 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:08.344242 19487 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:08.327936 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:08.152868 21714 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:08.285333 21264 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:08.238466 21864 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:08.334223 18841 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:08.095181 21865 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:08.345327 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:08.153146 21769 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:08.308646 21804 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.349031 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:08.321226 21758 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:08.347522 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:08.336628 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:08.314235 21811 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:08.378760 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:08.382190 18841 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.382803 18764 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:08.394021 18843 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:08.348372 21855 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.348186 21714 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.333364 21686 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:08.421232 21714 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.336201 21622 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:08.421881 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74434.4us
I20260709 12:24:08.427234 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:08.374682 21264 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:08.500304 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70733.7us
I20260709 12:24:08.393647 21804 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:08.507238 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 166715us
I20260709 12:24:08.423314 21780 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:08.452149 18844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.010s
I20260709 12:24:08.378773 21864 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:08.501582 21835 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.507s	user 0.000s	sys 0.001s
W20260709 12:24:08.541527 18773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 459) took 2266 ms (client timeout 1736 ms). Trace:
I20260709 12:24:08.395614 21758 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:08.503002 21850 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:08.380228 21865 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:08.546631 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 210071us
W20260709 12:24:08.568785 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 180819us
I20260709 12:24:08.538439 18764 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.573346 18845 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:08.573395 18844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.007s	sys 0.021s
W20260709 12:24:08.576596 21867 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:24:08.419564 21769 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:08.422227 21860 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.175s
W20260709 12:24:08.581310 18773 rpcz_store.cc:269] 0709 12:24:06.269931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.271050 (+  1119us) service_pool.cc:224] Handling call
0709 12:24:08.505270 (+2234220us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54001efd54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:08.536084 (+ 30814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3749033344}
W20260709 12:24:08.619525 21875 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:24:08.621722 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1816) took 1102 ms. Trace:
I20260709 12:24:08.622625 21804 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:08.627580 21865 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:08.582583 21881 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:08.630070 21881 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:08.630577 21881 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:08.631969 21622 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:08.637575 21751 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.638191 21751 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:08.640571 21751 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:08.588306 21868 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 12:24:08.644356 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 651) took 1142 ms. Trace:
W20260709 12:24:08.647329 21869 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:24:08.648837 19490 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:08.650669 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:08.651819 21826 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:08.619539 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:08.622114 18915 rpcz_store.cc:276] 0709 12:24:07.519799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.939796 (+419997us) service_pool.cc:224] Handling call
0709 12:24:07.945548 (+  5752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:07.945992 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:07.959498 (+ 13506us) log.cc:844] Serialized 14 byte log entry
0709 12:24:08.040074 (+ 80576us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.040682 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.040860 (+   178us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:08.040895 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.043612 (+  2717us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.621485 (+577873us) raft_consensus.cc:1685] finished
0709 12:24:08.621506 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.621655 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":261,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":244,"thread_start_us":8308,"threads_started":1,"wal-append.queue_time_us":369856}
I20260709 12:24:08.659140 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1809) took 1456 ms. Trace:
I20260709 12:24:08.644896 19492 rpcz_store.cc:276] 0709 12:24:07.502492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.520015 (+ 17523us) service_pool.cc:224] Handling call
0709 12:24:07.520383 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:07.654652 (+134269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.654691 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:07.683560 (+ 28869us) log.cc:844] Serialized 26 byte log entry
0709 12:24:07.901802 (+218242us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:07.901866 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.901961 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.644058 (+742097us) raft_consensus.cc:1685] finished
0709 12:24:08.644090 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.644273 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":195748,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":237232,"threads_started":2,"wal-append.queue_time_us":540640}
I20260709 12:24:08.659732 18918 rpcz_store.cc:276] 0709 12:24:07.202322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.202486 (+   164us) service_pool.cc:224] Handling call
0709 12:24:07.202851 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:07.203205 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.203242 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:07.203757 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:24:07.501090 (+297333us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:07.501153 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.501230 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.658817 (+1157587us) raft_consensus.cc:1685] finished
0709 12:24:08.658849 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.659054 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":783,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":34632,"thread_start_us":238307,"threads_started":1,"wal-append.queue_time_us":577571}
W20260709 12:24:08.574337 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.598639 21857 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:24:08.600257 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1820) took 1076 ms. Trace:
I20260709 12:24:08.601261 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.669170 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:08.669703 18841 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:24:08.671063 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.613982 21891 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:08.642576 21751 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.582319 21874 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:08.602361 21876 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:24:08.578711 21775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.007s	sys 0.028s
W20260709 12:24:08.666967 18772 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.005s	sys 0.018s
I20260709 12:24:08.671903 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:08.675753 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:08.668156 18922 rpcz_store.cc:276] 0709 12:24:07.523899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.042647 (+518748us) service_pool.cc:224] Handling call
0709 12:24:08.042947 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.043308 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.043342 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.198070 (+154728us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.537823 (+339753us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:08.538219 (+   396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.539169 (+   950us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.600011 (+ 60842us) raft_consensus.cc:1685] finished
0709 12:24:08.600036 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.600190 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1525,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":132149,"threads_started":1,"wal-append.queue_time_us":307944}
I20260709 12:24:08.573348 21295 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:24:08.682808 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:08.692255 18914 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:24:08.590301 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:08.693358 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:08.687390 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:08.690128 18772 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.005s	sys 0.018s
I20260709 12:24:08.691190 18918 raft_consensus.cc:2376] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6. Re-sending same reply.
W20260709 12:24:08.693413 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 103199us
I20260709 12:24:08.699175 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:08.702407 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.704363 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:08.626183 21864 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:08.711809 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:08.675062 21891 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:08.707629 21672 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.005s
I20260709 12:24:08.730261 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:08.730965 18773 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.685585 21751 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:08.680718 21714 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:08.734000 18764 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:08.701136 21775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.007s	sys 0.029s
I20260709 12:24:08.722555 21874 raft_consensus.cc:2764] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:08.723893 21865 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:08.741074 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:08.723008 21891 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.728655 21758 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:08.761839 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.753945 19491 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:08.745198 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:08.540400 21878 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:24:08.728721 21672 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:08.635236 21804 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:08.771426 18765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.004s	sys 0.023s
I20260709 12:24:08.588268 21879 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 12:24:08.692888 21826 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:24:08.740742 21769 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:08.754688 21881 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:08.759018 18841 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:08.770370 18917 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:08.770848 18773 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:08.779088 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
W20260709 12:24:08.778502 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.010s	sys 0.023s
I20260709 12:24:08.779819 18764 raft_consensus.cc:606] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:08.780354 18764 raft_consensus.cc:614] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:08.772460 18765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.005s	sys 0.023s
W20260709 12:24:08.779847 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.010s	sys 0.023s
W20260709 12:24:08.766292 21760 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.943s	user 0.011s	sys 0.003s
W20260709 12:24:08.783749 18921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.016s	sys 0.017s
I20260709 12:24:08.745990 21865 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:08.785645 18921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.016s	sys 0.017s
W20260709 12:24:08.770923 21856 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.013s	sys 0.014s
W20260709 12:24:08.789373 21856 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.014s	sys 0.015s
I20260709 12:24:08.796411 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:08.766139 21889 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:08.805281 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70004.5us
I20260709 12:24:08.793624 21865 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.782992 21848 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.795367 21760 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:08.795696 21874 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:08.805783 21800 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:08.813614 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 476) took 1967 ms. Trace:
W20260709 12:24:08.812463 21882 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:24:08.808154 21686 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:08.823166 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 458) took 1011 ms. Trace:
I20260709 12:24:08.808574 21878 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:08.807242 21264 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:08.823622 18844 rpcz_store.cc:276] 0709 12:24:07.811867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.812036 (+   169us) service_pool.cc:224] Handling call
0709 12:24:07.847924 (+ 35888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:07.856997 (+  9073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.857045 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:07.857742 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.591438 (+733696us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:08.591493 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.591590 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.822870 (+231280us) raft_consensus.cc:1685] finished
0709 12:24:08.822899 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.823080 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8493,"raft.queue_time_us":32753,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":24629,"thread_start_us":689988,"threads_started":1,"wal-append.queue_time_us":823759}
I20260709 12:24:08.818200 18766 rpcz_store.cc:276] 0709 12:24:06.846272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.846472 (+   200us) service_pool.cc:224] Handling call
0709 12:24:07.141126 (+294654us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:07.187999 (+ 46873us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:07.293669 (+105670us) log.cc:844] Serialized 14 byte log entry
0709 12:24:07.827596 (+533927us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:07.865363 (+ 37767us) log.cc:844] Serialized 78 byte log entry
0709 12:24:07.866771 (+  1408us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:07.866822 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.866893 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.813290 (+946397us) raft_consensus.cc:1685] finished
0709 12:24:08.813321 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.813534 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41063,"raft.queue_time_us":235617,"raft.run_cpu_time_us":693,"raft.run_wall_time_us":106396,"thread_start_us":465561,"threads_started":1,"wal-append.queue_time_us":1034634}
I20260709 12:24:08.806185 21888 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 12:24:08.809558 21889 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:08.815644 21846 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.834188 18842 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:08.867197 19487 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:08.868468 21904 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:08.869009 21904 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:08.869997 21904 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:08.830122 21800 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:08.871389 21904 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.871662 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 466) took 1054 ms. Trace:
I20260709 12:24:08.872257 18839 rpcz_store.cc:276] 0709 12:24:07.817672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.947798 (+130126us) service_pool.cc:224] Handling call
0709 12:24:07.948057 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.321480 (+373423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.871316 (+549836us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54003db154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:08.871577 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843654400}
I20260709 12:24:08.873307 21800 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:08.873869 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:08.880733 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:08.864746 21895 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:24:08.891950 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84560.5us
W20260709 12:24:08.894366 19456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.624s (SENT) [suppressed 42 similar messages]
I20260709 12:24:08.907773 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1817) took 1385 ms. Trace:
I20260709 12:24:08.908277 18921 rpcz_store.cc:276] 0709 12:24:07.522798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.954697 (+431899us) service_pool.cc:224] Handling call
0709 12:24:07.955030 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.001193 (+ 46163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.030140 (+ 28947us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.030735 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 12:24:08.786449 (+755714us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:08.787573 (+  1124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.787677 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.907504 (+119827us) raft_consensus.cc:1685] finished
0709 12:24:08.907526 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.907693 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1970,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":886,"thread_start_us":649591,"threads_started":1,"wal-append.queue_time_us":782374}
W20260709 12:24:08.911057 21903 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:24:08.911960 21751 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:08.895275 21264 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:08.910894 21881 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:08.913517 21672 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:09.075680 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.005837 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 457) took 1209 ms. Trace:
I20260709 12:24:08.949286 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1596) took 1219 ms. Trace:
I20260709 12:24:08.966511 21889 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.246351 18764 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
W20260709 12:24:09.022058 21905 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:24:09.237845 18772 rpcz_store.cc:276] 0709 12:24:07.729561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.747884 (+ 18323us) service_pool.cc:224] Handling call
0709 12:24:07.812098 (+ 64214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.812378 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:08.696307 (+883929us) log.cc:844] Serialized 14 byte log entry
0709 12:24:08.948740 (+252433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:08.948828 (+    88us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:08.948910 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.949005 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.949183 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19461,"prepare.queue_time_us":126299,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":91126,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":863,"thread_start_us":1115886,"threads_started":2}
I20260709 12:24:09.268308 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.269440 18764 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:09.225385 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 127661us
I20260709 12:24:09.270984 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:09.272708 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.914535 21888 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.284788 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.286203 18772 raft_consensus.cc:2410] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:09.296414 21865 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.299575 21865 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:09.267678 21891 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:09.318420 21891 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:09.266022 21264 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.325052 21264 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:09.303900 21888 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.329198 21888 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:09.348821 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.358254 19456 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.607s (SENT)
I20260709 12:24:09.358958 19456 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:09.359995 21865 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.237031 18840 rpcz_store.cc:276] 0709 12:24:07.796418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.822880 (+ 26462us) service_pool.cc:224] Handling call
0709 12:24:07.866689 (+ 43809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.329427 (+462738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.329466 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:08.329511 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:08.329544 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.005475 (+675931us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400326ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:09.005549 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.005753 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062771968}
I20260709 12:24:09.088496 19483 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:09.394446 19456 leader_election.cc:336] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.643s (SENT)
W20260709 12:24:09.405138 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.655s (SENT)
I20260709 12:24:09.405848 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:09.407685 21865 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:09.416574 21881 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:09.417519 21881 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.421044 21881 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:08.971975 21840 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.257s	user 0.004s	sys 0.000s
I20260709 12:24:09.025878 21855 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:09.445015 21855 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:09.446509 21855 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:09.447718 21855 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.075328 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.504587 18766 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:09.024302 21853 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.308s	user 0.002s	sys 0.000s
W20260709 12:24:08.985867 21898 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:24:09.040187 21833 raft_consensus.cc:1064] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:24:09.026551 21775 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.919060 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:08.922827 21909 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:09.040974 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:09.512225 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 471334us
W20260709 12:24:09.001616 21765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.010s	sys 0.005s
I20260709 12:24:09.028398 21839 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:08.973919 21901 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:24:09.022574 21844 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.315s	user 0.003s	sys 0.000s
W20260709 12:24:09.481837 19456 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.211s (SENT)
I20260709 12:24:09.518635 21839 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:09.491928 18739 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.642s (SENT)
I20260709 12:24:09.516672 21751 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:09.495791 21888 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:09.496323 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1991) took 2121 ms. Trace:
W20260709 12:24:09.496369 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 225493us
W20260709 12:24:09.518141 18769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.001s	sys 0.010s
W20260709 12:24:09.510852 21833 raft_consensus.cc:1068] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Unable to promote non-voter 43b520eabb65493abe84f4cf06806cba: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:09.548434 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:09.549659 18769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.002s	sys 0.010s
I20260709 12:24:09.547987 18917 rpcz_store.cc:276] 0709 12:24:07.375051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.622731 (+247680us) service_pool.cc:224] Handling call
0709 12:24:07.673573 (+ 50842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.778864 (+1105291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.496006 (+717142us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540008e654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:09.496230 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2521734912}
W20260709 12:24:09.522661 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 603729us
W20260709 12:24:09.515735 21765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.014s	sys 0.012s
I20260709 12:24:09.031066 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1597) took 1301 ms. Trace:
I20260709 12:24:09.561174 18770 rpcz_store.cc:276] 0709 12:24:07.729874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.757887 (+ 28013us) service_pool.cc:224] Handling call
0709 12:24:07.758320 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.899597 (+141277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.899642 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:07.899703 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:07.899763 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.030791 (+1131028us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000af0d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:09.030841 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.031003 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324202368}
W20260709 12:24:09.536110 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54344.9us
I20260709 12:24:09.508387 21775 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:09.511436 21909 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:09.494683 21836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.772s	user 0.006s	sys 0.009s
I20260709 12:24:09.546379 21714 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:09.542279 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:09.543315 18848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1915) took 3246 ms (client timeout 1711 ms). Trace:
I20260709 12:24:09.544440 21881 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:09.555558 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:09.534085 21762 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:09.559494 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:09.537434 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:09.547782 21888 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:09.520613 21672 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:24:09.595646 18848 rpcz_store.cc:269] 0709 12:24:06.296700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.296916 (+   216us) service_pool.cc:224] Handling call
0709 12:24:09.543019 (+3246103us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400108bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:09.543193 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2915528960}
I20260709 12:24:09.557484 21751 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:09.602468 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46983.8us
W20260709 12:24:09.581881 21836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.862s	user 0.006s	sys 0.010s
I20260709 12:24:09.601024 19483 raft_consensus.cc:2410] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:09.556736 21912 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:09.604143 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 112256us
W20260709 12:24:09.611178 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 88061.4us
I20260709 12:24:09.583777 21916 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.580870 21908 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.145s
I20260709 12:24:09.706010 21862 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:24:09.720950 21756 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:09.723336 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:09.724642 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:09.606374 21888 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:09.727140 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:09.731024 19487 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:09.733294 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:09.607685 21879 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.607496 21848 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:09.736001 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:09.611239 21930 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:09.743587 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.605398 21881 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.747193 19487 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:09.734627 21912 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:09.740880 21913 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 12:24:09.751470 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1598) took 2005 ms. Trace:
I20260709 12:24:09.751842 18765 rpcz_store.cc:276] 0709 12:24:07.746228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.783974 (+ 37746us) service_pool.cc:224] Handling call
0709 12:24:07.829695 (+ 45721us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:07.884891 (+ 55196us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:07.932640 (+ 47749us) log.cc:844] Serialized 14 byte log entry
0709 12:24:08.793047 (+860407us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:08.799614 (+  6567us) log.cc:844] Serialized 52 byte log entry
0709 12:24:08.799798 (+   184us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:08.805439 (+  5641us) log.cc:844] Serialized 14 byte log entry
0709 12:24:08.815362 (+  9923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.815483 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.751284 (+935801us) raft_consensus.cc:1685] finished
0709 12:24:09.751299 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.751417 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23006,"prepare.queue_time_us":147687,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":19025,"raft.queue_time_us":288933,"raft.run_cpu_time_us":554,"raft.run_wall_time_us":86240,"spinlock_wait_cycles":6765056,"thread_start_us":765738,"threads_started":2,"wal-append.queue_time_us":857573}
I20260709 12:24:09.748803 21751 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.738247 21836 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 12:24:09.757102 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.738519 21921 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:09.757407 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1614) took 1428 ms. Trace:
I20260709 12:24:09.758870 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.744289 21760 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:09.744403 21904 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:09.725492 21775 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:09.762185 18773 rpcz_store.cc:276] 0709 12:24:08.328877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.800952 (+472075us) service_pool.cc:224] Handling call
0709 12:24:08.808587 (+  7635us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:08.983897 (+175310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.983943 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:08.984759 (+   816us) log.cc:844] Serialized 52 byte log entry
0709 12:24:09.510836 (+526077us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:09.605887 (+ 95051us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.606094 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.606163 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.757152 (+150989us) raft_consensus.cc:1685] finished
0709 12:24:09.757173 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.757349 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196136,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":93229,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":69189,"thread_start_us":674517,"threads_started":3,"wal-append.queue_time_us":566765}
I20260709 12:24:09.725716 21916 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.783370 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:09.784364 18772 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:09.784447 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.705521 21839 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:09.786427 18770 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:09.788780 18766 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:09.790328 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62081.7us
I20260709 12:24:09.740309 21920 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:24:09.802572 21839 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:09.803076 21881 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:09.803880 21881 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:09.804525 21881 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:09.808354 21916 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:09.809509 21775 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:09.768059 21904 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:09.814682 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:09.816200 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 89680.4us
I20260709 12:24:09.818204 18772 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:09.818279 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:09.741336 21930 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.822700 21672 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:09.833000 21672 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:09.834028 21672 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.839903 21930 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:09.840855 21904 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.842084 21904 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:09.851490 21912 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.855990 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:09.857041 19483 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:09.858281 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2143) took 1561 ms. Trace:
I20260709 12:24:09.858764 18845 rpcz_store.cc:276] 0709 12:24:08.297052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.342814 (+ 45762us) service_pool.cc:224] Handling call
0709 12:24:08.343386 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.590925 (+247539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.858010 (+1267085us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003282d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:09.858212 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527485824}
I20260709 12:24:09.859815 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1939) took 1911 ms. Trace:
I20260709 12:24:09.858944 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.860229 18842 rpcz_store.cc:276] 0709 12:24:07.948851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.044095 (+ 95244us) service_pool.cc:224] Handling call
0709 12:24:08.044572 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.865696 (+821124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.859554 (+993858us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400238554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:09.859737 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815372160}
I20260709 12:24:09.862315 21891 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:09.862578 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:09.862943 21891 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.864336 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:09.865388 21891 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:09.874119 18845 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:09.873513 21888 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:09.860672 18772 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:09.883543 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1616) took 1553 ms. Trace:
I20260709 12:24:09.884065 18769 rpcz_store.cc:276] 0709 12:24:08.329669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.807147 (+477478us) service_pool.cc:224] Handling call
0709 12:24:08.813777 (+  6630us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:08.986299 (+172522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.986332 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:09.004789 (+ 18457us) log.cc:844] Serialized 78 byte log entry
0709 12:24:09.873409 (+868620us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540012df20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef5090 00007f335af026b8 00007f335af8b92b 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c
0709 12:24:09.873471 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:09.873863 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.875056 (+  1193us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.878866 (+  3810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.879249 (+   383us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:09.883188 (+  3939us) raft_consensus.cc:1685] finished
0709 12:24:09.883218 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:09.883440 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3474,"prepare.queue_time_us":832,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":97370,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":2386,"spinlock_wait_cycles":30471936,"thread_start_us":719225,"threads_started":2,"wal-append.queue_time_us":535547}
I20260709 12:24:09.879593 21891 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:09.879048 21900 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:09.882769 21811 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:09.886965 21889 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:24:09.916966 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.916533 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 183674us
I20260709 12:24:09.909420 21881 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:09.921538 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:09.924187 18917 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.911072 21811 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:09.928789 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:09.929625 18913 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:09.931573 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.934937 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:09.938690 18917 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:09.940728 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:09.940877 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.941926 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:09.942786 18772 raft_consensus.cc:2368] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6.
I20260709 12:24:09.943653 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:09.943992 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.944150 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.944332 18919 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:09.944737 18766 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 2.
W20260709 12:24:09.944098 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 79860.4us
I20260709 12:24:09.953052 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:09.959154 18738 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.697s (SENT)
I20260709 12:24:09.947841 18917 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:09.911264 21891 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:24:09.979175 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:09.979918 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:09.905027 21900 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:09.983613 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:09.988595 18917 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:09.990450 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:09.993724 18772 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:10.001309 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:10.001878 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.002737 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:10.003374 19492 raft_consensus.cc:2410] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:24:10.007411 18739 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.717s (SENT)
I20260709 12:24:10.008081 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.003559 18769 raft_consensus.cc:2376] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5. Re-sending same reply.
I20260709 12:24:09.922811 21836 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:24:10.022277 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.025276 18919 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:10.139525 18766 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:10.143438 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.023080 18913 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:10.123531 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.920s (SENT)
I20260709 12:24:09.985972 21854 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.052090 21746 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:10.153847 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.164924 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:10.101608 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 476) took 1404 ms. Trace:
I20260709 12:24:10.025501 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.166848 19489 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:10.136617 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.167481 19491 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:10.104379 21863 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.721s	user 0.011s	sys 0.006s
W20260709 12:24:10.150593 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 191498us
I20260709 12:24:10.133044 18764 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
W20260709 12:24:10.174162 18738 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.711s (SENT)
I20260709 12:24:10.160432 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.160799 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.163451 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.174762 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.150447 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.175232 18919 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:10.175732 18772 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:10.175823 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:10.174191 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 185587us
W20260709 12:24:10.099628 21925 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.360s	user 0.001s	sys 0.001s
I20260709 12:24:10.167294 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 473) took 1564 ms. Trace:
I20260709 12:24:10.172951 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.165762 18841 rpcz_store.cc:276] 0709 12:24:08.697478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.701980 (+  4502us) service_pool.cc:224] Handling call
0709 12:24:10.101339 (+1399359us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b5400285854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:10.101525 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127763712}
I20260709 12:24:10.022657 21941 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.176508 19483 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:10.178984 19488 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:10.176764 18886 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.632s (SENT)
W20260709 12:24:10.228211 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51480us
W20260709 12:24:10.229038 18886 connection.cc:256] RPC call timeout handler was delayed by -2.9743262709998817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
I20260709 12:24:10.229171 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:10.229660 18886 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.664s (SENT)
W20260709 12:24:10.230150 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 52717.3us
I20260709 12:24:10.124023 21888 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:10.231072 18886 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.697s (SENT)
I20260709 12:24:10.227626 18844 rpcz_store.cc:276] 0709 12:24:08.602712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.882179 (+279467us) service_pool.cc:224] Handling call
0709 12:24:08.896379 (+ 14200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.896700 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:08.906200 (+  9500us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.054760 (+1148560us) spinlock_profiling.cc:243] Waited 947 us on lock 0x7b1800410320. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:24:10.166422 (+111662us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.166785 (+   363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.166859 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:10.166938 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.167033 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.167192 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7847,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":1088,"raft.run_wall_time_us":3609,"spinlock_wait_cycles":122249728,"thread_start_us":110850,"threads_started":2,"wal-append.queue_time_us":1248397}
I20260709 12:24:10.232107 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:10.233466 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.231066 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:10.234467 18917 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:10.234956 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:10.237821 18886 connection.cc:256] RPC call timeout handler was delayed by -2.8910333609996997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 12:24:10.238574 18886 connection.cc:256] RPC call timeout handler was delayed by -2.8738858029996663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 12:24:10.239557 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.240715 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:10.241652 18886 connection.cc:256] RPC call timeout handler was delayed by -2.4706719850000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260709 12:24:10.242275 18886 connection.cc:256] RPC call timeout handler was delayed by -2.3869719849999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260709 12:24:10.242225 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:10.242946 18886 connection.cc:256] RPC call timeout handler was delayed by -2.3536719849998917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
W20260709 12:24:10.243566 18886 connection.cc:256] RPC call timeout handler was delayed by -2.2957262710001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2664s for a response
W20260709 12:24:10.244287 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70155.5us
W20260709 12:24:10.229331 21948 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:24:10.252228 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.250247 19483 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:10.245296 18886 connection.cc:256] RPC call timeout handler was delayed by -2.2596443859997635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 12:24:10.251611 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:10.254375 18886 connection.cc:256] RPC call timeout handler was delayed by -2.2596260700001949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 12:24:10.254884 18886 connection.cc:256] RPC call timeout handler was delayed by -2.235770015000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 12:24:10.255246 18886 connection.cc:256] RPC call timeout handler was delayed by -2.1853589880001891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28140000000000004s for a response
W20260709 12:24:10.255609 18886 connection.cc:256] RPC call timeout handler was delayed by -2.171304088999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 12:24:10.255916 18886 connection.cc:256] RPC call timeout handler was delayed by -2.1560040889999073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 12:24:10.255963 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:10.256325 18886 connection.cc:256] RPC call timeout handler was delayed by -2.1137040889998389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 12:24:10.256640 18886 connection.cc:256] RPC call timeout handler was delayed by -1.7168660669999554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 12:24:10.256984 18886 connection.cc:256] RPC call timeout handler was delayed by -1.6898660669999117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 12:24:10.257305 18886 connection.cc:256] RPC call timeout handler was delayed by -1.6772660669998913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:24:10.257599 18886 connection.cc:256] RPC call timeout handler was delayed by -1.6565660669998579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260709 12:24:10.257805 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:10.259481 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:10.259727 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:10.260337 18764 raft_consensus.cc:2376] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5. Re-sending same reply.
I20260709 12:24:10.261890 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.263334 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.264846 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.266185 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.267540 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.268240 18764 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:24:10.269001 21946 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:10.272404 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.273409 18764 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:10.270385 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:10.274988 21946 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.233587 21746 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:10.244396 21846 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:10.278373 21846 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.278846 21846 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:10.148304 21909 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.286309 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:10.287256 21909 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.288697 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.291064 18922 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:10.292040 21585 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.294664 21565 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:10.296979 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:10.297835 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44144.3us
I20260709 12:24:10.298687 21762 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:10.168965 21854 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.299297 21762 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:10.300310 21762 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.301227 21854 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.302115 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.290294 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.305002 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 475) took 3584 ms. Trace:
I20260709 12:24:10.305410 18767 rpcz_store.cc:276] 0709 12:24:06.720207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.720434 (+   227us) service_pool.cc:224] Handling call
0709 12:24:07.155717 (+435283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:07.392132 (+236415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.392180 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:07.401467 (+  9287us) log.cc:844] Serialized 52 byte log entry
0709 12:24:08.045083 (+643616us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:08.045143 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.046037 (+   894us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.103682 (+2057645us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:10.304612 (+200930us) raft_consensus.cc:1685] finished
0709 12:24:10.304634 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.304908 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31900,"raft.queue_time_us":127525,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":6392064,"thread_start_us":821595,"threads_started":2,"wal-append.queue_time_us":903588}
I20260709 12:24:10.307929 21826 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:10.308424 21826 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:10.309875 21940 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:24:10.312984 21900 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.314332 21879 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:10.314852 21879 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:10.243979 21775 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.315724 18917 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:10.316038 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.244174 21891 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.317830 21891 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:10.319000 18846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1913) took 4038 ms (client timeout 1697 ms). Trace:
W20260709 12:24:10.319478 18846 rpcz_store.cc:269] 0709 12:24:06.280982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.289763 (+  8781us) service_pool.cc:224] Handling call
0709 12:24:10.318731 (+4028968us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54003264d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:10.318915 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3597010816}
W20260709 12:24:10.321954 21937 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:24:10.326766 18847 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:10.327513 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.327842 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.328428 18913 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:10.328557 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1930) took 3718 ms. Trace:
I20260709 12:24:10.327517 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.329075 18847 rpcz_store.cc:276] 0709 12:24:06.610695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.610844 (+   149us) service_pool.cc:224] Handling call
0709 12:24:10.326498 (+3715654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:10.327302 (+   804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.328301 (+   999us) spinlock_profiling.cc:243] Waited 3.71 s on lock 0x7b54003264d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:10.328453 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8544344832}
I20260709 12:24:10.329666 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.329879 18917 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:10.330955 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.331604 18922 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
W20260709 12:24:10.331858 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.332137 21912 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.332720 21912 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.334523 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:10.335237 18921 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.342378 21904 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:10.348095 21904 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.333065 21796 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.315825 21879 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.351568 21879 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:10.351780 21873 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.919s	user 0.008s	sys 0.008s
W20260709 12:24:10.345906 21924 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.741s	user 0.001s	sys 0.000s
I20260709 12:24:10.347182 19488 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:10.355208 19458 connection.cc:256] RPC call timeout handler was delayed by -1.4887350779999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260709 12:24:10.355800 19458 connection.cc:256] RPC call timeout handler was delayed by -1.0956330099998013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 12:24:10.358193 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.364214 19488 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:10.364593 19487 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:10.364017 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:10.309408 21826 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.373443 21826 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.389843 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:10.074170 21811 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:10.407826 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.407430 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:10.413467 18847 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:10.413257 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.383458 21854 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.407902 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.407941 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:10.415671 18769 raft_consensus.cc:2376] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6. Re-sending same reply.
I20260709 12:24:10.408269 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:10.417131 18914 raft_consensus.cc:2410] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:24:10.406898 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 136616us
I20260709 12:24:10.399444 21529 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:10.423163 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 49733.3us
I20260709 12:24:10.424708 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.425642 18915 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:10.426986 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.397683 21797 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:10.403575 21878 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:10.461443 18921 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
W20260709 12:24:10.454687 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.403939 21953 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:10.457947 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:10.417513 21891 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:10.459671 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.388659 21900 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:24:10.468133 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:10.437081 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.470219 21442 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:10.477842 21955 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.323s	user 0.000s	sys 0.004s
I20260709 12:24:10.478499 21848 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.480324 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.428854 21775 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:24:10.484704 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:10.486629 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:10.428324 21934 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 12:24:10.491935 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 86973.2us
I20260709 12:24:10.488302 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:10.467411 21953 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:10.462558 21797 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.500618 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:10.503676 18769 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:10.463317 21836 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:24:10.488858 21565 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.465648 21874 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:24:10.534025 21842 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:10.534576 21842 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:10.501737 21746 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:10.535303 21746 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:10.535748 21746 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:10.535480 21842 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.536953 21842 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.488746 21442 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:10.539067 21442 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:10.485924 21891 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.502413 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:10.551270 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48937.9us
I20260709 12:24:10.465112 21878 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.499562 21953 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:10.505038 21848 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:10.557674 21848 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.560832 21904 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:10.562047 21848 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.518877 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:10.493250 21775 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:10.523572 18767 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:10.565068 18767 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:10.566083 18767 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.567472 18767 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.527408 21910 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.569437 21910 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.570863 18772 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:10.572362 21666 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:10.581066 18767 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:24:10.581787 18767 pending_rounds.cc:85] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 7
I20260709 12:24:10.582340 18767 pending_rounds.cc:107] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:24:10.582748 18767 raft_consensus.cc:2889] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:10.541533 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.546813 21846 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.549630 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.543718 21442 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:10.552973 19456 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.624s (SENT)
I20260709 12:24:10.557039 21962 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.596645 21962 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:10.509378 21836 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:10.597642 21836 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:10.598869 21836 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.600394 21836 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.560047 21878 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.493386 21906 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:10.563050 18769 raft_consensus.cc:606] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.606011 18769 raft_consensus.cc:614] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:10.519699 18771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 474) took 3898 ms (client timeout 1920 ms). Trace:
I20260709 12:24:10.495759 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:10.607643 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 111985us
I20260709 12:24:10.608861 18886 leader_election.cc:400] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6.
I20260709 12:24:10.609289 18886 leader_election.cc:403] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:10.563804 18773 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
W20260709 12:24:10.587673 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46225.3us
I20260709 12:24:10.593428 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:10.604502 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 195963us
I20260709 12:24:10.610800 18921 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:10.556123 21565 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:10.612169 21565 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:24:10.615336 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:10.616566 21848 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.617074 21848 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:10.617563 21848 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.618767 21775 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:10.618698 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.621663 18922 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
W20260709 12:24:10.606947 18771 rpcz_store.cc:269] 0709 12:24:06.621345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.622176 (+   831us) service_pool.cc:224] Handling call
0709 12:24:10.519388 (+3897212us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002a1554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:10.519589 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308615040}
I20260709 12:24:10.630874 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:10.637197 21664 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:10.632534 21565 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365)
I20260709 12:24:10.573802 21797 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.639973 19458 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:10.636161 21775 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6.
I20260709 12:24:10.640769 21846 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:10.595414 21841 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:10.641083 21565 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:10.647344 21565 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.641695 21442 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.635289 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:10.597213 21962 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.659967 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:10.658447 18886 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.648s (SENT)
W20260709 12:24:10.661934 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50638us
I20260709 12:24:10.668196 19458 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.664577 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:10.672868 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:10.659277 21775 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:10.663947 21841 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.705994 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 1992) took 3305 ms. Trace:
I20260709 12:24:10.706717 18920 rpcz_store.cc:276] 0709 12:24:07.375342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.656302 (+280960us) service_pool.cc:224] Handling call
0709 12:24:07.682927 (+ 26625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.734629 (+ 51702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.734679 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:07.734741 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:07.734797 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.680068 (+2945271us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b54003548d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:10.680122 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.680292 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118178688}
I20260709 12:24:10.674896 21933 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.724048 21963 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.676812 21833 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.705410 21775 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:10.706233 21841 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:10.742297 21775 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:10.746459 21841 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.746881 18764 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:10.732725 21963 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:10.747866 21963 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.750602 21878 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.751217 21878 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.751837 21565 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:10.753437 21878 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.730911 21833 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.771167 21833 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.789079 21852 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:10.789929 21664 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:10.802065 21664 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.808127 21833 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:10.811923 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.812166 21833 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:10.838461 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 170327us
W20260709 12:24:10.868109 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 164047us
I20260709 12:24:10.859839 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:10.887723 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:10.888408 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:10.890700 21811 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:10.891700 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:10.892727 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:10.895339 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:10.887341 21841 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.896490 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:10.897715 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:10.898545 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:10.898664 21841 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:10.903805 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45466.8us
I20260709 12:24:10.905092 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:10.916934 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.896699 21839 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:10.911783 21797 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:10.905853 21811 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:10.954514 21811 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.957031 21811 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:10.959030 21968 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:24:10.950003 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.922747 21841 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:10.962205 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:10.965884 21976 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:10.966537 21976 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:10.967507 21976 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.971681 18922 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:10.975557 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1625) took 1226 ms. Trace:
I20260709 12:24:10.963438 21565 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.976044 18770 rpcz_store.cc:276] 0709 12:24:09.748695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.748855 (+   160us) service_pool.cc:224] Handling call
0709 12:24:09.749249 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:09.788201 (+ 38952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.975269 (+1187068us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b540029d1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:10.975485 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78040320}
I20260709 12:24:10.988873 18922 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:10.992111 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93628.9us
I20260709 12:24:10.950448 21797 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:10.997037 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:10.997478 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:10.995749 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:11.002914 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:11.003791 18916 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.003014 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:11.006515 21964 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:24:10.991284 21959 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:24:11.012254 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:11.013540 18916 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:11.024808 21765 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.030771 21765 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.033166 21765 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:10.986752 21841 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:11.036026 21841 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:10.998984 21797 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:10.993697 21977 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.982321 21953 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.964922 21848 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:10.976833 21565 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:10.987957 21746 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.046913 21751 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:11.061167 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.034188 21975 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:11.073046 21990 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:11.057682 21977 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:11.083925 18915 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:11.087896 21970 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:24:11.069274 21751 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.065976 21982 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:11.090683 21848 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:11.091555 21910 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:11.082190 21975 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:11.104934 21565 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:11.106110 21962 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.108950 21962 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:11.094563 21751 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.088670 21977 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:11.135923 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 77550.3us
I20260709 12:24:11.140383 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:11.101936 21982 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:11.132006 21839 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:11.149641 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 153996us
W20260709 12:24:11.152612 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 154051us
W20260709 12:24:11.151607 18814 connection.cc:256] RPC call timeout handler was delayed by -1.671889801999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:24:11.156595 18814 connection.cc:256] RPC call timeout handler was delayed by -1.5656898019997243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:24:11.157155 18814 connection.cc:256] RPC call timeout handler was delayed by -1.5368898019996777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 12:24:11.157547 18814 connection.cc:256] RPC call timeout handler was delayed by -1.0597661480001079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2675s for a response
I20260709 12:24:11.164150 19458 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:11.169754 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:11.170650 18921 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:24:11.147269 21963 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.202963 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:11.176241 21664 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:11.209391 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:11.162629 21993 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:24:11.222087 19491 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.190049 21746 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:11.212752 21976 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.235741 21976 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.236243 21976 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.248406 21998 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:11.250941 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:11.182605 21775 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.205317 21974 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:24:11.271708 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:11.246490 21664 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:11.182286 21839 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.281741 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:11.282702 19489 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:11.225239 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.278482 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:11.290174 18921 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:11.267015 21953 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:11.298969 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:11.310799 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.289763 21702 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:11.183300 21975 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.227262 21982 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.332931 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.333943 18846 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:11.342024 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.343070 18846 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:11.350906 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.351785 18844 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
W20260709 12:24:11.351979 21933 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.615s	user 0.014s	sys 0.000s
I20260709 12:24:11.352667 21933 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:11.339313 21989 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 12:24:11.355150 21991 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:24:11.357009 19489 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:11.366705 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.375336 18921 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:11.379822 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.380826 18844 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:11.382026 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.383399 18847 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:11.385102 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.386298 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:11.387924 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.388800 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.389493 18844 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:11.390906 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.395915 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:11.396633 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:11.399747 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:11.400406 18844 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.405263 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:11.408386 21997 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:24:11.397733 21963 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:11.368464 21664 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.421021 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.423379 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:11.431290 22003 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:11.431301 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:11.432080 22003 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.433231 19487 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:11.414875 21775 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:11.437122 21702 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:11.437557 21702 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:11.443589 21996 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:11.438832 21841 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.447199 21841 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:11.447712 18840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 481) took 1933 ms (client timeout 1504 ms). Trace:
W20260709 12:24:11.448290 18840 rpcz_store.cc:269] 0709 12:24:09.513984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.541942 (+ 27958us) service_pool.cc:224] Handling call
0709 12:24:11.447382 (+1905440us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400020b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:11.447598 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730267392}
I20260709 12:24:11.438359 21702 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.450963 21702 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:11.451474 22006 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:11.452093 22008 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:11.452328 22006 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:11.452663 22008 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:11.453299 22006 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:11.451761 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55283.9us
W20260709 12:24:11.457165 22012 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 12:24:11.453648 22008 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.467212 21811 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.467836 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:11.467767 21811 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.470451 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:11.471277 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:11.429284 21797 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.472441 21993 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:11.474123 21811 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:11.476064 21565 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.476670 21775 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.477217 21806 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:11.482205 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:11.485220 21855 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.508527 18841 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:11.485402 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:11.497212 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:11.514441 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:11.513531 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:11.521533 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:11.523478 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:11.525470 18814 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:11.526623 18844 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:11.501523 21946 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:11.532177 21946 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.533780 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.534837 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.529896 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:11.534675 21973 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:11.543056 21973 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:11.543480 21973 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:11.494009 21977 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.529774 21672 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.507113 21775 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.546761 21672 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:11.547091 21977 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:11.547354 21672 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.547981 18845 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.490302 21976 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.548692 21775 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:11.549639 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.508121 21855 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:11.529289 21811 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.553167 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.527447 21963 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:11.507843 21565 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.534997 21990 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.571810 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.591996 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.614689 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.643435 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:11.647460 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 94785.6us
I20260709 12:24:11.556214 21855 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.574316 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.556173 21811 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:11.610118 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.673990 18845 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:11.575999 21965 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.665s	user 0.001s	sys 0.002s
I20260709 12:24:11.619242 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 632) took 1227 ms. Trace:
I20260709 12:24:11.680354 19487 rpcz_store.cc:276] 0709 12:24:10.392054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.392251 (+   197us) service_pool.cc:224] Handling call
0709 12:24:10.392577 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.433799 (+1041222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.618846 (+185047us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54005c0dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:11.619146 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2392709504}
I20260709 12:24:11.659168 19491 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:11.660892 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:11.558784 21977 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:11.603168 22011 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:24:11.678857 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.629798 22003 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:11.609371 21912 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:11.556450 21751 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.656526 18844 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.676393 21811 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.737236 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:11.718897 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 287635us
I20260709 12:24:11.764032 18922 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:11.775058 18847 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:11.775503 18916 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:11.696578 22013 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.793989 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:11.789714 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:11.782320 21797 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:11.736747 21672 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:11.573848 21990 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:11.926229 18843 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:11.930682 18848 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:11.818758 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:11.702761 21963 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:24:11.956678 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 497) took 1531 ms. Trace:
I20260709 12:24:11.784832 21751 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:11.788149 21976 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:11.958954 18765 rpcz_store.cc:276] 0709 12:24:10.424914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.457876 (+ 32962us) service_pool.cc:224] Handling call
0709 12:24:10.474969 (+ 17093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.475232 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:10.475608 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.679110 (+203502us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.681655 (+  2545us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.901685 (+220030us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b18000ff4c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f
0709 12:24:10.924633 (+ 22948us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b48000d0bd8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:24:11.036611 (+111978us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b18000ff4c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:11.956011 (+919400us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b18000ff4c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:24:11.956185 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:11.956240 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:11.956288 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.956378 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.956569 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1257132,"prepare.queue_time_us":366879,"prepare.run_cpu_time_us":162,"prepare.run_wall_time_us":167,"raft.queue_time_us":24657,"raft.run_cpu_time_us":3385,"raft.run_wall_time_us":236363,"spinlock_wait_cycles":85305344,"thread_start_us":201902,"threads_started":1,"wal-append.queue_time_us":320401}
W20260709 12:24:11.959220 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 165303us
W20260709 12:24:11.964412 18842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.013s	sys 0.045s
W20260709 12:24:11.968173 18842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.014s	sys 0.045s
I20260709 12:24:11.970489 18840 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.793828 21978 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:11.968763 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 474337us
I20260709 12:24:11.977830 18845 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:11.980585 18919 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:11.981012 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:11.984242 18919 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:11.819798 21565 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:11.985805 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:11.992060 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:11.992405 18919 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:24:11.988865 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 465476us
I20260709 12:24:11.965850 22003 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:12.026926 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:12.030179 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46684.8us
I20260709 12:24:12.030505 18914 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:12.031647 19458 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:11.995198 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:11.971916 21979 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.042851 18846 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:12.054733 18846 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:12.060686 18843 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:11.979451 21978 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:12.093569 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 98455us
I20260709 12:24:12.094893 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:12.096179 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:12.037436 21987 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.036732 21759 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:12.059511 22008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.003s	sys 0.026s
I20260709 12:24:12.050544 21786 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.152370 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:12.153060 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:12.153126 18839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.020s	sys 0.012s
W20260709 12:24:12.153815 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.050711 21865 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:12.154157 18839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.021s	sys 0.012s
I20260709 12:24:12.193598 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.200593 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:12.198774 18886 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.501s (SENT)
I20260709 12:24:12.207037 18773 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:12.154661 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.208143 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:12.208683 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.209070 18769 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:12.159613 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.155335 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.210242 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.215031 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.098217 21264 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:12.097862 21979 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.128888 21565 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:12.156205 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.155730 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.206254 18765 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:12.225485 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.253624 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.254187 18764 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:12.254630 18767 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:12.215945 18769 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:12.199612 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:12.259935 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.261384 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.157439 18772 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:12.152381 22008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.003s	sys 0.027s
I20260709 12:24:12.263417 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.244783 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.266496 18772 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.263509 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.268987 18764 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:24:12.273370 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73874.2us
I20260709 12:24:12.281747 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.282021 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.283420 18766 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.284981 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.292229 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.290535 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.294688 18841 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:12.297531 18765 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:12.297523 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.299538 18767 raft_consensus.cc:2368] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
I20260709 12:24:12.300976 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.217881 21759 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:12.304345 18764 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:12.217692 21912 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.217494 21846 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.237344 21848 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:12.237427 21941 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:12.279783 22009 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 12:24:12.255134 21906 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.291317 22019 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.487s	user 0.000s	sys 0.002s
I20260709 12:24:12.134147 21921 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.162s
I20260709 12:24:12.245431 21264 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:12.264909 21746 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.335367 18772 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:12.319298 21842 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:12.265349 21565 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:12.319845 22014 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.489s	user 0.001s	sys 0.000s
I20260709 12:24:12.201272 21786 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.338070 18919 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
W20260709 12:24:12.359004 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 321259us
I20260709 12:24:12.396592 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:12.300686 22004 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:24:12.314184 18766 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:12.403638 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 633) took 1156 ms. Trace:
W20260709 12:24:12.408715 18921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.022s	sys 0.023s
I20260709 12:24:12.238181 21978 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.410965 19491 rpcz_store.cc:276] 0709 12:24:11.247682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.247997 (+   315us) service_pool.cc:224] Handling call
0709 12:24:11.248408 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.682646 (+434238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.403241 (+720595us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54005c17d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:12.403543 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944147840}
I20260709 12:24:12.335057 21912 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:12.411095 18921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.022s	sys 0.023s
W20260709 12:24:12.365599 21855 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.679s	user 0.013s	sys 0.000s
W20260709 12:24:12.391010 21973 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.847s	user 0.015s	sys 0.000s
I20260709 12:24:12.428996 18766 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:12.361125 21979 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:12.363044 21746 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.415711 21992 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:24:12.458003 22020 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:24:12.406719 21852 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:12.458798 21852 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.331135 21848 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:12.354831 21264 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.390841 21565 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.334647 21941 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.436040 21920 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:12.429728 21842 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:12.346067 21906 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.492110 21852 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:12.338559 21846 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:12.445678 21855 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.453018 21973 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:12.504175 21920 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:12.535790 21848 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:12.538038 21855 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:12.539189 21920 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.548105 21987 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:12.548962 21987 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.548419 21978 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:12.552428 21990 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:12.556003 22026 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260709 12:24:12.556303 21973 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:12.559818 21973 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.561105 21973 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:12.562176 21973 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.575076 21973 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:12.578581 21973 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:12.578910 21941 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:12.535954 22006 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.623420 21912 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:12.671901 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.731074 18764 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.738919 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1949) took 1352 ms. Trace:
I20260709 12:24:12.739629 18840 rpcz_store.cc:276] 0709 12:24:11.386018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.647320 (+261302us) service_pool.cc:224] Handling call
0709 12:24:11.680992 (+ 33672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.973526 (+292534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.738187 (+764661us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400206054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:12.738648 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665027840}
I20260709 12:24:12.672801 18767 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:12.674798 18768 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.017s	sys 0.005s
I20260709 12:24:12.675511 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.685137 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2165) took 1269 ms. Trace:
W20260709 12:24:12.687094 18920 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.016s	sys 0.026s
I20260709 12:24:12.688252 18766 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:12.690971 18917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.010s	sys 0.005s
W20260709 12:24:12.691715 18918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.042s	sys 0.079s
I20260709 12:24:12.694216 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:12.700610 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:12.706698 19457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.021s	sys 0.035s
I20260709 12:24:12.709761 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 677) took 1288 ms. Trace:
W20260709 12:24:12.765661 19457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.022s	sys 0.035s
W20260709 12:24:12.765681 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:12.765081 18768 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.018s	sys 0.006s
W20260709 12:24:12.765254 18918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.043s	sys 0.080s
W20260709 12:24:12.764686 18920 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.017s	sys 0.026s
W20260709 12:24:12.765157 18917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.010s	sys 0.006s
I20260709 12:24:12.748278 18848 rpcz_store.cc:276] 0709 12:24:11.415741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.762614 (+346873us) service_pool.cc:224] Handling call
0709 12:24:11.766560 (+  3946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.931228 (+164668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.684299 (+753071us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003287d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:12.684841 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276767104}
I20260709 12:24:12.706293 18846 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.780670 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:12.782038 18767 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:12.781167 18846 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.465669 21759 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.791428 21842 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.798822 18769 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.574088 21906 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:12.843837 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 1950) took 1457 ms. Trace:
I20260709 12:24:12.830380 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1851) took 1115 ms. Trace:
W20260709 12:24:12.830642 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.005s	sys 0.006s
W20260709 12:24:12.866698 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.007s	sys 0.006s
I20260709 12:24:12.825233 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.835209 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:12.835631 21811 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.066s	user 0.014s	sys 0.000s
I20260709 12:24:12.834600 21846 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:12.852217 18841 rpcz_store.cc:276] 0709 12:24:11.386320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.647561 (+261241us) service_pool.cc:224] Handling call
0709 12:24:11.647986 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.297386 (+649400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.843098 (+545712us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:12.843586 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1486718848}
I20260709 12:24:12.890309 21811 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:12.855185 18918 rpcz_store.cc:276] 0709 12:24:11.714649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.714792 (+   143us) service_pool.cc:224] Handling call
0709 12:24:11.777008 (+ 62216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.777310 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:11.822146 (+ 44836us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.799906 (+977760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.814354 (+ 14448us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:12.829928 (+ 15574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.830060 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.830307 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44408,"prepare.queue_time_us":92907,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":16831,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":4745,"thread_start_us":954533,"threads_started":1,"wal-append.queue_time_us":763705}
I20260709 12:24:12.891601 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1848) took 1056 ms. Trace:
I20260709 12:24:12.831385 21973 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:12.749152 19489 rpcz_store.cc:276] 0709 12:24:11.421425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.422095 (+   670us) service_pool.cc:224] Handling call
0709 12:24:11.619473 (+197378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.644729 (+ 25256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.644792 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.885434 (+240642us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b2c00075be8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:24:11.885920 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:24:12.349931 (+464011us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:12.350493 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.350581 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.706962 (+356381us) raft_consensus.cc:1685] finished
0709 12:24:12.707010 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.709060 (+  2050us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54005c0dd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:12.709356 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24665,"raft.queue_time_us":25308,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":20732,"spinlock_wait_cycles":481858688,"thread_start_us":463129,"threads_started":1,"wal-append.queue_time_us":606429}
W20260709 12:24:12.902323 18736 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.009s	sys 0.002s
W20260709 12:24:12.906869 18736 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.009s	sys 0.003s
I20260709 12:24:12.907509 21746 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:12.909214 18922 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:12.909852 18916 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:12.909979 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:12.906446 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:12.898341 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 802212us
W20260709 12:24:12.911147 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.911321 18765 raft_consensus.cc:2410] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:12.911965 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:12.912581 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.913404 21786 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:12.888553 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48151.9us
I20260709 12:24:12.914284 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.919268 18765 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:12.914356 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:12.921373 18766 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:12.914255 21786 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:12.921864 18771 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:12.933054 21987 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:12.937480 18913 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:12.938510 21987 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:12.938931 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:12.943310 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 448885us
I20260709 12:24:12.942159 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1854) took 1226 ms. Trace:
I20260709 12:24:12.946275 18917 rpcz_store.cc:276] 0709 12:24:11.715694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.961376 (+245682us) service_pool.cc:224] Handling call
0709 12:24:11.972478 (+ 11102us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.972897 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.972933 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.983849 (+ 10916us) log.cc:844] Serialized 26 byte log entry
0709 12:24:12.920483 (+936634us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:12.941171 (+ 20688us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.941531 (+   360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.941664 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.941762 (+    98us) raft_consensus.cc:1685] finished
0709 12:24:12.941779 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.942048 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":322,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":101,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":12469,"thread_start_us":689328,"threads_started":1,"wal-append.queue_time_us":573832}
I20260709 12:24:12.948752 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:12.949457 18917 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.945708 18771 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:12.940183 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 246531us
I20260709 12:24:12.963325 18764 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:12.973825 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:12.926465 21811 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:12.952458 21746 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.899830 18921 rpcz_store.cc:276] 0709 12:24:11.698476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.698693 (+   217us) service_pool.cc:224] Handling call
0709 12:24:11.765348 (+ 66655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.765641 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:11.807978 (+ 42337us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.754275 (+946297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:12.754475 (+   200us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:12.754655 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.754804 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.755067 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8428,"prepare.queue_time_us":55555,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":147973,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":945399,"threads_started":2,"wal-append.queue_time_us":721050}
W20260709 12:24:12.989445 18839 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.009s	sys 0.015s
I20260709 12:24:13.002307 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:12.988632 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:13.006410 18839 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.010s	sys 0.015s
I20260709 12:24:12.979018 22043 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:13.013415 18769 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:12.979007 22008 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.014554 18846 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:24:13.011354 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:13.020334 18846 pending_rounds.cc:85] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 5
I20260709 12:24:13.028275 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:13.023352 18846 pending_rounds.cc:107] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:13.030799 18846 raft_consensus.cc:2889] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:13.034720 18917 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:13.030184 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:13.043107 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:13.042333 18770 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.703s	user 0.014s	sys 0.007s
I20260709 12:24:13.039826 18773 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:13.051864 18764 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:13.046700 18918 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:13.058794 22035 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.059693 22035 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.062515 18770 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:13.064043 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:13.064785 18770 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:13.064711 21672 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:12.996577 21973 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.062616 22042 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:13.076100 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1855) took 1338 ms. Trace:
I20260709 12:24:13.075914 22042 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.076568 18913 rpcz_store.cc:276] 0709 12:24:11.737288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.805794 (+ 68506us) service_pool.cc:224] Handling call
0709 12:24:13.075724 (+1269930us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54003548d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:13.076015 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165953280}
W20260709 12:24:13.082245 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 67632.2us
I20260709 12:24:13.083329 18922 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:13.072381 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 499) took 1030 ms. Trace:
I20260709 12:24:13.091162 18846 rpcz_store.cc:276] 0709 12:24:12.042186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.042352 (+   166us) service_pool.cc:224] Handling call
0709 12:24:12.042713 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.704823 (+662110us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b4c00045c80. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359257a20 00007f3359268a29 00007f335922e644 00007f3359255f2d 00007f3359255b93 00007f335af8618b 00007f335af86cb5 00007f335af81f30 00007f335af837de 00007f335af8db49 00007f335af8e416
0709 12:24:13.053978 (+349155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.072187 (+ 18209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196668800}
I20260709 12:24:13.086221 21992 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.096760 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:13.096568 21992 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.099864 18769 raft_consensus.cc:2376] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6. Re-sending same reply.
I20260709 12:24:13.102702 18771 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:13.030586 21746 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.106081 18767 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 3.
I20260709 12:24:13.110301 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:13.115234 18765 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:13.114035 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:13.120640 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:13.122087 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 207971us
I20260709 12:24:13.124702 19489 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:13.127315 19484 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:13.127573 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:13.129447 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:13.130504 19492 raft_consensus.cc:2368] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
W20260709 12:24:13.131944 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.132386 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.132871 21746 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:13.135421 21837 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:13.137162 21837 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:13.141987 21889 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:13.154594 18772 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:13.155679 22008 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.162144 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:13.158774 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:13.164567 22035 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:13.076494 22021 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:13.224108 18771 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:13.212108 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:13.229029 18771 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:13.231717 18766 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:13.234306 22008 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:24:13.235219 21987 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.251468 21987 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.236438 21751 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:24:13.248953 18770 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:13.238845 18767 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:24:13.262207 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.253778 21987 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:13.283397 18769 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:13.242522 18765 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:13.292747 18764 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:13.290947 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 204977us
I20260709 12:24:13.294852 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:13.249665 22042 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:13.308645 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.309434 18919 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:13.311178 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62555.8us
W20260709 12:24:13.322225 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.328047 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 170009us
W20260709 12:24:13.330879 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 353381us
W20260709 12:24:13.333937 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 269169us
I20260709 12:24:13.349164 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:13.345796 21264 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.841s	user 0.012s	sys 0.003s
I20260709 12:24:13.306506 21920 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:13.349912 19491 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:13.377138 21889 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:13.377748 21889 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:13.378777 21909 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:13.348145 22043 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:13.380735 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:13.381727 21978 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.831s	user 0.013s	sys 0.007s
I20260709 12:24:13.382686 21751 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:13.378094 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.388547 22050 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.346s	user 0.001s	sys 0.001s
I20260709 12:24:13.388754 21992 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:13.391153 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2164) took 1975 ms. Trace:
I20260709 12:24:13.391640 18844 rpcz_store.cc:276] 0709 12:24:11.415374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.709015 (+293641us) service_pool.cc:224] Handling call
0709 12:24:11.737215 (+ 28200us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:11.770145 (+ 32930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.770196 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:12.712618 (+942422us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b1800096100. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a
0709 12:24:12.713952 (+  1334us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b2c0005b308. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:24:12.831858 (+117906us) log.cc:844] Serialized 52 byte log entry
0709 12:24:12.892161 (+ 60303us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:12.906608 (+ 14447us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.906898 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.907057 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.390708 (+483651us) raft_consensus.cc:1685] finished
0709 12:24:13.390745 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.390962 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188174,"prepare.queue_time_us":11832,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":53,"raft.queue_time_us":28280,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":7391,"spinlock_wait_cycles":56271104,"thread_start_us":55340,"threads_started":1,"wal-append.queue_time_us":157856}
I20260709 12:24:13.367882 21264 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:13.390077 19456 leader_election.cc:336] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.976s (SENT)
W20260709 12:24:13.396893 22048 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:24:13.397209 21264 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:13.397804 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59273.9us
I20260709 12:24:13.399747 22043 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:13.367468 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:13.404208 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 488) took 3140 ms. Trace:
W20260709 12:24:13.440845 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 193462us
I20260709 12:24:13.439898 18913 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:13.440129 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:13.446156 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1850) took 1732 ms. Trace:
W20260709 12:24:13.471094 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 117294us
W20260709 12:24:13.472360 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 91930us
I20260709 12:24:13.464336 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 475) took 4843 ms. Trace:
W20260709 12:24:13.479774 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.481130 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114248us
I20260709 12:24:13.487968 21264 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:13.402258 22042 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.325832 22021 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:13.502344 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 134822us
I20260709 12:24:13.508847 21833 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:13.453692 21973 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:13.512267 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 152823us
I20260709 12:24:13.512953 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:13.528367 21264 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.530431 22013 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:13.530989 22013 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:13.531347 21264 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:13.464794 18920 rpcz_store.cc:276] 0709 12:24:11.714249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.714470 (+   221us) service_pool.cc:224] Handling call
0709 12:24:11.766610 (+ 52140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.766867 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:12.854085 (+1087218us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.294911 (+440826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.310689 (+ 15778us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:13.337228 (+ 26539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.349804 (+ 12576us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.446094 (+ 96290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60357,"prepare.queue_time_us":54630,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":50268,"spinlock_wait_cycles":37446400,"thread_start_us":1263269,"threads_started":2}
W20260709 12:24:13.529013 22054 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:24:13.521847 22008 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:13.441640 18768 rpcz_store.cc:276] 0709 12:24:10.261918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.277168 (+ 15250us) service_pool.cc:224] Handling call
0709 12:24:10.277604 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:10.278068 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.278101 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:10.359259 (+ 81158us) log.cc:844] Serialized 52 byte log entry
0709 12:24:10.484960 (+125701us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:10.752982 (+268022us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b1800186160. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:10.785302 (+ 32320us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.844735 (+2059433us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.339046 (+494311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.367664 (+ 28618us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.401736 (+ 34072us) raft_consensus.cc:1685] finished
0709 12:24:13.401762 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.401941 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1402784,"prepare.queue_time_us":653607,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":109,"raft.queue_time_us":1220148,"raft.run_cpu_time_us":530,"raft.run_wall_time_us":40740,"spinlock_wait_cycles":38959488,"thread_start_us":1578886,"threads_started":4,"wal-append.queue_time_us":162060,"wal-append.run_cpu_time_us":4601,"wal-append.run_wall_time_us":1277074}
I20260709 12:24:13.401316 22043 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.539391 21992 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:24:13.543172 21889 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.544271 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:13.545122 21889 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.547199 21264 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.547590 22021 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:13.549153 18812 leader_election.cc:400] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
I20260709 12:24:13.549540 18812 leader_election.cc:403] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:13.549562 22021 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:13.545189 21622 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:13.474205 18839 rpcz_store.cc:276] 0709 12:24:08.603230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.884043 (+280813us) service_pool.cc:224] Handling call
0709 12:24:09.235670 (+351627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.235947 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:09.274765 (+ 38818us) log.cc:844] Serialized 14 byte log entry
0709 12:24:09.522685 (+247920us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.539349 (+2016664us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b1800335ec0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:24:13.022129 (+1482780us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.306732 (+284603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.329768 (+ 23036us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:13.339280 (+  9512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.354224 (+ 14944us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.446633 (+ 92409us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10861,"prepare.queue_time_us":733858,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":152,"raft.queue_time_us":58443,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":31130,"spinlock_wait_cycles":2528000,"thread_start_us":1876099,"threads_started":4,"wal-append.queue_time_us":637029,"wal-append.run_cpu_time_us":8566,"wal-append.run_wall_time_us":1160105}
I20260709 12:24:13.557658 21987 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:13.559590 22052 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.456s	user 0.004s	sys 0.003s
I20260709 12:24:13.560544 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:13.539690 21746 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.563385 21746 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.564404 22021 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:13.565647 21264 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:13.566063 21264 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:13.555222 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:13.521953 21920 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.566157 21746 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:13.604686 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 116869us
I20260709 12:24:13.554636 21622 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:13.566768 22008 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:13.588831 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52532.7us
W20260709 12:24:13.626891 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75977.6us
I20260709 12:24:13.553988 22042 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:13.629621 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 104099us
I20260709 12:24:13.636896 22008 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.638329 22042 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:13.639205 22065 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.640027 19492 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:13.634145 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:13.634074 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:13.615235 21746 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:13.657853 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45610.1us
I20260709 12:24:13.658761 22065 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:13.664153 22006 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.653820 21264 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.676362 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:13.687317 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:13.690588 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:13.691533 18766 raft_consensus.cc:606] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:13.691941 18766 raft_consensus.cc:614] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:13.668848 22065 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:13.707204 21264 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.722550 22013 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.739703 22013 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:13.736526 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1653) took 1474 ms. Trace:
I20260709 12:24:13.742844 18772 rpcz_store.cc:276] 0709 12:24:12.262024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.965210 (+703186us) service_pool.cc:224] Handling call
0709 12:24:13.107207 (+141997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.155340 (+ 48133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.736153 (+580813us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540029c2d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:13.736420 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325444352}
W20260709 12:24:13.745074 22069 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
I20260709 12:24:13.712466 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:13.765793 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.768177 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 138679us
I20260709 12:24:13.703042 22065 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:13.774873 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65093.5us
I20260709 12:24:13.764104 22042 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:13.784116 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:13.766598 21746 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:13.821147 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 205327us
I20260709 12:24:13.822093 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:13.821401 21865 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:24:13.822640 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:13.825079 21565 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.191s	user 0.010s	sys 0.009s
I20260709 12:24:13.825405 22066 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.781175 21837 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:13.830726 21977 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:13.790980 19483 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:13.822356 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:13.836062 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59880.9us
I20260709 12:24:13.769979 22035 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:13.840348 21565 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:13.851624 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.854195 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.854997 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70967.1us
I20260709 12:24:13.842877 22066 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.843070 21837 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.768087 21622 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.840355 21751 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.864998 19492 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
W20260709 12:24:13.867344 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:13.870383 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 319799us
I20260709 12:24:13.821630 22068 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.214s
I20260709 12:24:13.834484 22070 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.189s
W20260709 12:24:13.879279 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.884248 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:13.865396 22042 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:13.879108 21751 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.888974 22076 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:13.889744 22055 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:24:13.889642 22076 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.890828 22075 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.891961 22076 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:13.891852 22075 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.892802 21865 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.893378 21865 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.891076 21751 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:13.896167 21746 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:13.896565 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 539) took 1017 ms. Trace:
I20260709 12:24:13.896849 21746 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:13.897598 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 116460us
I20260709 12:24:13.871757 21837 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.872184 22066 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.908111 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:13.908864 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50448.5us
I20260709 12:24:13.876080 21987 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
I20260709 12:24:13.880626 21920 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:13.897061 18916 rpcz_store.cc:276] 0709 12:24:12.880865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.041216 (+160351us) service_pool.cc:224] Handling call
0709 12:24:13.099460 (+ 58244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.235130 (+135670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.235200 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:13.236024 (+   824us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.338074 (+102050us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:13.338196 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.338295 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.896277 (+557982us) raft_consensus.cc:1685] finished
0709 12:24:13.896306 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.896484 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5288,"raft.queue_time_us":11659,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":61769,"spinlock_wait_cycles":302336,"thread_start_us":101027,"threads_started":1,"wal-append.queue_time_us":525511}
I20260709 12:24:13.849200 21977 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.899155 21865 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:13.869360 22035 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:13.898365 22042 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:13.921980 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:13.940888 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 159285us
I20260709 12:24:13.941629 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:13.897488 21746 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:13.946157 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60110.8us
W20260709 12:24:13.924841 22071 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:13.916312 21811 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:13.907092 22021 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:13.862258 22008 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.935266 21751 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.935621 22042 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:13.964162 22043 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:13.977439 21759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.015s	sys 0.015s
I20260709 12:24:13.977664 22075 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:13.977996 21759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.015s	sys 0.015s
I20260709 12:24:13.978911 21746 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:13.979157 22021 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:13.979790 21746 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:13.980407 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:13.981668 22021 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:13.982657 19491 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:13.974540 22008 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:13.987015 18739 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.584s (SENT) [suppressed 29 similar messages]
W20260709 12:24:13.969458 18738 connection.cc:256] RPC call timeout handler was delayed by -1.4542880019998847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 12:24:13.991115 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 64788us
W20260709 12:24:13.994293 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.981802 21746 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:13.978935 21565 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:13.986423 22067 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:14.006521 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:14.014227 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:14.017365 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:14.020220 18772 raft_consensus.cc:606] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:13.998061 22070 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.020715 18772 raft_consensus.cc:614] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:14.024960 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:14.026895 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.028220 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:14.006620 22067 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.014138 21264 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:24:14.024847 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:14.014226 22043 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:14.016952 22068 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:13.990489 21909 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:24:14.022629 22075 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.046020 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:14.060631 22073 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:14.061239 22073 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.061641 22073 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:14.064005 21909 consensus_queue.cc:1243] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:14.064813 21909 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:14.065258 21909 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:14.066924 18842 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:14.031288 22070 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.072151 21977 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.073112 22070 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:14.073704 22035 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:14.073623 22068 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.076288 22068 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:14.077275 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61984.1us
I20260709 12:24:14.078650 22013 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:14.079116 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:14.079550 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:14.081377 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:14.082911 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:14.083405 22081 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:14.084091 18841 raft_consensus.cc:2410] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:14.039713 22067 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.085224 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:14.085598 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:14.085954 18839 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:14.086947 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:14.085224 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:14.088671 22079 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:14.079151 22013 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:14.090514 22013 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.095547 21977 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:14.096683 21977 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:14.097501 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:14.098308 18844 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 4.
I20260709 12:24:14.099661 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:14.100976 21987 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:14.101500 21987 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:14.042582 22043 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.102835 22077 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:14.103807 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:14.105041 21565 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:14.105187 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59317.9us
W20260709 12:24:14.106889 22051 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.025s	user 0.008s	sys 0.006s
I20260709 12:24:14.106714 21987 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.110783 22043 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.118794 22075 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.122871 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:14.124511 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:14.125502 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.126561 18913 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:14.127336 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.131824 21909 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.132941 18919 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:14.133616 21909 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.097602 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:14.137117 18840 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:14.127847 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:14.138091 18839 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:14.138677 21622 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:14.150056 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 97063.1us
I20260709 12:24:14.127375 18920 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:14.152403 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45850.8us
I20260709 12:24:14.159339 18846 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:14.163530 22075 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:14.174827 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:14.176075 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:14.181725 21889 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.006s
I20260709 12:24:14.184258 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 682) took 1060 ms. Trace:
I20260709 12:24:14.184755 19487 rpcz_store.cc:276] 0709 12:24:13.124131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.126518 (+  2387us) service_pool.cc:224] Handling call
0709 12:24:13.126902 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.633859 (+506957us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:13.636415 (+  2556us) log.cc:844] Serialized 14 byte log entry
0709 12:24:13.911562 (+275147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:13.911618 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:13.911671 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.183803 (+272132us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400216bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:14.183864 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.184037 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4844,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":8800,"raft.queue_time_us":2760,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":19782,"spinlock_wait_cycles":1128551808,"thread_start_us":274421,"threads_started":1,"wal-append.queue_time_us":366342}
I20260709 12:24:14.186556 21977 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.060252 22092 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.070166 22006 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:14.192148 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:14.192494 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.220618 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58397.4us
I20260709 12:24:14.193516 22042 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.195899 22059 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:14.203804 22068 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.204070 22084 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:14.165380 22076 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:14.206754 22008 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:14.208137 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55909.1us
I20260709 12:24:14.208528 21264 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:14.191175 18921 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:14.060202 21746 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:14.228770 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.237195 18920 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:14.238845 22084 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.243067 22092 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.245082 22084 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.245553 22092 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:14.246927 18669 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 163) took 14115 ms (client timeout 15000 ms). Trace:
I20260709 12:24:14.251749 21264 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:14.252269 21264 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:14.225493 22059 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:14.255064 18913 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:14.263682 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 110885us
W20260709 12:24:14.265055 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.269429 19483 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.271622 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:14.236469 21746 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:14.280061 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.280867 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.282116 18738 connection.cc:256] RPC call timeout handler was delayed by -1.3345880019996912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 12:24:14.263346 21979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.010s	sys 0.021s
W20260709 12:24:14.282900 18738 connection.cc:256] RPC call timeout handler was delayed by -1.1248880019998069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 12:24:14.232040 22068 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:14.287650 18738 connection.cc:256] RPC call timeout handler was delayed by -1.042088001999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22740000000000002s for a response
W20260709 12:24:14.282681 22065 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.002s
W20260709 12:24:14.285593 21979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.011s	sys 0.021s
W20260709 12:24:14.300282 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.300848 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.302201 18913 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.284087 21992 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:14.234537 21837 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.303741 21264 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.283535 22021 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:14.302944 19492 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.316541 22058 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:24:14.306267 22036 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:24:14.296144 21865 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:24:14.294198 22092 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:24:14.323882 22092 consensus_queue.cc:1243] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:24:14.324031 22068 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.324486 22092 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:14.324875 22092 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:14.307034 21992 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:14.344580 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 101921us
I20260709 12:24:14.345719 22090 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.345566 22092 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.346343 22090 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.347077 22092 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.351596 21746 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.353192 21746 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:14.354058 22058 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:14.354588 22058 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:14.355741 22058 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.356747 21992 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:14.357273 22058 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:14.247681 18669 rpcz_store.cc:269] 0709 12:24:00.131521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.131695 (+   174us) service_pool.cc:224] Handling call
0709 12:24:14.246460 (+14114765us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:06.091827 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:06.092640 (+   813us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:06.092694 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:24:06.092722 (+    28us) tablet.cc:662] Decoding operations
0709 12:24:06.094160 (+  1438us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:06.115758 (+ 21598us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:06.166964 (+ 51206us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:24:06.629488 (+462524us) tablet.cc:701] Row locks acquired
0709 12:24:06.643663 (+ 14175us) write_op.cc:260] PREPARE: finished
0709 12:24:06.675543 (+ 31880us) write_op.cc:270] Start()
0709 12:24:06.719285 (+ 43742us) write_op.cc:276] Timestamp: P: 1783599846675455 usec, L: 0
0709 12:24:06.724212 (+  4927us) op_driver.cc:348] REPLICATION: starting
0709 12:24:06.896781 (+172569us) log.cc:844] Serialized 4480 byte log entry
0709 12:24:07.953088 (+1056307us) op_driver.cc:464] REPLICATION: finished
0709 12:24:08.748909 (+795821us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af86e28 00007f335e9c1581 00007f335e9c0d58 00007f335e9c59f1 00007f335e9c59a9 00007f335e9c5939 00007f335e9c5901 00007f335e9c4b2d 0000000000388634 0000000000388479
0709 12:24:08.895201 (+146292us) write_op.cc:301] APPLY: starting
0709 12:24:08.897782 (+  2581us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:08.966423 (+ 68641us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:08.974886 (+  8463us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:09.301233 (+326347us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:09.301597 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:24:09.301673 (+    76us) write_op.cc:312] APPLY: finished
0709 12:24:09.302164 (+   491us) log.cc:844] Serialized 83 byte log entry
0709 12:24:09.548450 (+246286us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.557995 (+  9545us) write_op.cc:454] Released schema lock
0709 12:24:09.580142 (+ 22147us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:09.719433 (+139291us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.722811 (+  3378us) write_op.cc:454] Released schema lock
0709 12:24:10.099059 (+376248us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
Metrics: {"mutex_wait_us":182987,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":847727,"apply.run_cpu_time_us":26468,"apply.run_wall_time_us":720229,"num_ops":11,"prepare.queue_time_us":182205,"prepare.run_cpu_time_us":25294,"prepare.run_wall_time_us":2657330,"raft.queue_time_us":299154,"raft.run_cpu_time_us":37599,"raft.run_wall_time_us":904205,"replication_time_us":1182733,"spinlock_wait_cycles":103329920,"thread_start_us":1743124,"threads_started":5,"wal-append.queue_time_us":958376,"wal-append.run_cpu_time_us":39225,"wal-append.run_wall_time_us":2721598}]]}
I20260709 12:24:14.345736 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:14.374109 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 65064.6us
W20260709 12:24:14.375622 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.387188 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.390332 22043 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.390549 21264 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.390625 18921 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:14.401610 22059 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.402611 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.402817 21837 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:14.403545 18921 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:14.404549 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:14.406102 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.309024 22066 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.405674 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.408406 22066 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:14.409394 22042 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.414673 22067 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.415293 22043 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.416118 19484 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:14.375593 22021 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.420810 22021 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:14.422572 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:14.425078 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:14.433755 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.454479 18886 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.757s (SENT)
I20260709 12:24:14.454698 18914 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:14.455350 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:14.456794 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:14.298139 22065 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.462333 19489 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:14.402832 22059 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.372572 22090 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:14.463558 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.470147 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.467507 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:14.472476 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:14.472752 22021 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:14.473158 18915 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:14.474155 22073 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.476506 22073 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.452235 21837 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:24:14.481024 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:14.481769 19488 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:14.482712 19487 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:14.488838 18915 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:14.488387 21672 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:14.494132 18918 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:14.495965 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70998.1us
I20260709 12:24:14.464700 22075 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.493373 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.499960 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.492329 21672 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:14.519162 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:14.522732 22090 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:14.522748 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.525170 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.485572 21992 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.528254 21992 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:14.519034 21672 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:14.533227 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.526333 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.537268 18921 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:14.538834 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.542199 19488 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:24:14.545221 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 293126us
I20260709 12:24:14.549273 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:14.555825 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 107545us
I20260709 12:24:14.559185 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:14.555759 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:14.559173 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.563162 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.562825 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:14.426481 22061 consensus_queue.cc:1175] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:14.571941 21751 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:14.554899 22090 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:14.572839 21751 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:14.571957 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.572978 22090 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:14.590108 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:14.590087 21751 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.578984 18922 raft_consensus.cc:2410] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:14.506230 22092 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
W20260709 12:24:14.592097 18886 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.796s (SENT)
I20260709 12:24:14.599045 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:14.600234 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.547714 22075 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.603240 22021 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:14.605805 22092 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:14.624032 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.605891 22065 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.606817 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:14.608767 22013 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.003s
W20260709 12:24:14.610982 22105 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:24:14.618286 22090 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.620434 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:14.638090 18919 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:14.638892 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.627521 18915 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:14.629216 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:14.630596 18917 raft_consensus.cc:2376] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10. Re-sending same reply.
I20260709 12:24:14.623993 22092 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:14.636299 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:14.643535 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70432.8us
W20260709 12:24:14.645133 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 85533.2us
I20260709 12:24:14.648795 18922 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:14.652716 18921 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.656661 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:14.660495 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.637904 22084 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.668833 18921 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.670919 18917 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:14.637914 22013 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.637737 22068 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:24:14.688791 18914 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:14.692059 22013 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.694743 22092 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.695711 18738 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:14.696370 22092 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.697310 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:14.709751 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.746912 18915 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:14.694764 22075 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:14.723131 21909 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:14.680223 22084 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.755458 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.708607 22094 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:14.754633 18917 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:14.759192 18886 leader_election.cc:336] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.993s (SENT)
W20260709 12:24:14.759641 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.762076 18913 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:24:14.759477 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 184493us
I20260709 12:24:14.766067 18916 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:14.767755 21920 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:14.769538 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:14.784286 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:14.785970 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 88811.3us
I20260709 12:24:14.784922 19483 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:14.787463 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:14.787781 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.799846 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:14.801978 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:14.807420 18916 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:14.790117 22107 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 12:24:14.811002 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54780.9us
W20260709 12:24:14.811868 18886 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.042s (SENT)
I20260709 12:24:14.808084 18916 pending_rounds.cc:85] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 3
I20260709 12:24:14.814556 18916 pending_rounds.cc:107] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:14.815092 18916 raft_consensus.cc:2889] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:14.819284 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.820169 18913 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:14.813683 21746 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.821276 21746 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.825836 19484 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:14.789602 22059 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:24:14.791829 21920 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.789994 21751 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:14.814121 22094 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:14.849375 21746 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:14.858556 22119 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:24:14.863292 22059 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:14.864985 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:14.865873 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:14.872619 18772 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.875819 22067 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:14.866811 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:14.866853 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:14.868742 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:14.869968 18765 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:14.870636 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:14.871376 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:14.881747 22075 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:14.884027 22075 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:14.889394 22075 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.893309 21920 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:14.904657 21977 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.905344 21977 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:14.911131 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.912796 22076 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.913432 22076 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.917035 21865 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:14.917513 21865 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:14.920568 18668 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 5, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.929628 18668 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 4, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 4 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.926748 22006 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:14.868772 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:14.939824 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.939900 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 75004.7us
I20260709 12:24:14.943480 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:14.971912 18919 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:14.970798 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.976480 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:14.986011 18772 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:14.987847 18919 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:14.990878 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:14.969661 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 157824us
W20260709 12:24:14.991611 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.979297 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:14.979105 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:14.993605 18915 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:24:14.979031 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:15.001473 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:14.837093 22094 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.007175 18668 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 5, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 5 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:15.011548 22042 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:15.012082 21264 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:15.012181 22042 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:15.013347 22042 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:15.018889 21622 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:15.019714 21622 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:15.020903 21622 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:14.966878 22006 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:15.030612 22006 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:14.967706 21865 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:15.032095 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46372.1us
I20260709 12:24:15.032492 21865 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:15.033135 21751 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:15.034557 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.938460 22084 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.036841 21977 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.037678 22076 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.038015 21909 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.973989 22098 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:15.028926 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.969127 21979 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.009577 18920 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:15.040804 18886 leader_election.cc:336] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.120s (SENT)
W20260709 12:24:15.041894 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.038789 22021 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.047914 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:15.049265 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70042.5us
I20260709 12:24:15.050944 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:15.051111 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:15.052028 21977 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.052377 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:15.055284 18668 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 6, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 6 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:15.059962 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 191262us
I20260709 12:24:15.025563 21746 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:15.072854 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:15.088048 19484 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:15.000422 22107 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:24:15.027472 22094 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.075551 22075 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.076218 18668 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:15.077674 19492 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:15.080394 18812 connection.cc:256] RPC call timeout handler was delayed by -1.5984711850001077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:24:15.080555 21833 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:15.121045 21833 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.121555 18668 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.122495 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:15.123145 18922 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:15.123230 18668 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 5, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.080384 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:15.081322 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:15.126157 18917 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:24:15.126612 18917 pending_rounds.cc:85] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 3
I20260709 12:24:15.126832 21833 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.126832 18917 pending_rounds.cc:107] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:24:15.082541 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:15.084314 19486 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:15.032112 22006 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:15.090032 19483 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:15.074640 21977 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.095062 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:15.146311 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.039809 21920 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:24:15.068966 21979 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:15.101393 22120 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 12:24:15.101922 19456 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.024s (SENT)
I20260709 12:24:15.109666 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:15.152269 18921 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
W20260709 12:24:15.110967 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60146.7us
I20260709 12:24:15.118858 22073 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:15.127729 18917 raft_consensus.cc:2889] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:15.097860 21909 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:15.128674 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:15.070552 22092 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:15.144568 21264 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:15.147724 19488 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:15.047355 22076 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:24:15.145720 18668 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.042649 22098 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:15.158331 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:15.159060 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.170011 18839 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:15.160826 21979 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:15.161588 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.162060 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:15.162422 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.162909 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:15.163637 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.155037 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:15.185930 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:15.189888 18846 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.191891 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:15.201188 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.203588 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:15.205719 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 164937us
W20260709 12:24:15.207675 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 117063us
I20260709 12:24:15.210940 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.185496 22115 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.220986 22115 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.221441 22115 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.223021 21977 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.157603 21746 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:24:15.224856 21746 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:15.225281 21746 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:15.225935 22068 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:15.195564 21833 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:15.210477 21987 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:15.231061 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:15.231334 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 129444us
W20260709 12:24:15.235196 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.227643 18668 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.243059 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:15.220350 18886 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.196s (SENT)
I20260709 12:24:15.236392 18839 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:15.219941 18846 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:15.197577 22073 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:15.252027 18668 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 7, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:15.228542 21987 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.227931 21833 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.279608 21976 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:15.251626 21909 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:15.285732 18844 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:15.290778 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:15.292567 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:15.294852 22132 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:15.295900 22132 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:15.296321 22132 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:15.296736 22132 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.301862 18841 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:15.302893 21833 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.228176 22098 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:15.305264 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 98425.1us
W20260709 12:24:15.327665 18886 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.203s (SENT)
W20260709 12:24:15.307602 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 105390us
I20260709 12:24:15.226447 22068 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:15.314352 18668 catalog_manager.cc:5697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 5, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 5 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:15.325512 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:15.333626 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.241812 22092 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:24:15.335990 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:15.337262 18668 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.339716 18668 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 8, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 8 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:15.340668 22115 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.342144 18840 raft_consensus.cc:2368] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:15.341799 18668 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 7, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 7 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.226361 21746 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.345032 22073 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.346254 21746 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:15.277580 21987 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:15.351605 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 186021us
I20260709 12:24:15.359550 18844 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:15.367992 18668 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 8, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 8 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:15.372541 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44948.2us
W20260709 12:24:15.374688 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.349745 22090 consensus_queue.cc:1175] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:15.332191 21672 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:24:15.375766 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:15.380389 18886 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.211s (SENT)
I20260709 12:24:15.380954 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:15.382263 22127 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:15.383638 22066 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:15.386771 22115 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.391088 22068 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.393615 22068 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:15.395860 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:15.403021 19456 leader_election.cc:336] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.601s (SENT)
I20260709 12:24:15.400867 18668 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 9, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 9 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:24:15.406347 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52615us
W20260709 12:24:15.433804 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60651.4us
I20260709 12:24:15.437021 18668 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 8, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 8 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:15.440974 18668 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 5, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 5 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:15.446525 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.414080 22075 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.449873 18668 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 6, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 6 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:15.460088 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.460980 18846 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:15.463892 18668 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:24:15.480831 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51706.3us
I20260709 12:24:15.482755 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:15.464066 22140 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:15.483978 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47272.3us
I20260709 12:24:15.489334 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:15.495402 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.498410 18668 catalog_manager.cc:5697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 4, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 4 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.502159 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:15.502228 18842 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
W20260709 12:24:15.507303 22137 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:24:15.508960 19490 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:15.490643 22140 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:15.510308 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.515285 21920 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Committing config change with OpId 6.9: config changed from index 7 to 9, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:15.518199 22140 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.520394 21833 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.512544 21746 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:24:15.524716 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.502210 22142 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:15.528031 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.536206 18846 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
W20260709 12:24:15.532244 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.480682 22075 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:24:15.498996 22066 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.540424 21833 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.544857 22131 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.545992 18918 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Committing config change with OpId 6.9: config changed from index 7 to 9, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:15.551363 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:15.483095 22141 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:24:15.559056 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:15.687855 18913 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:15.570744 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 69060.2us
I20260709 12:24:15.574776 22006 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:15.579002 22147 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:15.579473 22075 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:15.580993 18840 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:15.582352 22066 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.594048 22098 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:15.703773 22006 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.699738 22131 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:15.677634 22094 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.532s	user 0.013s	sys 0.000s
I20260709 12:24:15.601166 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.729600 22094 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:15.721369 22006 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.701481 22140 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.738765 22140 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.739948 21987 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.743974 22066 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:15.744096 18913 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
W20260709 12:24:15.750793 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44898.9us
I20260709 12:24:15.723615 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:15.722951 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:15.755849 18919 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:15.756763 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:15.757296 18919 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.768400 22094 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:15.769778 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:15.770578 19488 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.770769 22115 raft_consensus.cc:1064] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:24:15.773782 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.607947 22132 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:15.625260 18847 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:15.626379 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.628530 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.563881 18668 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 5 to 7, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 7 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.632958 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:15.653250 22092 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:15.654572 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.655601 18842 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:15.678493 18921 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:15.599932 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.816607 19491 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:15.818903 18843 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:15.820009 18922 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:15.822077 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:15.811195 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:15.820863 18839 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:15.823618 18844 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:15.830987 18772 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:15.718974 22075 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:15.834177 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:15.836645 18812 leader_election.cc:400] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
I20260709 12:24:15.896144 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:16.174508 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:16.193408 18922 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:16.194074 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 348316us
I20260709 12:24:15.805954 21987 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:15.972101 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:15.773813 22115 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:15.920800 18668 catalog_manager.cc:5697] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 4, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:16.175024 22075 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.206413 22075 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.212064 18840 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:24:16.176149 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.646s (SENT)
I20260709 12:24:16.214604 18848 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:16.215276 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.215792 19456 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.777s (SENT)
I20260709 12:24:16.215087 18668 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:16.216984 19456 leader_election.cc:336] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.958s (SENT)
W20260709 12:24:16.217862 19456 leader_election.cc:336] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.860s (SENT)
I20260709 12:24:15.855600 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:16.218724 18839 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
W20260709 12:24:16.218875 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.824190 22092 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:15.877318 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.220404 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:16.152557 22101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.016s
I20260709 12:24:16.220151 22092 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:16.221079 22101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.006s	sys 0.016s
I20260709 12:24:16.221107 18767 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:15.900430 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:16.177107 22132 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:16.221634 22092 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.180007 19488 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:15.895123 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.223347 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:16.180776 18847 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:16.224123 22101 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:16.224557 22101 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.224990 22101 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.184369 18919 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:16.185927 22131 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:16.187369 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.187883 18764 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:16.189302 22006 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:16.226244 18770 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:16.226502 22006 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:16.227631 22006 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:15.893567 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:16.190656 18765 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:16.230736 18846 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:16.231515 22131 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:16.232682 22131 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:16.234113 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:16.235044 18922 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:16.235850 22131 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:16.236616 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:16.237409 18922 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:15.910162 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:16.036166 18738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.014s	sys 0.046s
I20260709 12:24:15.818717 22094 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:16.220618 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.902948 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:16.218734 22042 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:24:16.185281 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.242358 18768 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:16.218241 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:16.243834 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.235791 22101 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.247970 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:16.248998 22101 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:16.250820 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:16.253700 22147 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:16.254215 22147 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:16.255270 22147 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:16.251884 22135 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:16.200803 18845 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:24:16.257944 18772 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:16.258329 18738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.017s	sys 0.047s
W20260709 12:24:16.269475 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 933503us
I20260709 12:24:16.180076 22065 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:16.266048 18770 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:16.220126 18886 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.693s (SENT)
I20260709 12:24:16.272763 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:16.267323 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 430920us
I20260709 12:24:16.239022 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:16.217623 18668 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.278147 18668 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:16.268067 22135 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:16.254596 21992 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:16.284588 22065 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.307945 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:16.308350 18770 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:16.288328 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:16.288507 18767 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:16.294703 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:16.297036 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:16.328181 18921 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.297926 18915 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:16.329097 18917 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:16.293349 21987 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:16.321470 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.297850 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:16.306859 18922 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
W20260709 12:24:16.352380 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.298496 21889 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:16.363171 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 68552.2us
I20260709 12:24:16.344060 18668 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.364897 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:16.367381 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 79163.4us
W20260709 12:24:16.368499 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 148399us
W20260709 12:24:16.370543 18886 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.033s (SENT)
I20260709 12:24:16.371213 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:16.271749 22094 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.383414 18668 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:16.385829 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:16.355873 22131 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:16.362852 22042 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:16.383078 22043 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:16.401480 18886 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.055s (SENT)
I20260709 12:24:16.378459 22075 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:16.400967 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:16.383967 22092 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.404826 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:16.408021 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:16.367063 21987 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:16.393321 22140 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:16.419451 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:16.379369 21889 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:16.423740 21833 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:16.423996 22066 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:16.398326 22141 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.414829 22075 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.406988 22131 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:16.438215 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 243364us
I20260709 12:24:16.438840 22131 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:16.424216 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59942 (request call id 1) took 2237 ms. Trace:
W20260709 12:24:16.434718 19456 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.162s (SENT)
I20260709 12:24:16.434476 22008 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:16.457161 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.387115 22135 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.441175 22075 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:16.433717 22140 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:16.459719 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.443506 21833 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:16.424774 22152 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:24:16.464425 18922 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:16.475282 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58577.1us
I20260709 12:24:16.479446 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.480485 18767 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
W20260709 12:24:16.481817 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50338.5us
W20260709 12:24:16.482901 19456 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.183s (SENT)
I20260709 12:24:16.483409 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:16.478361 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.486944 18765 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:24:16.487934 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.491115 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.491748 18771 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:16.493177 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.493923 18771 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.491677 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.496387 21833 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.491767 18766 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.499094 18764 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:16.511305 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.513779 18770 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:16.534279 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51343.5us
I20260709 12:24:16.517481 22135 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:16.564287 18886 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.779s (SENT)
W20260709 12:24:16.575608 18886 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.890s (SENT)
I20260709 12:24:16.580112 18772 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:16.584663 18770 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:24:16.589864 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 170545us
I20260709 12:24:16.597150 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:16.602120 22115 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.618441 22088 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:16.618736 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.619472 18768 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:16.619607 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.625375 18845 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:16.629762 18921 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:16.634042 18773 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:16.609439 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:16.635690 18886 leader_election.cc:336] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.498s (SENT)
I20260709 12:24:16.484501 21987 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.636232 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:16.636780 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.583165 22157 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:24:16.645107 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.649344 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:16.647593 22131 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:16.662509 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.666594 18773 raft_consensus.cc:2376] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7. Re-sending same reply.
I20260709 12:24:16.664376 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:16.664713 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 276522us
I20260709 12:24:16.667791 18767 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:16.668905 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:16.673656 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.644220 22066 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:16.686424 18921 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:16.659314 22113 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:16.693364 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44135.5us
I20260709 12:24:16.694543 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:16.697037 22101 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:16.697644 22101 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.697582 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.698441 18767 raft_consensus.cc:2376] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8. Re-sending same reply.
I20260709 12:24:16.672340 22065 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:16.708191 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:16.677095 22141 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:16.698251 22101 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:16.650434 22140 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.444329 21920 rpcz_store.cc:276] 0709 12:24:14.183459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.183746 (+   287us) service_pool.cc:224] Handling call
0709 12:24:14.268267 (+ 84521us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b2c00075be8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359893a0a 00007f3359893693 00007f3359893631 00007f335afc6902 00007f335afc66dd 00007f335af91f3f 00007f335af916b3 00007f335af899fa 00007f335ff514c9 00007f33594cdc54
0709 12:24:14.399656 (+131389us) log.cc:844] Serialized 487 byte log entry
0709 12:24:14.840487 (+440831us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b5400745020. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af04142 00007f335aee4eaa 00007f335aeebd53 00007f335aeebcd9 00007f335aeebc69 00007f335aeebc31 00007f335aeeadfd 0000000000388634 0000000000388479 00007f3357e9e475
0709 12:24:14.871811 (+ 31324us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b4c00493d80. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359257a20 00007f3359268a29 00007f335926913f 00007f335922d2ab 00007f335925af3c 00007f335925b3fe 00007f33594e850b 00007f335aee7381 00007f335aee526b 00007f335aeebd53 00007f335aeebcd9
0709 12:24:16.420675 (+1548864us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":262083,"raft.queue_time_us":268775,"raft.run_cpu_time_us":4029,"raft.run_wall_time_us":205087,"spinlock_wait_cycles":93346688,"thread_start_us":86673,"threads_started":1,"wal-append.queue_time_us":114576,"wal-append.run_cpu_time_us":2619,"wal-append.run_wall_time_us":1088467}
I20260709 12:24:16.731467 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:16.744778 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 219648us
I20260709 12:24:16.745179 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:16.730976 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:16.745550 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.739080 18765 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
W20260709 12:24:16.746158 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.741051 18766 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
W20260709 12:24:16.746831 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.757149 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.758908 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.759944 18766 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:16.751559 18770 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
W20260709 12:24:16.761897 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.718931 22013 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:16.707542 22066 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.776259 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.777283 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.781577 18765 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:16.772449 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.724059 22068 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:16.780144 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.786791 22065 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:16.787642 22075 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:16.756749 22008 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:24:16.790253 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.837685 18770 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
W20260709 12:24:16.791098 22167 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:24:16.792774 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.771764 22174 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:24:16.769420 22115 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:16.797988 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.799275 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 527) took 1065 ms. Trace:
I20260709 12:24:16.807072 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.843436 18767 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:16.813207 18768 raft_consensus.cc:2376] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9. Re-sending same reply.
I20260709 12:24:16.827539 18771 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:16.846877 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.850508 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.850920 18772 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:16.852273 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.836757 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:16.851267 18764 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:16.855715 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:16.862671 18765 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:16.843330 18848 rpcz_store.cc:276] 0709 12:24:15.733226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.218052 (+484826us) service_pool.cc:224] Handling call
0709 12:24:16.626268 (+408216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.644094 (+ 17826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:16.644140 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:16.644201 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:16.644241 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.644315 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.798231 (+153916us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400205150. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:16.798360 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18423,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8765,"spinlock_wait_cycles":938126080}
I20260709 12:24:16.867147 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:16.871816 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.876304 19486 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:16.890723 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:16.891480 18770 raft_consensus.cc:2376] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6. Re-sending same reply.
I20260709 12:24:16.893759 18771 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:16.895128 18768 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 3.
I20260709 12:24:16.897424 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.898145 18766 raft_consensus.cc:2376] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6. Re-sending same reply.
I20260709 12:24:16.894748 21672 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:24:16.911175 18768 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:16.921741 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:16.889676 22164 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:16.934244 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:16.832509 22042 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:24:16.888814 22116 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:16.832512 22131 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:24:16.931319 18766 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:16.929243 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c18380178684f0e93b10d0c7a912d02 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:24:16.966985 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 99319.4us
W20260709 12:24:16.974450 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.978534 18656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 163689us
W20260709 12:24:16.982940 18886 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.969s (SENT)
I20260709 12:24:16.983527 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:16.924576 21992 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:24:16.991966 18770 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:16.924821 22088 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:24:16.999074 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.025583 18772 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.980818 22164 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:17.014797 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.044122 18770 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:16.975128 22006 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:16.979329 22116 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:17.046164 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.074432 18770 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:17.047078 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64179.8us
I20260709 12:24:16.995338 22165 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:17.077364 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.079101 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 157486us
I20260709 12:24:16.984431 21920 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:24:17.122364 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:17.122972 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:17.124361 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.129844 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46816.4us
I20260709 12:24:17.136461 21672 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:17.140200 22187 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:24:17.141490 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:17.122465 22152 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.145272 18770 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:17.145761 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:17.146955 18772 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
W20260709 12:24:17.150944 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 221025us
I20260709 12:24:17.156208 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.157202 18770 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:17.153057 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 106184us
I20260709 12:24:17.140442 22201 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:17.165309 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:17.165714 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.166193 18922 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:17.108364 22165 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.108219 22006 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.168454 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.159426 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.144793 22042 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:17.173221 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 176862us
I20260709 12:24:17.133396 22098 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:24:17.136413 21992 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:17.233610 22164 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:17.231856 22113 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.234176 22164 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:17.234745 22164 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:17.234679 22113 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.237529 22113 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.147557 21920 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:24:17.240007 18772 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:17.215894 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:17.242151 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.179551 22042 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:17.243454 18886 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.526s (SENT)
I20260709 12:24:17.243681 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.245033 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:17.245361 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.170943 22201 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:17.239372 22092 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.809s	user 0.013s	sys 0.002s
I20260709 12:24:17.270838 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:17.274040 22183 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:24:17.274353 22006 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.274044 22131 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:17.173689 22199 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.275213 22131 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.278595 22008 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:17.279150 22131 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:17.279783 22165 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.280454 22165 raft_consensus.cc:2764] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:17.281239 22165 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:17.284013 22184 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:24:17.285280 18922 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:17.287248 18769 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:17.284118 22116 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.294814 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:17.295189 18922 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:17.296818 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:17.319782 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.320765 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.294821 18772 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:17.335345 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.336853 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:17.338119 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 122333us
I20260709 12:24:17.341117 18772 raft_consensus.cc:2368] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 3. Current term is 4.
I20260709 12:24:17.342361 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.157429 22152 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.349093 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.350248 18770 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:17.343794 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:17.352331 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.352093 18919 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:17.287286 22092 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.355618 21976 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.358493 22006 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:17.268091 22113 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.368847 18768 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:17.379926 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.376855 18917 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:17.380877 18772 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:17.370249 19490 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:17.384966 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.382254 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.394322 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.395759 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.396536 18767 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:17.397364 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.398934 22191 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:17.405695 22196 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:17.323419 22141 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:24:17.406688 22196 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.408530 22066 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:17.361047 21889 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.318943 22131 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:17.388257 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:17.412928 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.421358 18767 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:17.422691 18770 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:17.347139 21987 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:17.425576 19486 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:17.425654 21987 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:17.427511 21987 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.428061 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.429340 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.430419 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.431205 18769 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:17.433593 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45479.9us
I20260709 12:24:17.435058 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.436162 18770 raft_consensus.cc:2368] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:17.437167 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.442507 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:17.451857 19487 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:17.248387 22203 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 12:24:17.455185 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.456413 18769 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:17.457381 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 281602us
I20260709 12:24:17.436810 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:17.345361 22065 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:17.348038 22094 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.462067 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:17.339701 22195 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 12:24:17.472287 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:17.480464 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.338670 21977 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:24:17.341739 22084 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:24:17.481103 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.487813 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:17.472402 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.247345 22042 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.491989 18773 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:17.459748 22199 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:17.481653 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:17.534081 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 236088us
I20260709 12:24:17.536608 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:17.497795 18772 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:17.460430 22008 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:17.419373 22113 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.543933 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:17.544827 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 86683.2us
I20260709 12:24:17.481621 22094 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.546269 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:17.555738 18770 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
W20260709 12:24:17.497543 22190 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
I20260709 12:24:17.553424 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:17.553535 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.554369 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.457062 22131 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.558521 18772 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:17.558518 18764 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:17.561344 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.562237 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.562695 22174 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:17.459264 22164 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.469869 22141 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:24:17.565277 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.544991 22196 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:17.493448 22066 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.569597 18765 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
W20260709 12:24:17.569429 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56737.7us
W20260709 12:24:17.567605 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.487121 22065 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.576058 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:17.578263 18914 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:17.580228 22196 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:17.582590 19488 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:17.576018 22066 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:17.585153 22066 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:17.593482 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56966.9us
I20260709 12:24:17.596376 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.597532 18764 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:17.615509 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:17.632768 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.636266 21977 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.644204 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:17.567370 22200 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:17.567628 22199 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.592629 22174 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:17.496189 22171 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.155s
W20260709 12:24:17.648408 22175 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:17.656998 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.655982 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:17.654808 22199 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:17.648016 21977 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:17.650226 22200 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:17.696452 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 143104us
I20260709 12:24:17.571144 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.700371 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.701229 18772 raft_consensus.cc:2376] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8. Re-sending same reply.
I20260709 12:24:17.702270 22141 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:17.706089 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.706676 22140 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:17.713521 22174 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.703037 22141 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.714056 22140 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:24:17.716450 22141 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.717350 22140 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.681277 22199 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.720171 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:17.720732 22101 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.979s	user 0.013s	sys 0.003s
I20260709 12:24:17.721252 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:17.722872 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:17.723381 18765 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:17.726747 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:17.729118 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:17.736131 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.526s (SENT)
I20260709 12:24:17.697680 21977 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.704680 22214 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.746918 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:17.748062 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.752104 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.753296 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.755053 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.757359 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.758145 18841 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:17.762355 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.762668 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:17.763129 18839 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:17.763219 18846 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8. Re-sending same reply.
I20260709 12:24:17.713598 22200 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.790009 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1689) took 1023 ms. Trace:
I20260709 12:24:17.794780 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:17.795431 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.818890 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.536s (SENT)
I20260709 12:24:17.819468 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:17.791250 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.794131 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.822526 18843 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:17.815516 18765 rpcz_store.cc:276] 0709 12:24:16.766204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.785551 (+1019347us) service_pool.cc:224] Handling call
0709 12:24:17.785953 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.786183 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.786214 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.786261 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:17.786301 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.786363 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.789916 (+  3553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.825439 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:17.826435 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:17.830279 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.831183 18770 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:17.830830 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:17.830719 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.831630 18772 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.752005 22214 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:17.831867 18764 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
W20260709 12:24:17.847108 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 65583.2us
W20260709 12:24:17.787604 22222 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:24:17.849761 19456 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.769s (SENT)
W20260709 12:24:17.803406 22213 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:24:17.762156 22196 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.852411 19491 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:17.859215 18770 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:17.859352 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:17.860390 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1690) took 1094 ms. Trace:
I20260709 12:24:17.860875 18770 rpcz_store.cc:276] 0709 12:24:16.766377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.853112 (+1086735us) service_pool.cc:224] Handling call
0709 12:24:17.858795 (+  5683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.859986 (+  1191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.860301 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.751031 22101 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:17.793586 22065 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:17.903252 18772 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:17.902750 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.848294 22200 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.916814 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.780741 22209 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:17.906987 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.913967 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.923336 18772 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:17.917662 18769 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:17.857322 22177 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:17.847419 22214 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.929299 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:17.923450 18840 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:17.930574 18843 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:17.847635 22171 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:17.925556 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 100175us
I20260709 12:24:17.927963 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:17.963809 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.965267 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.975611 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:17.968348 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.976900 18846 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:17.969518 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:17.912910 22094 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.973100 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1688) took 1165 ms. Trace:
I20260709 12:24:17.972959 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:17.912292 22219 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:17.903823 22141 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:17.990900 22219 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:17.991310 22101 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:17.991225 22141 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.979069 18771 rpcz_store.cc:276] 0709 12:24:16.766014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.846472 (+ 80458us) service_pool.cc:224] Handling call
0709 12:24:17.931672 (+1085200us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b540029d6d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:17.931875 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105430912}
I20260709 12:24:17.994467 18771 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:17.994940 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:17.995253 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1694) took 1183 ms. Trace:
I20260709 12:24:17.915177 22185 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.995869 18840 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:17.996286 22185 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:17.998618 22094 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.001147 22094 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.996881 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.002108 22152 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:17.991457 22219 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.004608 18769 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:18.005539 22185 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.995883 18771 rpcz_store.cc:276] 0709 12:24:16.811537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.993487 (+1181950us) service_pool.cc:224] Handling call
0709 12:24:17.993945 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:17.994933 (+   988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.995186 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:17.923919 22113 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:17.926108 22209 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.992172 21889 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:18.009967 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.016860 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1686) took 1245 ms. Trace:
I20260709 12:24:18.020717 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.021354 18771 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:18.022084 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.025534 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.026232 18846 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.026412 18771 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.027904 18771 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.031219 22141 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:18.017429 18766 rpcz_store.cc:276] 0709 12:24:16.765615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.965185 (+199570us) service_pool.cc:224] Handling call
0709 12:24:16.984816 (+ 19631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.086034 (+101218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.086086 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.108375 (+ 22289us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.338265 (+229890us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.338317 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.338437 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:18.011088 (+672651us) raft_consensus.cc:1685] finished
0709 12:24:18.011122 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.011338 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46356,"raft.queue_time_us":40982,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":15188,"thread_start_us":197310,"threads_started":1,"wal-append.queue_time_us":363508}
I20260709 12:24:18.033246 18766 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:24:18.038980 22225 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:18.044359 18846 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:18.047017 22230 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:18.047554 22230 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:18.047953 22230 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.048513 18771 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:18.018026 22209 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:18.060114 22201 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.070947 21977 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.071652 22141 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:18.073678 18848 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:18.062935 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 90084.4us
I20260709 12:24:18.015610 22195 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:24:18.065089 18764 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.066907 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1684) took 1301 ms. Trace:
I20260709 12:24:18.075628 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:18.076205 18768 rpcz_store.cc:276] 0709 12:24:16.765260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.928817 (+163557us) service_pool.cc:224] Handling call
0709 12:24:16.943786 (+ 14969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.380266 (+436480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.066505 (+686239us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002a0654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:18.066815 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955473792}
I20260709 12:24:18.081497 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:18.079442 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.061705 22230 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:18.088014 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.011333 22094 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:18.106819 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 180987us
W20260709 12:24:18.136370 18887 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.524s (SENT)
I20260709 12:24:18.137212 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.137303 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.138839 18846 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
W20260709 12:24:18.139845 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.762s (SENT)
W20260709 12:24:18.141549 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.779s (SENT)
I20260709 12:24:18.142071 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.144448 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.069134 22201 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.145412 18843 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.078208 22152 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:18.161433 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1946) took 1304 ms. Trace:
W20260709 12:24:18.161523 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 82191.7us
I20260709 12:24:18.172459 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:18.162931 18887 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.793s (SENT)
I20260709 12:24:18.173496 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.081243 22042 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.171168 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.178957 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.080806 22192 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:18.180604 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.185997 18846 raft_consensus.cc:2376] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
W20260709 12:24:18.187995 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.182864 18915 rpcz_store.cc:276] 0709 12:24:16.857382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.857526 (+   144us) service_pool.cc:224] Handling call
0709 12:24:16.857827 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.858044 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:16.895675 (+ 37631us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.057728 (+1162053us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b1800365380. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:24:18.160886 (+103158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:18.160970 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:18.161067 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.161168 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.161347 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37465,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3105,"raft.queue_time_us":229497,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":16532,"spinlock_wait_cycles":17872128,"thread_start_us":100555,"threads_started":1}
I20260709 12:24:18.150905 22065 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.210157 22065 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.174939 22199 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.212584 22065 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:18.213191 22065 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.209393 22242 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.219354 22242 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.219825 22242 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.210613 22231 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.200825 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2277) took 1083 ms. Trace:
I20260709 12:24:18.222937 18769 rpcz_store.cc:276] 0709 12:24:17.117762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.005695 (+887933us) service_pool.cc:224] Handling call
0709 12:24:18.006092 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.006514 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.006548 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.007103 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.159590 (+152487us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:18.159653 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.159785 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:18.200479 (+ 40694us) raft_consensus.cc:1685] finished
0709 12:24:18.200509 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.200730 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8221,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8230,"thread_start_us":151963,"threads_started":1,"wal-append.queue_time_us":185697}
I20260709 12:24:18.171170 21977 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:18.153003 22094 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.213294 22199 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.226181 22199 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:18.226687 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:18.226773 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:18.227511 18921 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:18.226770 22199 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.228184 22230 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:18.181200 22152 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:18.229735 22152 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.231004 22152 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.231292 21889 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:18.231101 22199 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:18.231864 21889 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:18.232846 21889 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.214004 22192 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.023973 22171 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.196758 22232 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.237813 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.250540 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.170280 22115 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.181733 22043 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:18.258193 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.243271 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.191810 22141 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.235666 22214 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.264008 22185 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.263217 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.271822 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.289984 18917 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.297116 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:18.306520 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.301734 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 138868us
W20260709 12:24:18.310860 18887 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.828s (SENT)
I20260709 12:24:18.311494 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.312855 18845 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:18.270634 22092 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:18.320178 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 147847us
I20260709 12:24:18.329279 18915 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.330895 18844 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:18.331674 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.334930 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:18.320400 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 183221us
W20260709 12:24:18.326623 22066 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.005s
I20260709 12:24:18.323872 21920 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:24:18.322381 18843 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:18.380561 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.416919 18848 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:18.417433 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:18.347240 22226 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:24:18.376498 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.377671 22244 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.420681 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.351734 22236 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.285358 22101 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:24:18.379263 22214 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:18.287145 22141 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.350621 22209 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.346654 22066 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:18.380399 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52963us
I20260709 12:24:18.448047 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:18.450078 22199 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:18.396894 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2315) took 1021 ms. Trace:
W20260709 12:24:18.382591 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 71766.6us
I20260709 12:24:18.450266 18886 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:18.389801 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:18.415055 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 118082us
I20260709 12:24:18.418272 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:18.456442 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66750.4us
I20260709 12:24:18.271561 22115 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.420056 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.390872 22185 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:18.422264 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:18.422771 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.391979 22192 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.427591 18840 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:18.395960 22232 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.438025 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:18.336478 22238 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.471565 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.313093 22219 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.458555 18843 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:18.460180 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.453022 18766 rpcz_store.cc:276] 0709 12:24:17.375616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.034299 (+658683us) service_pool.cc:224] Handling call
0709 12:24:18.034810 (+   511us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:18.035479 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:18.035888 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.162312 (+126424us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:18.186705 (+ 24393us) log.cc:844] Serialized 78 byte log entry
0709 12:24:18.186861 (+   156us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:18.384286 (+197425us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.385656 (+  1370us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.396246 (+ 10590us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.396446 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.396545 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:18.396598 (+    53us) raft_consensus.cc:1685] finished
0709 12:24:18.396617 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.396818 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57356,"prepare.queue_time_us":106427,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"raft.queue_time_us":42417,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":20404,"spinlock_wait_cycles":50565376,"thread_start_us":271322,"threads_started":2,"wal-append.queue_time_us":170593}
I20260709 12:24:18.466334 18915 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:18.477437 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.462138 21672 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.485347 21672 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.485966 21672 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.486548 22248 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.487329 22248 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.489928 22171 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:18.495821 21672 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.511372 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:18.499204 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:18.485405 22237 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
I20260709 12:24:18.504715 22114 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:18.528316 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.528817 22065 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.528496 22114 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.466146 22230 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.474120 22247 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:24:18.506254 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.465955 21992 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:18.508460 22115 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:18.508899 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:18.510109 22209 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:18.465370 22232 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:18.543260 18915 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:18.543340 22232 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.544345 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:18.544946 18915 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:18.509789 22242 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.547438 22043 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.547958 22043 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.548497 22242 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.460055 22199 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:18.549180 22230 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.519754 22008 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.429050 22244 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.549837 22008 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.550280 22008 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.550838 22247 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:18.551266 22247 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:18.551777 22244 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:18.496618 22042 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:24:18.552139 22247 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.520184 22066 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.524644 22141 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:18.527761 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.553489 22247 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:18.532189 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.486088 22245 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:18.554458 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.555922 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.556494 18846 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.539141 22114 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:18.539417 21672 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:18.542593 21992 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.559544 21992 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.560681 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.561349 18839 raft_consensus.cc:2376] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10. Re-sending same reply.
I20260709 12:24:18.561487 22232 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.562539 22219 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.564090 22232 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:18.568365 21992 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.571576 21992 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.573381 22245 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:18.573736 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:18.538671 18843 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:18.587080 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 129761us
I20260709 12:24:18.574549 22245 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.549265 22199 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.581946 22172 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:18.583827 22115 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:18.582168 18844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
W20260709 12:24:18.534559 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81057.7us
I20260709 12:24:18.586546 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.596342 18844 raft_consensus.cc:606] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:18.596685 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.844s (SENT)
I20260709 12:24:18.596693 18839 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:18.587963 18916 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:18.597378 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.605443 18846 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
W20260709 12:24:18.609252 18887 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.879s (SENT)
I20260709 12:24:18.610600 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.626845 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.630832 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.651469 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:18.655205 18839 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.594808 22141 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.656308 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:18.656243 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:18.647104 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:18.658741 18764 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:18.659185 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.661094 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:18.662604 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:18.663308 18764 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.660009 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:18.666538 19488 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.601754 22248 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.662279 22244 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:18.606209 22238 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:18.672118 18915 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:18.673403 18844 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.675756 18846 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.678738 18846 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:18.679622 18846 pending_rounds.cc:85] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 6
I20260709 12:24:18.680300 18846 pending_rounds.cc:107] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:18.680739 18846 raft_consensus.cc:2889] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:18.682863 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:18.684273 22197 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.685256 18916 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:18.688239 18844 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:18.655018 22195 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.668285 22236 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:18.646621 22232 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:18.690354 18844 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:18.656461 22185 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:18.617650 18887 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.890s (SENT)
I20260709 12:24:18.616832 22171 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:18.691303 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 87742.2us
W20260709 12:24:18.695711 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.695338 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 233745us
I20260709 12:24:18.696502 18839 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:18.619190 18766 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:24:18.698333 18764 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:18.700062 18844 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:18.700834 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.701298 18846 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.730559 18846 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:18.701938 18915 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.735898 18915 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:18.736856 18915 pending_rounds.cc:85] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 3
I20260709 12:24:18.737192 18915 pending_rounds.cc:107] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:18.737489 18915 raft_consensus.cc:2889] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:18.674607 22244 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:18.695428 22236 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.743448 18915 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.673888 22255 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.673714 22202 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.742010 19488 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:18.745533 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 86469.4us
W20260709 12:24:18.741462 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 123845us
I20260709 12:24:18.748687 18915 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.742782 18846 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.749189 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:18.760442 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.756275 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:18.761680 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.750769 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:18.751763 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:18.730512 22101 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.669093 22141 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.762148 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:18.763917 18844 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.764437 18846 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:18.765512 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.769719 18844 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.771572 18844 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.779950 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:18.743940 22232 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.746316 22244 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:18.791719 18846 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:18.793282 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:18.793983 18766 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.784061 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:18.690929 22195 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.795418 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:18.746556 22236 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.731923 22185 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.803975 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:18.782164 22242 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.735834 22238 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.779271 22231 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.800886 22066 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.808089 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.754196 22200 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:24:18.808892 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:18.828119 18764 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:18.790632 22219 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.807843 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:18.794560 22255 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.739982 22171 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.819816 18766 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:18.824894 18846 raft_consensus.cc:2376] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8. Re-sending same reply.
W20260709 12:24:18.825193 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.799940 22192 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.803247 22256 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:18.782727 22101 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.811586 18839 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:24:18.829417 18768 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:18.790874 22214 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:24:18.833530 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:18.834584 22262 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.835140 22235 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:18.836812 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:18.837435 22268 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.817552 22232 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:18.804934 22201 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:24:18.841992 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.854218 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:18.855197 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:18.857334 22256 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:18.815395 22242 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.846546 22066 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.864442 18764 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.829841 22115 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:24:18.871901 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:18.873462 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78110.7us
I20260709 12:24:18.858676 22235 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.874322 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:18.860769 22197 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.879436 22197 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.880010 22261 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:18.880146 22197 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.880663 22261 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.822290 22231 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.883370 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:18.884380 22231 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.885048 22231 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:18.860888 22232 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.865372 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:18.852131 22226 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.877408 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.893610 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.894431 18839 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:18.892493 22232 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.899179 22238 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:18.899871 22238 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:18.900446 22238 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.870448 22065 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:18.886850 22255 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:18.923254 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45944.4us
I20260709 12:24:18.887216 22235 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:18.891631 22066 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.892665 22231 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:18.880177 22195 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.931331 22075 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:18.933295 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:18.933925 22242 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:18.934834 22205 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:18.935768 22214 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.936203 22266 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.863869 22268 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.936795 22042 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:18.892094 22226 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:18.942163 18768 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:18.946209 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.994910 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:18.995565 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.949081 18764 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:18.949895 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:18.996694 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:18.997347 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47607.6us
I20260709 12:24:18.997607 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:18.861284 22262 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:18.998548 18764 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:18.999658 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:19.000428 18764 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:18.961174 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:18.992908 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.998579 22233 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:19.001498 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:19.001905 22233 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:18.997799 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:18.854940 22192 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:18.996572 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:19.002360 18764 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.002435 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.013939 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.015704 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.021070 18846 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:19.034545 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73465.5us
I20260709 12:24:19.033893 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:19.037022 18765 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 5: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:19.039609 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:19.040463 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:19.040650 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.003847 18844 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:19.042164 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:18.984408 22205 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:19.012463 22251 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.633s	user 0.003s	sys 0.000s
I20260709 12:24:19.018332 22088 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:19.047238 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:19.048605 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:19.068357 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:19.045758 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45868.9us
I20260709 12:24:19.056152 22242 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:19.000445 22262 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:19.044562 22185 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:19.079546 18764 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:19.014348 22214 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.079116 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:19.084905 18765 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.012650 22192 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:19.008948 21920 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:24:19.018376 22042 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.080495 22094 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:19.095894 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:19.056946 22172 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:19.067873 22088 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:19.084923 22210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.018s	sys 0.018s
I20260709 12:24:19.106938 18764 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:19.073737 22248 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:19.111332 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.001549 22254 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:24:19.001202 22250 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:24:19.014385 22255 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:24:19.003160 22233 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.116784 22269 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:24:19.117314 22279 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:19.118472 22276 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.065053 22008 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:19.100539 22043 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.552s	user 0.014s	sys 0.000s
I20260709 12:24:19.136605 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:19.141713 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:19.143896 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 544) took 1287 ms. Trace:
I20260709 12:24:19.145308 22042 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:19.144343 18771 rpcz_store.cc:276] 0709 12:24:17.856110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.049599 (+193489us) service_pool.cc:224] Handling call
0709 12:24:18.087012 (+ 37413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.088896 (+  1884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.088942 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.170968 (+ 82026us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.319328 (+148360us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:18.355511 (+ 36183us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.379217 (+ 23706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.379302 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.011638 (+632336us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:19.143579 (+131941us) raft_consensus.cc:1685] finished
0709 12:24:19.143687 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.143832 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8245,"prepare.queue_time_us":35965,"prepare.run_cpu_time_us":4018,"prepare.run_wall_time_us":24092,"raft.queue_time_us":1975,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":13613,"spinlock_wait_cycles":15496064,"thread_start_us":108007,"threads_started":1,"wal-append.queue_time_us":167955}
I20260709 12:24:19.062876 22231 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.019636 22266 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.107484 22171 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:19.133962 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:18.992535 22256 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:19.137466 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 195357us
I20260709 12:24:19.137396 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:19.185066 18764 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.139361 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.187335 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.137354 22255 consensus_queue.cc:1243] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:24:19.133395 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.124034 22238 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:19.137449 22210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.019s	sys 0.018s
I20260709 12:24:19.180954 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.147261 22075 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.183576 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:19.183882 18765 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:19.200930 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:19.202023 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:19.202972 18765 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:19.188309 18922 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:19.205168 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.147565 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:19.150422 22279 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:19.206102 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:19.191057 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57205.4us
I20260709 12:24:19.194692 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.179260 22042 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:19.213743 22042 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.216387 22042 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:19.217064 22247 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.000s
I20260709 12:24:19.146512 22185 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:19.182571 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.141770 22065 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:19.210019 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.205965 18922 raft_consensus.cc:2368] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:19.212592 22008 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:19.213129 18769 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:19.219226 18812 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.299s (SENT) [suppressed 56 similar messages]
I20260709 12:24:19.213737 18771 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:19.221851 18764 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:19.143965 22043 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.199329 22200 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:19.118996 22270 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.184s
I20260709 12:24:19.230588 18764 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:24:19.079778 22226 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.234602 18771 raft_consensus.cc:1217] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Deduplicated request from leader. Original: 5.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:24:19.240275 22043 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:19.240921 22288 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:19.115293 22172 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.242093 22141 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:19.245393 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.249867 22288 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:19.252671 22226 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.252895 22288 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.253072 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.229859 22171 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.249454 18771 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:19.218127 22185 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:19.225096 22238 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:19.227649 22075 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:24:19.254606 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:19.638476 22250 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:19.287374 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:19.772064 18918 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.772271 18739 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:19.240010 22199 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.005s
I20260709 12:24:19.767803 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 545) took 1911 ms. Trace:
I20260709 12:24:19.769848 22250 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.774271 18739 leader_election.cc:400] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:19.857429 18739 leader_election.cc:403] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:19.858278 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 84212.1us
I20260709 12:24:19.276262 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.862519 18922 raft_consensus.cc:2410] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:19.859587 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:19.864665 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:19.810834 18764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.010s	sys 0.010s
W20260709 12:24:19.869982 18764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.011s	sys 0.010s
W20260709 12:24:19.712771 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.401358 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 215141us
I20260709 12:24:19.489284 22247 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:19.751423 22244 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.948s	user 0.012s	sys 0.000s
I20260709 12:24:19.532851 22042 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:19.709194 22236 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.904s	user 0.007s	sys 0.004s
I20260709 12:24:19.836848 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:19.806576 22094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.006s
W20260709 12:24:19.813063 22233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.006s	sys 0.019s
W20260709 12:24:19.899830 22094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.004s	sys 0.007s
W20260709 12:24:19.899935 22233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.007s	sys 0.021s
I20260709 12:24:19.429332 22208 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:19.900854 22208 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.501580 22065 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.476121 22043 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.838611 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:19.838907 18845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2189) took 2112 ms (client timeout 1526 ms). Trace:
W20260709 12:24:19.525274 22219 consensus_meta.cc:287] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.004s
I20260709 12:24:19.906965 22219 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:19.906751 18845 rpcz_store.cc:269] 0709 12:24:17.726344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.726484 (+   140us) service_pool.cc:224] Handling call
0709 12:24:19.838591 (+2112107us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400124b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:19.838774 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302112000}
I20260709 12:24:19.294332 22289 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.906833 18771 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:19.841313 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.842228 22164 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:19.846505 18773 rpcz_store.cc:276] 0709 12:24:17.856432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.056071 (+199639us) service_pool.cc:224] Handling call
0709 12:24:18.056539 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.226978 (+170439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.227013 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:18.227055 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:18.227102 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.767480 (+1540378us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001b12d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:19.767542 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.767714 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391478528}
I20260709 12:24:19.847693 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:19.912792 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.848170 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:19.849476 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:19.850669 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:19.850912 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:19.807183 22231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.003s
I20260709 12:24:19.918023 19484 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:19.855999 18918 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:19.820196 22197 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.939s	user 0.014s	sys 0.000s
W20260709 12:24:19.712817 22232 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.814s	user 0.008s	sys 0.002s
W20260709 12:24:19.676368 22246 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.300s	user 0.001s	sys 0.003s
I20260709 12:24:19.247800 22254 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:19.872891 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:19.932638 18764 raft_consensus.cc:606] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:19.502450 22279 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.874203 22172 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:19.291684 22268 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:19.825939 22270 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:19.788408 22292 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:19.890750 22247 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.867456 22140 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:19.897405 18770 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:19.952396 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1709) took 1058 ms. Trace:
I20260709 12:24:19.952942 18770 rpcz_store.cc:276] 0709 12:24:18.893905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.896809 (+1002904us) service_pool.cc:224] Handling call
0709 12:24:19.897205 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.951968 (+ 54763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.952309 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:19.897928 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.897867 22236 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.898837 22042 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.897303 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.868327 22238 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.908564 22289 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.871954 22214 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:19.917088 18840 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:19.917555 18773 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:19.969630 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1712) took 1040 ms. Trace:
I20260709 12:24:19.970196 18773 rpcz_store.cc:276] 0709 12:24:18.928947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.912774 (+983827us) service_pool.cc:224] Handling call
0709 12:24:19.917216 (+  4442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.969246 (+ 52030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.969549 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:19.477291 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.920380 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.920464 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.920789 22094 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.975556 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.977130 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.977895 18918 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:19.921145 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:19.921378 22231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.015s	sys 0.008s
I20260709 12:24:19.921211 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:19.922019 22092 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:19.922626 22296 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:19.923592 19489 raft_consensus.cc:2368] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:19.924288 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:19.981884 19484 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:19.924841 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:19.919569 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:19.865803 22171 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:19.911194 22288 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.005s
I20260709 12:24:19.987634 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:19.901024 22088 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.873823 22291 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:19.913544 22043 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.893550 22244 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:19.950431 18765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.023s
I20260709 12:24:19.955971 18914 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
W20260709 12:24:19.996827 18765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.010s	sys 0.023s
I20260709 12:24:19.958110 22065 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:19.959254 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 740012us
I20260709 12:24:19.866129 22199 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.999917 18846 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:20.000715 18841 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:19.990357 22301 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:19.951638 22292 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.980013 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:19.982980 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63497.6us
I20260709 12:24:19.932638 22197 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.034590 22292 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.035732 22197 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:19.933653 22232 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:19.982856 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 58166.3us
I20260709 12:24:20.037766 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:19.936822 22254 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.988430 18773 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:20.034524 22068 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:24:20.039260 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:20.039932 18773 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:20.040027 22254 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:19.933063 18764 raft_consensus.cc:614] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:20.040762 22244 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:20.040875 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:19.990505 22231 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:20.041904 18921 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:20.042261 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:20.042553 19486 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:20.043148 22042 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:20.043627 22235 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.073s	user 0.001s	sys 0.013s
I20260709 12:24:20.044102 22235 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.044845 22171 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.007114 22065 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.984529 22092 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.981842 22094 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:19.951596 22270 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:19.984720 22114 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:19.996044 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:19.990490 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:19.993295 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:19.992249 22226 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.003s
I20260709 12:24:19.985198 22296 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.049878 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.006371 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:20.053294 22006 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:19.987730 22140 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:20.012239 18918 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:20.055651 18773 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
W20260709 12:24:20.018466 22295 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 12:24:20.019405 22294 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:24:20.019928 22230 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:20.020923 21987 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:20.022785 22289 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.023190 22088 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.059994 22140 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.024214 22281 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:20.026981 22250 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:20.047818 22114 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:20.034492 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1954) took 1810 ms. Trace:
I20260709 12:24:20.037961 22232 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:19.985146 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1693) took 3181 ms. Trace:
I20260709 12:24:20.041710 22199 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.040702 18915 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.965171 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1713) took 1022 ms. Trace:
I20260709 12:24:20.117874 18917 rpcz_store.cc:276] 0709 12:24:18.224096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.229798 (+  5702us) service_pool.cc:224] Handling call
0709 12:24:18.230118 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.290568 (+ 60450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.034155 (+1743587us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b54000e3b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:20.034375 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126427392}
I20260709 12:24:20.119122 18770 rpcz_store.cc:276] 0709 12:24:18.956061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.963768 (+1007707us) service_pool.cc:224] Handling call
0709 12:24:19.964267 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.964610 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.964663 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:19.964732 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:19.964807 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.964904 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.965082 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:19.992462 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:20.054050 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.059360 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:20.059392 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2328) took 1253 ms. Trace:
I20260709 12:24:20.121208 18840 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:20.121398 18765 rpcz_store.cc:276] 0709 12:24:18.805972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.219650 (+413678us) service_pool.cc:224] Handling call
0709 12:24:19.232444 (+ 12794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.232929 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.232974 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.248338 (+ 15364us) log.cc:844] Serialized 26 byte log entry
0709 12:24:19.997285 (+748947us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:20.012665 (+ 15380us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.059071 (+ 46406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.059143 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.059182 (+    39us) raft_consensus.cc:1685] finished
0709 12:24:20.059197 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.059330 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46149,"prepare.queue_time_us":15404,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":49483,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":8262,"thread_start_us":553419,"threads_started":1,"wal-append.queue_time_us":727450}
I20260709 12:24:20.056680 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.110630 22197 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:20.123935 22302 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:20.124102 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67499.2us
I20260709 12:24:20.125005 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.060730 18914 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:20.057562 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:20.063751 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.064815 18841 raft_consensus.cc:1217] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-10.9]   Dedup: 6.7->[8.8-10.9]
I20260709 12:24:20.062177 22042 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.062424 22230 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:20.046887 22065 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:19.990810 22288 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.073361 22168 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:20.073624 22247 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:20.048852 22094 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.076475 22281 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:20.041783 22231 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.047087 22092 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.079119 22043 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:20.048866 22270 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.082998 22296 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.046356 22235 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.125514 18917 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:20.160483 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1976) took 1287 ms. Trace:
I20260709 12:24:20.161077 18917 rpcz_store.cc:276] 0709 12:24:18.872887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.124794 (+1251907us) service_pool.cc:224] Handling call
0709 12:24:20.125151 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.160154 (+ 35003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.160392 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.074785 22140 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:20.126334 18841 pending_rounds.cc:85] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 7
I20260709 12:24:20.162731 18841 pending_rounds.cc:107] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:24:20.163144 18841 raft_consensus.cc:2889] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:20.067239 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:20.126729 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 134363us
I20260709 12:24:20.130028 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1974) took 1263 ms. Trace:
I20260709 12:24:20.150838 21987 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:20.067508 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77125.5us
I20260709 12:24:20.165015 21987 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.165522 21987 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:20.166944 22230 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.143548 22172 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:20.169020 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1977) took 1290 ms. Trace:
I20260709 12:24:20.169799 22288 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.122570 18772 rpcz_store.cc:276] 0709 12:24:16.803602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.937208 (+1133606us) service_pool.cc:224] Handling call
0709 12:24:17.937715 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.970832 (+ 33117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.970877 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.971536 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.186854 (+215318us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:18.186893 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.186968 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.567309 (+1380341us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:19.981361 (+414052us) raft_consensus.cc:1685] finished
0709 12:24:19.981388 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.985081 (+  3693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15276288,"thread_start_us":43259,"threads_started":1,"wal-append.queue_time_us":262195}
I20260709 12:24:20.124102 22197 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.164827 18914 rpcz_store.cc:276] 0709 12:24:18.866479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.053736 (+1187257us) service_pool.cc:224] Handling call
0709 12:24:20.054096 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.129681 (+ 75585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.129963 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.171597 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:20.143030 22168 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:20.139817 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82338.6us
I20260709 12:24:20.070627 22171 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:20.144663 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 81044.5us
I20260709 12:24:20.150614 22238 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:20.031289 22208 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.124593 22302 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.060061 22301 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.132023 22068 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:20.129861 22196 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.161687 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:20.174678 22168 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.172314 18914 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:20.189579 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1971) took 1336 ms. Trace:
W20260709 12:24:20.173508 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.177920 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:20.190745 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:20.180994 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.191809 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 1998) took 1972 ms. Trace:
I20260709 12:24:20.192054 18840 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:20.138937 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.133132 22042 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.183789 22006 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:20.185424 22172 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:20.186926 19488 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:24:20.154762 22281 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.188334 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:20.128891 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:20.195448 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56615us
I20260709 12:24:20.193312 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:20.133956 22114 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.194303 18737 leader_election.cc:400] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:20.192209 18843 rpcz_store.cc:276] 0709 12:24:18.216240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.505907 (+289667us) service_pool.cc:224] Handling call
0709 12:24:20.188375 (+1682468us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b540041afd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:20.188526 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4377984}
I20260709 12:24:20.082269 22292 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.207571 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:20.206523 18914 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:20.208662 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.190214 18922 rpcz_store.cc:276] 0709 12:24:18.853384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.048615 (+1195231us) service_pool.cc:224] Handling call
0709 12:24:20.049041 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.061076 (+ 12035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.061112 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.067226 (+  6114us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.189101 (+121875us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.189154 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.189250 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.189316 (+    66us) raft_consensus.cc:1685] finished
0709 12:24:20.189336 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.189503 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3417,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"thread_start_us":63306,"threads_started":1,"wal-append.queue_time_us":100444}
I20260709 12:24:20.209020 18737 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.209481 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:20.195851 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.211432 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:20.169426 18917 rpcz_store.cc:276] 0709 12:24:18.878443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.162124 (+1283681us) service_pool.cc:224] Handling call
0709 12:24:20.168490 (+  6366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.168680 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.168704 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.168746 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.168781 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.168837 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.168964 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.213476 18915 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:20.211180 22092 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.214599 22196 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:20.214841 22281 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:20.215334 22196 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:20.216444 22196 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.217908 22094 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:20.218369 22094 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.218739 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.221570 22042 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.207505 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:20.218811 22094 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:20.223026 22042 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:20.212393 22171 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.222795 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:20.230773 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:20.234297 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.247107 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:20.248632 18765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:20.251830 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:20.252962 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:20.254254 18922 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:20.205888 22277 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:20.257251 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.258685 18766 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:20.260273 22300 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:20.195106 22291 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:20.265638 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.260658 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.193161 22296 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.265137 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1715) took 1249 ms. Trace:
I20260709 12:24:20.270920 18766 rpcz_store.cc:276] 0709 12:24:19.015372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.241312 (+1225940us) service_pool.cc:224] Handling call
0709 12:24:20.241663 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.264796 (+ 23133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.265064 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.272414 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:20.261988 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.270030 18765 raft_consensus.cc:606] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.274765 18765 raft_consensus.cc:614] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:20.226514 22172 consensus_queue.cc:1243] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:20.276472 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:20.226624 22042 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:20.258195 21977 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:20.248595 22276 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:20.256033 22006 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:20.284883 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.269114 22277 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.259846 22094 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.293608 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:20.294529 19485 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:20.312474 18913 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:20.270361 22231 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:20.308557 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.226353 21987 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.275816 22291 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.313532 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:20.258008 22226 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:24:20.225518 22140 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.280005 22270 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:20.321105 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1978) took 1433 ms. Trace:
W20260709 12:24:20.320107 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67228.5us
I20260709 12:24:20.311691 22277 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:20.308145 22296 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.324806 22098 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:24:20.312368 22247 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:20.341087 18840 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:20.286051 22172 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:24:20.314302 21977 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:20.313748 22261 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.339773 18913 rpcz_store.cc:276] 0709 12:24:18.892396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.320189 (+1427793us) service_pool.cc:224] Handling call
0709 12:24:20.320543 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.320744 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.320776 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.320817 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.320869 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.320921 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.321037 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.352843 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1714) took 1380 ms. Trace:
I20260709 12:24:20.333981 22231 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:20.353957 18843 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:20.323954 22291 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.308617 22276 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.353394 22247 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.359592 18913 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:20.367509 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1979) took 1473 ms. Trace:
I20260709 12:24:20.367916 18913 rpcz_store.cc:276] 0709 12:24:18.894261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.359071 (+1464810us) service_pool.cc:224] Handling call
0709 12:24:20.359412 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.367189 (+  7777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.367442 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.369504 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1980) took 1465 ms. Trace:
I20260709 12:24:20.357689 22231 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:20.361151 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1975) took 1492 ms. Trace:
I20260709 12:24:20.369848 18913 rpcz_store.cc:276] 0709 12:24:18.904134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.368672 (+1464538us) service_pool.cc:224] Handling call
0709 12:24:20.368980 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.369162 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.369189 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.369245 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.369284 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.369337 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.369447 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.350459 22296 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.374142 18918 rpcz_store.cc:276] 0709 12:24:18.868870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.054910 (+1186040us) service_pool.cc:224] Handling call
0709 12:24:20.055231 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.059219 (+  3988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.059247 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.068452 (+  9205us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.270846 (+202394us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:20.270905 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.270981 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.360903 (+ 89922us) raft_consensus.cc:1685] finished
0709 12:24:20.360931 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.361090 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5171,"raft.queue_time_us":4098,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8637,"thread_start_us":138242,"threads_started":1,"wal-append.queue_time_us":265248}
I20260709 12:24:20.360373 21987 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.395789 22256 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:20.396854 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.362272 22094 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:20.419173 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.388661 22068 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:20.402657 22152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.699s	user 0.015s	sys 0.018s
I20260709 12:24:20.377840 22231 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.428580 19489 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:24:20.422358 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.400996 22302 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:20.467914 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:20.360445 22321 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:24:20.420589 22288 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:20.487877 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.424541 22006 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.425391 22292 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:20.435545 22152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.732s	user 0.015s	sys 0.018s
I20260709 12:24:20.375437 22042 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.488860 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.399272 22114 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:24:20.494813 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.435019 21977 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.498512 22006 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.507499 22301 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:20.512944 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.513358 18918 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:20.514102 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:20.486624 22226 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:20.469839 22320 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.495947 22094 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.494853 22326 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:20.501113 22308 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 12:24:20.526959 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:20.527608 18839 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.522280 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:20.523629 22317 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:24:20.529780 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:20.529353 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74065.5us
I20260709 12:24:20.533349 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:20.529894 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1963) took 2242 ms. Trace:
I20260709 12:24:20.531286 22326 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.534380 18916 rpcz_store.cc:276] 0709 12:24:18.287957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.615065 (+327108us) service_pool.cc:224] Handling call
0709 12:24:18.616089 (+  1024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.685640 (+ 69551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.529631 (+1843991us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b54000339d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:20.529827 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158195072}
I20260709 12:24:20.495345 22288 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.538231 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.540299 22247 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.521456 22131 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.538906 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1984) took 1504 ms. Trace:
I20260709 12:24:20.565725 18916 rpcz_store.cc:276] 0709 12:24:19.034861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.538055 (+1503194us) service_pool.cc:224] Handling call
0709 12:24:20.538357 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.538574 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.538605 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.538647 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.538686 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.538739 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.538837 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.566270 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.567871 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.571141 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:20.573997 18847 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:20.597402 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:20.601888 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:20.614073 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1985) took 1490 ms. Trace:
W20260709 12:24:20.565186 22309 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:24:20.617416 18916 rpcz_store.cc:276] 0709 12:24:19.123356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.581868 (+1458512us) service_pool.cc:224] Handling call
0709 12:24:20.613531 (+ 31663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.613717 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.613744 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.613786 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.613817 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.613872 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.614006 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.532822 22006 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.540505 22326 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.525602 22320 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.710726 22257 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:20.683449 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1986) took 1474 ms. Trace:
I20260709 12:24:20.738525 18916 rpcz_store.cc:276] 0709 12:24:19.208877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.682301 (+1473424us) service_pool.cc:224] Handling call
0709 12:24:20.682699 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.682947 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.682985 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.683045 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:20.683101 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.683182 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.683363 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.521638 22226 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.526733 22094 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.588528 22140 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.645035 22152 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:20.740909 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1988) took 1526 ms. Trace:
I20260709 12:24:20.759299 18916 rpcz_store.cc:276] 0709 12:24:19.214915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.739791 (+1524876us) service_pool.cc:224] Handling call
0709 12:24:20.740186 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.740459 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:20.740492 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.740546 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.740599 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.740675 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.740848 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.712654 22247 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.731971 22292 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.733760 22131 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:20.749759 22276 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.783962 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1991) took 1549 ms. Trace:
W20260709 12:24:20.697566 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.785319 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 168656us
I20260709 12:24:20.761034 22296 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.787468 18919 rpcz_store.cc:276] 0709 12:24:19.247452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.783039 (+1535587us) service_pool.cc:224] Handling call
0709 12:24:20.783397 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.783604 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.783629 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.783673 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:20.783718 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.783776 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.783897 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.764909 22289 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:20.786080 22168 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.003s
W20260709 12:24:20.794096 22319 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:24:20.765192 22152 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.771736 22247 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.805682 18919 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:20.793836 22322 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:24:20.769842 22140 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:20.827641 22325 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:24:20.827539 22140 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:20.812273 22307 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:24:20.772979 22292 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.830533 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 712) took 1857 ms. Trace:
I20260709 12:24:20.830921 19483 rpcz_store.cc:276] 0709 12:24:18.973099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.974376 (+  1277us) service_pool.cc:224] Handling call
0709 12:24:18.975254 (+   878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.990483 (+ 15229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.990536 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.028036 (+1037500us) spinlock_profiling.cc:243] Waited 926 us on lock 0x7b4c00493bc0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359257a20 00007f3359268a29 00007f335922e644 00007f3359255f2d 00007f3359255b93 00007f335af8618b 00007f335af86cb5 00007f335af88004 00007f335af87729 00007f335af8cd96 00007f335af81adb
0709 12:24:20.028918 (+   882us) log.cc:844] Serialized 548 byte log entry
0709 12:24:20.189230 (+160312us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.189278 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.189355 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.830191 (+640836us) raft_consensus.cc:1685] finished
0709 12:24:20.830212 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.830463 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129152,"thread_start_us":159681,"threads_started":1,"wal-append.queue_time_us":253888}
I20260709 12:24:20.832324 22292 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.832849 22226 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.808019 22042 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.834316 22328 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:24:20.832870 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.830112 22140 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.836635 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1992) took 1361 ms. Trace:
I20260709 12:24:20.853168 18919 rpcz_store.cc:276] 0709 12:24:19.474997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.792800 (+1317803us) service_pool.cc:224] Handling call
0709 12:24:20.793123 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.836319 (+ 43196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.836569 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.785714 22131 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.809055 22168 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:20.838485 22320 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.838833 22152 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.844291 22247 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:20.846607 22094 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.834795 22042 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.794088 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:20.808941 22289 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:20.810668 22088 consensus_meta.cc:287] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.736s	user 0.007s	sys 0.007s
I20260709 12:24:20.860436 18839 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:20.863401 18919 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:21.000542 22288 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.929142 22196 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.111967 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1993) took 1269 ms. Trace:
I20260709 12:24:20.909796 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.112385 18919 rpcz_store.cc:276] 0709 12:24:19.842915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.862773 (+1019858us) service_pool.cc:224] Handling call
0709 12:24:20.863220 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.111683 (+248463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.111903 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:20.983503 22277 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.632s	user 0.000s	sys 0.013s
I20260709 12:24:21.113516 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.111593 22196 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.114151 22289 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.357028 18772 rpcz_store.cc:276] 0709 12:24:18.972962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.170908 (+1197946us) service_pool.cc:224] Handling call
0709 12:24:20.171247 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.171466 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:20.286736 (+115270us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.352101 (+ 65365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.352513 (+   412us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.352582 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.352650 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.352777 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183697,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":311,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5941,"thread_start_us":179562,"threads_started":2,"wal-append.queue_time_us":68506}
I20260709 12:24:20.908371 22168 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:20.983896 22330 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:24:21.115479 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:21.113387 22277 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.116109 18772 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.116551 18847 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:20.977504 22296 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:21.117895 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:20.874372 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.120162 22276 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.121892 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 327868us
I20260709 12:24:20.907382 18770 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:21.035812 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 126500us
I20260709 12:24:21.120718 22276 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.129977 22265 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:20.852770 22291 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.118878 22211 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.132957 18848 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:24:21.132798 22211 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:20.861527 22292 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.864724 22333 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:21.132102 22101 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.135579 22281 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:21.136418 22042 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:20.906551 22131 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.138634 18839 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:24:21.118162 22296 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.134801 22292 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.152988 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2078) took 1161 ms. Trace:
I20260709 12:24:21.157272 18914 rpcz_store.cc:276] 0709 12:24:19.991217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.150963 (+1159746us) service_pool.cc:224] Handling call
0709 12:24:21.151424 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.152402 (+   978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.152474 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.152545 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:21.152602 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.152694 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.152878 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.123808 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:21.161593 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:21.116506 22196 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:21.139322 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.117985 22277 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:20.977330 22140 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.132133 22276 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.175071 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:21.178252 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.178264 19483 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:21.162472 18772 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:21.154327 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:21.180557 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.181941 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.171056 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:21.168265 22131 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:21.167986 22042 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.183588 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.187964 19490 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:21.190721 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:21.169356 22320 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.183027 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:21.185125 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.178624 22291 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.199946 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1982) took 2212 ms. Trace:
I20260709 12:24:21.200815 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2077) took 1210 ms. Trace:
I20260709 12:24:21.173044 22247 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:21.193245 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.194708 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.203900 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:21.182283 22231 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.003s
I20260709 12:24:21.192243 22288 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:21.183709 22276 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:21.179355 22140 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.218516 19483 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:21.184505 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:21.205523 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.220404 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.205793 22168 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:21.223349 22168 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.216146 22231 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.223912 22168 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:21.224520 18916 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:21.208349 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:21.214766 22196 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:21.227098 22196 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:21.192535 22094 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:21.204659 18848 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:21.200464 18918 rpcz_store.cc:276] 0709 12:24:18.987268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.382898 (+1395630us) service_pool.cc:224] Handling call
0709 12:24:20.383266 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.513818 (+130552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.199564 (+685746us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000e4554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:21.199852 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298812288}
I20260709 12:24:21.228914 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.229569 18848 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:21.229775 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.230717 18918 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 4.
I20260709 12:24:21.227903 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:21.232595 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:21.222303 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.234527 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.222319 18772 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.225978 22231 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.237279 18848 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:21.240159 18848 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:21.241310 18848 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.238494 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:21.195030 22131 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.194869 22042 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:21.244685 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 77227.8us
I20260709 12:24:21.250370 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:21.256299 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.257012 18918 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:24:21.259418 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:21.259562 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:21.229148 22088 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:21.248332 18772 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:21.264536 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.232401 22211 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:21.235743 22247 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:21.227901 22094 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.267870 19490 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:24:21.250123 22288 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:21.265107 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.270251 19483 raft_consensus.cc:2955] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 3 to 6, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:21.284382 18918 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:21.267405 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2339) took 1020 ms. Trace:
I20260709 12:24:21.285008 18772 rpcz_store.cc:276] 0709 12:24:20.246538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.184168 (+937630us) service_pool.cc:224] Handling call
0709 12:24:21.267336 (+ 83168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.288333 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:21.289183 18772 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:21.266474 22276 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:21.262110 22231 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:21.293099 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.296343 18772 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:21.296911 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2343) took 1046 ms. Trace:
I20260709 12:24:21.296764 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:21.297364 18772 rpcz_store.cc:276] 0709 12:24:20.250936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.289981 (+1039045us) service_pool.cc:224] Handling call
0709 12:24:21.296827 (+  6846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.299528 22197 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:21.299724 22140 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.302222 22266 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.201267 18919 rpcz_store.cc:276] 0709 12:24:19.990923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.113255 (+1122332us) service_pool.cc:224] Handling call
0709 12:24:21.113555 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.113772 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:21.172263 (+ 58491us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.200459 (+ 28196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.200516 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:21.200564 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.200638 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.200757 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"thread_start_us":85936,"threads_started":2}
I20260709 12:24:21.305256 22177 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:21.305445 22345 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.306345 18920 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:21.307618 22177 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:21.308089 22177 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:21.309058 22177 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.310847 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1996) took 1067 ms. Trace:
I20260709 12:24:21.311352 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.312228 18764 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:21.311261 18914 rpcz_store.cc:276] 0709 12:24:20.242983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.164069 (+921086us) service_pool.cc:224] Handling call
0709 12:24:21.164437 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.172679 (+  8242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.172720 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.179148 (+  6428us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.286076 (+106928us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.286136 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.286209 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.310494 (+ 24285us) raft_consensus.cc:1685] finished
0709 12:24:21.310516 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.310786 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7799,"raft.queue_time_us":8267,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":2642,"thread_start_us":81199,"threads_started":1,"wal-append.queue_time_us":108887}
I20260709 12:24:21.313184 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.299528 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:21.313850 18764 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:21.314191 18772 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.265817 22343 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:21.266605 22340 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:21.318840 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.305318 18919 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:21.319828 22276 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:21.321712 22292 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.322075 22197 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:21.322626 22276 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.323401 22270 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:21.323921 22270 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.324851 18764 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:21.325562 22131 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.310245 22177 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:21.326979 22339 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:24:21.329270 22042 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.326864 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.330219 18764 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:21.331645 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:21.332077 18915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 1973) took 2469 ms (client timeout 1508 ms). Trace:
I20260709 12:24:21.332664 22281 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:21.332535 18915 rpcz_store.cc:269] 0709 12:24:18.862792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.865081 (+  2289us) service_pool.cc:224] Handling call
0709 12:24:21.331842 (+2466761us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540027c9d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:21.331971 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2648146304}
I20260709 12:24:21.333256 22094 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.333371 22281 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.333910 22281 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.334050 22296 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.325592 22264 raft_consensus.cc:993] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:21.320861 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:21.336580 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.294947 22247 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:21.275612 22088 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.297667 22231 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.348842 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.350247 18915 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.350754 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.351681 18919 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:21.347304 18764 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:21.354595 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2341) took 1105 ms. Trace:
I20260709 12:24:21.355332 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.356240 18914 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:21.355754 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.357877 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.355034 18764 rpcz_store.cc:276] 0709 12:24:20.249276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.336289 (+1087013us) service_pool.cc:224] Handling call
0709 12:24:21.354518 (+ 18229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.322602 22197 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:21.359246 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.359395 18920 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:21.357878 18772 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:21.360325 18764 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:21.360749 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2337) took 1115 ms. Trace:
I20260709 12:24:21.337903 22340 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:21.361186 18772 rpcz_store.cc:276] 0709 12:24:20.245414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.299254 (+1053840us) service_pool.cc:224] Handling call
0709 12:24:21.360685 (+ 61431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.347074 21672 raft_consensus.cc:1081] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:21.361414 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.365213 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.365412 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.366247 18914 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:21.365104 18764 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:21.367316 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.367959 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:21.368707 18764 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.369343 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.347352 22131 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:21.371639 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 102691us
I20260709 12:24:21.348925 22231 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.372706 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.374300 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.375269 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.376037 18772 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:21.377461 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.379179 18919 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:21.380069 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.381650 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:21.381778 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.383994 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:21.385354 22266 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.385820 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:21.386693 22292 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:21.381008 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2340) took 1132 ms. Trace:
I20260709 12:24:21.319751 22343 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.387738 18915 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:21.387807 18772 rpcz_store.cc:276] 0709 12:24:20.248635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.371510 (+1122875us) service_pool.cc:224] Handling call
0709 12:24:21.380937 (+  9427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.388227 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:21.363575 22197 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.388907 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.389755 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.390362 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:21.391561 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.392335 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.387091 22292 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:21.394151 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.396174 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:21.372982 22131 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.399009 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:21.400123 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.397962 22140 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:21.400975 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2342) took 1150 ms. Trace:
I20260709 12:24:21.401307 18772 rpcz_store.cc:276] 0709 12:24:20.250205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.395845 (+1145640us) service_pool.cc:224] Handling call
0709 12:24:21.400912 (+  5067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.402410 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:21.403155 18764 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:21.403560 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.404251 18772 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:21.405342 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.404521 22320 raft_consensus.cc:2955] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index 3 to 6, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:21.404141 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.406493 22290 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:21.407332 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:21.407828 18772 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:21.408937 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2344) took 1157 ms. Trace:
I20260709 12:24:21.391971 22094 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:21.410351 18772 rpcz_store.cc:276] 0709 12:24:20.251560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.405110 (+1153550us) service_pool.cc:224] Handling call
0709 12:24:21.408874 (+  3764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.412029 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:21.409901 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.413009 18764 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:21.414467 18764 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:21.397959 22131 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.420253 22168 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.421196 22291 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:21.421422 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1989) took 2206 ms. Trace:
I20260709 12:24:21.420668 22140 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:21.421763 18916 rpcz_store.cc:276] 0709 12:24:19.215204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.763849 (+1548645us) service_pool.cc:224] Handling call
0709 12:24:20.764257 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.224942 (+460685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.421140 (+196198us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54000e3654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:21.421342 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058032000}
I20260709 12:24:21.422595 22140 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.423015 22340 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.422926 22131 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.425040 18919 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:21.425144 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2330) took 1440 ms. Trace:
I20260709 12:24:21.425590 18770 rpcz_store.cc:276] 0709 12:24:19.984369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.120516 (+136147us) service_pool.cc:224] Handling call
0709 12:24:21.424938 (+1304422us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:21.425081 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612522368}
I20260709 12:24:21.399144 22292 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.426847 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:21.428285 22343 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.428694 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:21.429509 21672 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:21.430058 21672 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:21.430918 21672 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.434188 22264 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:21.434855 22264 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:21.435277 22264 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.444500 22088 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.445123 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 710) took 2479 ms. Trace:
I20260709 12:24:21.445317 18919 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:21.445583 19488 rpcz_store.cc:276] 0709 12:24:18.952238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.952451 (+   213us) service_pool.cc:224] Handling call
0709 12:24:18.992996 (+ 40545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.204916 (+1211920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.431291 (+1226375us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540079ed54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:21.431549 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2745176448}
I20260709 12:24:21.445603 18839 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:21.447161 18839 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:21.449260 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.452095 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.453343 18770 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:21.454324 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1720) took 2370 ms. Trace:
I20260709 12:24:21.454836 18770 rpcz_store.cc:276] 0709 12:24:19.084348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.443142 (+2358794us) service_pool.cc:224] Handling call
0709 12:24:21.453105 (+  9963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.454001 (+   896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.454254 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.457280 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.461295 22205 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.466233 18916 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:21.462738 22296 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.431655 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1719) took 2349 ms. Trace:
I20260709 12:24:21.447961 18839 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.473001 18839 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.488246 22131 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:21.489102 18764 rpcz_store.cc:276] 0709 12:24:19.081971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.413798 (+2331827us) service_pool.cc:224] Handling call
0709 12:24:21.414248 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.423860 (+  9612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.431589 (+  7729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.490741 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.496093 18922 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:21.491307 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:21.497680 18770 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:21.486145 18839 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:21.503155 18770 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:21.504168 18916 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:21.504189 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 265784us
I20260709 12:24:21.506223 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1725) took 2370 ms. Trace:
I20260709 12:24:21.506878 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:21.506820 18770 rpcz_store.cc:276] 0709 12:24:19.135867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.501660 (+2365793us) service_pool.cc:224] Handling call
0709 12:24:21.502986 (+  1326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.503574 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.506132 (+  2558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.508988 22168 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.497452 22263 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:24:21.497993 22205 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.514670 18839 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.515990 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:21.534705 18839 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:21.504719 22043 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:21.502355 18917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54084
I20260709 12:24:21.538589 18917 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.539005 18917 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.529769 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:21.541371 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2333) took 1555 ms. Trace:
I20260709 12:24:21.541024 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.543567 18922 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:21.494202 22296 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.502111 22265 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:21.549590 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1997) took 1306 ms. Trace:
I20260709 12:24:21.551301 18918 rpcz_store.cc:276] 0709 12:24:20.243324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.285250 (+1041926us) service_pool.cc:224] Handling call
0709 12:24:21.297751 (+ 12501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.313383 (+ 15632us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:21.337664 (+ 24281us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.419726 (+ 82062us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b1800370600. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:24:21.549199 (+129473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.549258 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:21.549310 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.549389 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.549519 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24002,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2093,"raft.queue_time_us":100,"spinlock_wait_cycles":4554112,"thread_start_us":129071,"threads_started":1}
I20260709 12:24:21.529872 22088 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:24:21.556752 18917 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.531032 22113 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:24:21.550467 21977 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:24:21.576468 22231 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.607767 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 663) took 1761 ms. Trace:
I20260709 12:24:21.565286 22264 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.583550 22281 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.562934 22356 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:21.592339 22357 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:21.593997 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2015) took 1418 ms. Trace:
I20260709 12:24:21.611387 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2226) took 1171 ms. Trace:
I20260709 12:24:21.611279 18843 rpcz_store.cc:276] 0709 12:24:20.175901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.208060 (+ 32159us) service_pool.cc:224] Handling call
0709 12:24:21.593779 (+1385719us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b540041c3d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:21.593930 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205039872}
I20260709 12:24:21.593609 22197 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.573655 22270 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:21.594636 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.595799 18917 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:21.595911 22296 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.597466 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.598104 18922 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
W20260709 12:24:21.598994 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47793us
I20260709 12:24:21.599715 22292 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.607508 22113 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:21.608206 19491 rpcz_store.cc:276] 0709 12:24:19.846546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.852282 (+  5736us) service_pool.cc:224] Handling call
0709 12:24:19.852682 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.038893 (+186211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.038925 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.038970 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:20.039018 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.607504 (+1568486us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540051cf54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:21.607555 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.607701 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427691904}
I20260709 12:24:21.608958 18914 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:21.609591 18768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 550) took 2990 ms (client timeout 1944 ms). Trace:
I20260709 12:24:21.612680 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1711) took 2688 ms. Trace:
I20260709 12:24:21.611898 18847 rpcz_store.cc:276] 0709 12:24:20.440095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.644306 (+204211us) service_pool.cc:224] Handling call
0709 12:24:20.644678 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.117065 (+472387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.611138 (+494073us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54003be554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:21.611322 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084772608}
I20260709 12:24:21.616338 22098 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:21.637965 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.638511 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.639562 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.616422 22231 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:21.633579 18768 rpcz_store.cc:269] 0709 12:24:18.618719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.656030 (+ 37311us) service_pool.cc:224] Handling call
0709 12:24:21.609353 (+2953323us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54001c2354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:21.609479 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393642880}
I20260709 12:24:21.637040 22094 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:21.633652 18771 rpcz_store.cc:276] 0709 12:24:18.924795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.909178 (+984383us) service_pool.cc:224] Handling call
0709 12:24:19.929836 (+ 20658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.938832 (+  8996us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:19.967648 (+ 28816us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.075810 (+108162us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.083605 (+  7795us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.084218 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.084436 (+   218us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.084679 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.136907 (+ 52228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.136994 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.602752 (+1465758us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b1800068620. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:21.612466 (+  9714us) raft_consensus.cc:1685] finished
0709 12:24:21.612488 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.612618 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48416,"prepare.queue_time_us":19243,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":103,"raft.queue_time_us":73653,"raft.run_cpu_time_us":557,"raft.run_wall_time_us":27493,"spinlock_wait_cycles":43507712,"thread_start_us":80399,"threads_started":1,"wal-append.queue_time_us":176267}
I20260709 12:24:21.622290 22357 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:21.647734 22357 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.649001 22088 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.650293 18766 raft_consensus.cc:2368] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
I20260709 12:24:21.667814 22088 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.650830 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2009) took 1636 ms. Trace:
I20260709 12:24:21.651796 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 664) took 1804 ms. Trace:
W20260709 12:24:21.652777 18773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 554) took 1665 ms (client timeout 1878 ms). Trace:
W20260709 12:24:21.671602 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 176264us
I20260709 12:24:21.653053 18764 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:21.653563 18921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2074) took 2463 ms (client timeout 1623 ms). Trace:
W20260709 12:24:21.671963 18773 rpcz_store.cc:269] 0709 12:24:19.987236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.041985 (+ 54749us) service_pool.cc:224] Handling call
0709 12:24:21.652589 (+1610604us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54001d6d54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:21.652712 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29191040}
W20260709 12:24:21.672851 18921 rpcz_store.cc:269] 0709 12:24:19.190594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.836495 (+645901us) service_pool.cc:224] Handling call
0709 12:24:21.653364 (+1816869us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400261bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:21.653495 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340632320}
I20260709 12:24:21.636310 22113 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:21.654913 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2335) took 1657 ms. Trace:
I20260709 12:24:21.655086 22281 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.633477 22356 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:21.655892 18771 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:21.705605 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2336) took 1718 ms. Trace:
I20260709 12:24:21.705997 18771 rpcz_store.cc:276] 0709 12:24:19.986921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.655390 (+1668469us) service_pool.cc:224] Handling call
0709 12:24:21.655714 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.705332 (+ 49618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.705546 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.637699 22098 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:21.645550 19458 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:21.710821 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 65351us
I20260709 12:24:21.711661 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:21.710950 22098 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.712630 22098 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:21.713603 22210 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:21.714098 22210 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:21.716593 18773 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 7. Ops: [5.5-5.5]
I20260709 12:24:21.716830 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.721108 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:21.663791 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 144577us
I20260709 12:24:21.671785 19486 rpcz_store.cc:276] 0709 12:24:19.846943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.849741 (+  2798us) service_pool.cc:224] Handling call
0709 12:24:19.850131 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.042990 (+192859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.651548 (+1608558us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400555fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:21.651729 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441981184}
I20260709 12:24:21.674839 18768 rpcz_store.cc:276] 0709 12:24:19.986604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.643543 (+1656939us) service_pool.cc:224] Handling call
0709 12:24:21.643865 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.644035 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.644059 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.644101 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:21.644137 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.644187 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.644301 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.724014 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 557) took 1734 ms. Trace:
I20260709 12:24:21.725917 18772 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:21.691435 22113 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.679194 22231 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:21.670819 18846 rpcz_store.cc:276] 0709 12:24:20.014158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.014277 (+   119us) service_pool.cc:224] Handling call
0709 12:24:20.014688 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.050237 (+ 35549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.050270 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.050779 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.299167 (+248388us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:21.650248 (+1351081us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.650489 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.650568 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.650614 (+    46us) raft_consensus.cc:1685] finished
0709 12:24:21.650628 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.650756 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1385841,"prepare.queue_time_us":1351567,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":38064,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":247999,"threads_started":1,"wal-append.queue_time_us":338053}
I20260709 12:24:21.730681 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.746366 18916 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:21.724387 18768 rpcz_store.cc:276] 0709 12:24:19.989729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.723192 (+1733463us) service_pool.cc:224] Handling call
0709 12:24:21.723499 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.723687 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.723711 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.723750 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:21.723785 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.723837 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.723954 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.729947 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 555) took 1740 ms. Trace:
I20260709 12:24:21.729327 22075 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:21.738993 22094 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:21.739082 22363 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:21.742630 22214 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:21.714571 22210 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:21.743723 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.745416 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2008) took 1731 ms. Trace:
I20260709 12:24:21.700306 19489 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.747793 18773 rpcz_store.cc:276] 0709 12:24:19.989123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.673155 (+1684032us) service_pool.cc:224] Handling call
0709 12:24:21.716088 (+ 42933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.729505 (+ 13417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.729882 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.643018 22343 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:24:21.749415 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 558) took 1758 ms. Trace:
I20260709 12:24:21.750448 19458 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:21.768985 22343 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:21.769462 22343 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:21.769681 22257 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:21.770161 22257 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.770537 22257 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.729878 22349 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:21.751773 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 555) took 1213 ms. Trace:
I20260709 12:24:21.748657 22236 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.753535 22075 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:21.792636 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.754837 22113 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:21.794647 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.792162 18842 rpcz_store.cc:276] 0709 12:24:20.538854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.799486 (+260632us) service_pool.cc:224] Handling call
0709 12:24:20.800099 (+   613us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:20.803854 (+  3755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.803887 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:20.837082 (+ 33195us) log.cc:844] Serialized 52 byte log entry
0709 12:24:21.105912 (+268830us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:21.653104 (+547192us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.751287 (+ 98183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.751412 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.751480 (+    68us) raft_consensus.cc:1685] finished
0709 12:24:21.751500 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.751688 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":546797,"prepare.queue_time_us":547612,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":38720,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":4935,"thread_start_us":362398,"threads_started":2,"wal-append.queue_time_us":265018}
I20260709 12:24:21.679833 22088 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.763104 18773 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:21.766794 22356 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.801194 22214 consensus_queue.cc:1243] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:24:21.802881 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:21.803576 18846 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:21.803885 18846 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:21.804136 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:21.804643 18846 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.805588 18846 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.805742 18839 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:21.806195 18839 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:21.768817 18768 rpcz_store.cc:276] 0709 12:24:19.990982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.747878 (+1756896us) service_pool.cc:224] Handling call
0709 12:24:21.748303 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.748913 (+   610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.748956 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.749027 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:21.749085 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.749172 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.749338 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":229,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96}
I20260709 12:24:21.806957 18839 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.761138 18841 rpcz_store.cc:276] 0709 12:24:20.013871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.016083 (+  2212us) service_pool.cc:224] Handling call
0709 12:24:20.016564 (+   481us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:20.163993 (+147429us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:20.275963 (+111970us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.429874 (+153911us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:20.451639 (+ 21765us) log.cc:844] Serialized 52 byte log entry
0709 12:24:20.451911 (+   272us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:21.652303 (+1200392us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.652633 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.745073 (+ 92440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.745151 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.745195 (+    44us) raft_consensus.cc:1685] finished
0709 12:24:21.745207 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.745349 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1200062,"prepare.queue_time_us":2687362,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":81354,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":19536,"thread_start_us":317262,"threads_started":3,"wal-append.queue_time_us":237816}
W20260709 12:24:21.798980 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.800184 19489 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:21.809875 18839 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.804795 18844 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:21.800119 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2346) took 1434 ms. Trace:
I20260709 12:24:21.810762 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1729) took 1417 ms. Trace:
I20260709 12:24:21.810868 18773 rpcz_store.cc:276] 0709 12:24:20.365638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.762335 (+1396697us) service_pool.cc:224] Handling call
0709 12:24:21.762714 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.799805 (+ 37091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.800039 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.812646 18773 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:21.813248 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1731) took 1412 ms. Trace:
I20260709 12:24:21.744969 22205 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:24:21.811115 18768 rpcz_store.cc:276] 0709 12:24:20.393594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.809052 (+1415458us) service_pool.cc:224] Handling call
0709 12:24:21.810238 (+  1186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.810456 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.810481 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.810525 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:21.810555 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.810594 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.810685 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.813576 18773 rpcz_store.cc:276] 0709 12:24:20.400399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.812059 (+1411660us) service_pool.cc:224] Handling call
0709 12:24:21.812425 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.812991 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.813193 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.817080 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:21.817752 18847 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.817740 18768 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:24:21.818786 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 556) took 1829 ms. Trace:
I20260709 12:24:21.818233 18845 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:21.819213 18771 rpcz_store.cc:276] 0709 12:24:19.989492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.707047 (+1717555us) service_pool.cc:224] Handling call
0709 12:24:21.707567 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.708205 (+   638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.708250 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.708942 (+   692us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.784188 (+ 75246us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:21.814250 (+ 30062us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.818473 (+  4223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.818550 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.818591 (+    41us) raft_consensus.cc:1685] finished
0709 12:24:21.818603 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.818727 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30526,"raft.queue_time_us":3954,"thread_start_us":74730,"threads_started":1,"wal-append.queue_time_us":83794}
I20260709 12:24:21.824467 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.826808 19486 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
W20260709 12:24:21.828557 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.827656 22364 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.829517 22292 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.829665 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:21.830046 22364 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.831861 22094 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:21.832274 22094 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:21.832697 22094 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:21.813889 22349 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:21.835014 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:21.773926 22343 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.819232 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1733) took 1403 ms. Trace:
I20260709 12:24:21.845027 22349 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.840934 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 541) took 4416 ms. Trace:
I20260709 12:24:21.814710 22320 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:21.843245 22264 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.844005 22266 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:21.822456 22075 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.848802 18846 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:21.855597 18847 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:21.756661 22231 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:21.856945 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 48692.8us
I20260709 12:24:21.845816 18768 rpcz_store.cc:276] 0709 12:24:20.415602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.816723 (+1401121us) service_pool.cc:224] Handling call
0709 12:24:21.817442 (+   719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.818918 (+  1476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.819166 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:21.846161 18767 rpcz_store.cc:276] 0709 12:24:17.424884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.049291 (+624407us) service_pool.cc:224] Handling call
0709 12:24:18.049645 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.050092 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.050121 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.050698 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.185805 (+135107us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:18.421747 (+235942us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.421966 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.422048 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.619342 (+3197294us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b18001d4760. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1
0709 12:24:21.771317 (+151975us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b18001d4760. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:21.840663 (+ 69346us) raft_consensus.cc:1685] finished
0709 12:24:21.840706 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.840864 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48989,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":10796,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":10197,"spinlock_wait_cycles":28143232,"thread_start_us":318128,"threads_started":2,"wal-append.queue_time_us":385478}
I20260709 12:24:21.879042 18839 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:24:21.879482 18839 pending_rounds.cc:85] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 8
I20260709 12:24:21.879722 18839 pending_rounds.cc:107] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:24:21.879985 18839 raft_consensus.cc:2889] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:21.887431 21833 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:21.913419 22364 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.895244 22195 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:21.915011 22195 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.915894 22231 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:21.917560 22195 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.825019 22210 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.920306 19486 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:21.926443 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:21.913743 21833 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:21.887699 22197 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:21.935716 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:21.938128 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:21.940003 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:21.940903 18917 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.912312 22205 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:21.867784 22320 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:21.930768 22362 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:21.934824 22343 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:22.090360 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.093084 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.944867 22210 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:21.952050 22365 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.085444 22356 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.956666 22205 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.127708 21833 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:22.128604 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:22.129523 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1723) took 3000 ms. Trace:
W20260709 12:24:22.129806 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.135031 18840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2014) took 1959 ms (client timeout 1857 ms). Trace:
W20260709 12:24:22.135581 18840 rpcz_store.cc:269] 0709 12:24:20.175582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.193864 (+ 18282us) service_pool.cc:224] Handling call
0709 12:24:22.134738 (+1940874us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54003be054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:22.134938 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300310272}
I20260709 12:24:22.129988 18764 rpcz_store.cc:276] 0709 12:24:19.129665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.499164 (+2369499us) service_pool.cc:224] Handling call
0709 12:24:21.652866 (+153702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.672832 (+ 19966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.129329 (+456497us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54001d6d50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:22.129461 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352575872}
I20260709 12:24:22.138592 18922 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:22.140569 18919 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:22.142357 18917 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 5.
I20260709 12:24:22.158205 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:22.095500 22362 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.160220 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:22.161062 19458 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:22.169191 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:22.169309 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1732) took 1768 ms. Trace:
I20260709 12:24:22.171684 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:22.170308 18773 rpcz_store.cc:276] 0709 12:24:20.400786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.815836 (+1415050us) service_pool.cc:224] Handling call
0709 12:24:21.816145 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.816373 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:21.937586 (+121213us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.168560 (+230974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.168661 (+   101us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:22.168774 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.168976 (+   202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.169212 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283455,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":210,"thread_start_us":340719,"threads_started":2}
I20260709 12:24:22.162269 22177 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:22.175078 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.106864 22365 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:22.178617 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 191833us
I20260709 12:24:22.167927 22344 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:22.113708 22356 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.176187 22094 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.175923 22164 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:22.170528 22088 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:22.178016 22210 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:22.175751 22195 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:22.187443 22373 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:24:22.206363 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.208487 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.170094 22351 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:24:22.210280 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1705) took 3324 ms. Trace:
I20260709 12:24:22.219779 18773 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:22.210839 22164 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:22.225630 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.228148 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.228250 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 301267us
W20260709 12:24:22.229144 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.206163 22210 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:22.208786 22195 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.233560 22210 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:22.231252 22113 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:24:22.237534 22320 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:22.257472 22231 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.258265 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1737) took 1540 ms. Trace:
I20260709 12:24:22.258131 22231 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:22.258824 22374 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:24:22.260701 22231 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:22.233198 22195 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.258746 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1734) took 1834 ms. Trace:
I20260709 12:24:22.269035 21889 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.269297 18771 rpcz_store.cc:276] 0709 12:24:20.424637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.826563 (+1401926us) service_pool.cc:224] Handling call
0709 12:24:21.868611 (+ 42048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.869195 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.869239 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.933737 (+ 64498us) log.cc:844] Serialized 548 byte log entry
0709 12:24:22.154563 (+220826us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:22.154619 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.154762 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.258468 (+103706us) raft_consensus.cc:1685] finished
0709 12:24:22.258489 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.258667 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":220387,"threads_started":1,"wal-append.queue_time_us":243433}
I20260709 12:24:22.272135 22356 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:22.272636 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.274302 22379 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:24:22.275403 18921 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:22.278084 22202 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:22.278687 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1736) took 1597 ms. Trace:
W20260709 12:24:22.278475 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.279942 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.279852 22068 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:22.280216 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:22.258744 18767 rpcz_store.cc:276] 0709 12:24:20.718205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.875705 (+1157500us) service_pool.cc:224] Handling call
0709 12:24:21.876166 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:21.888583 (+ 12417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.888615 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:21.922878 (+ 34263us) log.cc:844] Serialized 52 byte log entry
0709 12:24:22.187573 (+264695us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:22.207584 (+ 20011us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.208174 (+   590us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.208450 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.208727 (+   277us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.257999 (+ 49272us) raft_consensus.cc:1685] finished
0709 12:24:22.258016 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.258187 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22142,"prepare.queue_time_us":44964,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":3422,"raft.queue_time_us":1555,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":19469,"spinlock_wait_cycles":30052992,"thread_start_us":239217,"threads_started":1,"wal-append.queue_time_us":289622}
I20260709 12:24:22.283332 18847 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:22.282805 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:22.279089 18768 rpcz_store.cc:276] 0709 12:24:20.681360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.872890 (+1191530us) service_pool.cc:224] Handling call
0709 12:24:21.873364 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.930009 (+ 56645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.930043 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.932936 (+  2893us) log.cc:844] Serialized 26 byte log entry
0709 12:24:22.206538 (+273602us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:22.206948 (+   410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.207033 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.278464 (+ 71431us) raft_consensus.cc:1685] finished
0709 12:24:22.278485 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.278620 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4433,"raft.queue_time_us":52414,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5079,"thread_start_us":151255,"threads_started":1,"wal-append.queue_time_us":284191}
I20260709 12:24:22.280422 22068 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:22.303835 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:22.304764 22331 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.496s	user 0.005s	sys 0.000s
I20260709 12:24:22.306137 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:22.306680 22344 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:22.307387 19489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 674) took 1880 ms (client timeout 1565 ms). Trace:
I20260709 12:24:22.279212 22202 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:22.250895 22372 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:24:22.313262 19491 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:24:22.316438 19489 rpcz_store.cc:269] 0709 12:24:20.426674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.496577 (+ 69903us) service_pool.cc:224] Handling call
0709 12:24:22.307128 (+1810551us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540080b954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:22.307285 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2726393728}
I20260709 12:24:22.309448 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:22.321590 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:22.322245 18839 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:22.323913 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:22.330621 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1739) took 1601 ms. Trace:
W20260709 12:24:22.337177 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 85013.1us
I20260709 12:24:22.340062 18771 rpcz_store.cc:276] 0709 12:24:20.729481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.270783 (+1541302us) service_pool.cc:224] Handling call
0709 12:24:22.271129 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.271328 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:22.271636 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.330260 (+ 58624us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.330308 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:22.330358 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.330443 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.330560 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":738,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"thread_start_us":57491,"threads_started":1}
I20260709 12:24:22.314918 22266 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:22.320062 22351 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:22.344017 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 160086us
I20260709 12:24:22.347879 22385 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:22.348501 22385 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.348822 18771 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:22.350023 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2349) took 1533 ms. Trace:
I20260709 12:24:22.319423 22202 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:22.351958 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.355607 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.348958 22385 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.581795 22191 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:22.586931 22191 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.586975 22202 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.588577 22202 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.589304 22191 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:22.590554 22365 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:22.591326 22231 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.591840 22231 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:22.592589 22257 consensus_meta.cc:287] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.822s	user 0.007s	sys 0.005s
I20260709 12:24:22.593050 22257 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.579535 22266 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.597149 22266 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:22.542352 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 194618us
I20260709 12:24:22.597787 22266 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:22.598580 22266 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.601667 22266 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:22.602790 22068 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:22.604017 22068 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.606048 19484 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:22.607074 22208 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.325619 22356 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.252s
I20260709 12:24:22.601496 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:22.613859 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.623343 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 1981) took 3597 ms. Trace:
W20260709 12:24:22.624056 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 278115us
I20260709 12:24:22.625259 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:22.633514 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.634361 19485 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:22.594158 22231 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:22.632455 18913 rpcz_store.cc:276] 0709 12:24:18.986863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.375851 (+1388988us) service_pool.cc:224] Handling call
0709 12:24:20.376183 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.376595 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.376625 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.385972 (+  9347us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.645624 (+259652us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:20.645705 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.645815 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.304115 (+1658300us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:22.352898 (+ 48783us) raft_consensus.cc:1685] finished
0709 12:24:22.352921 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.583859 (+230938us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":6124,"spinlock_wait_cycles":3465472,"thread_start_us":259281,"threads_started":1,"wal-append.queue_time_us":384255}
I20260709 12:24:22.577499 22205 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:22.653048 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.350508 18771 rpcz_store.cc:276] 0709 12:24:20.816491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.348109 (+1531618us) service_pool.cc:224] Handling call
0709 12:24:22.348458 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.349720 (+  1262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.349962 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:22.678359 22386 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:24:22.682641 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.682852 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:22.683588 19487 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:22.685734 19483 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:22.680406 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:22.690261 19485 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:22.342724 22164 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.634569 22208 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.658989 22094 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:22.699025 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:22.699695 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1744) took 1485 ms. Trace:
I20260709 12:24:22.701826 19488 raft_consensus.cc:1813] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Handling vote request from an unknown peer 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:22.701767 18771 rpcz_store.cc:276] 0709 12:24:21.213893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.670231 (+1456338us) service_pool.cc:224] Handling call
0709 12:24:22.699120 (+ 28889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.699313 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.699341 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.699383 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:22.699424 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.699483 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.699615 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.702967 19488 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:22.705742 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1738) took 1987 ms. Trace:
W20260709 12:24:22.689167 22279 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:24:22.706188 18764 rpcz_store.cc:276] 0709 12:24:20.718606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.137785 (+1419179us) service_pool.cc:224] Handling call
0709 12:24:22.138282 (+   497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:22.142813 (+  4531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.142861 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:22.154701 (+ 11840us) log.cc:844] Serialized 52 byte log entry
0709 12:24:22.233753 (+ 79052us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:22.697232 (+463479us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.705373 (+  8141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.705465 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.705510 (+    45us) raft_consensus.cc:1685] finished
0709 12:24:22.705526 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.705673 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3943,"prepare.queue_time_us":16553,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":14127,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":10785,"thread_start_us":484697,"threads_started":2,"wal-append.queue_time_us":142801}
I20260709 12:24:22.714649 18764 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:22.715274 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 560) took 1400 ms. Trace:
I20260709 12:24:22.715533 18764 rpcz_store.cc:276] 0709 12:24:21.314925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.714113 (+1399188us) service_pool.cc:224] Handling call
0709 12:24:22.714504 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.715041 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.715213 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.716509 18764 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:22.716998 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 564) took 1401 ms. Trace:
I20260709 12:24:22.719475 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1745) took 1505 ms. Trace:
I20260709 12:24:22.721035 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 563) took 1405 ms. Trace:
I20260709 12:24:22.721853 18772 rpcz_store.cc:276] 0709 12:24:21.315789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.411776 (+ 95987us) service_pool.cc:224] Handling call
0709 12:24:22.720845 (+1309069us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001d5454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:22.720967 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616960384}
I20260709 12:24:22.723572 18772 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:22.724375 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 565) took 1408 ms. Trace:
W20260709 12:24:22.728856 22391 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.382s	user 0.000s	sys 0.002s
I20260709 12:24:21.541754 18770 rpcz_store.cc:276] 0709 12:24:19.986137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.509512 (+1523375us) service_pool.cc:224] Handling call
0709 12:24:21.509928 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.510194 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:21.511061 (+   867us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.540989 (+ 29928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:21.541048 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.541110 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.541186 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.541312 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":322,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":5437,"thread_start_us":25514,"threads_started":1}
I20260709 12:24:22.717263 18764 rpcz_store.cc:276] 0709 12:24:21.316008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.716129 (+1400121us) service_pool.cc:224] Handling call
0709 12:24:22.716383 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.716827 (+   444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.716958 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.737212 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:22.724764 18772 rpcz_store.cc:276] 0709 12:24:21.316226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.722910 (+1406684us) service_pool.cc:224] Handling call
0709 12:24:22.723325 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.724071 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.724322 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.739853 18770 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:22.746058 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 569) took 1421 ms. Trace:
I20260709 12:24:22.746528 18770 rpcz_store.cc:276] 0709 12:24:21.324656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.736376 (+1411720us) service_pool.cc:224] Handling call
0709 12:24:22.739125 (+  2749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.745769 (+  6644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.745992 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.739737 18771 rpcz_store.cc:276] 0709 12:24:21.214166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.703057 (+1488891us) service_pool.cc:224] Handling call
0709 12:24:22.718922 (+ 15865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.719103 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.719126 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.719175 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:22.719218 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.719284 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.719396 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.742889 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47220 (request call id 32) took 2551 ms. Trace:
I20260709 12:24:22.747637 18765 rpcz_store.cc:276] 0709 12:24:20.187662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.204345 (+ 16683us) service_pool.cc:224] Handling call
0709 12:24:22.738950 (+2534605us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54002120d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af85853 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:22.739073 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44895104}
I20260709 12:24:22.693292 22113 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:24:22.748322 18764 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:22.751449 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.759645 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.765297 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.741622 22365 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:22.776479 19487 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:24:22.777182 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 90256.9us
I20260709 12:24:22.779062 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:22.779135 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.780171 18765 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:22.787055 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:22.783017 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.768014 22094 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.788296 18771 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:22.774704 22257 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:22.785187 22210 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:24:22.807217 18916 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:22.808102 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:22.813812 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:22.815129 18917 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:22.809543 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:22.823004 18772 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:22.824644 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.827087 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.827875 18772 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 4.
I20260709 12:24:22.828684 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:22.829290 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.829391 18913 raft_consensus.cc:2376] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7. Re-sending same reply.
I20260709 12:24:22.830668 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.831319 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.832137 18913 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:22.832687 18913 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:22.834465 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:22.835362 18770 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:22.793335 22364 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:22.836300 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:22.841683 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:22.842705 18765 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.842837 18918 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:22.781781 22365 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.798655 22094 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:22.854212 18921 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:22.784566 22191 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:24:22.801512 22098 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:22.868851 21833 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.822307 22210 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.873785 22385 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.818508 22398 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:22.909112 22231 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.885679 18765 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:22.910257 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1741) took 2164 ms. Trace:
I20260709 12:24:22.837738 18913 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:22.895635 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:22.910755 18767 rpcz_store.cc:276] 0709 12:24:20.746123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.283487 (+1537364us) service_pool.cc:224] Handling call
0709 12:24:22.283820 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.284502 (+   682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.284533 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.285064 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:24:22.788764 (+503700us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:22.788818 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.788902 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.910009 (+121107us) raft_consensus.cc:1685] finished
0709 12:24:22.910032 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.910188 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":368,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7335,"thread_start_us":451929,"threads_started":1,"wal-append.queue_time_us":563983}
I20260709 12:24:22.901460 21833 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:22.916615 21833 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:22.916769 22210 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:22.916733 22094 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:22.907097 22385 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:22.911554 18921 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:22.870169 22393 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:22.912431 18913 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.832137 18772 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:22.901324 18919 raft_consensus.cc:2955] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 3 to 6, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:22.936728 22281 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:22.937309 22281 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:22.937470 22403 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:22.938143 22403 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:22.938442 22281 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:22.939705 22281 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.940609 22403 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:22.941069 22195 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.004s
I20260709 12:24:22.928004 22393 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:22.941550 22195 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.943638 22393 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:22.946260 22365 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:22.909778 22231 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:22.909205 22398 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:22.948486 22231 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:22.949604 22398 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:22.946125 22357 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.954710 19492 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:22.956925 22195 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:22.968289 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:22.977865 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:22.986156 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:22.987349 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.989234 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:22.993904 18844 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.999480 18913 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:24:22.999923 22164 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.988241 22300 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:23.003015 22164 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.005499 22164 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:23.000164 18913 pending_rounds.cc:85] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 2
I20260709 12:24:23.006141 18913 pending_rounds.cc:107] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:24:23.006480 18913 raft_consensus.cc:2889] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.006564 22279 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:23.006991 22279 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:23.007902 22279 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:23.009258 22402 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.072s	user 0.000s	sys 0.002s
I20260709 12:24:23.009409 22279 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.000774 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.152541 18840 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:23.153753 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.036042 18848 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.159535 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.161382 18842 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:23.163995 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:23.165097 18767 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:23.035565 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.171324 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:23.159626 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.172413 18765 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:23.173267 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.175894 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.181740 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:23.056249 22362 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.199100 18770 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.041275 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:23.209591 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:23.044893 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:23.210718 22343 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:23.038892 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:23.050010 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.217557 18913 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.218561 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.220081 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.080605 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 726) took 1208 ms. Trace:
I20260709 12:24:23.225101 22302 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.042805 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.224829 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:23.226130 22302 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.226971 22266 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.227353 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.228689 18921 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:23.025132 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:23.070843 22202 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.051203 22092 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:23.229604 22302 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:23.229775 22092 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:23.085777 22209 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:23.248313 22209 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:23.248471 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:23.252630 19491 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:22.984522 22131 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:23.234232 22345 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:23.255348 22345 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.255484 22131 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:23.093595 22208 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:23.190172 18768 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:23.027423 22195 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:23.026543 22177 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:23.190413 22219 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:23.262967 22219 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.045668 22088 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:23.264556 22088 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:23.265372 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:23.266561 22219 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.061878 22230 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.267431 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:23.267557 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:23.268999 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:23.269338 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:23.269999 19492 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:23.271453 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:23.273224 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:23.030606 22231 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:23.249958 22209 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.275594 22231 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:23.276026 22209 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.277284 22231 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.191730 22236 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.281644 22236 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.285717 18920 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:23.191799 22196 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.286808 22400 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.287397 22196 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.287536 22400 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.026219 22245 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:24:23.286545 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:23.291592 22266 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:23.292100 22266 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.292567 22266 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.292418 22245 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:23.293397 22245 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:23.190246 22075 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.194074 22296 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:23.195441 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.295050 22075 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.295958 18846 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:23.297328 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.193192 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.196934 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.197839 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.025767 22300 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:23.313287 22245 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.314321 22300 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.316165 18921 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:23.316656 18920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2099) took 1936 ms (client timeout 1545 ms). Trace:
I20260709 12:24:23.317363 22196 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:23.317168 18920 rpcz_store.cc:269] 0709 12:24:21.380284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.381543 (+  1259us) service_pool.cc:224] Handling call
0709 12:24:23.316339 (+1934796us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540027d8d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:23.316545 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4376412544}
I20260709 12:24:23.285666 22236 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:23.298329 22075 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.258056 22131 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.322839 18841 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:23.186038 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:23.033771 18914 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2094) took 1663 ms (client timeout 2210 ms). Trace:
W20260709 12:24:23.070698 22387 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.720s	user 0.003s	sys 0.000s
I20260709 12:24:22.988457 22407 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:24:23.332235 18914 rpcz_store.cc:269] 0709 12:24:21.370493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.374053 (+  3560us) service_pool.cc:224] Handling call
0709 12:24:23.033521 (+1659468us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400034dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:23.033701 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537455360}
I20260709 12:24:23.333757 22407 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:23.203819 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.334332 22407 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:23.204772 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:23.209681 18766 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2338) took 2963 ms (client timeout 1572 ms). Trace:
W20260709 12:24:23.336242 18766 rpcz_store.cc:269] 0709 12:24:20.246166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.272057 (+ 25891us) service_pool.cc:224] Handling call
0709 12:24:23.209182 (+2937125us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002107d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:23.209442 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3166964480}
I20260709 12:24:23.042640 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.336143 22407 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.211645 22343 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.339111 22407 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.211018 18769 rpcz_store.cc:276] 0709 12:24:18.885379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.229063 (+343684us) service_pool.cc:224] Handling call
0709 12:24:19.778875 (+549812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.779179 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:19.817787 (+ 38608us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.131394 (+2313607us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b18003e2840. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:24:22.209555 (+ 78161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.209627 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:22.209704 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.209793 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.209942 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11,"prepare.queue_time_us":38252,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":2122,"spinlock_wait_cycles":4106112,"thread_start_us":77874,"threads_started":1,"wal-append.queue_time_us":2374183}
W20260709 12:24:23.214524 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.212006 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.215380 22403 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:23.215659 18915 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.341481 18918 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:23.216279 18764 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:23.084384 19484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 672) took 3033 ms (client timeout 2284 ms). Trace:
I20260709 12:24:23.224375 19486 rpcz_store.cc:276] 0709 12:24:21.872651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.874005 (+  1354us) service_pool.cc:224] Handling call
0709 12:24:21.874471 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.920834 (+ 46363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.080100 (+1159266us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b5400216bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:23.080467 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104871808}
I20260709 12:24:23.342887 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.043534 18922 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:23.344065 18847 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:23.345257 22400 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:23.345358 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.345916 22196 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.185081 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 571) took 1041 ms. Trace:
W20260709 12:24:23.234043 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 208855us
I20260709 12:24:23.346527 18914 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:23.346712 22196 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.347141 19490 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:23.348476 18839 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:24:23.230033 22202 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.255818 22345 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.190742 22197 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.266631 22088 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:23.292958 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.295503 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 125065us
I20260709 12:24:23.071581 22270 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:23.192973 22292 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:23.196839 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.373610 22197 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.377451 22197 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:23.196305 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.234340 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.311414 18913 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:23.318218 18921 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:23.330224 18767 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:23.346349 18847 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.356961 18765 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
W20260709 12:24:23.342908 19484 rpcz_store.cc:269] 0709 12:24:20.051270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.051431 (+   161us) service_pool.cc:224] Handling call
0709 12:24:23.084065 (+3032634us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b5400788554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:23.084248 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5614120832}
I20260709 12:24:23.357610 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2348) took 2567 ms. Trace:
I20260709 12:24:23.346719 18773 rpcz_store.cc:276] 0709 12:24:22.144051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.174783 (+ 30732us) service_pool.cc:224] Handling call
0709 12:24:23.184613 (+1009830us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b54001c1954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:23.184896 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74272128}
W20260709 12:24:23.359498 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.349663 22196 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:23.362600 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.385409 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.365494 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.367422 22202 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:23.369467 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.368860 22208 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:23.370205 22211 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.372138 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.377681 22075 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.298267 18846 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:23.378777 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.340972 22343 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:23.373405 22292 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:23.398960 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48674.3us
I20260709 12:24:23.399238 22092 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.390375 22177 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:24:23.386374 18920 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:23.341493 22403 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.394156 22211 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.381498 18768 rpcz_store.cc:276] 0709 12:24:20.786816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.285767 (+1498951us) service_pool.cc:224] Handling call
0709 12:24:23.189574 (+903807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.259583 (+ 70009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.353175 (+ 93592us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54001c1950. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:23.354080 (+   905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077406464}
I20260709 12:24:23.401638 18846 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:23.402346 22075 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.394296 18914 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:23.390115 18840 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:23.404166 18841 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.404650 22292 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.404537 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:23.408552 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.423961 19486 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:23.427073 22403 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.429347 22211 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:23.425981 22075 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:23.389261 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.415413 22092 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:23.412192 22195 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:23.437558 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.442292 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:23.442095 22236 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:23.458153 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.458568 22381 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:23.459455 22381 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:23.460906 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 56493.3us
I20260709 12:24:23.465755 18839 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:23.468387 22381 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.469192 19490 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:23.478981 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:23.479270 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 126883us
I20260709 12:24:23.480089 18840 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:23.481140 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.478971 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.482697 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.483330 18845 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:23.483634 18922 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:23.484308 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.484773 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.485082 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.485450 18922 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:23.485936 18921 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:23.486971 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.487996 18920 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:23.491726 18846 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
W20260709 12:24:23.489971 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47778.8us
I20260709 12:24:23.496601 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:23.444849 22202 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:24:23.492121 18846 pending_rounds.cc:85] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 9
I20260709 12:24:23.501859 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.463513 22236 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:23.500154 18846 pending_rounds.cc:107] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:24:23.511611 18846 raft_consensus.cc:2889] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.505760 18848 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:23.499102 22195 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:23.526803 18844 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:23.527493 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.504448 22365 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:23.531731 18847 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:23.505592 22211 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:23.535261 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2243) took 2341 ms. Trace:
I20260709 12:24:23.537195 22094 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.537423 18921 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:23.538072 22094 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.540856 22094 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:23.546185 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.547290 18768 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:23.548692 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:23.550799 22406 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.551611 22406 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.553128 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:23.557365 18840 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:23.535908 18848 rpcz_store.cc:276] 0709 12:24:21.182088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.236814 (+ 54726us) service_pool.cc:224] Handling call
0709 12:24:21.237135 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.034919 (+1797784us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b58005a1ad0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335aee70aa 00007f335af69447 00007f335af81fe7 00007f335af837de 00007f335af8db49 00007f335af8e416 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4
0709 12:24:23.512642 (+477723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.523139 (+ 10497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377572224}
I20260709 12:24:23.560405 22393 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.560786 22088 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.561264 22393 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.562620 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.563508 18768 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:23.563796 18767 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:23.563977 22245 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.523685 22195 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.521368 22296 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.580328 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:23.584263 18922 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:23.584316 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.571812 22195 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.585323 18772 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:23.614794 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:23.615727 18767 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.618863 21977 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.619990 22272 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.619577 21977 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.620697 22272 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:23.623783 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.624045 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.606853 22296 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.625365 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.623332 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:23.627236 22296 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:23.627816 18922 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:23.629951 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.580025 22406 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.592939 22094 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.641892 22397 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:23.584474 22365 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:23.648368 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.575476 22266 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.657269 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:23.658047 18768 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:23.659099 22266 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.662846 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:23.663818 18773 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:23.665961 18772 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:23.653007 22296 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:24:23.650619 18915 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:23.655591 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.675882 18841 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:23.679854 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.679314 18770 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:23.682121 18765 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:23.682125 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.684770 18768 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:23.661834 22345 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.676566 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:23.687681 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 161734us
I20260709 12:24:23.691603 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:23.695133 18772 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:23.651768 22397 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:23.692940 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:23.649451 21977 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.703637 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:23.708782 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.710336 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.722038 19485 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:23.726171 18841 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.718098 18764 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:23.705777 22397 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:23.746299 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.685889 22266 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:24:23.740222 18846 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.743844 19490 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:23.745898 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:23.752077 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.757390 21977 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.758224 21977 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.679718 22236 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.771261 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:23.771545 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.784157 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.785874 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:23.789103 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 183582us
W20260709 12:24:23.813607 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.821225 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.830950 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.847178 18764 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 4.
I20260709 12:24:23.781025 22292 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.867436 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:23.874441 18773 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:23.872599 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:23.870817 22292 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.882287 22292 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:23.883170 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.791414 22272 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:23.890967 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.903241 18767 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:23.892565 18841 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:23.853243 22381 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:23.911252 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:23.919626 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60806.9us
W20260709 12:24:23.920457 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.921350 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:23.921645 22426 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:23.923480 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:23.932754 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58415.8us
I20260709 12:24:23.940554 18768 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:23.927435 22075 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.925467 22393 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:23.953567 18846 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:23.953433 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:23.927209 22403 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.957836 22075 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:23.945350 22406 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:23.969089 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.938854 22381 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:23.955873 22211 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:23.981516 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.984872 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.987798 18846 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:23.962954 22393 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.996043 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:23.997184 18846 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:23.966527 22365 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:23.971721 22345 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:24.004149 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.004423 22352 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.005126 22352 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.007649 22352 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:24.008302 22352 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:24.008852 22352 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:23.991091 22393 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:24.024287 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.004170 22409 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:24.033603 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.022344 22393 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.997349 22403 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:24.040795 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.010077 22352 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.019809 22406 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:24.056906 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 135648us
I20260709 12:24:24.057159 19489 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:24.063611 18843 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:24.063025 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:24.050633 22426 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:24.072858 22266 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:24.082842 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:24.083470 22266 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.083851 18843 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:24.083977 22266 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:24.056668 18847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:24.085973 18847 raft_consensus.cc:606] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.086346 18847 raft_consensus.cc:614] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:24.088299 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:24.088426 22272 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:24.090116 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:24.091507 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:24.092736 22427 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:24.094774 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.094978 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:24.095511 18918 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:24.097823 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.064633 22092 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.098295 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.099165 18918 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:24.098798 22092 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.101346 22406 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.066759 22075 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.102535 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:24.103361 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.104849 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:24.106130 22362 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:24.106590 22362 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:24.106614 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:24.107098 22362 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.052759 22409 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.108705 22406 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:24.077256 22209 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.008s
I20260709 12:24:24.112825 22426 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.117403 22403 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:24.118557 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.121766 22092 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.123075 21977 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.123574 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.125276 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.125910 22075 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:24.126686 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.135052 22406 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:24.131790 22245 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.001s
I20260709 12:24:24.151341 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.152392 18922 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
W20260709 12:24:24.139340 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76552.8us
I20260709 12:24:24.138983 22381 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:24.155164 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:24.156096 18918 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:24.166137 18772 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:24.172298 22075 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:24.153731 22092 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:24.179627 22300 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.180442 22300 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:24.182744 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 300753us
I20260709 12:24:24.182863 22300 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:24.183760 18886 connection.cc:256] RPC call timeout handler was delayed by -1.5347105830001055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:24:24.184198 18886 connection.cc:256] RPC call timeout handler was delayed by -1.3151105830002052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 12:24:24.184517 18886 connection.cc:256] RPC call timeout handler was delayed by -1.1864105829999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 12:24:24.184824 18886 connection.cc:256] RPC call timeout handler was delayed by -1.1765105829999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 12:24:24.185113 18886 connection.cc:256] RPC call timeout handler was delayed by -1.0418609739999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 12:24:24.185854 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:24.190655 19491 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:24.152870 22403 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.192198 22403 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:24.195246 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.196276 22409 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:24.196889 22195 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.590s	user 0.005s	sys 0.005s
I20260709 12:24:24.168128 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:24.200346 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:24.202572 18814 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.203074 22092 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:24.203684 22092 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.204082 22092 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:24.221174 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.223863 19458 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:24.227416 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 137988us
W20260709 12:24:24.236282 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 111116us
I20260709 12:24:24.225049 18670 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 3 to 7, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 7 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.209353 22075 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:24.241745 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 298753us
I20260709 12:24:24.199743 22211 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:24.225566 22409 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:24.197343 22195 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.208366 22397 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.242070 22075 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.256940 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.259330 22442 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:24.261650 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.267647 19484 raft_consensus.cc:2368] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
W20260709 12:24:24.275171 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 89463.4us
I20260709 12:24:24.254328 22245 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:24.258358 22075 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.281185 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:24.260571 22409 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:24.288820 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:24.289487 22195 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.289096 22211 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.288976 22409 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.290531 22439 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.290609 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:24.291323 22439 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.292307 22300 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:24.292819 22300 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:24.294819 22300 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.295305 22439 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.278373 22403 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:24.298830 22447 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.298735 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.294075 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:24.307798 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 138809us
I20260709 12:24:24.312012 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:24.312875 18920 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.272931 22292 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.317075 22406 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.317832 22406 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.300380 22407 raft_consensus.cc:2764] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:24.318775 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:24.320050 22397 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.320184 22406 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:24.320317 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:24.321846 22236 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:24.307407 22266 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.322674 22403 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:24.323238 22403 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:24.323618 22403 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.324457 22266 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:24.325975 22451 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:24.326192 22439 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:24.300467 22362 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.327956 22439 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:24.328358 22439 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:24.328665 22362 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:24.329180 22292 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:24.329381 22439 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:24.330147 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.331471 22245 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:24.331897 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.332592 22245 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.334810 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:24.336544 18915 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.338671 22441 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.339013 22407 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:24.335070 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:24.335292 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:24.342820 22231 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:24.343335 22231 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:24.343794 22231 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:24.334064 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.335875 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:24.346724 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.547s (SENT) [suppressed 12 similar messages]
W20260709 12:24:24.349824 22094 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.007s
I20260709 12:24:24.336038 22430 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:24.329384 22362 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:24.334246 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.355547 18915 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:24.341723 22393 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.363015 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:24.368873 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 81624.1us
I20260709 12:24:24.350445 22094 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.371265 22195 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:24.371932 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.360086 22362 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:24.395469 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:24.406787 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.374568 18737 leader_election.cc:400] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
W20260709 12:24:24.412288 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 184002us
I20260709 12:24:24.412757 18737 leader_election.cc:403] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:24.351400 22092 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.364879 22407 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:24.367362 21977 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:24.373965 22430 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:24.428067 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 68427.7us
W20260709 12:24:24.429207 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.399175 22292 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:24.432034 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.436278 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.436897 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.437908 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.445112 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:24.449998 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:24.424386 21977 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.454499 22448 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.455175 22448 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.457412 22448 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.459873 22407 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.466214 22393 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.451591 22266 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.468822 22440 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:24.454970 22362 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.472960 18920 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:24.392686 22300 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:24.477380 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70769.4us
I20260709 12:24:24.473963 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:24.478230 19489 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:24.478672 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:24.434350 22195 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:24.480895 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 109867us
I20260709 12:24:24.483458 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.447947 22094 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.398690 22438 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:24:24.449124 22292 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:24.471741 21977 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.453567 22454 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:24.411355 22447 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:24:24.477650 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:24.524427 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 48049.9us
I20260709 12:24:24.525086 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.496752 22211 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:24.533160 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.523315 22231 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.538959 22231 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:24.527884 22426 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:24.543267 22092 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:24.544618 18668 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 287) took 19604 ms (client timeout 15000 ms). Trace:
I20260709 12:24:24.522655 22393 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:24.550707 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:24.541744 22075 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.528774 22397 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:24.555716 18840 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:24.564544 22439 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.566651 22092 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.546959 18670 catalog_manager.cc:5697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 1 to 4, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 4 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.574651 22292 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.566254 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:24.579022 22296 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:24.579452 22296 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.579859 22296 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:24.545090 18668 rpcz_store.cc:269] 0709 12:24:04.984541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.009428 (+ 24887us) service_pool.cc:224] Handling call
0709 12:24:24.544336 (+19534908us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:17.233551 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:17.252205 (+ 18654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:17.283522 (+ 31317us) write_op.cc:435] Acquired schema lock
0709 12:24:17.283546 (+    24us) tablet.cc:662] Decoding operations
0709 12:24:17.291871 (+  8325us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:17.291958 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:17.291987 (+    29us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:24:17.650937 (+358950us) tablet.cc:701] Row locks acquired
0709 12:24:17.668117 (+ 17180us) write_op.cc:260] PREPARE: finished
0709 12:24:17.681314 (+ 13197us) write_op.cc:270] Start()
0709 12:24:17.745672 (+ 64358us) write_op.cc:276] Timestamp: P: 1783599857675008 usec, L: 0
0709 12:24:17.747971 (+  2299us) op_driver.cc:348] REPLICATION: starting
0709 12:24:17.911082 (+163111us) log.cc:844] Serialized 10795 byte log entry
0709 12:24:18.672974 (+761892us) op_driver.cc:464] REPLICATION: finished
0709 12:24:18.849203 (+176229us) write_op.cc:301] APPLY: starting
0709 12:24:18.849342 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:18.849906 (+   564us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:18.850058 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:19.540577 (+690519us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:19.541299 (+   722us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 12:24:19.541374 (+    75us) write_op.cc:312] APPLY: finished
0709 12:24:19.732405 (+191031us) log.cc:844] Serialized 188 byte log entry
0709 12:24:19.961139 (+228734us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:19.981167 (+ 20028us) write_op.cc:454] Released schema lock
0709 12:24:19.990543 (+  9376us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:20.046603 (+ 56060us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:20.046642 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":121192,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":153581,"apply.run_cpu_time_us":38066,"apply.run_wall_time_us":1203797,"num_ops":28,"prepare.queue_time_us":381362,"prepare.run_cpu_time_us":55541,"prepare.run_wall_time_us":966787,"raft.queue_time_us":227196,"raft.run_cpu_time_us":10935,"raft.run_wall_time_us":81150,"replication_time_us":924803,"spinlock_wait_cycles":9984,"thread_start_us":673372,"threads_started":5,"wal-append.queue_time_us":625073,"wal-append.run_cpu_time_us":38159,"wal-append.run_wall_time_us":2339267}]]}
I20260709 12:24:24.586571 22362 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:24.568540 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 173222us
I20260709 12:24:24.569290 18840 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:24.587960 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56695.8us
I20260709 12:24:24.574076 22365 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:24.590718 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.590898 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59099us
I20260709 12:24:24.590793 22365 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:24.580940 18670 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 4 to 5, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:24.595031 22365 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.596427 22365 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.595582 18670 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 2 to 5, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:24:24.598114 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.603068 22300 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:24.553179 22211 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:24.597925 18670 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.603956 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:24.618903 22211 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.619688 22075 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.611970 18840 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.621254 18840 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.618945 18913 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:24.623198 18913 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:24.624097 18913 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.625229 18913 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:24.625968 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:24.610198 22451 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:24.627079 22451 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.627485 22451 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.631099 22266 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:24.631695 22453 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
W20260709 12:24:24.638583 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.660178 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.667721 18917 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:24.671890 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.675283 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.675468 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.676277 18917 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:24.680631 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.681963 22272 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.682668 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.682600 22272 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.684952 22272 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.686204 22272 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.686734 22272 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.687731 18918 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:24.689307 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:24.691309 19489 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
W20260709 12:24:24.698522 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 132406us
I20260709 12:24:24.700982 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.701695 18917 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:24.658442 22300 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:24.720616 18840 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:24.751861 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:24.731663 18913 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:24:24.706964 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 103205us
I20260709 12:24:24.712489 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.714594 22195 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:24.819403 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 107042us
I20260709 12:24:24.758730 22448 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:24:24.719872 18917 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:24.720125 22407 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:24.722992 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.734889 22441 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.757546 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.822795 18917 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:24.710678 22266 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.821208 22430 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:24.840119 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:24.821336 22381 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:24:24.843295 18840 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:24.842943 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:24.817449 22300 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:24.844111 18846 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:24.821488 22362 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.846936 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:24.850106 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:24.850124 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:24.852363 18913 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:24.847977 22449 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:24.845079 22407 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.855115 18917 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.740024 22075 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
W20260709 12:24:24.891884 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51875.8us
I20260709 12:24:24.863334 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:24.728196 22403 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.705911 22296 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.861200 18841 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 5: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:24.886927 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:24.864941 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 107676us
I20260709 12:24:24.842943 22345 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.828415 21977 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:24.828759 22397 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:24:24.847206 22365 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.902581 22449 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:24.903457 22458 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:24.896255 22209 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.849326 22300 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:24.891649 22448 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:24.886759 22092 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:24.860284 22430 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:24.890482 22245 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:24.910012 22272 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.931636 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:24.846633 22266 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.859130 22427 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:24:24.930476 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:24.927855 22448 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.907735 22362 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.911829 22345 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.958099 21977 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:24.861469 22441 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.964836 18847 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:24.970266 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:24.925307 22209 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.949740 22292 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:24.974822 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54876.7us
I20260709 12:24:24.951110 22448 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:24.976210 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.953303 22447 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:24.936699 22245 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:24.936515 22365 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:24.998577 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.994920 22094 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
I20260709 12:24:24.995919 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:24.995270 22296 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.005059 18886 leader_election.cc:400] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
I20260709 12:24:25.005656 18886 leader_election.cc:403] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.008565 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.011298 22362 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.011523 22345 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:24.981859 22447 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.012184 22447 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.014942 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:25.017402 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:25.018263 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 101299us
I20260709 12:24:25.025949 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.026300 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:25.026958 18918 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.032960 22407 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:25.034547 22465 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:24:25.035926 22451 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.027148 22442 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:25.041345 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63400us
I20260709 12:24:25.019420 22231 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7.
W20260709 12:24:25.047542 22474 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:24:25.048084 22177 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:25.048898 22177 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.050328 22245 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:25.006997 22430 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.052940 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:25.054131 18913 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:25.055769 22209 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:25.057860 18917 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:25.028195 22292 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:25.028355 22397 raft_consensus.cc:2764] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:24:25.061847 22441 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.062426 22427 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:25.063501 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80947.2us
I20260709 12:24:25.096768 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:25.097530 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:25.065040 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:25.098750 18914 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:25.093341 22292 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:25.072940 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:25.073745 22477 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:25.094074 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47757.6us
I20260709 12:24:25.099601 22441 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:25.067879 22440 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:25.099432 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:25.109488 18918 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:25.114494 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:25.106442 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.111227 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.120482 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:25.098078 22397 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:24:25.122841 18920 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:25.123154 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:25.118219 22432 raft_consensus.cc:2764] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:25.118914 22209 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:25.124246 22177 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:25.125510 22451 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:25.127066 22447 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.109555 22292 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.102784 22477 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:25.127404 22427 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:25.136343 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:25.112591 22440 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:25.137411 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.122735 22195 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.155289 22266 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.155076 22195 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.118036 22441 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:25.130059 22236 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:25.138052 22458 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:25.158989 22458 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.159104 22403 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:25.159435 22458 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.159804 22441 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.153581 22477 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.139982 21977 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:25.163043 22477 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.164386 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:25.165874 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:25.166597 19489 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:25.167620 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:25.168185 22195 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:25.169478 22365 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:25.170966 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47920.9us
I20260709 12:24:25.171787 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.172595 22407 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:25.172989 22407 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:25.173390 22407 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:25.174365 19491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:24:25.175110 19491 raft_consensus.cc:606] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:25.175479 19491 raft_consensus.cc:614] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:25.177645 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:25.133752 22231 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:25.152880 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.135362 22092 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:25.138849 22209 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.112700 22094 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:24:25.140861 22345 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:24:25.164012 22440 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.148906 22427 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:25.263176 18917 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:25.263664 22427 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.265604 22427 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:25.147090 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50540.7us
W20260709 12:24:25.181972 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44640.8us
W20260709 12:24:25.269747 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 91013.8us
I20260709 12:24:25.270433 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:25.183074 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:25.184795 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.157773 22448 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:25.187616 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.187825 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:25.190905 18848 raft_consensus.cc:2368] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9.
I20260709 12:24:25.188436 22209 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.266480 22480 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:25.274945 18917 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:25.274535 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 91519.4us
I20260709 12:24:25.283641 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:25.284318 18920 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.282264 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:25.192836 22092 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:25.289600 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:25.277129 22397 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:25.313678 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:25.315073 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:25.316751 22448 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:25.293012 22430 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:25.319159 22430 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.284160 22480 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:25.320361 22480 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.322491 22430 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:25.323339 22300 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.287284 22231 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:24:25.325021 18921 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:25.325706 22300 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.330528 22292 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.332959 22292 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:25.333875 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56403.3us
I20260709 12:24:25.336418 22365 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:25.339663 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.340186 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:25.340762 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:25.341005 18914 raft_consensus.cc:2368] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6.
I20260709 12:24:25.342490 18739 leader_election.cc:400] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6.
I20260709 12:24:25.342831 18739 leader_election.cc:403] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.351140 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:25.351871 18914 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.296361 22440 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.342599 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.383220 18918 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:25.383826 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:25.390992 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48666.8us
I20260709 12:24:25.367074 22403 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:25.393086 22403 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:25.393563 22403 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.392998 18914 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:25.371747 22231 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:25.408327 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.409693 22272 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:25.409914 22480 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:25.410578 22272 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:25.413713 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 78999.8us
W20260709 12:24:25.414533 22482 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 12:24:25.414953 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:25.415316 22486 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:25.415140 22209 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.415859 22486 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.416353 22486 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.376142 22177 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:24:25.417783 18916 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:25.411520 22092 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.429736 18920 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:25.403471 22300 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:25.441329 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:25.444785 18922 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:24:25.442471 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 322092us
W20260709 12:24:25.445255 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 61547.1us
I20260709 12:24:25.445989 18738 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:25.447454 18738 leader_election.cc:400] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9.
I20260709 12:24:25.447719 18738 leader_election.cc:403] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.450418 22094 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:25.431937 22296 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:24:25.410892 22480 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.418540 22485 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.433331 22209 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:25.473330 22480 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.475086 18765 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:25.418344 22245 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:24:25.443447 22447 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:25.497154 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.497924 18764 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:25.491573 22449 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:24:25.499068 18773 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:25.500047 22406 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:25.500522 22406 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:25.501442 22406 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.489972 22296 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.505709 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.506768 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.507791 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.509325 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:25.468858 22438 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:25.510864 22438 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:25.511857 22438 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.489588 22439 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:24:25.514976 22430 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.517472 22430 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.518489 22245 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:25.518677 22407 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.519208 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:25.519999 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:25.531397 19489 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:25.531719 19484 raft_consensus.cc:2368] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:25.520530 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:25.531862 18922 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:25.520804 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.521508 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:25.521708 18766 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:25.471063 22458 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.534054 19486 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:25.534752 18913 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:25.522346 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.523800 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.535055 18840 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 7. Ops: []
I20260709 12:24:25.535512 22458 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.523974 18772 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:25.536536 18841 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:24:25.524950 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.536815 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.525238 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.525804 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.538424 18844 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.533193 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.537458 18843 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:25.541622 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.544663 18915 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:25.552444 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.555905 18886 leader_election.cc:400] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:25.561833 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:25.556799 18886 leader_election.cc:403] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.564749 22454 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
W20260709 12:24:25.566654 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.569166 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:25.572291 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.568410 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:25.573562 19484 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.579080 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.579427 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.579879 18773 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:25.580761 18770 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:25.445195 22272 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.581712 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.582413 18773 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:25.582419 18848 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:25.555667 22406 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.584357 18844 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:25.561262 22435 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:25.592173 22435 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:25.593317 22435 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.561537 22409 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:25.586797 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:25.587219 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.594928 22409 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:25.595369 22409 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.595494 18842 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:25.566205 22202 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:25.596587 22202 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:25.597524 22202 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.588581 22407 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.590901 22365 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:25.591511 18769 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:25.609036 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.610636 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.611181 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.606863 19484 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:25.612850 18845 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:25.626853 18848 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:25.628790 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.638139 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.644186 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.654587 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.644966 18769 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:25.639245 22435 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.667832 18848 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:25.668519 18773 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:25.668634 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.670094 18845 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:25.670761 18772 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:25.671329 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.671996 18770 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:25.672113 18842 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:25.676625 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.697228 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:25.697525 18845 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:25.697968 18769 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.704386 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.713508 18842 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:25.721146 18918 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:25.720865 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.721587 18918 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:25.721974 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.724804 18772 raft_consensus.cc:2376] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8. Re-sending same reply.
I20260709 12:24:25.676262 22403 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.751897 22403 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.753083 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.754917 18922 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:25.723354 18918 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.756982 18918 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:25.759094 22495 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:24:25.754532 22499 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:25.762555 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.763262 18848 raft_consensus.cc:2376] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6. Re-sending same reply.
I20260709 12:24:25.764186 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.765266 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.767746 22485 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 5. Current term is 6.
W20260709 12:24:25.768695 22493 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:24:25.771632 22458 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:25.772404 22458 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:25.766309 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:25.775089 22497 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:25.771644 22403 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:25.786914 22427 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.004s
I20260709 12:24:25.787322 22403 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:25.777839 22407 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:24:25.787907 22403 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.788115 19483 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:25.776494 22458 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:25.775285 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.790334 18842 raft_consensus.cc:2376] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
W20260709 12:24:25.792819 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.775733 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.792569 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.794030 18772 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:25.797340 18769 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:25.803265 18848 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:25.804278 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.804917 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.805694 18769 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:25.808574 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.818981 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.819995 18848 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:25.822717 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.824433 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.825387 18767 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:25.826921 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:25.827098 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.828409 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.830883 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.834095 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.834348 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.834895 18842 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:25.822229 22296 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9.
I20260709 12:24:25.835985 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.837474 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.779377 22177 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:24:25.847296 18844 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:25.839640 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.843897 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:25.853492 19456 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:25.835225 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 80028.4us
I20260709 12:24:25.857069 18918 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:24:25.857626 18918 pending_rounds.cc:85] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 9
I20260709 12:24:25.859735 18918 pending_rounds.cc:107] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:24:25.860317 18918 raft_consensus.cc:2889] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:25.861888 18767 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:25.860481 18773 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:25.865497 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.866230 18767 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:25.869617 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.870416 18764 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:25.870667 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:25.873302 18848 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:25.874505 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.846086 22458 raft_consensus.cc:476] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:24:25.881358 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.883584 18848 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 8: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:25.863544 22195 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:25.884217 18842 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:25.884634 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:25.876353 22440 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.895570 22440 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:25.896224 22503 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:24:25.888309 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.886206 18764 raft_consensus.cc:2955] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 3 to 6, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:25.879411 22454 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:25.907254 18844 raft_consensus.cc:2376] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8. Re-sending same reply.
I20260709 12:24:25.914674 22231 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:25.915273 22231 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:25.915689 22231 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:25.919363 22434 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:25.927464 18845 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:25.930938 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.932454 18844 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:25.933974 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.934999 18848 raft_consensus.cc:2376] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8. Re-sending same reply.
I20260709 12:24:25.936414 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.872164 22407 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:24:25.940891 18848 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:25.941794 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.944847 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.945528 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:25.946636 18844 raft_consensus.cc:2410] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:25.948396 18844 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:24:25.948966 18844 pending_rounds.cc:85] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 7
I20260709 12:24:25.949339 18844 pending_rounds.cc:107] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:24:25.949717 18844 raft_consensus.cc:2889] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:25.962785 18848 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:25.965498 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:25.919940 22434 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.966602 18845 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:25.965631 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.969036 18773 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:25.906589 22504 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
W20260709 12:24:25.986744 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53565.2us
W20260709 12:24:25.992537 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 139127us
I20260709 12:24:25.971269 22434 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.001304 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:25.968623 22454 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 12:24:26.006027 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.008288 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:25.994238 22409 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.008663 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:26.021210 22507 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:26.021888 22507 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:26.033046 18765 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
W20260709 12:24:26.033468 22486 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.617s	user 0.014s	sys 0.000s
I20260709 12:24:26.033597 18764 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:26.033922 22486 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.005652 22209 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:24:26.041145 22486 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:26.025681 22477 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:26.051365 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.049834 22477 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.037357 22504 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.065387 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.066362 18764 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.070461 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:26.059000 22393 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:26.072260 22393 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:26.073489 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.081615 18764 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:26.143735 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 236206us
I20260709 12:24:26.144829 18887 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:26.148972 22519 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.152052 22503 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:26.152622 22503 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:26.145740 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:26.155402 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:26.160629 22454 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:26.176406 18918 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:26.184005 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:26.184434 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:26.186645 22440 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:26.187700 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:26.188596 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:26.188994 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:26.189975 22478 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:26.190769 22478 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:26.191581 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:26.192358 18841 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:26.191881 22478 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:26.194203 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:26.059899 22511 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:24:26.194977 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:26.084592 22507 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.186715 22300 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:26.197013 22300 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:26.097929 22502 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:24:26.098176 22477 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:26.161191 22454 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.081432 22177 raft_consensus.cc:2764] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:26.198704 22454 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:26.198232 22300 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.099543 22521 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.100142 22504 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:26.102509 22409 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:26.106101 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.201493 18771 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.096668 22231 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:26.106511 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:26.108765 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.211090 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:26.211434 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 102743us
I20260709 12:24:26.211776 19490 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:26.111266 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.096751 22403 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:26.112931 22209 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:26.099599 22393 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:26.231493 18842 raft_consensus.cc:2368] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8.
I20260709 12:24:26.123921 22524 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:26.128636 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:26.237777 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:26.128823 22522 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.128906 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:26.129738 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 78442.5us
I20260709 12:24:26.131026 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:26.247452 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 116517us
I20260709 12:24:26.247905 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:26.248179 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:26.132905 22435 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:26.122062 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.257328 18841 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
W20260709 12:24:26.135552 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 62134.8us
I20260709 12:24:26.257856 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:26.189929 22407 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:26.197069 22507 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.054946 22195 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:24:26.238134 22442 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:26.202015 22202 consensus_queue.cc:1175] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47b48b5c69f245b79ecb292eff89927f" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 9 } }
I20260709 12:24:26.207051 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.213321 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.204252 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:26.291713 18769 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.093535 18773 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:26.224742 18771 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:26.292528 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:26.293609 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:26.226696 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.227523 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:26.295555 18848 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.295955 18770 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:26.232888 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:26.250710 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:26.296793 18922 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.257848 18765 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:26.258846 18917 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:26.259302 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:26.298368 18845 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.258610 18840 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:26.273615 18839 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:26.269001 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.300664 18766 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:26.227680 22209 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.277007 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.105926 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.305809 18768 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:26.304569 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:26.285722 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:26.117986 22434 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:26.297701 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 84468us
I20260709 12:24:26.311978 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.312126 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:26.312862 18843 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:26.268759 22458 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:26.303771 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:26.315680 19483 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:26.268471 22409 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:26.323541 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.316650 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.317472 18772 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:26.317853 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.338382 18773 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:26.287220 22442 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.353863 18848 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:26.376236 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:26.383584 18918 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.380738 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:26.304520 22440 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:26.312143 22209 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.260206 22522 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.412532 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:26.381490 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64918.2us
I20260709 12:24:26.378882 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.276470 22524 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:24:26.314495 22477 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:26.404455 18769 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:26.411598 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.424631 18771 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:26.421104 18918 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:26.423498 18913 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:26.429282 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.430124 18765 raft_consensus.cc:2368] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9.
I20260709 12:24:26.424721 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:26.416719 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.418195 18845 raft_consensus.cc:2410] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:26.430441 18922 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:26.389751 22442 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:26.427753 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 223568us
I20260709 12:24:26.437353 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.389396 22458 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:26.395112 22449 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:26.455350 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:26.398687 22447 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:26.428661 22494 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:24:26.458420 22449 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:24:26.434540 22493 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:24:26.471693 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.431097 22440 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:26.459574 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.433955 22477 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:26.434700 22407 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:26.611894 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:26.586473 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.757874 18772 raft_consensus.cc:2376] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5. Re-sending same reply.
I20260709 12:24:26.759711 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.476231 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.762018 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.764212 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.711627 19490 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
W20260709 12:24:26.626410 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 209768us
W20260709 12:24:26.490957 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.723483 22522 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:26.614979 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:26.615049 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:26.588707 22533 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:26.592490 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:26.770154 19490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 718) took 1239 ms (client timeout 1545 ms). Trace:
I20260709 12:24:26.473343 18920 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:26.459574 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.772564 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.745079 18765 raft_consensus.cc:2368] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:26.742168 22449 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.723109 22403 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:26.607425 22486 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 12:24:26.582207 22458 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.459842 22195 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:26.741240 22409 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:26.750337 22538 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.435725 22521 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.750839 19483 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:26.434540 22427 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:26.442324 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 160090us
W20260709 12:24:26.760219 22454 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.003s
I20260709 12:24:26.722651 22231 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:26.717260 22434 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:26.617414 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:26.494547 22381 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:26.558514 22519 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.555140 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.558035 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:26.832793 19485 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:24:26.568234 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 152745us
I20260709 12:24:26.707832 18843 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:26.770258 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.771821 18764 raft_consensus.cc:2376] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6. Re-sending same reply.
I20260709 12:24:26.834100 18771 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 6: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:26.833457 18770 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:26.772939 18766 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
W20260709 12:24:26.828228 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 372816us
I20260709 12:24:26.835254 18772 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:26.774190 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:26.753775 22477 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.837047 18765 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:26.613710 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:26.599321 22345 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:26.777686 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 282244us
I20260709 12:24:26.839556 18773 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:26.764757 22407 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:26.772351 19490 rpcz_store.cc:269] 0709 12:24:25.526699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.526856 (+   157us) service_pool.cc:224] Handling call
0709 12:24:26.210928 (+684072us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800106598. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:24:26.765784 (+554856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515328}
I20260709 12:24:26.803874 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.772058 22533 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:26.559195 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:26.852429 18769 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.835824 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:26.847489 18764 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:26.826622 22381 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.847779 22540 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:26.849548 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:26.850735 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:26.847846 18773 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:26.870165 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:26.871971 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:26.856989 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:26.853941 18766 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:26.860595 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:26.861562 18920 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
W20260709 12:24:26.862556 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 91469.8us
I20260709 12:24:26.850989 22407 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:26.882239 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:26.839507 22345 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:26.822729 22427 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.853763 22533 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.803660 22538 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.856238 22521 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:26.840158 22231 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:24:26.866714 22519 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:26.826792 22454 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.879627 22536 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:26.905320 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:26.906193 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49280.7us
I20260709 12:24:26.902262 22434 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.864329 22381 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.937552 19487 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:26.885648 22478 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.861364 22195 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:26.865818 22202 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:24:26.935408 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 95442us
I20260709 12:24:26.916801 22541 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.919880 22300 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.915105 18769 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:26.928409 22530 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:26.942204 19490 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:26.864246 22440 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:26.944480 22403 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.933488 22519 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:26.882197 22409 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:26.920850 22209 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:27.015618 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 110402us
I20260709 12:24:27.017961 18886 leader_election.cc:400] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9.
W20260709 12:24:27.019235 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 89241.4us
I20260709 12:24:27.020319 18886 leader_election.cc:403] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.031014 19484 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:27.036159 18920 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:27.005940 22530 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:27.048581 22539 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:24:27.048004 22503 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:27.067175 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 191746us
I20260709 12:24:27.056864 22549 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:27.061474 22552 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:27.055912 22521 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.071887 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:27.072535 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 190223us
I20260709 12:24:27.076478 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:27.072779 18920 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:27.038867 22548 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.086311 18918 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:27.092176 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.099815 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 149805us
I20260709 12:24:27.113057 18920 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:27.115105 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:27.008247 22345 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:27.114812 22545 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:24:27.066344 22541 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9.
I20260709 12:24:27.078807 22552 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:27.130831 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 113019us
I20260709 12:24:27.131836 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:27.163102 19485 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
W20260709 12:24:27.174613 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58272.5us
I20260709 12:24:27.170526 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:27.180030 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65177us
I20260709 12:24:27.085943 22521 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.062930 22519 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.093509 22503 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:27.181236 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:27.176106 22553 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:27.140838 22393 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:27.151957 22427 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:27.208627 22442 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.002s
I20260709 12:24:27.172056 22538 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:27.232277 22563 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:27.233075 22563 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:27.197518 22561 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.239987 22454 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:27.242646 22442 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.247619 22521 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:27.193133 22537 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:27.160503 22557 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:27.251067 22551 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:27.230796 22552 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.232338 22538 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:24:27.193974 22549 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:24:27.221108 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:27.295410 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 102848us
I20260709 12:24:27.141132 22202 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:24:27.125561 22548 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:27.304450 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 83435.5us
I20260709 12:24:27.289458 19488 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:27.306718 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:27.312256 22403 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.314862 22571 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.315320 22209 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:27.315657 22571 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.317471 22570 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.318075 22570 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.320504 22570 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:27.320295 22407 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.321146 22570 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:27.322002 22570 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.254613 22553 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.321571 18917 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:27.323295 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2383) took 1097 ms. Trace:
W20260709 12:24:27.320339 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 99357.2us
I20260709 12:24:27.336287 18770 rpcz_store.cc:276] 0709 12:24:26.225530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.838771 (+613241us) service_pool.cc:224] Handling call
0709 12:24:26.861379 (+ 22608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.005869 (+144490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.005904 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.017670 (+ 11766us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.276069 (+258399us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:27.276134 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.276243 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.323076 (+ 46833us) raft_consensus.cc:1685] finished
0709 12:24:27.323095 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.323234 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1700,"raft.queue_time_us":176808,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":292221,"threads_started":2,"wal-append.queue_time_us":242647}
W20260709 12:24:27.340821 18886 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.547s (SENT)
I20260709 12:24:27.267597 22551 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.345876 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:27.318231 22571 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:27.352759 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56221.2us
I20260709 12:24:27.305480 22442 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:27.359913 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 280924us
I20260709 12:24:27.265872 22393 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.367589 22555 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:27.368495 22559 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:24:27.371758 22407 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:27.374010 22393 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:27.376667 22552 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.378801 22558 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:27.379328 22558 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:27.380276 22558 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.381726 22558 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.352455 22541 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.348526 22551 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.387902 22434 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.388195 22571 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.389106 22571 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:27.390331 22575 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:27.390774 22575 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:27.391638 22575 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.214891 22530 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.314885 22554 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:24:27.341838 22570 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.336225 22563 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.436450 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:27.437088 18848 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.439291 18842 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:27.415665 22553 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:27.416729 22449 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.003s
I20260709 12:24:27.417196 22548 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:27.398371 22541 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.434325 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:27.435464 18843 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:27.447641 19492 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:27.450655 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:27.470742 18842 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:27.476305 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:27.478379 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:27.489041 18848 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:27.490604 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:27.492372 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:27.492599 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:27.492906 18848 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.493274 19490 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:27.494040 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:27.495898 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 273311us
I20260709 12:24:27.496565 18843 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 6.
I20260709 12:24:27.498184 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:27.500186 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:27.503825 18847 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:27.504104 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 158315us
I20260709 12:24:27.506548 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:27.474745 22546 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.507388 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:27.513505 18843 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:27.516306 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:27.527055 18840 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:27.554363 18848 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
W20260709 12:24:27.605762 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.521212 22381 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.004s
I20260709 12:24:27.648530 22576 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.169s
W20260709 12:24:27.649346 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.650445 22442 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:27.681449 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 324042us
W20260709 12:24:27.655321 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 139085us
I20260709 12:24:27.658565 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:27.684170 18917 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:27.659842 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:27.661172 18920 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:27.663524 18913 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:24:27.687132 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 215411us
I20260709 12:24:27.688233 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1789) took 1580 ms. Trace:
I20260709 12:24:27.688635 18772 rpcz_store.cc:276] 0709 12:24:26.107998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.776373 (+668375us) service_pool.cc:224] Handling call
0709 12:24:26.834923 (+ 58550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.835610 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.688023 (+852413us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b5400211bd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:27.688172 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133482752}
I20260709 12:24:27.691690 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2381) took 1523 ms. Trace:
I20260709 12:24:27.692175 18771 rpcz_store.cc:276] 0709 12:24:26.168445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.838029 (+669584us) service_pool.cc:224] Handling call
0709 12:24:26.862052 (+ 24023us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:26.953580 (+ 91528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.964684 (+ 11104us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:27.009506 (+ 44822us) log.cc:844] Serialized 52 byte log entry
0709 12:24:27.346724 (+337218us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:27.347160 (+   436us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.679954 (+332794us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.691355 (+ 11401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.691439 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.691478 (+    39us) raft_consensus.cc:1685] finished
0709 12:24:27.691488 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.691633 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43689,"prepare.queue_time_us":2344,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":48,"raft.queue_time_us":187284,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":7276,"thread_start_us":689324,"threads_started":3,"wal-append.queue_time_us":387882}
I20260709 12:24:27.694943 22564 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.170s
I20260709 12:24:27.667702 18847 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:27.474301 22449 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.521883 22552 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:27.671120 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.699779 18886 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.831s (SENT)
I20260709 12:24:27.686596 18913 pending_rounds.cc:85] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 4
I20260709 12:24:27.709177 18913 pending_rounds.cc:107] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:27.709575 18913 raft_consensus.cc:2889] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:27.577450 22427 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 12:24:27.680964 22434 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.723436 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:27.724624 18915 raft_consensus.cc:2410] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:24:27.723641 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:27.711246 22562 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:24:27.737033 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:27.738081 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:27.739751 18844 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:27.710752 22477 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.857s	user 0.013s	sys 0.000s
I20260709 12:24:27.744779 22075 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:27.745025 22577 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.736217 22409 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:27.758769 22583 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.721060 22552 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:27.696535 22554 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:27.522135 22546 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.770848 18842 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:27.670857 22381 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.774238 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:27.773583 18846 raft_consensus.cc:2955] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Committing config change with OpId 6.9: config changed from index 7 to 9, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:24:27.767046 22574 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:24:27.780377 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80694.8us
W20260709 12:24:27.793243 18886 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.851s (SENT)
I20260709 12:24:27.793840 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:27.802038 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.720531 22549 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:24:27.776228 22511 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:27.818135 18767 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:24:27.778684 22393 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 12:24:27.822857 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 315565us
I20260709 12:24:27.823904 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:27.824939 18773 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:27.827733 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:27.829051 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:27.830758 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:27.831136 18841 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:27.766734 22434 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.801113 22519 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:27.816063 22555 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.778865 22075 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.853428 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:27.801070 22486 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:27.832119 22536 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.778103 22477 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.854277 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:27.867733 22540 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:27.873987 22447 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:27.879679 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:27.880056 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:27.880892 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:27.881446 19491 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:27.818603 22427 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.783776 22409 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.780676 22583 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.863602 22570 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:27.904213 22503 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 12:24:27.816464 22554 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.909781 22486 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.865841 22519 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.904241 22551 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:27.847519 22511 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:27.860330 22576 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:27.847167 22548 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.850497 22564 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:27.920783 22568 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:27.938022 22585 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.920954 22552 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:28.016710 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 176665us
W20260709 12:24:28.020530 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 167191us
I20260709 12:24:28.064862 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.021551 19485 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:28.018961 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.028671 18764 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:28.028525 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:28.030726 18845 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:28.018594 22533 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.092s	user 0.016s	sys 0.008s
I20260709 12:24:28.015648 22549 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:28.024103 22300 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:28.018896 22540 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:28.030323 22579 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.046988 18921 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:24:28.048118 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.050702 22594 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:28.051596 22442 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.052868 22409 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.054908 19486 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:28.056964 22582 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.057068 22554 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.028771 22427 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.027169 22440 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:28.023164 22447 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:28.066044 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:28.068456 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:28.034348 22541 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.104028 22541 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:28.073014 18839 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:28.036571 22570 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:28.076634 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:28.061213 22576 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:28.091336 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 209851us
I20260709 12:24:28.095105 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:28.074776 22568 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:28.072182 22589 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:28.077970 22434 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:28.085094 22522 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.072458 22533 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.116791 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.084685 22442 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.097752 22381 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.121294 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:28.111527 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45561.4us
I20260709 12:24:28.075390 22549 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:28.127764 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56400.9us
I20260709 12:24:28.130822 18842 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:28.073757 22585 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.110952 22554 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.105113 22541 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:24:28.078884 22579 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.153956 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:28.120692 22548 raft_consensus.cc:2764] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:28.096470 22582 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.082526 22594 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.115031 22546 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.194285 18766 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.195530 22585 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.196182 18847 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:28.197463 22579 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:28.198458 22593 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260709 12:24:28.198551 22576 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.200023 22576 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:28.115324 22409 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:24:28.167621 18920 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:28.200732 18846 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:28.201476 22442 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.202291 22536 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:28.202383 22409 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:28.202980 22536 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.203094 22409 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.204319 22551 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.126964 22540 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.119273 22300 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:24:28.206866 22540 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.165997 19491 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:28.126947 22577 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:28.157318 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.132114 22522 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:28.177665 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74940.3us
I20260709 12:24:28.226670 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:28.186750 22568 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:28.199198 22595 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:24:28.166949 18916 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:28.169515 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:28.207592 22558 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.010s
W20260709 12:24:28.211489 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.169836 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.211375 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.241695 18842 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 5.
I20260709 12:24:28.213240 18847 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:28.216863 18844 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:24:28.119849 22570 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.198176 22427 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:28.210443 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56805us
I20260709 12:24:28.240070 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.244836 22598 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.253340 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.255017 18915 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:28.256969 22589 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:24:28.258306 22589 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:28.258745 22589 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:28.259673 22589 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.261370 22589 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.215029 22594 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.263470 22594 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:28.264402 22594 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:28.229781 22600 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:28.166119 22554 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:28.271083 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.271404 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 60124.7us
I20260709 12:24:28.274792 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.273608 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.241398 22477 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.236675 22609 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.280618 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.275465 18766 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:28.249890 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:28.248881 22300 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:28.283617 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.289155 18841 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:28.288033 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.175168 22447 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.299636 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.284847 18848 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:28.315760 22585 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.306620 22554 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.307562 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.316378 22585 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.317510 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:28.307332 22610 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:28.310812 18764 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.241156 22577 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.327073 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:28.328203 18769 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.327086 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.237598 22551 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:24:28.266031 22594 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:24:28.387154 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 271769us
I20260709 12:24:28.342981 18846 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:28.278651 22434 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:28.421065 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.459939 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.462011 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.290218 22556 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:28.349822 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:28.465266 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:28.386009 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 149815us
I20260709 12:24:28.479910 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.487242 19489 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:28.486024 18769 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:28.488826 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:28.490044 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 238108us
I20260709 12:24:28.288161 22300 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:28.327232 22486 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.496862 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45480 (request call id 739) took 2358 ms. Trace:
I20260709 12:24:28.498600 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.509320 19484 rpcz_store.cc:276] 0709 12:24:26.128509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.128640 (+   131us) service_pool.cc:224] Handling call
0709 12:24:28.486801 (+2358161us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54003075d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:28.486985 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804897024}
W20260709 12:24:28.499689 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 150006us
I20260709 12:24:28.507427 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.522161 18764 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:28.524436 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:28.461463 22434 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.546497 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:28.283475 22602 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.258s
I20260709 12:24:28.279740 22598 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.536243 22477 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:28.480973 22548 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:24:28.544584 22434 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:28.565641 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 309505us
I20260709 12:24:28.283875 22600 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:28.575664 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 318524us
I20260709 12:24:28.291958 22609 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.559355 22585 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.567782 22477 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:28.606117 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.589053 22619 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:28.578636 22570 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.651084 18769 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.651767 22609 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.652395 22616 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:28.652967 22616 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.655129 22533 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.655337 22616 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:28.584393 22511 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:28.644375 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 144440us
I20260709 12:24:28.552532 22615 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
W20260709 12:24:28.655484 22611 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:24:28.642640 22558 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.638053 22546 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.664767 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:28.648248 22477 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.674221 18846 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:28.639264 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.656831 22486 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.656381 22622 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:28.682354 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.682191 22622 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.683791 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:28.684370 18770 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.684998 22622 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.686239 22582 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.687948 22625 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:28.688577 22625 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.677598 22546 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.690855 22600 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.698936 22546 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.700438 22618 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:28.701112 22618 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.701470 22533 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:28.702472 22625 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.700507 22622 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.705164 22622 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.695626 22486 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.707501 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.701489 22618 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.707506 22622 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:28.702275 22533 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:28.709010 22486 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.712509 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.713385 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.717751 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.718658 18764 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:28.719722 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.720383 18764 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:28.721614 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:28.722576 22577 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.723809 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2160) took 1016 ms. Trace:
I20260709 12:24:28.735718 18769 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:28.736838 18770 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:28.724267 18921 rpcz_store.cc:276] 0709 12:24:27.707636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.707802 (+   166us) service_pool.cc:224] Handling call
0709 12:24:28.723591 (+1015789us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:28.723744 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637337344}
I20260709 12:24:28.740249 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.741123 18770 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:28.698848 22627 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:28.740301 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.720618 22434 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:28.743948 22600 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:28.744031 22598 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:28.719899 22621 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:24:28.739789 22577 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.751631 22575 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:28.755893 22558 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:28.758818 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.759349 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 186471us
I20260709 12:24:28.759615 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:28.760198 18770 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:28.760227 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:28.700085 22632 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:24:28.772522 18770 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:28.774034 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:28.780174 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.784065 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.786947 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:24:28.790874 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 157181us
I20260709 12:24:28.758575 22434 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:28.792563 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50409.7us
I20260709 12:24:28.793584 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:28.793675 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:28.765439 22577 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:28.785269 22598 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:28.792141 22554 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:28.804692 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.806027 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:28.807097 22530 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:28.807610 22600 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:28.807780 22530 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:28.808106 22566 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.629s	user 0.006s	sys 0.013s
I20260709 12:24:28.808897 22530 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.806026 18770 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
W20260709 12:24:28.803031 22576 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.000s
I20260709 12:24:28.800585 22621 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:28.813248 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.814184 18770 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:28.806106 22598 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.816107 22598 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.817243 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.828657 22635 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:28.811569 22434 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:28.830664 22622 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:28.832065 22625 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:28.813305 22533 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:24:28.812462 22554 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.823136 22632 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:24:28.858022 18770 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:28.857210 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.851915 22622 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.866822 22628 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:28.867483 22628 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:28.868548 22628 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.870296 22613 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:28.871083 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.871941 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 723) took 1941 ms. Trace:
I20260709 12:24:28.876029 22583 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:28.879689 19486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 704) took 2268 ms (client timeout 1865 ms). Trace:
I20260709 12:24:28.879923 22554 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:28.880219 19486 rpcz_store.cc:269] 0709 12:24:26.611401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.611560 (+   159us) service_pool.cc:224] Handling call
0709 12:24:28.879417 (+2267857us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400720bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:28.879537 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944403200}
I20260709 12:24:28.881978 22628 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.885687 22075 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.872664 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.826172 22618 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.872388 19492 rpcz_store.cc:276] 0709 12:24:26.930376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.930817 (+   441us) service_pool.cc:224] Handling call
0709 12:24:26.948395 (+ 17578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.470483 (+522088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.871607 (+1401124us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400788554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:28.871841 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023091456}
I20260709 12:24:28.914878 18921 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:28.896205 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.917094 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.841686 22630 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:24:28.887140 22622 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.921540 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:28.925390 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:28.917428 22583 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:28.928943 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.930003 18773 raft_consensus.cc:2368] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:28.928978 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.931146 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.931514 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.931985 18773 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:28.933166 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.933597 18886 leader_election.cc:400] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8.
I20260709 12:24:28.934662 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:28.934687 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:28.935060 22553 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:28.936621 22075 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.937235 22075 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.938796 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:28.951470 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:28.953145 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:28.955257 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:28.957744 22551 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:28.958295 22551 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.958067 22637 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.958734 22551 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:28.959329 22607 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:28.959931 22607 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:28.960165 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:28.960878 22607 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.961911 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:28.962596 22546 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.963372 22546 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.964421 18921 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:28.968134 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.968420 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.969726 18922 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:28.967314 22546 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.971807 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:28.972059 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.973217 22578 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:28.974020 22578 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:28.975858 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:28.976249 22381 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:28.975590 22578 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.984581 22583 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.985332 22583 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:28.989746 22583 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:28.998502 22637 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.001384 22583 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.002048 22583 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.005470 22645 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:29.006446 22645 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.007961 22583 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:29.012112 18771 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:29.012171 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:29.013370 18915 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:29.020659 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:29.025967 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:29.028362 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93791.4us
I20260709 12:24:29.028849 18764 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:29.029012 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.956705 22553 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:29.029042 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.034591 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:28.956809 22621 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:29.044708 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:29.029603 22434 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:29.040457 22533 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:29.026553 22546 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:24:29.044096 22625 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:29.040225 22563 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:29.043246 22630 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:29.032549 22559 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:24:29.056280 22591 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:29.057224 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.056895 22434 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.057917 22645 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:29.041805 22575 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.055414 22633 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:29.052115 22547 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.041854 22551 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.051107 22589 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:29.044286 22632 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:29.064242 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.074766 22553 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.035707 22477 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.075531 22075 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:29.053462 22631 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:29.050275 22637 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:29.081616 22589 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.081862 22551 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:29.083528 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.095141 22645 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Committing config change with OpId 5.5: config changed from index 3 to 5, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:29.082305 22632 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.090806 22643 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:29.091435 18841 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:29.094437 22618 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:29.097976 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 244249us
I20260709 12:24:29.100909 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:29.065181 22630 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.059449 22533 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:29.109624 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.118615 18846 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:29.078299 22547 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.115264 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:29.083187 22633 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.121935 18921 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:29.110106 22589 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:29.123011 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:29.124078 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.121317 22547 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.131482 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.130733 22503 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:29.118212 22630 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.082798 22575 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.121146 22477 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:29.138319 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.141871 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:29.118703 22621 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.126026 22650 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:29.137748 22503 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.147918 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.150280 18846 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:29.159838 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:29.161294 18846 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.116400 22643 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.153590 22503 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.169778 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:29.171622 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.180789 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.181604 18842 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:29.137646 22625 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.144666 22533 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.189049 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:29.179746 22633 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:29.203819 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.201923 22533 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.215581 22522 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:29.216962 22632 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:29.218145 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.224378 18841 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:29.238086 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.238965 22615 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:29.239491 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.461581 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:29.372771 18846 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
W20260709 12:24:29.248859 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.471936 18841 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:29.494155 22598 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.494805 18842 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:29.494908 22598 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.497638 22598 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:29.498157 22576 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.498759 22576 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.501150 22576 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:29.667145 22511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.078s
W20260709 12:24:29.672360 22511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.007s	sys 0.078s
I20260709 12:24:29.458007 22618 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:29.457574 22075 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:29.744254 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:29.745373 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.386583 22628 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:29.892648 22633 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.915234 22633 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.892199 22075 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.945508 22575 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:29.946837 22643 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:29.783933 22638 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:29.948104 22638 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.689465 22576 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:29.966432 22503 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.748s	user 0.006s	sys 0.000s
I20260709 12:24:29.983289 22503 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.983996 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 706) took 2106 ms. Trace:
I20260709 12:24:29.984689 19483 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:29.987138 22613 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:29.987744 22613 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:29.988900 22613 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:29.992082 22503 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:29.470894 22615 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.006637 22632 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:29.963255 22622 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.001s
W20260709 12:24:29.974254 22533 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.001s
I20260709 12:24:29.784996 22618 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:29.951978 22075 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:30.033954 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.056609 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.058116 19486 raft_consensus.cc:2410] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:24:30.059954 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2085) took 1283 ms. Trace:
I20260709 12:24:30.063649 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2290) took 2631 ms. Trace:
I20260709 12:24:30.016799 22628 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.019127 22575 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.021014 22393 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.080104 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 701) took 3242 ms. Trace:
I20260709 12:24:30.064321 18839 rpcz_store.cc:276] 0709 12:24:27.432682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.432853 (+   171us) service_pool.cc:224] Handling call
0709 12:24:27.433252 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.105883 (+672631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.063368 (+1957485us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54003287d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:30.063579 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470854912}
I20260709 12:24:27.291378 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:30.009518 22576 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.063175 18913 rpcz_store.cc:276] 0709 12:24:27.877796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.877957 (+   161us) service_pool.cc:224] Handling call
0709 12:24:28.724826 (+846869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.725032 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.725059 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:28.725103 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:28.725134 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.725187 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.983720 (+1258533us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540027e2d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:29.983885 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946894208}
I20260709 12:24:30.042448 22643 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.060627 18846 rpcz_store.cc:276] 0709 12:24:28.776595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.789611 (+1013016us) service_pool.cc:224] Handling call
0709 12:24:30.059202 (+269591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.059458 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.059497 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.059557 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:30.059612 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.059704 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.059867 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.990317 22613 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.080744 18916 rpcz_store.cc:276] 0709 12:24:26.837888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.838033 (+   145us) service_pool.cc:224] Handling call
0709 12:24:26.855903 (+ 17870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.241528 (+1385625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.079760 (+1838232us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540011fdd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:30.080031 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3000673664}
I20260709 12:24:30.022725 22622 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.081218 22533 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:30.080904 22393 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:30.114178 22630 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.970s	user 0.013s	sys 0.000s
I20260709 12:24:30.082046 22575 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.136650 22511 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.093245 22643 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.069185 22632 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:30.145689 22547 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.015s	user 0.019s	sys 0.000s
I20260709 12:24:30.183251 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:30.184216 18765 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
W20260709 12:24:30.184911 18765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1816) took 1188 ms (client timeout 1572 ms). Trace:
W20260709 12:24:30.168434 22589 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.037s	user 0.005s	sys 0.009s
I20260709 12:24:30.188187 22589 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.190939 22615 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.191583 22615 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.192049 22615 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.195000 22618 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.183768 22662 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:30.196059 22662 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.198262 22576 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.198273 22662 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.200030 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2397) took 2179 ms. Trace:
I20260709 12:24:30.200516 18764 rpcz_store.cc:276] 0709 12:24:28.021013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.721351 (+700338us) service_pool.cc:224] Handling call
0709 12:24:30.199789 (+1478438us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540029ccd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.199959 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704309632}
I20260709 12:24:30.203850 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 705) took 3592 ms. Trace:
I20260709 12:24:30.204346 19489 rpcz_store.cc:276] 0709 12:24:26.611789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.611951 (+   162us) service_pool.cc:224] Handling call
0709 12:24:28.486968 (+1875017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.487782 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.203586 (+1715804us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54003075d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.203748 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4311289088}
I20260709 12:24:30.207506 22393 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:30.208421 22622 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:30.185395 18765 rpcz_store.cc:269] 0709 12:24:28.997020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.178993 (+1181973us) service_pool.cc:224] Handling call
0709 12:24:30.184830 (+  5837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.202004 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:30.210920 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 620) took 1200 ms. Trace:
I20260709 12:24:30.211230 18764 rpcz_store.cc:276] 0709 12:24:29.010650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.201679 (+1191029us) service_pool.cc:224] Handling call
0709 12:24:30.210867 (+  9188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.147011 22511 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:30.216461 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:30.218243 18769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1801) took 1992 ms (client timeout 1932 ms). Trace:
W20260709 12:24:30.218737 18769 rpcz_store.cc:269] 0709 12:24:28.225487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.515237 (+289750us) service_pool.cc:224] Handling call
0709 12:24:30.218050 (+1702813us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002120d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.218165 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289423104}
I20260709 12:24:30.219851 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:30.220499 18769 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:30.146070 22533 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.220983 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 619) took 1218 ms. Trace:
I20260709 12:24:30.225127 18769 rpcz_store.cc:276] 0709 12:24:29.002513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.219541 (+1217028us) service_pool.cc:224] Handling call
0709 12:24:30.220925 (+  1384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.194195 22615 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.148267 22630 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.228874 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:30.230427 18765 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:30.231931 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:30.235745 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2418) took 1054 ms. Trace:
I20260709 12:24:30.233129 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:30.236128 18765 rpcz_store.cc:276] 0709 12:24:29.180940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.210317 (+1029377us) service_pool.cc:224] Handling call
0709 12:24:30.235650 (+ 25333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.236131 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2417) took 1082 ms. Trace:
I20260709 12:24:30.237248 18764 rpcz_store.cc:276] 0709 12:24:29.154028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.211781 (+1057753us) service_pool.cc:224] Handling call
0709 12:24:30.235995 (+ 24214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.247572 22511 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.248267 22511 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.248742 22511 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.179306 22547 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.213356 22589 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:30.223248 22662 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.232221 22622 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.240818 22615 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.276614 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.279337 18765 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:30.280368 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2399) took 2258 ms. Trace:
I20260709 12:24:30.281386 18765 rpcz_store.cc:276] 0709 12:24:28.021608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.264774 (+2243166us) service_pool.cc:224] Handling call
0709 12:24:30.278847 (+ 14073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.280022 (+  1175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.280290 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.274296 22622 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.267547 22662 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.289073 22575 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.304849 18914 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.310122 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.318060 19486 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:30.284490 22615 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.298517 22628 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.329962 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:30.330790 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.297555 22519 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.301391 22393 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:30.340694 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.340921 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.343973 19486 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:30.345696 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.346275 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.347086 18913 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:30.325984 22381 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.363721 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.337242 22511 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.364675 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.364861 19484 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:30.365868 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.365841 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:30.343051 22557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.094s	user 0.017s	sys 0.049s
I20260709 12:24:30.364248 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.368204 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.371620 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.368265 19487 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:30.377046 19488 raft_consensus.cc:1813] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Handling vote request from an unknown peer 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:30.364351 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.380003 19486 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:30.382875 19488 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:30.372480 22643 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:30.386459 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2093) took 1466 ms. Trace:
W20260709 12:24:30.370957 22661 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.199s	user 0.001s	sys 0.004s
I20260709 12:24:30.386942 18841 rpcz_store.cc:276] 0709 12:24:28.920430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.498824 (+578394us) service_pool.cc:224] Handling call
0709 12:24:29.499274 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.950776 (+451502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.950826 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.951510 (+   684us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.253913 (+302403us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:30.269681 (+ 15768us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.269980 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.270054 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.386146 (+116092us) raft_consensus.cc:1685] finished
0709 12:24:30.386168 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.386355 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1985,"prepare.queue_time_us":15473,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":4002,"raft.queue_time_us":452608,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":13030,"spinlock_wait_cycles":9803136,"thread_start_us":301854,"threads_started":1,"wal-append.queue_time_us":375331}
I20260709 12:24:30.376377 18916 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:30.407799 18766 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 610) took 2600 ms (client timeout 1669 ms). Trace:
I20260709 12:24:30.402653 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.398931 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:30.412488 18766 rpcz_store.cc:269] 0709 12:24:27.807833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.807974 (+   141us) service_pool.cc:224] Handling call
0709 12:24:30.407507 (+2599533us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54002116d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.407700 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843299072}
I20260709 12:24:30.413084 18915 raft_consensus.cc:2410] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:24:30.395835 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.406141 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 730) took 1277 ms. Trace:
I20260709 12:24:30.414273 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1798) took 2257 ms. Trace:
I20260709 12:24:30.415987 18766 rpcz_store.cc:276] 0709 12:24:28.156921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.413431 (+2256510us) service_pool.cc:224] Handling call
0709 12:24:30.413779 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.413966 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.413990 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.414032 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:30.414067 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.414121 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.414218 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.396814 22671 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.417662 22671 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.418828 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 613) took 2609 ms. Trace:
I20260709 12:24:30.365765 22547 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:30.395875 22590 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:30.420007 22590 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:30.374486 22598 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:30.420680 22654 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:30.420751 22598 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.420960 22590 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.421412 22654 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:30.373848 22663 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:30.422780 22674 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.394996 22662 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.423352 22674 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.406998 22449 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:30.423559 22654 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.396332 22622 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.424825 22449 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:30.425788 22674 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.425586 22449 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.419260 18768 rpcz_store.cc:276] 0709 12:24:27.809010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.809122 (+   112us) service_pool.cc:224] Handling call
0709 12:24:27.809479 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.823728 (+ 14249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.823759 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.850823 (+ 27064us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.224476 (+2373653us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b18003487c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:24:30.338483 (+114007us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:30.371854 (+ 33371us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.372133 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.372230 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.413443 (+ 41213us) raft_consensus.cc:1685] finished
0709 12:24:30.418544 (+  5101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.418750 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32913,"raft.queue_time_us":40697,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":24938,"spinlock_wait_cycles":36057856,"thread_start_us":133973,"threads_started":2,"wal-append.queue_time_us":2538394}
I20260709 12:24:30.366812 22632 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.426123 22575 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:30.415169 19483 rpcz_store.cc:276] 0709 12:24:29.128660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.128792 (+   132us) service_pool.cc:224] Handling call
0709 12:24:29.135794 (+  7002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.985090 (+849296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.405740 (+420650us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54005c0dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:30.406045 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951741184}
I20260709 12:24:30.429637 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.348366 22393 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.432489 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.434221 18919 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:30.433283 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.433482 19489 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:24:30.376139 22557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.127s	user 0.018s	sys 0.049s
I20260709 12:24:30.434996 18768 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:30.403354 22633 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.435113 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1800) took 2210 ms. Trace:
I20260709 12:24:30.436841 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1808) took 1802 ms. Trace:
I20260709 12:24:30.436820 18766 rpcz_store.cc:276] 0709 12:24:28.224690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.416772 (+2192082us) service_pool.cc:224] Handling call
0709 12:24:30.434538 (+ 17766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.434752 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.434779 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.434828 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:30.434864 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.434925 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.435054 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.438074 18915 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:30.402081 22409 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:30.430907 22645 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.321s	user 0.015s	sys 0.000s
I20260709 12:24:30.395370 22630 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.427433 22590 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.423559 22598 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.437472 18768 rpcz_store.cc:276] 0709 12:24:28.634039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.426685 (+1792646us) service_pool.cc:224] Handling call
0709 12:24:30.428269 (+  1584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.436531 (+  8262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.436783 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.416999 22533 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.437114 22671 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:30.448357 18766 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.480288 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1810) took 1786 ms. Trace:
I20260709 12:24:30.480815 18766 rpcz_store.cc:276] 0709 12:24:28.694130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.438177 (+1744047us) service_pool.cc:224] Handling call
0709 12:24:30.448213 (+ 10036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.479892 (+ 31679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.480199 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:30.481549 22652 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.321s	user 0.002s	sys 0.008s
I20260709 12:24:30.482730 18766 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:30.449048 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.428099 22674 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:30.485793 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.453627 22393 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:30.410446 22300 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.437397 22557 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:30.459153 22615 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.434193 22575 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.463352 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.471679 22613 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:30.478961 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.495364 18918 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
W20260709 12:24:30.452296 18738 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.242s (SENT) [suppressed 29 similar messages]
W20260709 12:24:30.450006 22658 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:24:30.484864 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1814) took 1697 ms. Trace:
I20260709 12:24:30.500219 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2098) took 1516 ms. Trace:
I20260709 12:24:30.499938 18766 rpcz_store.cc:276] 0709 12:24:28.787878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.481798 (+1693920us) service_pool.cc:224] Handling call
0709 12:24:30.482275 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.484470 (+  2195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.484783 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.500733 18922 rpcz_store.cc:276] 0709 12:24:28.977191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.983304 (+  6113us) service_pool.cc:224] Handling call
0709 12:24:28.983856 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.032017 (+ 48161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.032047 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.041920 (+  9873us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.139769 (+ 97849us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:29.139842 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.139954 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.480905 (+1340951us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:30.486602 (+  5697us) raft_consensus.cc:1685] finished
0709 12:24:30.486626 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.493023 (+  6397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52775,"raft.queue_time_us":55269,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6224,"spinlock_wait_cycles":4849536,"thread_start_us":76554,"threads_started":1,"wal-append.queue_time_us":109798}
I20260709 12:24:30.499167 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59942 (request call id 0) took 16316 ms. Trace:
I20260709 12:24:30.510444 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 731) took 1375 ms. Trace:
I20260709 12:24:30.510963 19492 rpcz_store.cc:276] 0709 12:24:29.136293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.136436 (+   143us) service_pool.cc:224] Handling call
0709 12:24:29.153053 (+ 16617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.159106 (+  6053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.159147 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.168029 (+  8882us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.234734 (+ 66705us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:29.234806 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.234908 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.510144 (+1275236us) raft_consensus.cc:1685] finished
0709 12:24:30.510165 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.510343 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6552,"thread_start_us":51957,"threads_started":1,"wal-append.queue_time_us":990615}
I20260709 12:24:30.516893 22447 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.522502 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 618) took 1732 ms. Trace:
I20260709 12:24:30.524763 18769 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:30.525538 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2404) took 1734 ms. Trace:
I20260709 12:24:30.525853 18769 rpcz_store.cc:276] 0709 12:24:28.790685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.524106 (+1733421us) service_pool.cc:224] Handling call
0709 12:24:30.524499 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.525250 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.525478 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.527734 18764 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:30.570025 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2405) took 1779 ms. Trace:
I20260709 12:24:30.570456 18764 rpcz_store.cc:276] 0709 12:24:28.790927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.527058 (+1736131us) service_pool.cc:224] Handling call
0709 12:24:30.527410 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.569731 (+ 42321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.569967 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.526908 22557 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.490273 22674 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.522979 18765 rpcz_store.cc:276] 0709 12:24:28.789672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.521579 (+1731907us) service_pool.cc:224] Handling call
0709 12:24:30.521936 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.522120 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.522147 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.522188 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:30.522230 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.522284 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.522436 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.504055 22300 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.511622 22645 rpcz_store.cc:276] 0709 12:24:14.183112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.187462 (+  4350us) service_pool.cc:224] Handling call
0709 12:24:14.286255 (+ 98793us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b2c00075be8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359893a0a 00007f3359893693 00007f3359893631 00007f335afc6902 00007f335afc66dd 00007f335af91f3f 00007f335af916b3 00007f335af899fa 00007f335ff514c9 00007f33594cdc54
0709 12:24:14.386361 (+100106us) log.cc:844] Serialized 487 byte log entry
0709 12:24:14.748418 (+362057us) spinlock_profiling.cc:243] Waited 967 us on lock 0x7b1800423be0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335aee4b0b 00007f335af69b63 00007f335af91752 00007f335af899fa
0709 12:24:30.498909 (+15750491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264152,"raft.queue_time_us":264684,"raft.run_cpu_time_us":2166,"raft.run_wall_time_us":83670,"spinlock_wait_cycles":58126080,"thread_start_us":97760,"threads_started":1,"wal-append.queue_time_us":105410,"wal-append.run_cpu_time_us":3820,"wal-append.run_wall_time_us":1217308}
I20260709 12:24:30.538730 22449 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.540578 22575 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.504839 22613 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.711899 18769 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:30.738884 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2408) took 1945 ms. Trace:
I20260709 12:24:30.738955 18764 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.739320 18769 rpcz_store.cc:276] 0709 12:24:28.793033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.569518 (+1776485us) service_pool.cc:224] Handling call
0709 12:24:30.711655 (+142137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.738546 (+ 26891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.738813 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.739909 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2409) took 1940 ms. Trace:
I20260709 12:24:30.740418 18764 rpcz_store.cc:276] 0709 12:24:28.799736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.571188 (+1771452us) service_pool.cc:224] Handling call
0709 12:24:30.738695 (+167507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.739584 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.739828 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.743058 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.744295 18918 raft_consensus.cc:2410] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:30.750551 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.753435 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2413) took 1930 ms. Trace:
I20260709 12:24:30.753937 18769 rpcz_store.cc:276] 0709 12:24:28.822809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.750585 (+1927776us) service_pool.cc:224] Handling call
0709 12:24:30.752885 (+  2300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.753070 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.753117 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.753158 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:30.753196 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.753251 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.753369 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:30.777045 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 324766us
I20260709 12:24:30.778141 18765 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:24:30.779942 18769 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:30.780603 18764 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:30.781024 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2295) took 3346 ms. Trace:
I20260709 12:24:30.781332 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2411) took 1977 ms. Trace:
I20260709 12:24:30.788769 18764 rpcz_store.cc:276] 0709 12:24:28.803608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.750510 (+1946902us) service_pool.cc:224] Handling call
0709 12:24:30.780199 (+ 29689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.781098 (+   899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.781278 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.798192 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2410) took 1994 ms. Trace:
I20260709 12:24:30.798830 18765 rpcz_store.cc:276] 0709 12:24:28.803365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.750493 (+1947128us) service_pool.cc:224] Handling call
0709 12:24:30.777797 (+ 27304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:30.797751 (+ 19954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.798100 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.781523 18845 rpcz_store.cc:276] 0709 12:24:27.434222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.447991 (+ 13769us) service_pool.cc:224] Handling call
0709 12:24:27.448453 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.068297 (+619844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.780779 (+2712482us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001090d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:30.780957 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338640256}
W20260709 12:24:30.801677 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.780624 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2415) took 1953 ms. Trace:
I20260709 12:24:30.803655 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.803519 18769 rpcz_store.cc:276] 0709 12:24:28.827059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.755043 (+1927984us) service_pool.cc:224] Handling call
0709 12:24:30.770951 (+ 15908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.780381 (+  9430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.780566 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:30.808655 18921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2097) took 1835 ms (client timeout 1791 ms). Trace:
W20260709 12:24:30.809118 18921 rpcz_store.cc:269] 0709 12:24:28.975311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.975557 (+   246us) service_pool.cc:224] Handling call
0709 12:24:30.808365 (+1832808us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400353ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.808578 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333159680}
W20260709 12:24:30.810273 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68131.1us
W20260709 12:24:30.776821 22552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.891s	user 0.015s	sys 0.018s
W20260709 12:24:30.818991 18770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2407) took 2027 ms (client timeout 1804 ms). Trace:
W20260709 12:24:30.819481 18770 rpcz_store.cc:269] 0709 12:24:28.791435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.816965 (+ 25530us) service_pool.cc:224] Handling call
0709 12:24:30.818752 (+2001787us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b54000af0d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.818901 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92216576}
I20260709 12:24:30.823988 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1809) took 2130 ms. Trace:
I20260709 12:24:30.824465 18767 rpcz_store.cc:276] 0709 12:24:28.693844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.427400 (+1733556us) service_pool.cc:224] Handling call
0709 12:24:30.822077 (+394677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.822306 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.822338 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.822405 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.822448 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.822513 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.823765 (+  1252us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54000af0d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.823909 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906834816}
I20260709 12:24:30.827194 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1812) took 2125 ms. Trace:
I20260709 12:24:30.827634 18768 rpcz_store.cc:276] 0709 12:24:28.701586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.451839 (+1750253us) service_pool.cc:224] Handling call
0709 12:24:30.452289 (+   450us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:30.452829 (+   540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.452863 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:30.453660 (+   797us) log.cc:844] Serialized 78 byte log entry
0709 12:24:30.512002 (+ 58342us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.530051 (+ 18049us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.531311 (+  1260us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.531509 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.531616 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.826935 (+295319us) raft_consensus.cc:1685] finished
0709 12:24:30.826959 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.827119 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20304,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":32153,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":8428,"thread_start_us":57877,"threads_started":1,"wal-append.queue_time_us":317889}
I20260709 12:24:30.830310 18768 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:30.803417 22575 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.834460 22592 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 2.812s	user 0.025s	sys 0.018s
I20260709 12:24:30.834769 22575 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.835971 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.837018 18847 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:30.837182 22598 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.837303 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.837821 22598 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.838274 18918 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:30.833431 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:30.839766 22654 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.840233 22654 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:30.811797 22552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.927s	user 0.016s	sys 0.018s
I20260709 12:24:30.840698 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2419) took 1598 ms. Trace:
I20260709 12:24:30.826275 18767 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:30.845901 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2416) took 1928 ms. Trace:
I20260709 12:24:30.845328 18768 rpcz_store.cc:276] 0709 12:24:29.241890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.829557 (+1587667us) service_pool.cc:224] Handling call
0709 12:24:30.829912 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.840439 (+ 10527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.840636 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.846570 18767 rpcz_store.cc:276] 0709 12:24:28.917094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.825622 (+1908528us) service_pool.cc:224] Handling call
0709 12:24:30.826008 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.845593 (+ 19585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.845839 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.847164 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 605) took 3405 ms. Trace:
I20260709 12:24:30.838845 18764 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:30.860594 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1815) took 1962 ms. Trace:
I20260709 12:24:30.861208 18764 rpcz_store.cc:276] 0709 12:24:28.897731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.817027 (+1919296us) service_pool.cc:224] Handling call
0709 12:24:30.838222 (+ 21195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.860128 (+ 21906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.860522 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.847728 18843 rpcz_store.cc:276] 0709 12:24:27.441288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.514741 (+ 73453us) service_pool.cc:224] Handling call
0709 12:24:27.597877 (+ 83136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.680947 (+ 83070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.680980 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.681538 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.783509 (+101971us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:28.072477 (+288968us) log.cc:844] Serialized 14 byte log entry
0709 12:24:28.079359 (+  6882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.079456 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.818090 (+2738634us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:30.846846 (+ 28756us) raft_consensus.cc:1685] finished
0709 12:24:30.846957 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.847095 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67662,"prepare.queue_time_us":526658,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":38026,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":22820,"spinlock_wait_cycles":8757504,"thread_start_us":338630,"threads_started":2,"wal-append.queue_time_us":230675}
I20260709 12:24:30.881304 22638 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.882653 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1485e54f9795416785f4baf244599201 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:24:30.895130 22613 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.889950 22674 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.886039 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:30.897087 22571 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.897516 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:30.898859 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:30.899771 18811 connection.cc:256] RPC call timeout handler was delayed by -2.473389268000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:24:30.900508 22553 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.901057 22553 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.900921 18669 catalog_manager.cc:5697] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 4 to 7, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.902330 22674 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.902585 22625 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.902905 22674 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.903230 22625 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.903033 18669 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 4, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 4 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:30.905203 22674 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:30.904826 18669 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:30.906973 18919 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:24:30.907403 18919 pending_rounds.cc:85] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 3
W20260709 12:24:30.907245 18771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1804) took 2374 ms (client timeout 1852 ms). Trace:
I20260709 12:24:30.907711 18919 pending_rounds.cc:107] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:24:30.908087 18919 raft_consensus.cc:2889] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:30.907814 18771 rpcz_store.cc:269] 0709 12:24:28.532518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.707176 (+174658us) service_pool.cc:224] Handling call
0709 12:24:30.906975 (+2199799us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540029c2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.907158 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698433408}
I20260709 12:24:30.908571 22553 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.909286 22536 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.910090 18773 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:30.910104 22381 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.911388 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2396) took 2890 ms. Trace:
I20260709 12:24:30.911136 22381 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:30.911764 18773 rpcz_store.cc:276] 0709 12:24:28.020608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.936966 (+916358us) service_pool.cc:224] Handling call
0709 12:24:30.909892 (+1972926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.910566 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.911187 (+   621us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b540029c2d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:30.911321 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4536526720}
I20260709 12:24:30.913697 22381 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.910473 22625 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:30.898860 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:30.916685 18670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 277) took 28449 ms (client timeout 15000 ms). Trace:
W20260709 12:24:30.918366 18670 rpcz_store.cc:269] 0709 12:24:02.467193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.468195 (+  1002us) service_pool.cc:224] Handling call
0709 12:24:30.916601 (+28448406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:25.021239 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:25.059051 (+ 37812us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:25.059104 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:24:25.059123 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:25.064530 (+  5407us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:25.064633 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:25.064659 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:24:25.065398 (+   739us) tablet.cc:701] Row locks acquired
0709 12:24:25.065455 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:24:25.065648 (+   193us) write_op.cc:270] Start()
0709 12:24:25.065821 (+   173us) write_op.cc:276] Timestamp: P: 1783599865065569 usec, L: 0
0709 12:24:25.065848 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:24:25.119713 (+ 53865us) log.cc:844] Serialized 2105 byte log entry
0709 12:24:25.473403 (+353690us) op_driver.cc:464] REPLICATION: finished
0709 12:24:25.640288 (+166885us) write_op.cc:301] APPLY: starting
0709 12:24:25.659592 (+ 19304us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:25.696873 (+ 37281us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:25.714723 (+ 17850us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:25.869196 (+154473us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:25.898804 (+ 29608us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:24:25.898863 (+    59us) write_op.cc:312] APPLY: finished
0709 12:24:25.899211 (+   348us) log.cc:844] Serialized 47 byte log entry
0709 12:24:25.899440 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:25.899559 (+   119us) write_op.cc:454] Released schema lock
0709 12:24:25.899625 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:25.900063 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:25.900096 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":731270,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":125154,"apply.run_cpu_time_us":4711,"apply.run_wall_time_us":289236,"num_ops":5,"prepare.queue_time_us":123377,"prepare.run_cpu_time_us":22744,"prepare.run_wall_time_us":284380,"raft.queue_time_us":77990,"raft.run_cpu_time_us":11677,"raft.run_wall_time_us":92742,"replication_time_us":407357,"thread_start_us":223828,"threads_started":4,"wal-append.queue_time_us":171891,"wal-append.run_cpu_time_us":6902,"wal-append.run_wall_time_us":1621353}]]}
I20260709 12:24:30.922499 22549 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:30.922631 22612 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:30.923205 22612 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.923560 22612 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:30.927825 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:30.906332 18669 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 5 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:30.933400 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.950892 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.951812 19484 raft_consensus.cc:2410] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:30.950140 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:30.952490 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:30.947423 22532 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:30.944007 18669 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 5 to 8, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 8 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 12:24:30.930763 22549 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:30.955874 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:30.959865 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:30.970237 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127044us
I20260709 12:24:30.949258 22594 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.930495 22583 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:24:30.973752 18669 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:24:30.978163 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.981587 22536 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:30.960026 22393 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.961102 22549 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.982270 22536 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:30.994827 18669 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.998721 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.974561 22625 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:31.000542 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:31.002254 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.008836 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.963377 22532 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.012917 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.013846 18922 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:31.015062 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.015928 18920 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:31.010243 18917 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:31.010021 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:30.990094 22549 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:31.018486 18916 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:30.994185 22671 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:31.019701 18669 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 4 to 5, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 5 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.021639 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.027706 18921 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:30.981205 22594 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.034262 18669 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 5 to 6, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.020988 22625 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:31.051270 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.054857 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:31.063264 22575 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:31.068060 22671 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.070254 18847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2078) took 2796 ms (client timeout 2242 ms). Trace:
I20260709 12:24:31.075500 22627 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:31.079439 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:31.099570 18773 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:31.101105 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:31.082376 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:31.083604 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:31.093150 18669 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:31.103466 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:31.104346 18768 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:31.106057 18768 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:31.095145 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:31.115209 18769 raft_consensus.cc:2376] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8. Re-sending same reply.
W20260709 12:24:31.097999 18847 rpcz_store.cc:269] 0709 12:24:28.274283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.274507 (+   224us) service_pool.cc:224] Handling call
0709 12:24:31.070019 (+2795512us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b54003269d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:31.070137 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5884604288}
I20260709 12:24:31.123733 22532 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:31.122985 18669 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 7 to 8, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 8 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:31.125224 18669 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:31.126762 18669 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:31.128320 18669 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 5 to 7, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.130165 18669 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 6 to 7, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.130811 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:31.132202 18669 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:31.134618 18669 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 4 to 5, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 5 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:31.136484 18669 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 5 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 6 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:31.137989 18669 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 2 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.143179 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 617) took 2353 ms. Trace:
I20260709 12:24:31.143832 18766 rpcz_store.cc:276] 0709 12:24:28.789444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.503187 (+1713743us) service_pool.cc:224] Handling call
0709 12:24:30.513907 (+ 10720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.514313 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.514345 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.514887 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.877123 (+362236us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:30.877180 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.877268 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.142934 (+265666us) raft_consensus.cc:1685] finished
0709 12:24:31.142957 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.143111 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"thread_start_us":138652,"threads_started":1,"wal-append.queue_time_us":262607}
I20260709 12:24:31.143247 18669 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.147414 22594 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.148417 18669 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:31.153343 18669 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 1 to 6, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:31.151636 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 195880us
I20260709 12:24:31.116851 22627 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.155998 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.158167 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.160072 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.161871 18669 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 5 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.167815 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:31.173503 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:31.181581 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 121455us
I20260709 12:24:31.182586 22536 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:31.157819 22627 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:31.184455 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.184384 22562 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:31.186081 22562 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.189491 22562 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.190568 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:31.191625 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:31.157871 22594 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:31.193352 22654 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:31.195106 22393 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.174888 22555 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.170249 22575 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:31.198561 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:31.178866 22577 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:31.196753 22583 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:31.149048 22671 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.222702 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:31.223608 19484 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:31.224651 22671 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:31.213882 22654 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.226873 22654 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.219403 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:31.220299 22583 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:31.230726 22583 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.232937 22694 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:31.233481 22694 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:31.233856 22694 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:31.211229 22577 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.238991 22577 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.190594 22571 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:31.239552 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:31.240594 19458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.761s	user 0.050s	sys 0.054s
I20260709 12:24:31.240592 19489 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
W20260709 12:24:31.241250 19458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.762s	user 0.051s	sys 0.055s
I20260709 12:24:31.221864 22625 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:31.242480 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 2.78249e+06us
I20260709 12:24:31.247531 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.245460 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:31.260713 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:31.265012 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:31.266813 18812 connection.cc:256] RPC call timeout handler was delayed by -1.6257906949999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 12:24:31.239894 22627 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.271749 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:31.253278 22536 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:31.275465 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82358.5us
I20260709 12:24:31.275985 19490 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:31.278908 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2083) took 2383 ms. Trace:
I20260709 12:24:31.253453 22626 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:31.256141 22549 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.286434 22393 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:31.287473 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3098906949999218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 12:24:31.287521 22553 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.288010 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2071727430002284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 12:24:31.288283 22553 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.289204 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.290634 22447 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:31.290676 22553 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.291272 22447 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:31.292048 22627 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:31.292255 22447 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.273437 22579 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.256702 22610 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:24:31.293869 22579 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.296911 22610 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:31.297300 22610 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:31.298336 22579 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:31.258822 22613 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:31.299978 22549 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.300537 22613 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:31.300999 22613 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:31.262995 22625 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:24:31.302064 22625 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:31.302488 22625 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:31.298126 22610 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.303668 22610 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.303467 22625 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.304854 22625 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.279666 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:31.277774 22536 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:31.284409 22654 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.279345 18914 rpcz_store.cc:276] 0709 12:24:28.895949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.897229 (+  1280us) service_pool.cc:224] Handling call
0709 12:24:28.897665 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.315771 (+1418106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.278633 (+962862us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400334854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:31.278833 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3235557632}
I20260709 12:24:31.263913 22572 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.309242 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:31.434242 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 176117us
I20260709 12:24:31.341018 19487 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:31.346314 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66793us
I20260709 12:24:31.439474 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:31.364111 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.446749 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 137579us
W20260709 12:24:31.449394 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.479053 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.480137 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:31.482124 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:31.483048 18770 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:31.484735 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:31.301832 22613 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.422612 22300 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.450754 22536 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:31.263741 22695 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.216s
I20260709 12:24:31.490867 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.451340 22638 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.488564 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.505205 18914 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:31.495905 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.506623 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.507488 18916 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:31.481755 22393 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:31.508927 22393 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:31.509374 22393 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:31.497094 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.527799 18847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:31.528744 18847 raft_consensus.cc:606] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.530819 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:31.531410 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:31.531847 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:31.532438 18846 raft_consensus.cc:1813] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Handling vote request from an unknown peer 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:31.533034 18846 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 8 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:31.533661 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:31.452291 22555 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.533994 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:31.488505 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.477039 22579 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.455502 22562 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:31.274032 22612 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.498746 22300 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.542737 18773 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:31.542842 22300 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:31.534790 22538 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:31.543852 22538 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.544274 22575 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:31.477797 22671 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:31.546710 22538 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.532868 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:31.533821 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:31.549391 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.549544 18842 raft_consensus.cc:2410] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:24:31.496618 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62638.3us
I20260709 12:24:31.421932 22440 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:31.502017 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 605) took 3696 ms. Trace:
I20260709 12:24:31.486274 22427 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:31.535225 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:31.539562 18848 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:31.535022 22613 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.534806 18839 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:31.486855 22654 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.552407 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:31.549006 18841 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:31.534906 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.565235 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.565845 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.565733 19458 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:31.566290 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.566704 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.547279 22538 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.552330 18772 rpcz_store.cc:276] 0709 12:24:27.805418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.805569 (+   151us) service_pool.cc:224] Handling call
0709 12:24:27.806118 (+   549us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:28.060668 (+254550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.060730 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:30.963402 (+2902672us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b2c00057528. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:24:30.973775 (+ 10373us) log.cc:844] Serialized 513 byte log entry
0709 12:24:31.180471 (+206696us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.180512 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.501575 (+321063us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540017a7d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:31.501684 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.501734 (+    50us) raft_consensus.cc:1685] finished
0709 12:24:31.501750 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.501947 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34964,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":16534,"spinlock_wait_cycles":587669632,"thread_start_us":198593,"threads_started":1,"wal-append.queue_time_us":226908}
I20260709 12:24:31.560282 18919 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:31.486603 22511 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:24:31.586820 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 719) took 1220 ms. Trace:
I20260709 12:24:31.592217 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.592622 19485 rpcz_store.cc:276] 0709 12:24:30.366757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.366904 (+   147us) service_pool.cc:224] Handling call
0709 12:24:30.373764 (+  6860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.374210 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.374248 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.383820 (+  9572us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.556231 (+1172411us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b18003b0e60. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1
0709 12:24:31.556429 (+   198us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:31.556468 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.556536 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.556580 (+    44us) raft_consensus.cc:1685] finished
0709 12:24:31.556589 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.586730 (+ 30141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16735,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":34537,"spinlock_wait_cycles":7744256,"thread_start_us":43623,"threads_started":1,"wal-append.queue_time_us":99312,"wal-append.run_cpu_time_us":2027,"wal-append.run_wall_time_us":1031226}
I20260709 12:24:31.594914 18922 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:31.591251 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:31.595933 18919 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.589907 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:31.599042 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.599550 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.600116 18917 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:31.601106 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.601966 18920 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:31.606945 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.607307 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.550964 22562 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:31.614990 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 141726us
I20260709 12:24:31.618690 18920 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:31.609524 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 161568us
I20260709 12:24:31.472599 22572 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.622819 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.620481 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.622216 18921 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:24:31.625547 18918 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:31.539193 22638 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.577786 22300 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:31.634632 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.628161 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.628216 18919 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:31.629917 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:31.630339 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46375.7us
I20260709 12:24:31.608134 22635 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:31.635780 18918 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:31.615690 22509 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:31.569581 22674 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:24:31.660332 22075 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.608500 22447 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:31.664471 18847 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:31.638484 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.534377 22555 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.645283 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:31.645881 18917 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:31.665630 18917 pending_rounds.cc:85] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 3
I20260709 12:24:31.665951 18917 pending_rounds.cc:107] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:31.666253 18917 raft_consensus.cc:2889] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:31.570235 22427 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.613546 22562 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:31.562417 22440 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.668722 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:31.553252 22579 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.623731 22612 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.587056 22538 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.772461 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:31.773168 18772 raft_consensus.cc:606] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:31.773540 18772 raft_consensus.cc:614] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:31.592849 22654 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.634503 22549 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.677476 18842 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:31.677938 22440 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.644296 22300 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.685421 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:31.643322 22509 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:31.870811 22509 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:31.864087 18660 maintenance_manager.cc:419] P bcc1b451ad6147bd802f7cd458a81a5c: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033353
I20260709 12:24:31.675302 22381 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:31.864195 22634 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:31.774956 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:31.875258 22440 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:31.869882 18843 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:31.875515 22634 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.876291 18844 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:31.628510 22697 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:24:31.877341 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:31.877919 22536 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.878881 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:31.861675 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 222263us
I20260709 12:24:31.668268 22635 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:31.862308 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:31.680119 22427 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:31.866179 18767 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:31.868464 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:31.964587 18772 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:31.636680 22577 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:31.875741 18768 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:31.862236 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:31.966655 18769 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:31.944479 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63368.4us
I20260709 12:24:31.968611 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:31.981972 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.992481 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 442524us
I20260709 12:24:31.885744 22075 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.208s
W20260709 12:24:32.176419 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 491069us
I20260709 12:24:32.187767 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:32.147687 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 261245us
I20260709 12:24:32.112031 18769 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:32.064231 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:31.997717 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.199396 18770 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:32.120473 22447 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:32.223809 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 235130us
I20260709 12:24:32.223727 22447 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.227792 22558 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:32.229022 22558 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:32.232208 22625 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.001s
I20260709 12:24:32.233199 22558 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:32.236615 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 48996.8us
I20260709 12:24:32.238656 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 606) took 4777 ms. Trace:
I20260709 12:24:31.991693 22705 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:31.987946 22602 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:24:32.189579 22583 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.958s	user 0.011s	sys 0.001s
I20260709 12:24:32.239120 18840 rpcz_store.cc:276] 0709 12:24:27.441544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.528814 (+ 87270us) service_pool.cc:224] Handling call
0709 12:24:27.530576 (+  1762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.854234 (+323658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.854276 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.923279 (+2069003us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b2c0005b308. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:24:29.923722 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.304001 (+380279us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:30.325071 (+ 21070us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.325442 (+   371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.893394 (+567952us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b1800480a60. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:32.218522 (+1325128us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400285354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:32.218591 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.218649 (+    58us) raft_consensus.cc:1685] finished
0709 12:24:32.218664 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.218857 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119360,"prepare.queue_time_us":22001,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":75026,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":13345,"spinlock_wait_cycles":713380992,"thread_start_us":379783,"threads_started":1,"wal-append.queue_time_us":444561,"wal-append.run_cpu_time_us":2408,"wal-append.run_wall_time_us":1050885}
W20260709 12:24:32.240716 22694 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.006s	user 0.011s	sys 0.001s
I20260709 12:24:32.115473 22674 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:32.280777 18768 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:32.271525 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:32.254994 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.273727 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.275122 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.276343 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:32.269313 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 275389us
W20260709 12:24:32.283867 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.312578 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.313951 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.286932 18769 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
W20260709 12:24:32.316116 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.315765 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.286916 22555 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:32.323624 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.323931 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.335515 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.336530 18768 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:32.279644 22625 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:24:32.311105 22572 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:32.344911 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 153415us
I20260709 12:24:32.315758 22671 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.279018 22583 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.278519 22602 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.350826 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:32.351938 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.352885 22557 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:32.354312 22556 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:32.355386 22707 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:24:32.333431 22538 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:32.364895 19486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 721) took 1925 ms (client timeout 1686 ms). Trace:
W20260709 12:24:32.362869 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.365549 19486 rpcz_store.cc:269] 0709 12:24:30.439057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.364627 (+1925570us) service_pool.cc:211] Skipping call since client already timed out
0709 12:24:32.364801 (+   174us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:24:32.366128 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.359445 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:32.369906 18768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:32.370877 18768 raft_consensus.cc:606] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.371371 18768 raft_consensus.cc:614] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:32.375977 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 471561us
W20260709 12:24:32.377152 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.382299 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.382990 18772 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:32.358044 22557 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:32.311307 22674 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.333016 22717 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:24:32.418957 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:32.382853 22558 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:32.282155 22694 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.422961 18844 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.369572 22604 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:32.425331 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 187913us
I20260709 12:24:32.356181 22671 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.386744 22654 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:32.460879 18840 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:32.417642 22638 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:32.416733 22536 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:32.386593 22538 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:24:32.423630 22558 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.481228 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:32.483831 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:32.485648 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 126277us
I20260709 12:24:32.487195 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:24:32.457440 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 146921us
I20260709 12:24:32.467685 18766 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:32.467569 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:32.471426 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61827us
I20260709 12:24:32.491237 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:32.465066 22715 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:32.464395 22579 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:32.471619 22613 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.903s	user 0.007s	sys 0.007s
I20260709 12:24:32.501760 22434 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:24:32.493510 22558 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:32.505822 22687 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.503s	user 0.008s	sys 0.024s
W20260709 12:24:32.506806 22716 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:24:32.506889 22721 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:32.507525 22721 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.507918 22721 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:32.508746 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.509137 22720 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:32.509519 18846 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:32.509650 22720 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:32.510732 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.511547 18846 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:32.512563 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.513216 18846 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:32.514581 22536 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:32.515085 22536 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:32.515342 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.505496 18768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:32.516902 18768 raft_consensus.cc:606] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.469730 22635 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:32.517349 18768 raft_consensus.cc:614] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:32.517798 18915 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:32.515528 22536 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:32.518199 18915 pending_rounds.cc:85] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 3
I20260709 12:24:32.521879 18915 pending_rounds.cc:107] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:32.522265 18915 raft_consensus.cc:2889] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:32.514178 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.524648 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.525381 18841 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:32.531512 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.534121 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.535303 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:32.537706 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.539714 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.499864 22616 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:32.540141 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.544116 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.544385 22616 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.545949 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.539583 18844 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
W20260709 12:24:32.543237 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47844us
I20260709 12:24:32.537241 22724 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:32.542454 18886 connection.cc:256] RPC call timeout handler was delayed by -2.4230498280003303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 12:24:32.499291 22638 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.501075 22634 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.547706 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:32.547909 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.548599 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57460.5us
I20260709 12:24:32.549130 22724 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.471431 22604 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.549281 22638 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.560496 22638 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:32.553362 22720 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.546435 22558 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.561682 22720 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.562744 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.563432 19492 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:32.563910 22558 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.550511 18846 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:32.567229 19486 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:32.551390 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.493762 22557 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.551309 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:32.571476 22557 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.553073 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.544894 22616 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:32.590000 22509 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.000s
I20260709 12:24:32.605146 18846 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
W20260709 12:24:32.556803 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.569157 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.569155 18841 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:32.578887 22722 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:32.579336 22598 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.553790 22552 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:32.585750 22610 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.282s	user 0.012s	sys 0.000s
W20260709 12:24:32.586167 22562 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.901s	user 0.004s	sys 0.005s
I20260709 12:24:32.555892 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.516606 22625 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:24:32.594812 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:32.630043 18767 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.599387 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.602432 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.602454 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.555145 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:32.605831 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 88100.6us
I20260709 12:24:32.632349 18844 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:32.632826 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.633399 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.633690 19489 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 7: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:32.612783 18886 connection.cc:256] RPC call timeout handler was delayed by -1.832254993999868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 12:24:32.634613 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:32.634773 18886 connection.cc:256] RPC call timeout handler was delayed by -1.5488891720001448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 12:24:32.634974 19489 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:32.635231 18844 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:32.613353 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:32.593624 22393 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.084s	user 0.010s	sys 0.004s
I20260709 12:24:32.558240 22724 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:32.619737 18765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
I20260709 12:24:32.625314 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.639930 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:32.639968 18765 raft_consensus.cc:606] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.636099 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:32.618659 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 67645.2us
I20260709 12:24:32.641258 18765 raft_consensus.cc:614] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:32.641486 18844 raft_consensus.cc:1813] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.642506 18844 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:24:32.619634 22728 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:24:32.645407 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:32.612428 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:32.637861 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:32.640368 19491 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 5.
I20260709 12:24:32.646412 18841 raft_consensus.cc:2376] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7. Re-sending same reply.
I20260709 12:24:32.627602 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:32.634167 19456 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.669s (SENT)
I20260709 12:24:32.613267 22722 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.648948 22558 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:32.649892 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.717393 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.710606 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.640616 22610 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:32.642899 22598 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:32.616264 22486 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:24:32.707846 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:32.636926 22717 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.734707 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.659454 22589 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:32.715607 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.618057 22552 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.657454 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:32.715332 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 64230.8us
I20260709 12:24:32.650310 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:32.719841 18767 raft_consensus.cc:2410] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:32.629165 22635 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:32.640017 22562 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.741343 22717 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.741878 22635 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.743963 22717 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:32.744377 22635 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:32.731072 22634 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:32.745651 22634 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:32.747330 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.747571 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.747627 22562 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:32.748227 19484 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:32.725915 22558 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.629618 22427 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:24:32.697686 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.749361 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:32.750304 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.722164 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.724103 22602 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.711514 22583 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.727325 22538 raft_consensus.cc:993] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:32.727938 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:32.726552 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 88776us
W20260709 12:24:32.768585 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 128723us
I20260709 12:24:32.700485 22722 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:32.774587 22440 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:32.739370 19491 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:32.732826 22674 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:32.699787 18921 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:32.740203 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:32.751597 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.751601 18770 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
W20260709 12:24:32.779722 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.612869 22509 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.643755 22694 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:32.780172 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.755191 18919 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:24:32.756835 18765 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:32.725078 22579 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:32.726598 22739 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:24:32.761989 22732 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:32.730502 22625 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:24:32.768585 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45017.9us
I20260709 12:24:32.770612 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.738683 22725 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:24:32.775063 22729 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:32.737349 22598 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:32.725744 22708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.026s
I20260709 12:24:32.644073 22393 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.795972 18844 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:32.749384 22427 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:32.797202 22427 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:32.798481 22558 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:32.798379 22427 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.799803 22427 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.802732 18769 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:32.787701 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.804858 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.805565 18765 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
W20260709 12:24:32.807034 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.794827 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.738237 22552 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.734189 22610 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.808530 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.808324 18770 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:32.812719 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.813336 18770 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:32.814558 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:32.815771 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45245.5us
I20260709 12:24:32.817394 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:32.815963 19457 connection.cc:256] RPC call timeout handler was delayed by -1.2259617949998756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2637s for a response
W20260709 12:24:32.818625 19457 connection.cc:256] RPC call timeout handler was delayed by -1.0886863980003909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 12:24:32.818846 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.819561 18765 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:32.820490 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.821003 18765 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:32.821691 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:32.823325 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.823509 18767 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.796490 22564 raft_consensus.cc:1081] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:32.828855 22602 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:32.831239 22509 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.831506 22616 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.832388 22393 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:32.833408 19485 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:32.823410 22721 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.811770 22589 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:24:32.827180 22536 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.837210 22721 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:32.837478 22671 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.839484 22610 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:32.840227 22556 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:32.840306 22598 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.842100 18848 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:32.842929 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2313) took 1170 ms. Trace:
I20260709 12:24:32.843281 18848 rpcz_store.cc:276] 0709 12:24:31.672139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.841448 (+1169309us) service_pool.cc:224] Handling call
0709 12:24:32.841860 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.842607 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.842857 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.845773 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.846694 18841 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:32.847571 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:32.848201 18921 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.849026 18841 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:32.849709 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2315) took 1177 ms. Trace:
I20260709 12:24:32.851423 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:32.852064 18771 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.850010 18841 rpcz_store.cc:276] 0709 12:24:31.672647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.848438 (+1175791us) service_pool.cc:224] Handling call
0709 12:24:32.848767 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.849451 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.849652 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.853686 18841 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:32.856134 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2117) took 1257 ms. Trace:
I20260709 12:24:32.856741 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.857559 18765 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:32.857642 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 631) took 1632 ms. Trace:
I20260709 12:24:32.825630 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.858162 18766 rpcz_store.cc:276] 0709 12:24:31.225133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.225300 (+   167us) service_pool.cc:224] Handling call
0709 12:24:31.225651 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.488530 (+1262879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.857416 (+368886us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001d5454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:32.857578 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2855951744}
I20260709 12:24:32.854355 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2318) took 1180 ms. Trace:
I20260709 12:24:32.859830 22626 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:32.860244 22626 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:32.861415 18767 raft_consensus.cc:2410] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:32.861112 22626 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.856575 18915 rpcz_store.cc:276] 0709 12:24:31.604401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.608317 (+  3916us) service_pool.cc:224] Handling call
0709 12:24:31.608643 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.522950 (+914307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.855877 (+332927us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540008e654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:32.856071 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2090045696}
I20260709 12:24:32.814520 22579 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:32.838250 22536 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:32.870533 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:32.877018 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59731.3us
I20260709 12:24:32.870988 18848 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:32.871277 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:32.869585 22724 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:32.871878 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:32.870582 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:32.872577 19487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45480 (request call id 763) took 1630 ms (client timeout 2030 ms). Trace:
I20260709 12:24:32.872784 18771 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:32.873708 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2108) took 1343 ms. Trace:
W20260709 12:24:32.864286 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51284.5us
I20260709 12:24:32.892834 19491 raft_consensus.cc:2410] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:24:32.878157 19489 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:32.893014 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:32.892730 18847 rpcz_store.cc:276] 0709 12:24:31.530125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.534867 (+  4742us) service_pool.cc:224] Handling call
0709 12:24:32.873468 (+1338601us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540041afd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:32.873621 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243584896}
I20260709 12:24:32.859508 18841 rpcz_store.cc:276] 0709 12:24:31.673478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.853153 (+1179675us) service_pool.cc:224] Handling call
0709 12:24:32.853495 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.854038 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.854287 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.899224 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 1821) took 1125 ms. Trace:
I20260709 12:24:32.899902 18771 rpcz_store.cc:276] 0709 12:24:31.773655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.774489 (+   834us) service_pool.cc:224] Handling call
0709 12:24:32.851266 (+1076777us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:24:32.899140 (+ 47874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311424}
I20260709 12:24:32.900226 18847 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:32.879851 19487 rpcz_store.cc:269] 0709 12:24:31.242465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.244636 (+  2171us) service_pool.cc:224] Handling call
0709 12:24:32.872374 (+1627738us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54003075d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:32.872514 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105812224}
I20260709 12:24:32.900324 18841 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:32.901324 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.901849 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2334) took 1217 ms. Trace:
I20260709 12:24:32.901895 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2319) took 1228 ms. Trace:
I20260709 12:24:32.902253 18771 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:32.902422 18847 rpcz_store.cc:276] 0709 12:24:31.684859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.899603 (+1214744us) service_pool.cc:224] Handling call
0709 12:24:32.900046 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.901578 (+  1532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.901785 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.902575 18841 rpcz_store.cc:276] 0709 12:24:31.674950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.899314 (+1224364us) service_pool.cc:224] Handling call
0709 12:24:32.899831 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.901642 (+  1811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.901843 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.903576 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.904263 18841 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:32.905778 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.905580 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.904315 18771 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:32.910020 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:32.907140 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.864246 22740 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:32.875953 22626 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.908087 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.910359 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2101) took 1380 ms. Trace:
I20260709 12:24:32.910475 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:32.913880 19491 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:32.911217 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.915243 18765 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:32.901027 22572 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:32.911214 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.912097 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:32.913152 18846 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:32.914592 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.917017 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.920440 18765 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:32.921558 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.911600 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.922706 18771 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:32.923635 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.922133 18765 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:32.908856 22556 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:32.928642 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:32.917205 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.913663 18845 rpcz_store.cc:276] 0709 12:24:31.528040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.530194 (+  2154us) service_pool.cc:224] Handling call
0709 12:24:31.530804 (+   610us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:31.531366 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.531422 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:31.532311 (+   889us) log.cc:844] Serialized 52 byte log entry
0709 12:24:31.625476 (+ 93165us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:32.871322 (+1245846us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b180014bea0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf
0709 12:24:32.871475 (+   153us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.893988 (+ 22513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.894108 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.894170 (+    62us) raft_consensus.cc:1685] finished
0709 12:24:32.908161 (+ 13991us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.908331 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58595,"prepare.queue_time_us":690510,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3949,"raft.queue_time_us":35780,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":21688,"spinlock_wait_cycles":36529408,"thread_start_us":317764,"threads_started":2,"wal-append.queue_time_us":335269}
I20260709 12:24:32.929303 18915 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:32.910074 22486 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:32.925360 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.925360 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:32.927030 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:32.908408 18841 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:32.947525 19489 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:32.948011 18765 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
W20260709 12:24:32.933385 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.949205 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.949172 18771 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:32.928858 22645 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:32.949467 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:32.950547 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2100) took 1422 ms. Trace:
I20260709 12:24:32.950865 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.951040 18843 rpcz_store.cc:276] 0709 12:24:31.527722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.530488 (+  2766us) service_pool.cc:224] Handling call
0709 12:24:32.950341 (+1419853us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400327dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:32.950483 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777998592}
I20260709 12:24:32.951766 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.950776 18765 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.953290 18771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:47220
W20260709 12:24:32.953886 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.953963 18771 raft_consensus.cc:606] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:32.955585 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 318421us
I20260709 12:24:32.957051 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:32.958699 19457 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.536s (SENT)
I20260709 12:24:32.959360 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:32.960397 22589 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:32.960891 22589 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.961293 22589 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.960951 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:32.909601 22722 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:32.964993 19457 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.552s (SENT)
I20260709 12:24:32.918941 22739 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:32.967401 19492 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:32.970119 18915 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:32.971542 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:32.931311 22556 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.927455 22572 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:32.962817 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:32.978574 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:32.929308 22616 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:32.981552 18768 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:32.979754 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:32.926661 22740 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:32.947675 22486 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.963361 22743 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:32.947305 22557 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:32.989013 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:32.955067 22598 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:32.969769 22741 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.970129 22739 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.954599 22645 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:32.995360 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:33.006173 19489 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:33.000870 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:32.968698 22721 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:32.996541 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:33.008996 22645 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:33.014894 22742 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:24:33.006999 22610 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:33.021227 22610 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:33.021663 22610 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.007225 22638 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:24:33.027382 22638 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:33.027761 22638 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:33.028590 22638 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.029677 22725 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.030059 22638 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.030252 22725 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.031213 22577 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:33.032735 22725 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:33.008973 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:33.036441 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:33.037484 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2327) took 1354 ms. Trace:
I20260709 12:24:32.984675 22617 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:32.985046 22486 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.037845 18842 rpcz_store.cc:276] 0709 12:24:31.683256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.357043 (+673787us) service_pool.cc:224] Handling call
0709 12:24:33.026354 (+669311us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66eee 000000000036eb39 00007f335feda1e0 00007f335ffa30c4 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:24:33.037402 (+ 11048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3962112}
I20260709 12:24:32.994279 18771 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:32.955040 22579 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:32.983116 22556 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.045271 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:32.987344 22743 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.011726 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:33.045892 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 51950.5us
I20260709 12:24:32.975430 22536 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:24:33.079084 19489 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:32.991439 22532 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:24:33.088594 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.985353 22572 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:33.090646 18771 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:33.092329 18771 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:33.095934 18771 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:33.057529 22345 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:32.998348 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:33.083755 19491 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:33.010947 22739 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:33.085551 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:33.083002 18915 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:33.078188 22721 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:33.103278 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 105022us
I20260709 12:24:33.077651 22718 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:24:33.123164 22721 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.083048 22548 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:33.104805 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1826) took 1107 ms. Trace:
I20260709 12:24:33.104074 18771 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:33.009395 22741 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:33.116863 22610 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.044153 22746 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:24:33.086877 22743 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.112771 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:33.098599 22300 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:33.147270 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:33.108603 22608 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:33.154739 22726 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:33.155335 22726 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.141147 18921 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:33.048801 18768 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:33.111357 22532 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:33.140229 18772 rpcz_store.cc:276] 0709 12:24:31.997332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.177197 (+179865us) service_pool.cc:224] Handling call
0709 12:24:32.177567 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.383449 (+205882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.104525 (+721076us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540029d1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:33.104737 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471918336}
I20260709 12:24:33.160470 18772 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:33.105471 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.111642 22720 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:33.210748 18772 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:33.152854 18771 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:24:33.156630 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2314) took 1484 ms. Trace:
I20260709 12:24:33.212406 18772 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:33.211845 18848 rpcz_store.cc:276] 0709 12:24:31.672400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.844084 (+1171684us) service_pool.cc:224] Handling call
0709 12:24:32.844456 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.882660 (+ 38204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.156366 (+273706us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5400071054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:33.156559 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60566400}
I20260709 12:24:33.213708 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:33.214438 18848 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:33.215538 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:33.216385 18848 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:33.217290 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:33.169191 18765 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:33.155741 22726 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.108566 22552 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.218326 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:33.229040 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:33.148348 22536 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:33.235052 18848 raft_consensus.cc:2368] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7.
W20260709 12:24:33.237392 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 225754us
I20260709 12:24:33.237583 19489 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:24:33.237715 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:33.238336 18842 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.152218 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:33.240347 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 88231.1us
I20260709 12:24:33.241914 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:33.242774 19491 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:33.243379 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:33.244204 18765 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:33.245052 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:33.245159 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:33.208477 22720 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.248548 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:33.144447 22548 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.214104 22724 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:33.249871 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:33.246182 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:33.250515 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 460292us
I20260709 12:24:33.251930 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:33.232918 18772 raft_consensus.cc:2955] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:33.214013 22177 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:24:33.112627 22740 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:33.306993 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.368546 18773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 628) took 2282 ms (client timeout 1503 ms). Trace:
W20260709 12:24:33.371620 18773 rpcz_store.cc:269] 0709 12:24:31.085882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.100723 (+ 14841us) service_pool.cc:224] Handling call
0709 12:24:33.368219 (+2267496us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54001d6854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:33.368427 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013396352}
W20260709 12:24:33.372531 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 120657us
I20260709 12:24:33.372862 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:33.307785 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:33.373674 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:33.374037 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:33.233716 22536 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:33.376250 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:33.376865 18773 raft_consensus.cc:2368] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:24:33.377571 18765 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:33.380602 18773 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:33.382344 18842 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:33.383725 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:33.384410 18766 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:33.228634 22721 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:33.386381 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 136602us
I20260709 12:24:33.280164 22300 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:33.389793 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:33.389966 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.251057 22746 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:33.252686 22564 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:33.291126 22722 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:33.386097 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:33.375687 22635 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:33.254644 22720 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.380791 22536 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.393061 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:33.387836 22725 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:33.390067 22579 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:33.410043 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:33.411198 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:33.357542 22645 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:33.412812 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:33.375176 22589 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.416522 19457 leader_election.cc:400] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7.
I20260709 12:24:33.416860 19457 leader_election.cc:403] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:33.416906 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:33.417616 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:33.396831 22746 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:33.417909 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:33.418246 18915 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:33.283573 22674 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 12:24:33.401767 22724 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:33.419798 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:33.418310 22511 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:33.450834 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:33.451000 22511 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:33.451560 19489 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:33.451650 22511 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:33.421196 18914 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:33.421888 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:33.454757 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:33.444626 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.455857 18915 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:33.424597 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:33.966678 18918 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:33.423696 18917 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:33.443776 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2200) took 1799 ms. Trace:
I20260709 12:24:33.974874 18919 rpcz_store.cc:276] 0709 12:24:31.644673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.644869 (+   196us) service_pool.cc:224] Handling call
0709 12:24:33.443539 (+1798670us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400155754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:33.443705 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504914688}
I20260709 12:24:33.455555 18914 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.451135 18913 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:33.418309 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:33.981647 18921 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:33.469588 19489 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:33.427134 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:33.446178 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:33.438616 19492 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:33.414443 22177 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:33.420630 22300 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:33.428732 22486 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.482489 22511 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:33.441347 22564 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:33.423955 22447 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:33.426311 22509 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.994270 22486 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:33.994621 22511 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:33.998762 22718 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:33.433902 22589 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:33.999701 22718 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.326953 22532 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.002601 22300 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.003191 22300 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.443770 22548 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:33.456122 22552 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:33.414618 22617 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:34.007114 22617 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:34.007682 22617 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:33.485298 22556 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.012954 22556 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:33.484416 22572 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.017156 22572 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:33.478152 22626 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
I20260709 12:24:34.022432 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.023279 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:33.493893 22726 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.023926 22548 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:33.412667 22721 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:34.025359 22721 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.027585 22726 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:34.027216 22721 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:33.483767 22645 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:33.473095 22753 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:33.414968 22722 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:34.031324 18915 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:34.031176 22722 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.033982 22722 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:33.428270 22664 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.459189 22741 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.035113 22664 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.036880 19488 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:33.443490 22743 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.432036 22746 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:33.487970 22720 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:33.546795 22536 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.052934 22720 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:34.053934 22536 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:34.056530 22548 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:33.634923 22381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.387s	user 0.006s	sys 0.001s
W20260709 12:24:34.058136 22381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.819s	user 0.006s	sys 0.002s
I20260709 12:24:34.045001 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:33.635027 22613 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:34.059679 22613 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:33.671157 22610 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:33.682766 22612 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.000202 22511 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:34.132284 22511 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:34.132802 22511 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:34.134128 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:33.713250 18840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2326) took 2030 ms (client timeout 1609 ms). Trace:
W20260709 12:24:33.721238 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.750133 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 624) took 1204 ms. Trace:
I20260709 12:24:33.803185 18922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54084
I20260709 12:24:33.804538 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 635) took 1422 ms. Trace:
W20260709 12:24:33.814256 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.861256 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.894935 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:33.898861 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:33.912981 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.931603 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.944666 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.002s	sys 0.010s
W20260709 12:24:33.948673 18771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.014s
W20260709 12:24:34.140921 18771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.010s	sys 0.014s
I20260709 12:24:34.135821 22764 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 12:24:33.960767 18772 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.010s
I20260709 12:24:34.139536 18922 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:34.024297 18846 raft_consensus.cc:2368] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9.
I20260709 12:24:34.143227 18922 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.063683 22612 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.144308 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.145767 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.024027 18845 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:34.137233 22538 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:34.054520 18920 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:33.986364 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 559177us
I20260709 12:24:33.992515 22564 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.704602 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1825) took 1819 ms. Trace:
I20260709 12:24:33.987875 22695 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:34.456326 22695 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:34.457490 22695 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:33.485054 22739 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.440984 22300 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:33.868367 22747 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.554s	user 0.004s	sys 0.000s
I20260709 12:24:33.432684 22730 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:34.067217 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.069593 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.485309 22730 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:34.065521 18917 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:34.486429 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.487299 18843 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:34.487282 22730 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.488524 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.488833 22730 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.489341 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2140) took 1043 ms. Trace:
I20260709 12:24:34.083274 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1837) took 1477 ms. Trace:
I20260709 12:24:34.092679 22718 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:34.099712 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53135.4us
I20260709 12:24:34.115010 18914 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:34.491225 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2141) took 1045 ms. Trace:
I20260709 12:24:34.491600 18914 rpcz_store.cc:276] 0709 12:24:33.446120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.454369 (+  8249us) service_pool.cc:224] Handling call
0709 12:24:34.491136 (+1036767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.492725 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:34.493422 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.127125 22664 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.129506 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:34.494248 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.148787 22612 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:34.151415 18773 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.151611 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:34.152649 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.004s	sys 0.011s
I20260709 12:24:34.486378 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.490370 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.497222 18841 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:34.138986 18840 rpcz_store.cc:269] 0709 12:24:31.682959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.271240 (+588281us) service_pool.cc:224] Handling call
0709 12:24:33.712500 (+1441260us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400125054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:33.712805 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408065920}
I20260709 12:24:34.134335 22511 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.155969 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:34.140312 18769 rpcz_store.cc:276] 0709 12:24:32.382217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.382438 (+   221us) service_pool.cc:224] Handling call
0709 12:24:32.386017 (+  3579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.803257 (+417240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.802354 (+999097us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54001793d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:33.804270 (+  1916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957793536}
I20260709 12:24:34.164942 18922 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.137715 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:34.139204 18844 rpcz_store.cc:276] 0709 12:24:32.545704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.649982 (+104278us) service_pool.cc:224] Handling call
0709 12:24:33.749439 (+1099457us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b5400285854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:33.749852 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132721920}
I20260709 12:24:34.181449 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:34.181770 18918 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:34.183588 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:34.179333 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.208838 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1847) took 1215 ms. Trace:
W20260709 12:24:34.219515 18887 connection.cc:256] RPC call timeout handler was delayed by -1.7478928159998759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:24:34.231662 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 647) took 1145 ms. Trace:
W20260709 12:24:34.505357 18887 connection.cc:256] RPC call timeout handler was delayed by -1.6799392210000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 12:24:34.228754 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.505656 18772 rpcz_store.cc:276] 0709 12:24:33.086481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.219398 (+132917us) service_pool.cc:224] Handling call
0709 12:24:33.223517 (+  4119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.231583 (+  8066us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:34.142778 (+911195us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.230635 (+ 87857us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.231142 (+   507us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.231233 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:34.231326 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.231393 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.231577 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5532,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":17188,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":307,"thread_start_us":77601,"threads_started":2,"wal-append.queue_time_us":38923}
I20260709 12:24:34.506825 18920 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:34.507123 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.269135 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.508306 18843 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:34.508211 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 370682us
I20260709 12:24:34.269922 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 623) took 1745 ms. Trace:
I20260709 12:24:34.508270 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:34.294265 18738 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.652s (SENT)
I20260709 12:24:34.315796 22548 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:34.318490 22722 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:34.518663 18842 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:34.319000 22721 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:34.319360 22538 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:34.515661 18767 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:34.322607 22486 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:34.509044 18847 rpcz_store.cc:276] 0709 12:24:32.524797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.903502 (+378705us) service_pool.cc:224] Handling call
0709 12:24:32.903778 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.903988 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:32.917546 (+ 13558us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.252005 (+1334459us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18004995a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:24:34.268277 (+ 16272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.268378 (+   101us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:34.268475 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.268585 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.269707 (+  1122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13370,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":4190,"raft.queue_time_us":838,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"spinlock_wait_cycles":5437696,"thread_start_us":15798,"threads_started":1,"wal-append.queue_time_us":1369238}
I20260709 12:24:34.319969 22764 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:34.324695 18848 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:34.330221 19488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 747) took 3397 ms (client timeout 2119 ms). Trace:
I20260709 12:24:34.522735 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.523274 22764 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:34.523185 19488 rpcz_store.cc:269] 0709 12:24:30.943223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.948340 (+  5117us) service_pool.cc:224] Handling call
0709 12:24:34.329866 (+3381526us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b5400136854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:34.330092 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7071420672}
I20260709 12:24:34.523746 22764 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:34.325807 18765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.004s	sys 0.006s
I20260709 12:24:34.524729 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:34.344767 22617 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.527136 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:34.527390 22777 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:34.527791 22777 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:34.528249 22777 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.528492 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.528901 22617 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:34.347623 22509 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 6. Current term is 7.
I20260709 12:24:34.529857 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.530275 19486 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:34.530613 18844 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:34.530886 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.354014 22589 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.359926 22712 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:34.376682 22608 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.377808 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:34.379225 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:34.380761 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.381274 19483 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:34.061717 22613 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.543474 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:34.417730 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:34.427484 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:34.429661 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:34.544797 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.545522 18918 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:34.546200 22509 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.431686 19487 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:34.433701 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:34.548350 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:34.442807 22556 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.446511 22746 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.549054 18767 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.549310 22556 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.550338 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:34.540555 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:34.447496 22427 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:34.455186 18764 rpcz_store.cc:276] 0709 12:24:31.885077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.950917 (+ 65840us) service_pool.cc:224] Handling call
0709 12:24:31.987909 (+ 36992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.996888 (+  8979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.996927 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:32.925311 (+928384us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b2c00057528. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:24:32.934034 (+  8723us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.221052 (+287018us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.221112 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.221212 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.703762 (+482550us) raft_consensus.cc:1685] finished
0709 12:24:33.703805 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.704308 (+   503us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99292,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":2914688,"thread_start_us":238659,"threads_started":1,"wal-append.queue_time_us":362998}
I20260709 12:24:34.551035 22746 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:34.490604 18768 rpcz_store.cc:276] 0709 12:24:32.606152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.157545 (+551393us) service_pool.cc:224] Handling call
0709 12:24:33.157952 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.158405 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.158449 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.159057 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.366943 (+207886us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.366986 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.367058 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.082716 (+715658us) raft_consensus.cc:1685] finished
0709 12:24:34.082757 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.083035 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49812,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13852,"thread_start_us":158980,"threads_started":1,"wal-append.queue_time_us":188775,"wal-append.run_cpu_time_us":3767,"wal-append.run_wall_time_us":1072104}
I20260709 12:24:34.551874 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:34.552398 18915 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:34.552757 18764 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.585752 22604 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.056244 22552 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.589435 22552 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.589907 22741 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.466004 22739 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.044965 22743 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.467929 18916 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:34.469944 22564 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.474344 22300 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:34.496212 18914 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:34.597775 18914 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:34.489737 18917 rpcz_store.cc:276] 0709 12:24:33.445848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.970162 (+524314us) service_pool.cc:224] Handling call
0709 12:24:33.970631 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.486689 (+516058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.489108 (+  2419us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b54003548d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:34.489280 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217039616}
I20260709 12:24:34.515661 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:34.516088 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:34.602303 18913 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.516285 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.607537 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.608148 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:34.608652 18767 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:34.609968 18915 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:34.517777 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:24:34.518302 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 1.1322e+06us
I20260709 12:24:34.519917 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.623842 18913 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:34.345089 22447 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:34.523993 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.624976 22447 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:34.351586 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 633) took 1348 ms. Trace:
W20260709 12:24:34.526914 18765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.004s	sys 0.007s
I20260709 12:24:34.623935 18886 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:34.527817 18921 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:34.627267 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:34.540522 22712 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:34.625506 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.594956 22564 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:34.628579 22300 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:34.541628 18839 raft_consensus.cc:2368] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
W20260709 12:24:34.629555 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.629997 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.539469 22608 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.541635 22612 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:34.631242 22612 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:34.631620 22612 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:34.632566 22608 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.632682 22612 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.625666 18845 rpcz_store.cc:276] 0709 12:24:33.002929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.003549 (+   620us) service_pool.cc:224] Handling call
0709 12:24:33.003939 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.146698 (+1142759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.351252 (+204554us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400154ad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:34.351518 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344897408}
I20260709 12:24:34.536950 22589 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.634455 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.636034 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.636260 22589 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.527191 22721 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:34.542694 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:34.636907 18845 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:34.637025 22721 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.547645 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:34.637929 18766 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.624986 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2133) took 1202 ms. Trace:
I20260709 12:24:34.554119 18922 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:34.537535 19492 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:34.505247 18771 rpcz_store.cc:276] 0709 12:24:32.992990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.214676 (+221686us) service_pool.cc:224] Handling call
0709 12:24:33.215035 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:33.216880 (+  1845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.216909 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:33.226183 (+  9274us) log.cc:844] Serialized 52 byte log entry
0709 12:24:34.141656 (+915473us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:34.179480 (+ 37824us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.188601 (+  9121us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.191217 (+  2616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.208378 (+ 17161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.208483 (+   105us) raft_consensus.cc:1685] finished
0709 12:24:34.208498 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.208748 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43839,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":90,"raft.queue_time_us":13964,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":5233,"thread_start_us":853060,"threads_started":2,"wal-append.queue_time_us":226061}
I20260709 12:24:34.555177 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.524792 22764 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.569280 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 636) took 1564 ms. Trace:
I20260709 12:24:34.571511 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:34.573273 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 155766us
I20260709 12:24:34.575327 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:34.577744 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:34.577409 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 150233us
I20260709 12:24:34.645162 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:34.645807 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.578823 22486 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:34.646322 22075 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:34.579335 22548 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:34.646854 22075 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:34.647326 22548 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.647327 22075 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.648681 22548 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.650485 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54084 (request call id 2137) took 1195 ms. Trace:
I20260709 12:24:34.638274 22721 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.650998 18922 rpcz_store.cc:276] 0709 12:24:33.444766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.764003 (+319237us) service_pool.cc:224] Handling call
0709 12:24:34.639745 (+875742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.651947 22721 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.652432 18771 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:34.654217 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:34.654937 18770 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:34.655036 22764 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.655220 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:34.658818 18844 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:34.658681 22486 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:34.659022 22608 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:34.659781 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.650614 22300 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:34.661051 22608 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:34.585894 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53972.6us
I20260709 12:24:34.643850 18848 rpcz_store.cc:276] 0709 12:24:33.005088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.236150 (+231062us) service_pool.cc:224] Handling call
0709 12:24:33.236650 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.522855 (+1286205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.568929 (+ 46074us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003d9ad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:34.569192 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501294848}
I20260709 12:24:34.663306 22608 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:34.590621 22741 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.665848 22741 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:34.594894 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44742.5us
I20260709 12:24:34.658820 22604 raft_consensus.cc:2764] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:34.611855 18846 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:34.650998 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:34.611359 22552 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.517099 18919 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 9 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:24:34.667436 22300 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.667914 22300 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:34.668355 22300 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.517338 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.668927 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.669665 18846 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.669817 22552 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:34.612515 22511 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:34.672134 22608 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.615056 22556 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:34.620205 22427 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:34.673763 22608 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.676085 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:34.623935 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 106384us
I20260709 12:24:34.678916 18921 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:34.679368 22486 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:34.679940 18772 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:34.624918 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.520450 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:34.681402 18842 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:34.682096 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 388011us
I20260709 12:24:34.679932 22486 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.625514 22447 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.627928 22712 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:34.534202 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.541141 19489 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:34.691520 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:34.635699 18659 maintenance_manager.cc:643] P bcc1b451ad6147bd802f7cd458a81a5c: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.354s	user 0.202s	sys 0.091s Metrics: {"bytes_written":30264,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":8737,"dirs.run_cpu_time_us":497,"dirs.run_wall_time_us":35344,"drs_written":1,"lbm_read_time_us":469,"lbm_reads_lt_1ms":4,"lbm_write_time_us":89330,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":8871,"threads_started":1,"update_count":23}
I20260709 12:24:34.638764 18916 rpcz_store.cc:276] 0709 12:24:33.422585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.422729 (+   144us) service_pool.cc:224] Handling call
0709 12:24:33.423047 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.592430 (+1169383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.624656 (+ 32226us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000e3654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:34.624907 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2401429760}
I20260709 12:24:34.564766 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.567665 18773 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:34.640328 18839 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:34.640937 18918 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:34.644639 18764 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:34.659950 22743 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:34.661017 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:34.662931 18887 connection.cc:256] RPC call timeout handler was delayed by -1.5966686050001044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 12:24:34.585223 19490 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
W20260709 12:24:34.699214 18887 connection.cc:256] RPC call timeout handler was delayed by -1.5588686050000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 12:24:34.699620 18887 connection.cc:256] RPC call timeout handler was delayed by -1.5156928159999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 12:24:34.699893 18887 connection.cc:256] RPC call timeout handler was delayed by -1.3734928159997253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 12:24:34.699970 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45480 (request call id 777) took 1254 ms. Trace:
W20260709 12:24:34.700219 18887 connection.cc:256] RPC call timeout handler was delayed by -1.2895621180000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 12:24:34.700583 18887 connection.cc:256] RPC call timeout handler was delayed by -1.268168605000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
I20260709 12:24:34.700383 19490 rpcz_store.cc:276] 0709 12:24:33.445675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.445839 (+   164us) service_pool.cc:224] Handling call
0709 12:24:34.699735 (+1253896us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54006ff254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:34.699890 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257754368}
W20260709 12:24:34.701007 18887 connection.cc:256] RPC call timeout handler was delayed by -1.2281392210002195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23620000000000002s for a response
I20260709 12:24:34.663736 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.634202 22612 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:34.702231 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.702903 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.703881 18844 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:34.704898 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.705686 18844 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:34.608273 18840 raft_consensus.cc:2376] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6. Re-sending same reply.
I20260709 12:24:34.706699 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.707123 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.707803 18840 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.708170 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.673802 22427 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.622406 22718 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:34.709576 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.715363 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.567225 22613 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:34.615499 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:34.701457 18887 connection.cc:256] RPC call timeout handler was delayed by -1.0904761930000859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 12:24:34.719704 18848 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 5.
I20260709 12:24:34.725649 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.672891 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:34.726961 22564 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:34.726841 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:34.728189 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55385.6us
I20260709 12:24:34.728569 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:34.729040 18814 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:34.730924 18843 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:34.637962 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.735262 18840 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:34.747637 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55886.6us
I20260709 12:24:34.748783 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:34.627710 22532 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.752204 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:34.756659 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.757426 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:34.770783 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 77502.3us
I20260709 12:24:34.778635 22786 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:34.779202 22786 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:34.780540 22786 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.781688 22786 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:34.783051 18839 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:34.783669 22777 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.785226 18845 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:34.785642 22718 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:34.786670 22777 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.786350 22718 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.787135 18848 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 9 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:24:34.788349 18848 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:34.789135 18845 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:24:34.790540 22571 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:34.790781 18848 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:34.791600 22571 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.792006 22571 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.792356 22571 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.683961 22486 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.795585 18848 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:34.800443 22718 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.802749 18840 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:34.804904 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:34.805879 18773 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:34.806890 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77976.2us
I20260709 12:24:34.808126 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:34.808771 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:34.809693 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:34.810456 18764 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:34.809652 22556 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:34.811990 22556 consensus_queue.cc:1243] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:34.812585 22556 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:34.812170 22722 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:34.813095 22556 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.813825 22722 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:34.814690 22552 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:34.815191 22552 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.815428 22739 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:34.816018 22739 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:34.819195 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 142109us
I20260709 12:24:34.819638 22538 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:34.820200 22538 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.821331 22538 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.823632 22538 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.824741 18766 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:34.785521 22447 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.825673 18842 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:34.817332 22739 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.827556 22739 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.828383 22617 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.828821 22617 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.829144 22617 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.830526 22564 raft_consensus.cc:2764] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:24:34.835662 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.836534 18917 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:34.837131 22712 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.838016 22741 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:34.838668 22712 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:34.841995 22509 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.730568 22743 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:34.842643 22509 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.843014 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:34.843237 22743 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.844743 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:34.845127 22743 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.845273 22509 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:34.845495 19490 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:34.733266 22746 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.784305 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:34.826383 22447 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.848906 18773 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:34.860289 18846 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
W20260709 12:24:34.871649 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51547.5us
I20260709 12:24:34.875912 18770 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:34.834205 18660 maintenance_manager.cc:419] P bcc1b451ad6147bd802f7cd458a81a5c: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8908 bytes on disk
I20260709 12:24:34.890970 22552 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:34.892609 22552 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.894520 22548 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:34.895313 22548 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.757797 22532 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:34.896313 22532 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.896759 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:34.897019 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.897526 18839 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:34.897826 18917 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:34.838675 22741 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:34.900230 18659 maintenance_manager.cc:643] P bcc1b451ad6147bd802f7cd458a81a5c: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":311,"lbm_reads_lt_1ms":4}
I20260709 12:24:34.900882 22741 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.814162 22556 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.902871 22075 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.905195 22075 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:34.883715 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:34.895677 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:34.935010 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63743.4us
I20260709 12:24:34.936177 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:34.942376 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2444) took 1699 ms. Trace:
I20260709 12:24:34.942939 18765 rpcz_store.cc:276] 0709 12:24:33.243394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.378101 (+134707us) service_pool.cc:224] Handling call
0709 12:24:33.378347 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.384865 (+  6518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.384896 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.385342 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.626017 (+1240675us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:34.626421 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.941908 (+315487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.942006 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.942073 (+    67us) raft_consensus.cc:1685] finished
0709 12:24:34.942089 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.942311 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":764,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":59768,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":242,"thread_start_us":1540186,"threads_started":3,"wal-append.queue_time_us":212320,"wal-append.run_cpu_time_us":4571,"wal-append.run_wall_time_us":1004324}
I20260709 12:24:34.963927 18668 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.965787 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:34.966459 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.966567 18839 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
W20260709 12:24:34.973655 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.974504 18845 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:34.979197 18841 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:34.983249 22427 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:34.986788 18847 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:34.962186 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:34.991075 18922 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:24:34.991382 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 239258us
W20260709 12:24:34.994791 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.973515 22548 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:34.986162 22427 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:34.966037 18668 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 3 to 9, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 9 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.960979 22604 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:34.938587 22746 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.007233 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:35.019058 22788 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:24:35.025210 22571 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.010975 22604 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.026793 22604 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.028515 22532 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.030373 19492 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:35.033322 22786 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:35.034657 22612 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:35.035046 22612 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:35.035367 18738 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.771s (SENT)
I20260709 12:24:35.036104 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:35.037142 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.988502 22617 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.036083 18668 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 9, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 9 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:35.036001 22612 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.052970 19489 raft_consensus.cc:2368] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
W20260709 12:24:35.053571 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 325136us
W20260709 12:24:35.106611 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 134568us
I20260709 12:24:35.057938 22793 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:35.064018 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.066254 18943 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9a40 after lost signal to thread 17571
W20260709 12:24:35.112174 18943 debug-util.cc:398] Leaking SignalData structure 0x7b0800128400 after lost signal to thread 18705
I20260709 12:24:35.006502 22739 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.008692 22787 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:34.988952 22721 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:24:35.107019 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:35.134560 18943 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2e60 after lost signal to thread 18797
W20260709 12:24:35.135046 18943 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2d80 after lost signal to thread 18798
I20260709 12:24:35.135640 18668 catalog_manager.cc:5697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:24:35.147027 18943 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa5e0 after lost signal to thread 18872
W20260709 12:24:35.148389 18943 debug-util.cc:398] Leaking SignalData structure 0x7b08003661e0 after lost signal to thread 18946
W20260709 12:24:35.149099 18943 debug-util.cc:398] Leaking SignalData structure 0x7b0800288e40 after lost signal to thread 18947
W20260709 12:24:35.150344 18943 debug-util.cc:398] Leaking SignalData structure 0x7b0800348400 after lost signal to thread 19516
W20260709 12:24:35.150733 18943 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5da0 after lost signal to thread 19517
W20260709 12:24:35.152886 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45963.4us
I20260709 12:24:35.132203 22746 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:35.157618 18922 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:35.158571 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 123306us
W20260709 12:24:35.159765 18943 debug-util.cc:398] Leaking SignalData structure 0x7b08003e25e0 after lost signal to thread 22740
I20260709 12:24:35.156306 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:35.144402 22509 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:35.168651 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:35.166863 19489 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:35.170179 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:35.149171 22612 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.165161 18737 leader_election.cc:400] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
W20260709 12:24:35.168946 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.172942 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:35.173377 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:35.167230 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.206079 18917 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.162683 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:35.206972 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44359us
I20260709 12:24:35.207525 18737 leader_election.cc:403] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:24:35.161533 18668 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 7, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 7 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.172380 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:35.208705 18914 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:35.174757 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:35.176098 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:35.211199 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49559.3us
W20260709 12:24:35.172662 22785 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:35.213441 22712 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.213824 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:35.217964 19486 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.175477 18918 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:35.203236 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.220919 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.235410 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.185344 22571 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:35.237113 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:35.243767 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.145830 22787 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.218001 22743 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:35.249130 18886 connection.cc:256] RPC call timeout handler was delayed by -1.2212718159998985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 12:24:35.234694 22730 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 12:24:35.246904 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.248513 22782 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 12:24:35.255515 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 85496.7us
I20260709 12:24:35.256548 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:35.249248 22743 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:35.267356 18738 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.844s (SENT)
I20260709 12:24:35.255231 22556 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:24:35.248222 22695 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:24:35.275125 22796 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:35.275615 22695 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:35.276031 22695 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:35.276074 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:35.277482 22645 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.275628 22796 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:35.278447 22743 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.278069 22645 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.280510 22787 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:35.277081 22695 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.289319 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:35.244757 22604 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:35.339483 22794 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:24:35.346700 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:35.357753 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:35.363164 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:35.350160 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:35.365221 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:35.365563 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:35.366268 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 81648.4us
I20260709 12:24:35.367203 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:35.298228 22552 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:35.370975 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:35.372247 18770 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
W20260709 12:24:35.373449 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.373575 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:35.374215 18915 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:35.374436 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:35.340072 22787 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:35.344378 22548 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:35.379318 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 124292us
I20260709 12:24:35.371896 18913 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:35.381982 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:35.384253 18921 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.391911 22617 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:35.392854 18921 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
W20260709 12:24:35.367504 22300 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.699s	user 0.014s	sys 0.001s
I20260709 12:24:35.332974 22645 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:35.401973 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:35.403565 18773 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:35.404281 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 105469us
I20260709 12:24:35.398828 22803 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:35.407398 22803 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.407773 22695 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.409224 22447 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:35.409893 22447 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:35.410576 22764 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.411442 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:35.379070 22721 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.412518 22746 raft_consensus.cc:2764] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:24:35.412753 22721 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.412441 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:35.407852 22803 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.415755 22721 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:35.417590 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:35.417824 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:35.418663 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:35.419111 18847 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:35.411163 22447 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.421626 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:35.431957 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:35.433224 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:35.411182 22764 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.433672 22803 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.436364 22764 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:35.424145 18765 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:35.439325 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:35.439575 22604 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:35.440567 18765 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:35.429855 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:35.436451 22803 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:35.437224 18845 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:35.399269 22730 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:35.428843 18738 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.863s (SENT)
I20260709 12:24:35.379488 22777 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:24:35.451325 22486 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:35.451928 22486 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.452392 22486 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.452469 22777 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:35.453148 22777 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:35.454797 22739 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:35.455029 22796 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.455575 22739 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:35.456566 22796 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.457036 22739 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.458490 22548 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.371865 22613 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.450758 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:35.464941 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.475651 18764 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:35.464042 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:35.377278 22795 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:35.507071 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 132757us
I20260709 12:24:35.506004 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:35.499030 22730 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:35.515065 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 133517us
I20260709 12:24:35.489530 22788 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:35.504552 22645 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:35.535260 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71339.9us
I20260709 12:24:35.405813 22300 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.506873 22795 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:35.540130 19486 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:24:35.545807 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.548722 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:35.549767 22803 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:35.549980 22730 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.539644 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:35.497594 22743 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.518883 22787 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:35.525235 22613 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:35.564164 19491 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:35.566180 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:35.547304 22721 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:35.566937 18841 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:35.569011 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:35.569911 18773 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:35.571219 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:35.573176 19486 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:35.570902 18739 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 3.019s (SENT) [suppressed 47 similar messages]
I20260709 12:24:35.574290 18847 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:35.574816 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:35.504962 22777 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.575768 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:35.553149 22795 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:35.579717 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 150925us
I20260709 12:24:35.589146 19492 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:35.590085 18914 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:35.591495 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:35.592485 18922 raft_consensus.cc:2410] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:35.593081 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.595314 18915 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:35.596431 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:35.597059 18915 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.597395 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:35.598799 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:35.599618 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:35.599975 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:35.600276 18913 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:24:35.600620 18913 pending_rounds.cc:85] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
I20260709 12:24:35.600847 18913 pending_rounds.cc:107] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:24:35.601140 18913 raft_consensus.cc:2889] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:35.601751 22613 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:35.602172 22300 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:35.602790 22645 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.603683 22645 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:35.604069 22645 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:35.605248 18772 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:35.598871 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:35.601064 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:35.532099 22788 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.628270 18913 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:35.634728 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:35.612109 19491 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:35.646302 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:35.647222 18913 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.686954 18769 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:35.693691 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:35.610877 22427 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:35.697261 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:35.697871 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:35.694661 18914 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
W20260709 12:24:35.692389 18738 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.871s (SENT)
I20260709 12:24:35.696732 22613 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:35.702591 18886 leader_election.cc:400] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:24:35.703063 18886 leader_election.cc:403] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:24:35.702700 22613 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.703763 22800 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:24:35.705066 22800 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:35.705315 22613 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:35.706032 22613 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:35.707690 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:35.698340 19486 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:35.571655 22801 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 12:24:35.705197 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:35.610658 22538 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:35.724431 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.728569 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:35.610714 22803 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
W20260709 12:24:35.744446 22802 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:24:35.730192 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:35.745980 18769 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
W20260709 12:24:35.751191 22805 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:24:35.752122 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47040.2us
W20260709 12:24:35.753219 22806 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:35.753908 22803 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:35.754560 22803 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.755044 22803 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:35.728618 22721 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:35.743654 22801 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:35.759658 22801 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:35.760708 22801 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.756523 22746 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.762420 22746 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:35.757087 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.714660 22613 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:35.771242 22613 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.772696 22764 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:35.696771 22427 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:35.734876 18917 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 12:24:35.777482 18917 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
W20260709 12:24:35.778923 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 86582.6us
I20260709 12:24:35.780596 18913 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:35.782830 18915 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:35.805054 18765 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:35.802584 18772 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
W20260709 12:24:35.808693 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 212087us
I20260709 12:24:35.732358 22538 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:35.811154 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 245656us
I20260709 12:24:35.777804 22613 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.778975 22300 raft_consensus.cc:2764] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:35.814780 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:35.803004 22427 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:35.824796 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71624.1us
W20260709 12:24:35.824967 18738 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.923s (SENT)
W20260709 12:24:35.827598 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 252851us
I20260709 12:24:35.829054 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:35.831323 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 115499us
I20260709 12:24:35.838773 18765 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:24:35.842856 18765 pending_rounds.cc:85] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 8
I20260709 12:24:35.843122 18765 pending_rounds.cc:107] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:24:35.843379 18765 raft_consensus.cc:2889] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:35.821427 22075 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.847296 22824 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:35.847721 22824 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:35.848412 22612 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.003s
I20260709 12:24:35.848484 22486 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.851459 22486 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:35.846694 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:35.829922 22447 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.856801 18768 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:35.865974 22821 raft_consensus.cc:2764] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:24:35.867316 22721 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.870903 18920 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:35.814913 22617 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:24:35.871400 18920 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:35.895460 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48857.2us
W20260709 12:24:35.900501 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.875943 22730 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.906220 22730 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.906003 18920 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.906694 22730 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.907148 18920 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:35.909828 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 90144.3us
I20260709 12:24:35.845943 22746 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:35.896291 22712 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.001s
I20260709 12:24:35.926601 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:35.810006 22645 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.928733 18920 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:24:35.928975 22808 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:24:35.929160 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 101075us
I20260709 12:24:35.914101 22739 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:35.933449 18920 pending_rounds.cc:85] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
I20260709 12:24:35.942479 18920 pending_rounds.cc:107] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:24:35.942840 18920 raft_consensus.cc:2889] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:35.918679 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 96108.1us
I20260709 12:24:35.923544 22712 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
W20260709 12:24:35.936514 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.912992 22075 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:35.951097 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.944890 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:35.911491 22538 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.975616 22741 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:35.976251 22741 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:35.977154 22741 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:35.979357 18766 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:35.943312 22645 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:35.952162 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:35.848654 22824 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:35.943693 22486 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:24:35.959287 18738 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.024s (SENT)
I20260709 12:24:35.913117 22556 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 12:24:35.989802 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 53930.6us
I20260709 12:24:35.990818 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:35.991314 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 76273.3us
I20260709 12:24:35.993906 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:35.998036 22712 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.998314 18920 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:24:35.989174 22695 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.002s
I20260709 12:24:36.003161 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:36.012300 18764 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.006927 22824 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.991168 22808 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.990537 22447 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:24:35.982123 22795 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.117470 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:36.109493 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:36.078289 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:36.124511 19486 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:36.124511 19483 raft_consensus.cc:2410] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:36.090700 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.044380 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 85144us
I20260709 12:24:36.051783 22075 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.125934 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:36.024827 22532 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:36.125810 18738 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.070s (SENT)
I20260709 12:24:36.112937 18764 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:36.125797 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:36.098277 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.028867 18739 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.536s (SENT)
I20260709 12:24:36.034256 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:36.117470 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:36.128255 22730 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.141937 22835 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:36.093284 22608 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.144096 19483 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:36.144848 22795 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:36.052201 22832 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:24:35.996762 22427 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.109114 22830 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:36.028013 22695 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 12:24:36.140939 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 311972us
I20260709 12:24:36.131958 19484 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:36.046772 22792 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.833s	user 0.012s	sys 0.000s
W20260709 12:24:36.150411 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 121927us
W20260709 12:24:36.024190 22796 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.567s	user 0.014s	sys 0.000s
I20260709 12:24:36.151849 22808 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:36.237749 22695 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.238514 22695 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.131923 22788 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:36.242130 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:36.243253 19484 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:36.243726 22836 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:24:36.158881 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 80713.8us
I20260709 12:24:36.160151 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:36.245590 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 216763us
I20260709 12:24:36.246001 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:36.246788 18922 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:36.248663 22730 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.248771 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:36.160815 18738 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.114s (SENT)
W20260709 12:24:36.250188 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 89410.8us
I20260709 12:24:36.250309 22664 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:36.250939 22664 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.251322 22664 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:36.251441 18738 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.140s (SENT)
I20260709 12:24:36.251937 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:36.158854 22835 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:36.252857 22381 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:24:36.253018 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:36.253872 18922 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.161650 22801 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.120024 22803 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.171442 18668 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 9, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 9 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.252882 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:36.256527 22803 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:36.164529 22743 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.177487 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:36.258219 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 80823.1us
I20260709 12:24:36.258846 22741 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.259820 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:36.225147 22427 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.152499 22548 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.253087 22835 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.260907 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1864) took 1598 ms. Trace:
W20260709 12:24:36.262379 18739 leader_election.cc:336] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.557s (SENT)
W20260709 12:24:36.172904 22814 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.470s	user 0.003s	sys 0.003s
I20260709 12:24:36.251277 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:36.280390 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48273.1us
I20260709 12:24:36.261938 18771 rpcz_store.cc:276] 0709 12:24:34.662442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.663424 (+   982us) service_pool.cc:224] Handling call
0709 12:24:34.663798 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:34.664532 (+   734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.664574 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:34.734644 (+ 70070us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b2c00057528. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:24:34.754309 (+ 19665us) log.cc:844] Serialized 52 byte log entry
0709 12:24:35.143178 (+388869us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:35.143216 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.143284 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.016654 (+873370us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:36.260656 (+244002us) raft_consensus.cc:1685] finished
0709 12:24:36.260680 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.260843 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":85685248,"thread_start_us":328392,"threads_started":1,"wal-append.queue_time_us":398533}
W20260709 12:24:36.281402 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.305337 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:36.313720 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.309140 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:36.312021 22509 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 12:24:36.321512 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70127.3us
W20260709 12:24:36.322285 18738 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.146s (SENT)
I20260709 12:24:36.322716 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:36.280514 22695 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.314805 22803 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:36.330010 22712 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:36.308296 22645 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:36.331463 22645 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.331861 22645 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:36.312093 22552 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:24:36.313169 22764 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:24:36.334770 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 83601.5us
I20260709 12:24:36.345942 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:36.338893 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 86075.3us
I20260709 12:24:36.348590 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:36.343782 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:36.341392 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:36.312649 22808 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:36.339110 22743 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:36.353888 22075 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.354627 22075 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.357695 22075 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.359691 22612 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:36.359586 22552 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:36.361075 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.361016 22612 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:36.362555 22427 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.363575 22813 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.660s	user 0.011s	sys 0.032s
I20260709 12:24:36.364051 22830 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:36.364594 22830 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:36.363269 22427 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.361050 22381 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.368212 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:36.372637 18915 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.368562 18922 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:36.165102 22608 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.373844 18913 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:36.379856 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:36.382433 18913 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:36.339898 22739 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.384056 18921 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:36.381825 22831 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.381860 22075 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:36.362102 22612 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.369172 22800 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:36.378752 22695 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.386097 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:36.402832 19489 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:36.403306 19484 raft_consensus.cc:1813] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Handling vote request from an unknown peer 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:36.379923 22571 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:36.403371 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81145.8us
I20260709 12:24:36.340139 22819 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:36.374881 22796 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.410008 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.374928 22743 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:36.415536 18917 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:24:36.418205 19484 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:36.382081 22712 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:36.402683 22808 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.420311 22664 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.420806 22612 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.394187 18921 pending_rounds.cc:85] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 4
I20260709 12:24:36.436767 18921 pending_rounds.cc:107] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:36.416236 22075 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:36.375435 22486 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 12:24:36.434032 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48011.2us
I20260709 12:24:36.442790 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:36.437515 18921 raft_consensus.cc:2889] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:36.445549 18738 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.185s (SENT)
I20260709 12:24:36.446105 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:36.448868 18915 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:36.420365 22427 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.378515 22381 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:36.453471 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74117.2us
I20260709 12:24:36.365523 22830 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.404049 22739 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.474582 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:36.438763 22824 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:36.524858 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.529810 22822 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:36.530884 22822 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.535346 22822 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:36.555019 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 115096us
I20260709 12:24:36.423847 22695 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.434612 22796 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.564116 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2146) took 1154 ms. Trace:
W20260709 12:24:36.566619 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.566628 18845 rpcz_store.cc:276] 0709 12:24:35.409340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.411146 (+  1806us) service_pool.cc:224] Handling call
0709 12:24:36.563907 (+1152761us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5400285854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:36.564046 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57604992}
I20260709 12:24:36.405925 22831 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.475486 22427 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:36.569329 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:36.485138 22824 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.427959 22819 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.477295 22612 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:36.580590 18738 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.214s (SENT)
I20260709 12:24:36.586107 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:36.581584 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 651) took 1189 ms. Trace:
W20260709 12:24:36.587057 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 324711us
I20260709 12:24:36.570580 18921 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
W20260709 12:24:36.583010 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 108523us
I20260709 12:24:36.590149 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:36.562358 22803 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:36.587107 18766 rpcz_store.cc:276] 0709 12:24:35.381539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.381708 (+   169us) service_pool.cc:224] Handling call
0709 12:24:36.570642 (+1188934us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54002a1054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:36.570781 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372118784}
I20260709 12:24:36.578452 22812 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:36.583011 22824 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.604133 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:36.611472 18768 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:36.605991 22664 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.606631 22571 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:36.607115 22712 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:36.608340 18771 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:36.608853 22612 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:36.595580 22800 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:36.621711 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 179006us
I20260709 12:24:36.593775 22486 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.596964 22552 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.583695 22427 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.633481 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:36.635288 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.599895 22812 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.592097 22803 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:36.637647 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 69503.7us
I20260709 12:24:36.619516 22842 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.660912 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 78369.8us
I20260709 12:24:36.657902 22552 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.600122 22075 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.651314 22556 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:24:36.663662 22427 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.582772 22743 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.651597 22486 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.634845 22612 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.665307 22831 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:36.657932 22788 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.655997 22803 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:36.655701 22812 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:36.656883 22608 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:36.687350 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51764.4us
I20260709 12:24:36.689716 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:36.691066 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.638110 22712 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.734252 22835 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.756760 22712 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.663662 22695 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.697456 22486 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.757215 22835 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.764221 22788 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:36.770546 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.770918 22826 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.814s	user 0.005s	sys 0.002s
I20260709 12:24:36.697588 22816 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:36.772585 22816 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:36.773816 22816 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:36.698452 18738 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.242s (SENT)
I20260709 12:24:36.699880 22846 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:36.775792 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:36.701426 22851 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 12:24:36.776858 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84073.2us
I20260709 12:24:36.777770 22712 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:36.703595 22746 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:36.705185 22612 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.724313 22556 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.724912 22848 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:36.725250 22427 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:36.727326 22538 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.729279 22812 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:36.736009 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46439.2us
I20260709 12:24:36.706286 22552 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.737538 22764 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.740592 22381 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.724925 22808 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:36.743533 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 373526us
I20260709 12:24:36.739341 18668 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.660152 22842 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.747255 22739 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.778323 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:36.781023 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74412.3us
I20260709 12:24:36.791280 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:36.778635 22746 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:36.800717 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 131990us
I20260709 12:24:36.780768 22712 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.801944 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:36.803210 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.804382 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:36.801836 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:36.809803 18921 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:36.804822 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:36.810806 18913 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:36.809803 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:36.812008 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:36.754750 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.813160 18922 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:36.813517 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.814815 18739 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.773s (SENT)
I20260709 12:24:36.818548 22612 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:36.819065 22612 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.819561 22612 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:36.819125 22824 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.821789 22824 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.800725 22764 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.823100 22835 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:36.823571 22835 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:36.823951 22835 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:36.824913 22764 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.782536 22556 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.827282 22300 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:36.827911 22300 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:36.828888 22556 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.828835 22300 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.829730 22818 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.830330 22818 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.830819 22712 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.806980 22746 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.833432 22818 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.840137 22812 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.791013 22788 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:24:36.843168 22788 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:36.843792 18913 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:36.843760 22788 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:36.845745 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:36.845994 22788 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.847321 22788 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:36.845387 22824 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:36.848783 22824 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:36.849727 22824 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:36.850659 22075 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.851271 22075 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.852653 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:36.853688 22075 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.854183 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:36.855702 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:36.856084 22741 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.002s
I20260709 12:24:36.856673 19484 raft_consensus.cc:2410] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:36.857084 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:36.856647 22741 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:36.857945 19483 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:36.842872 22835 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.859019 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:36.840350 22842 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.860687 22819 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:36.844197 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:36.863231 18917 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
W20260709 12:24:36.870934 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 151612us
W20260709 12:24:36.871557 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.871940 18921 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:36.873093 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:36.876564 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:36.875738 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 207922us
W20260709 12:24:36.880594 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.883524 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:36.884429 18764 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:36.898356 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:36.899329 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:36.901937 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:36.894502 22538 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:36.903960 22538 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:36.906185 22538 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:36.907603 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:36.902702 18765 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:36.911751 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:36.873093 22842 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:36.875870 22800 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.876072 22827 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.894701 22818 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:36.920718 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58012.7us
I20260709 12:24:36.924743 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:36.926930 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:36.883368 22830 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.884855 22075 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:36.933786 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:36.919271 18767 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:36.934908 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:36.944093 18770 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:36.944618 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:36.944222 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:36.946178 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:36.947535 18845 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:36.948253 18846 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:36.811115 22645 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.056468 22777 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.047763 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.053542 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:37.050735 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.058717 18769 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:37.059661 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.051075 22803 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.060933 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.061817 22803 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.061903 18839 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:37.063326 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:37.065508 22859 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:24:37.066354 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:37.066803 22796 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.068055 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.039417 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:36.935809 22800 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.073092 18843 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:37.036046 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.047763 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.071866 18920 raft_consensus.cc:2368] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
W20260709 12:24:37.023193 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.989514 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:36.950512 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.001731 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.076985 18915 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:37.001394 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.080013 18913 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:37.077095 18847 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:37.082144 22712 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:36.999006 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.001248 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.083988 18917 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:37.077728 18848 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:37.084908 22816 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.085695 18848 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:37.085901 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.087265 18848 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:37.087371 22846 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:37.087934 22846 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:37.088879 18848 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:37.089051 22846 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.077303 18842 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:37.085024 18768 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:24:37.093601 18669 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 268) took 22166 ms (client timeout 15000 ms). Trace:
I20260709 12:24:37.095353 18842 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:24:37.083272 22712 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:37.103492 18668 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 10, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 10 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.107309 18668 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 8, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 8 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:37.109386 18668 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 8, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 8 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.121940 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.123113 18915 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:37.124926 18668 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 5 to 7, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:37.130491 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.131958 18920 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:37.134006 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.078425 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:37.116032 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:37.116278 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 237455us
I20260709 12:24:37.135191 19492 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:37.137948 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.138162 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.138782 18920 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:36.932106 22819 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.138818 18915 raft_consensus.cc:2368] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
I20260709 12:24:37.142089 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:36.945439 22818 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:37.094254 18669 rpcz_store.cc:269] 0709 12:24:14.927357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.927573 (+   216us) service_pool.cc:224] Handling call
0709 12:24:37.093231 (+22165658us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:31.643737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:31.660083 (+ 16346us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:31.660115 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:24:31.660131 (+    16us) tablet.cc:662] Decoding operations
0709 12:24:31.661776 (+  1645us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:31.661853 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:31.661881 (+    28us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:24:32.411472 (+749591us) tablet.cc:701] Row locks acquired
0709 12:24:32.415398 (+  3926us) write_op.cc:260] PREPARE: finished
0709 12:24:32.427500 (+ 12102us) write_op.cc:270] Start()
0709 12:24:32.463209 (+ 35709us) write_op.cc:276] Timestamp: P: 1783599872424655 usec, L: 0
0709 12:24:32.464296 (+  1087us) op_driver.cc:348] REPLICATION: starting
0709 12:24:32.547279 (+ 82983us) log.cc:844] Serialized 9003 byte log entry
0709 12:24:32.749692 (+202413us) op_driver.cc:464] REPLICATION: finished
0709 12:24:33.872596 (+1122904us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b18004227a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:33.872991 (+   395us) write_op.cc:301] APPLY: starting
0709 12:24:33.873165 (+   174us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:33.876699 (+  3534us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:33.876743 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:33.889409 (+ 12666us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:33.890760 (+  1351us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=46
0709 12:24:33.890821 (+    61us) write_op.cc:312] APPLY: finished
0709 12:24:33.904223 (+ 13402us) log.cc:844] Serialized 158 byte log entry
0709 12:24:33.923369 (+ 19146us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:33.924098 (+   729us) write_op.cc:454] Released schema lock
0709 12:24:33.924200 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:33.924926 (+   726us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:33.924968 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1850070,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":369361,"apply.run_cpu_time_us":10969,"apply.run_wall_time_us":51917,"num_ops":23,"prepare.queue_time_us":374158,"prepare.run_cpu_time_us":25035,"prepare.run_wall_time_us":1010487,"raft.queue_time_us":102047,"raft.run_cpu_time_us":12952,"raft.run_wall_time_us":404423,"replication_time_us":283403,"spinlock_wait_cycles":56119680,"thread_start_us":690415,"threads_started":5,"wal-append.queue_time_us":99734,"wal-append.run_cpu_time_us":11073,"wal-append.run_wall_time_us":2553081}]]}
I20260709 12:24:37.055334 22608 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.146332 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68024.1us
I20260709 12:24:37.115028 22548 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.944576 22855 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:37.140789 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:36.933490 22842 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.039500 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.144497 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.164824 18841 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.982991 22571 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.151189 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:37.058048 22777 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.157487 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.144528 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:37.159490 18668 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 10, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 10 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:37.171001 18920 raft_consensus.cc:2376] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9. Re-sending same reply.
I20260709 12:24:37.171339 18771 raft_consensus.cc:2410] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:37.161553 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.134027 22722 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.133376 22796 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.141969 22854 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:37.172003 18917 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:37.165936 18921 raft_consensus.cc:2368] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
I20260709 12:24:37.171666 18668 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:37.186829 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.151345 22818 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:37.132705 22803 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:37.136283 22869 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.066426 22612 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:37.182276 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.217515 18841 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:37.210364 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:37.228132 18768 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.229576 18844 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:37.144784 22695 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:37.173740 22764 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:36.950764 22827 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.201252 18668 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 5 to 7, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 7 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:37.250254 18668 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 7, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 7 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:37.161226 22739 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:37.134192 22822 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:24:37.133143 22556 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:24:37.115605 22830 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:37.238438 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 64188us
I20260709 12:24:37.186264 22854 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:37.150840 22819 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.180968 22831 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:37.263871 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.266597 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.283772 18921 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:37.167807 22548 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.196321 22824 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.187891 18920 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.204533 22867 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.161193 22608 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.277549 18765 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:37.199951 22722 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.285604 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.182204 22664 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:24:37.184856 22746 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.263260 22739 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.167474 22741 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:24:37.183151 22571 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.321899 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:37.323067 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.279657 22854 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.308395 18848 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:37.201088 22796 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.325034 18919 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:37.325771 22796 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:37.197821 22855 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.306983 22867 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.254261 22801 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:37.287828 22831 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:37.316735 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48439.4us
I20260709 12:24:37.318005 18768 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:37.264873 22381 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:24:37.246352 22803 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.321211 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.323242 18915 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:24:37.365658 18922 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:37.381479 18769 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:37.384104 18917 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:37.294137 22835 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.318667 22822 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:37.302840 18921 raft_consensus.cc:2376] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11. Re-sending same reply.
I20260709 12:24:37.265285 22869 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.313668 22739 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:37.390985 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 444895us
I20260709 12:24:37.313484 22876 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.300129 22824 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.432775 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.364650 22712 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.382437 22831 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:37.448475 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.480559 18917 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:37.453305 18920 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:37.447772 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:37.456019 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 83534.3us
I20260709 12:24:37.447342 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.291757 22486 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.458909 22801 consensus_queue.cc:1243] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:24:37.382467 22695 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:37.475286 22865 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:24:37.475819 22571 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.477171 22722 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.398968 22822 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:37.481637 18915 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:37.481451 18919 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:37.481814 18921 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:37.486732 18768 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:37.489792 22486 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.507266 22608 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:37.507160 22822 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.506246 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.487567 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.507598 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.509136 18920 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:37.509361 18915 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:37.510660 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:37.490518 22801 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.518860 22571 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:37.519122 22612 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:37.540074 22827 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.540833 22612 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:37.541230 22612 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:37.541438 22855 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:37.541654 22801 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.510439 22800 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.540150 22486 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.544031 22777 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:37.544255 22801 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:37.545066 22842 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:37.546607 22871 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:24:37.519274 22664 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:37.548341 22664 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:37.548804 22664 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:37.519694 22844 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:24:37.520188 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.554951 18915 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:37.556286 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.557008 18915 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.520823 22695 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:37.559171 22866 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:24:37.506283 22880 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.561388 22880 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.564390 22880 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:37.566123 22869 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.567539 22873 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:37.568562 22873 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:37.521663 22824 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.484262 22876 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:37.522749 22872 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:24:37.523643 22548 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.523912 22867 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:37.485999 22712 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.500351 22075 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:37.524853 22746 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.525713 22819 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.444010 22877 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 12:24:37.525959 22788 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.000s
I20260709 12:24:37.533595 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.613252 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.527081 22645 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:37.536044 22868 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:24:37.516569 22830 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:37.527108 22803 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:37.537936 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.628156 18917 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:37.539130 22822 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.542248 22612 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.549669 22664 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.576855 22876 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:37.584896 18772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.004s
I20260709 12:24:37.587615 19491 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:37.634377 22664 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:37.591519 18843 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.513s	user 0.013s	sys 0.003s
I20260709 12:24:37.635547 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
W20260709 12:24:37.600246 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 129371us
W20260709 12:24:37.634268 18772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.007s	sys 0.004s
W20260709 12:24:37.601894 18739 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.769s (SENT)
W20260709 12:24:37.605000 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 120059us
W20260709 12:24:37.640800 18739 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.933s (SENT)
I20260709 12:24:37.640900 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:37.644328 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.606534 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.613875 18769 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:37.616039 18914 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:24:37.585489 22855 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:37.626979 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.645731 18914 pending_rounds.cc:85] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 7
I20260709 12:24:37.646059 18914 pending_rounds.cc:107] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:24:37.646384 18914 raft_consensus.cc:2889] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:37.647562 18915 raft_consensus.cc:2410] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:37.647442 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.648401 18917 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:37.654984 19484 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.016s	sys 0.008s
W20260709 12:24:37.655503 19484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.017s	sys 0.008s
I20260709 12:24:37.655857 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.657678 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:37.658784 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.659548 18915 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:37.660893 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.661823 18915 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:37.665670 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.670951 18920 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:37.672480 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.673378 18920 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:37.674959 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.680120 22888 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:37.680263 22889 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:37.680711 22888 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:37.680814 22893 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:37.681615 22893 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.684334 22893 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:37.685534 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.687325 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:37.688303 18921 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:37.689258 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.680946 22889 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.694583 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.695273 19484 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:37.647115 22855 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:37.702543 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:37.711266 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53718.1us
I20260709 12:24:37.649276 22645 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:37.718534 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:37.723548 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.739799 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:37.741492 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.742136 18920 raft_consensus.cc:1813] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Handling vote request from an unknown peer 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:37.742730 18920 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:24:37.742619 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 103694us
I20260709 12:24:37.744794 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:37.746687 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:37.756502 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.700043 22511 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:37.712052 22803 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:37.759547 18920 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:24:37.681758 22888 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:37.763700 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 253117us
I20260709 12:24:37.764864 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.773888 18915 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:37.781323 18920 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:37.699553 22889 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:37.745457 22846 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:37.743563 22746 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.754220 22612 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.780190 22486 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:37.786496 22890 consensus_queue.cc:1175] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 8 status { last_received { term: 8 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 8 index: 4 } }
I20260709 12:24:37.787739 22867 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:37.756568 22873 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:37.816884 22873 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:37.818246 22873 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.820354 22873 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:37.714707 22831 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.766709 22511 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.823185 22511 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:37.823534 18916 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:37.824295 22831 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:37.825512 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:37.759126 22877 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:24:37.801663 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.807381 22722 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:37.811267 22486 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.815212 22712 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:37.730939 22854 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:37.795146 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.868291 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:37.868499 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 123794us
I20260709 12:24:37.831838 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.870733 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:37.872874 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.833483 22722 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.865345 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.873118 22645 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:37.874416 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:37.837687 22851 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:37.874117 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.878772 22904 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:37.878788 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.869374 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.882587 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.873745 22722 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.797832 22739 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.893795 19490 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:37.832360 18886 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.912051 19489 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
W20260709 12:24:37.914863 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 82602.2us
I20260709 12:24:37.895887 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:37.877290 22552 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:37.912655 22823 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:37.912794 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.880476 22830 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:37.874257 22712 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:37.923064 19487 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:37.898028 22890 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:37.917300 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.918116 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.938297 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.938426 19488 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:37.939028 18845 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:37.897866 19483 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:37.836133 22486 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.897722 22645 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:37.928810 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.942180 18841 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:37.897181 22818 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.004s
I20260709 12:24:37.926339 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:37.914005 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44736.8us
I20260709 12:24:37.952345 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:37.935974 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.936539 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.936909 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.910836 22904 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.956437 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:37.894439 22851 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.929863 22552 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:37.961436 22904 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:37.949831 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.952924 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:37.978740 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:37.935037 22556 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:24:37.955065 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.981611 18839 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:37.957106 18840 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:37.978740 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.930908 22800 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.930219 22869 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:37.959635 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.961228 19485 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:37.930442 22823 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.941239 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:37.931134 22788 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:37.931375 22830 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.871538 22855 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.954308 22538 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:24:37.965871 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.948189 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:38.005666 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53378.9us
I20260709 12:24:37.977948 18848 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:37.980190 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:38.006944 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:37.998816 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.953984 18843 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:38.008627 22905 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.008787 22856 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:37.991829 22075 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:38.009462 22381 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:38.010072 22075 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:37.982698 18844 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:37.957837 22427 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:24:37.954362 22712 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:37.968941 22851 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.017450 18844 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:38.018802 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:37.987226 22857 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:37.993268 22788 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.997196 22830 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:37.989707 18914 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:37.976483 22803 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:38.031100 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:37.995402 19484 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:38.013931 22548 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:38.035853 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 333440us
I20260709 12:24:38.032622 19484 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:37.988775 18916 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:38.006172 18919 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:37.958773 22818 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.009485 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:38.035370 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:37.970963 22552 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:38.020495 18739 leader_election.cc:336] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.904s (SENT)
I20260709 12:24:38.046607 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:38.021421 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:37.992403 22823 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.022141 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:37.984342 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:38.026904 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:38.029625 19483 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:38.050266 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:38.011132 22721 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:38.010161 22856 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 12:24:38.059036 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52178.5us
I20260709 12:24:38.011757 22869 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:38.047613 18848 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:38.061563 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:37.993511 22800 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.047621 19484 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.062968 18919 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:37.970147 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:38.051208 18914 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:38.008301 22886 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 12:24:38.042666 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:38.009207 22905 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.025600 22824 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:38.011247 22900 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:38.030316 22803 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:38.065640 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:38.066535 19491 raft_consensus.cc:2368] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:24:38.028277 22788 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.067101 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:38.045944 22893 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:38.055775 22897 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 12:24:38.043491 22901 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.020792 22511 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.045488 22894 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:24:38.066882 22777 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:38.079319 22909 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:24:38.081595 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61134.1us
W20260709 12:24:38.138648 18739 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.992s (SENT)
W20260709 12:24:38.139350 18739 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 2.037s (SENT)
I20260709 12:24:38.139734 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:38.140923 18739 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 2.133s (SENT)
I20260709 12:24:38.141686 22914 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:38.146189 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.148142 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.149129 18773 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:24:38.077351 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 330739us
I20260709 12:24:38.150283 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.068110 22867 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:38.013846 22645 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.096004 22854 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.102437 19486 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:38.103516 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2362) took 1175 ms. Trace:
I20260709 12:24:38.151049 18770 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:38.106633 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:38.107086 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.161412 18914 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:38.106432 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.127302 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:38.171784 18918 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:38.064669 22827 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:38.074411 22896 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.091964 22818 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.298702 18773 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:38.299918 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.081876 22877 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:38.154086 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.095489 22739 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.152067 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:38.067124 18841 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:38.079061 22803 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.159025 18847 rpcz_store.cc:276] 0709 12:24:36.928256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.081414 (+153158us) service_pool.cc:224] Handling call
0709 12:24:37.081784 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:37.136296 (+ 54512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.136334 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:37.156387 (+ 20053us) log.cc:844] Serialized 52 byte log entry
0709 12:24:37.317181 (+160794us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:37.382545 (+ 65364us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.394505 (+ 11960us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.576966 (+182461us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18002b0840. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:37.748814 (+171848us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18002b0840. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:24:37.749043 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.749119 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.806607 (+ 57488us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b18002b0840. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:38.029670 (+223063us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18002b0840. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:38.103185 (+ 73515us) raft_consensus.cc:1685] finished
0709 12:24:38.103219 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.103430 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98528,"prepare.queue_time_us":119785,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":82,"raft.queue_time_us":413794,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":15753,"spinlock_wait_cycles":43353344,"thread_start_us":64678,"threads_started":1,"wal-append.queue_time_us":261419}
W20260709 12:24:38.223814 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.290218 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.320411 18765 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:38.091056 22486 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.095266 22869 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.323191 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.303565 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.324349 18917 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:38.102285 22905 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:38.305814 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.306344 18769 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:38.067412 22831 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 12:24:38.296468 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.349535 18918 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:38.308804 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 156793us
I20260709 12:24:38.097774 22712 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:38.312623 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.353982 18768 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.087366 22075 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.103829 22876 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:38.132016 22903 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:38.100289 22901 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.316030 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:38.317067 18773 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:38.159996 22867 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.323895 18766 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.108891 22888 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:38.090888 22864 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.637s	user 0.003s	sys 0.007s
I20260709 12:24:38.102041 22511 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.126935 22777 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.330885 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.399732 18765 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.365873 22831 consensus_queue.cc:1243] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:24:38.314778 22877 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.305104 22896 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.343328 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.411259 18769 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:38.346570 22739 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:38.113083 22907 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:24:38.350625 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:38.449824 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 99439.8us
I20260709 12:24:38.315016 18913 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:38.326507 22827 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.318367 22721 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.367821 18922 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:38.368995 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.459761 18772 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.197546 22856 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 12:24:38.374003 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.329843 22746 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:38.383240 18768 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:38.495942 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:38.386523 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 351040us
I20260709 12:24:38.497385 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:38.402845 22486 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.498618 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:38.389277 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 73355.6us
W20260709 12:24:38.391778 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 330283us
I20260709 12:24:38.500984 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:38.138209 22552 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:38.403467 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 336433us
I20260709 12:24:38.363844 22876 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:38.365667 22903 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:38.409199 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 343621us
I20260709 12:24:38.384433 22867 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.417295 18766 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:38.419035 18917 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:38.399222 22712 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:38.403646 22777 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.499845 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.397143 18914 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:38.399597 22075 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.548611 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.506991 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.549845 18769 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:38.418968 22896 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:38.509258 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.554257 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.516923 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:38.507088 22812 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:38.410322 22877 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.448163 22857 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:38.480105 22556 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:38.479718 22511 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:24:38.492789 22721 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.570281 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.503643 22816 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:24:38.458081 22827 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:38.511898 22486 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.418751 22548 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:38.542550 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.588762 18768 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:38.503310 22764 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:38.520696 22915 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:24:38.556355 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:38.593849 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.461087 22739 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.564504 18773 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:38.564970 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:38.472493 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:38.597904 19489 raft_consensus.cc:2368] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:38.504540 22695 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:24:38.512349 22917 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:38.574673 18845 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.001s
I20260709 12:24:38.607352 18845 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:38.607631 18766 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:38.535996 18886 leader_election.cc:400] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:24:38.576797 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:38.608186 18772 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:38.608980 19491 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:38.544236 22746 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:38.533670 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:38.568360 22889 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.003s
I20260709 12:24:38.554977 22800 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:38.569975 22848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.022s	sys 0.057s
I20260709 12:24:38.536995 22894 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:24:38.573493 22721 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.573849 22556 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:38.478072 22722 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.001s
I20260709 12:24:38.595188 18769 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 7: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:38.599596 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.552690 22788 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:38.622845 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 150478us
I20260709 12:24:38.558653 22075 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.610849 19484 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:38.592002 22823 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.005s
I20260709 12:24:38.685352 22823 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.608314 18886 leader_election.cc:403] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:24:38.585319 22827 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.619143 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.687340 18772 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:38.610425 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:38.688052 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 77778.5us
I20260709 12:24:38.688939 22900 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:38.689520 22900 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.689987 22900 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:38.628126 22739 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:38.687199 22830 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
W20260709 12:24:38.630757 22911 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.548s	user 0.003s	sys 0.000s
I20260709 12:24:38.632020 18769 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:24:38.692528 22830 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.632311 22855 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.695083 22922 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:38.624213 22556 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.696125 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1906) took 1450 ms. Trace:
I20260709 12:24:38.633287 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:38.633786 22856 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.636850 22894 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:24:38.710687 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77468.6us
W20260709 12:24:38.711011 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 175237us
W20260709 12:24:38.640586 22916 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
W20260709 12:24:38.655275 22908 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:24:38.656493 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 122959us
I20260709 12:24:38.657315 22818 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:38.658463 22857 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:38.618232 22848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.022s	sys 0.057s
I20260709 12:24:38.659323 22876 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.663733 22552 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:38.680416 18739 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.772s (SENT)
I20260709 12:24:38.735554 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:38.736919 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56580us
W20260709 12:24:38.680420 22851 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.002s
I20260709 12:24:38.620147 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.738502 18766 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.689079 22823 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.620826 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.744382 18773 raft_consensus.cc:2410] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:38.632674 22764 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.752092 18773 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:24:38.727298 22739 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:38.696633 18771 rpcz_store.cc:276] 0709 12:24:37.245934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.246182 (+   248us) service_pool.cc:224] Handling call
0709 12:24:37.275093 (+ 28911us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:37.275740 (+   647us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:37.299973 (+ 24233us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.796069 (+496096us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b180042f220. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:24:37.958102 (+162033us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:37.973091 (+ 14989us) log.cc:844] Serialized 52 byte log entry
0709 12:24:37.973285 (+   194us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:37.973322 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.973396 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.630041 (+656645us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:38.695896 (+ 65855us) raft_consensus.cc:1685] finished
0709 12:24:38.695923 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.696066 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32110,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":6964,"raft.queue_time_us":1794,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":25742,"spinlock_wait_cycles":182442752,"thread_start_us":159701,"threads_started":1,"wal-append.queue_time_us":760213}
I20260709 12:24:38.706115 19484 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:38.718034 22922 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:38.709774 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2197) took 1242 ms. Trace:
W20260709 12:24:38.699769 22904 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.001s
W20260709 12:24:38.732064 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.695070 22830 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:38.760154 18915 rpcz_store.cc:276] 0709 12:24:37.467247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.779234 (+311987us) service_pool.cc:224] Handling call
0709 12:24:37.799475 (+ 20241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.800170 (+   695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.800221 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:37.800813 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:24:38.035472 (+234659us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:38.154739 (+119267us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:38.399352 (+244613us) log.cc:844] Serialized 14 byte log entry
0709 12:24:38.618355 (+219003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.618485 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.618533 (+    48us) raft_consensus.cc:1685] finished
0709 12:24:38.709459 (+ 90926us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.709685 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":512281,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":7023,"raft.queue_time_us":192810,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":48383,"spinlock_wait_cycles":18348288,"thread_start_us":707756,"threads_started":3,"wal-append.queue_time_us":296454}
I20260709 12:24:38.720671 22924 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:24:38.707190 22746 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:38.744813 18772 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:24:38.757244 18918 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:38.699740 18765 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:38.750054 22712 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.743403 22818 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:38.625396 22889 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.699364 22722 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.713598 22856 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.731901 22888 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:38.806738 22888 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.809366 22888 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:38.810961 22921 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.811643 22921 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:38.815289 22925 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:24:38.820962 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.719980 22894 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.774652 18766 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:38.754462 22931 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:38.838304 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.838515 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.838011 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:38.842614 18768 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:38.843132 18917 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:38.749825 22851 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.845394 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.819761 22788 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:38.766721 22881 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:24:38.852602 18917 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.795763 22739 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:38.852969 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:38.859185 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.845634 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2188) took 1458 ms. Trace:
W20260709 12:24:38.860795 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 304494us
I20260709 12:24:38.860836 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:38.861016 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.869951 18768 raft_consensus.cc:2376] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7. Re-sending same reply.
I20260709 12:24:38.864032 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:38.864283 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:38.870355 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:38.873032 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.873715 18915 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.873955 22777 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.851405 22867 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.879067 22867 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:38.880021 22803 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.549s	user 0.002s	sys 0.008s
I20260709 12:24:38.880513 22803 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.765102 22548 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.882189 22894 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.883769 22722 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.884985 22903 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.886245 22903 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.887423 22739 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.888406 22075 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:38.890456 22876 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.866551 18921 rpcz_store.cc:276] 0709 12:24:37.386762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.690128 (+303366us) service_pool.cc:224] Handling call
0709 12:24:37.694609 (+  4481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.710671 (+ 16062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.710706 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:37.736533 (+ 25827us) log.cc:844] Serialized 26 byte log entry
0709 12:24:38.164005 (+427472us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:38.164047 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.164121 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.845417 (+681296us) raft_consensus.cc:1685] finished
0709 12:24:38.845443 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.845578 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387,"raft.queue_time_us":5472,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":16690,"thread_start_us":373280,"threads_started":1,"wal-append.queue_time_us":708568}
I20260709 12:24:38.893318 22721 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.894555 22921 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.896828 22803 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:38.897737 18913 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:38.902832 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.903584 18766 raft_consensus.cc:2376] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6. Re-sending same reply.
I20260709 12:24:38.904590 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.878647 22818 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.906625 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:38.923532 19491 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.898280 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:38.912663 18917 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:38.927932 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:38.928153 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:38.928720 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58440.2us
I20260709 12:24:38.929363 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.928045 18766 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.929994 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:38.927217 18915 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:38.929383 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.933895 18765 raft_consensus.cc:2376] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10. Re-sending same reply.
W20260709 12:24:38.928932 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76079.5us
I20260709 12:24:38.936770 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.937675 18768 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:38.940848 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:38.943897 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:38.766919 22904 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:38.930009 18917 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.968312 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:38.946168 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:38.946985 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:38.944859 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:38.964670 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 100480us
I20260709 12:24:38.945894 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:38.978976 19487 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.979034 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:38.965881 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.934909 22921 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:38.970995 18764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.042s
I20260709 12:24:38.955018 22886 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:38.944121 22381 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:24:38.971918 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:38.973133 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.011390 18768 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:38.944793 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.923657 22645 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.850756 22931 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:38.954288 22867 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:38.879096 22486 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:38.967425 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.088474 18765 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:38.969446 22803 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.984063 18769 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 12:24:38.985733 18764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.009s	sys 0.043s
W20260709 12:24:38.971626 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.987941 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:39.019733 18917 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:39.033025 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:38.977231 22923 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:39.091709 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.113627 18768 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:39.068276 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52586.1us
I20260709 12:24:39.075891 18915 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:39.075685 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 170062us
W20260709 12:24:39.115155 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.078581 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 104012us
I20260709 12:24:38.949944 22924 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:39.089577 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.091601 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:39.093863 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 105991us
I20260709 12:24:38.983454 18847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:39.094302 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:39.122490 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.122987 18847 raft_consensus.cc:606] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:39.123363 18917 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:39.122545 18772 raft_consensus.cc:2376] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9. Re-sending same reply.
I20260709 12:24:39.124219 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:39.095852 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:38.986765 22921 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.983856 22552 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:39.120471 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:39.131606 18848 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:39.121251 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:39.132633 18844 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:39.123441 18768 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:39.124934 18917 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:39.089643 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:38.976114 18766 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:24:39.000191 22888 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:39.125996 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:39.129756 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:39.129976 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.188050 18843 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:39.188520 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:39.151252 18773 raft_consensus.cc:2410] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:39.082193 22877 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
I20260709 12:24:39.184571 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:39.186527 22933 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.190567 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64670.7us
I20260709 12:24:39.220139 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:39.197607 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.221567 18772 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:39.202427 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.203759 22888 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:39.203833 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.125526 22894 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:39.205886 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.236225 18766 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:39.129529 22848 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.246925 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.224772 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:39.127385 22803 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.111330 22886 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:38.970567 22922 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:39.262203 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.262984 18766 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:39.231609 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:39.232914 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.122053 22905 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.235030 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.211447 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:39.265795 18773 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:39.266091 18918 raft_consensus.cc:2368] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:39.139017 22921 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:39.095472 22846 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 12:24:39.253506 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:39.187199 22923 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:39.255383 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.095695 22645 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.258479 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.295356 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.267681 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.267684 18768 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:39.296118 18766 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:39.296284 18843 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:39.221349 22552 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:39.271049 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.303442 18840 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 6.
I20260709 12:24:39.304646 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:39.304535 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51152.7us
W20260709 12:24:39.277634 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 297515us
I20260709 12:24:39.189051 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.306596 18844 raft_consensus.cc:2368] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
I20260709 12:24:39.306756 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:39.267933 18916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.017s	sys 0.015s
I20260709 12:24:39.189293 22824 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:24:39.250372 22830 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:39.261415 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.313179 18772 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
W20260709 12:24:39.308236 18916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.017s	sys 0.015s
I20260709 12:24:39.311344 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.315513 18841 raft_consensus.cc:2368] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
I20260709 12:24:39.261435 22894 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:39.264142 22948 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:39.267815 22930 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:39.329356 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.321224 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.323807 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.332405 18766 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:39.331951 18915 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.343573 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.344291 18767 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:39.331928 18768 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:39.346803 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1922) took 1048 ms. Trace:
I20260709 12:24:39.347208 18769 rpcz_store.cc:276] 0709 12:24:38.298522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.693872 (+395350us) service_pool.cc:224] Handling call
0709 12:24:38.694285 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:39.093000 (+398715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.346518 (+253518us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b540017a7d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:39.346738 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665647872}
I20260709 12:24:39.218794 22933 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.342592 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:39.357004 22803 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:39.359308 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:39.346642 22721 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:39.398864 18842 raft_consensus.cc:2368] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:24:39.399915 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.400664 18842 raft_consensus.cc:2368] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
W20260709 12:24:39.401047 22827 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.714s	user 0.002s	sys 0.012s
I20260709 12:24:39.360937 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.401464 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.401481 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.402226 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:39.359999 18739 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 2.908s (SENT)
I20260709 12:24:39.366670 19487 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:39.362383 22917 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.403439 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.403209 22552 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.403784 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:39.403569 22917 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.406411 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:39.407228 18914 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:39.407390 19491 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
W20260709 12:24:39.407655 19456 leader_election.cc:336] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.165s (SENT)
I20260709 12:24:39.402691 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:39.371822 22556 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.676s	user 0.003s	sys 0.008s
I20260709 12:24:39.230315 22877 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.378662 22851 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:39.379479 22936 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:24:39.382766 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.383230 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.437072 18772 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:39.384694 22645 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:39.386191 22777 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:39.360980 22923 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.387076 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:39.426961 22900 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.736s	user 0.012s	sys 0.004s
I20260709 12:24:39.388849 22904 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:39.390606 22894 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:39.284402 22905 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.392324 18921 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.393252 22889 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:39.393833 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.400494 22888 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.402035 22886 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:39.318424 22929 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:24:39.402637 18842 raft_consensus.cc:2368] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:39.257908 22848 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:39.412842 18840 raft_consensus.cc:1813] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Handling vote request from an unknown peer 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:39.479566 18840 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:39.370688 18848 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:39.480770 18848 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.486449 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.486740 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.487226 18771 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:39.487803 18772 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:39.486369 18768 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:39.418586 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 285092us
I20260709 12:24:39.511788 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:39.516038 18842 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:39.515282 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.435751 22556 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:39.433383 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.518294 18772 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:39.434329 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 467088us
W20260709 12:24:39.427361 22855 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.732s	user 0.005s	sys 0.017s
W20260709 12:24:39.422334 22764 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.666s	user 0.004s	sys 0.007s
I20260709 12:24:39.387871 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:39.453927 18767 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:39.463454 19490 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:39.431710 22924 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:39.465260 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:39.522246 18766 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:39.544263 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.418139 18773 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:39.496949 19456 leader_election.cc:336] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.960s (SENT)
I20260709 12:24:39.499724 18840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:39.504434 18765 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:39.549731 18840 raft_consensus.cc:606] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:39.549849 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52948.2us
W20260709 12:24:39.506943 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.550870 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.028s (SENT)
I20260709 12:24:39.551290 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:39.492372 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 185727us
W20260709 12:24:39.521086 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.517688 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:39.441502 22948 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:39.413858 22827 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.527222 22824 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.527522 22764 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:39.529036 22819 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:39.590724 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:39.529701 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.594517 18922 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:39.594638 18767 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:39.594936 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:39.531700 18844 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:39.595633 18915 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.536677 18839 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
I20260709 12:24:39.538213 22931 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:39.538720 22721 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:39.538112 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:39.540422 22903 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.654s	user 0.004s	sys 0.006s
I20260709 12:24:39.542793 22901 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:39.543210 19491 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.546657 18769 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:39.490654 22904 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:39.548331 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:39.552767 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.520140 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.553013 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:39.587800 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:39.587930 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2205) took 1660 ms. Trace:
I20260709 12:24:39.589509 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1921) took 1420 ms. Trace:
I20260709 12:24:39.461401 22900 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.536036 22556 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:39.595781 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72393.4us
I20260709 12:24:39.605247 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.587586 22824 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:39.616215 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:39.646309 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.588541 22608 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:39.594262 22924 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:39.649797 18768 raft_consensus.cc:2376] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10. Re-sending same reply.
I20260709 12:24:39.615667 18773 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:39.650218 18766 raft_consensus.cc:2376] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10. Re-sending same reply.
I20260709 12:24:39.627678 18916 rpcz_store.cc:276] 0709 12:24:37.927317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.037925 (+110608us) service_pool.cc:224] Handling call
0709 12:24:38.038222 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.038374 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:38.765978 (+727604us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.586825 (+820847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.586894 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:39.586962 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.587280 (+   318us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.587790 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26870,"prepare.queue_time_us":554694,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":37,"raft.queue_time_us":178781,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":1299703,"threads_started":3,"wal-append.queue_time_us":696605}
I20260709 12:24:39.717293 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 780) took 1158 ms. Trace:
W20260709 12:24:39.631793 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 83534.1us
I20260709 12:24:39.694623 18772 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:39.693017 18770 raft_consensus.cc:2368] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12.
I20260709 12:24:39.629658 18920 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:39.656911 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 118902us
I20260709 12:24:39.643406 18771 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:39.783910 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:39.683413 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 369552us
W20260709 12:24:39.722702 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.785127 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.684311 18915 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:39.786082 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:39.781070 19490 rpcz_store.cc:276] 0709 12:24:38.558803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.559128 (+   325us) service_pool.cc:224] Handling call
0709 12:24:38.559474 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.525756 (+966282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.716978 (+191222us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54005c0dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:39.717192 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078407936}
I20260709 12:24:39.628832 18764 rpcz_store.cc:276] 0709 12:24:38.168614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.185862 (+ 17248us) service_pool.cc:224] Handling call
0709 12:24:38.311626 (+125764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.311876 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.311939 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.330414 (+ 18475us) log.cc:844] Serialized 26 byte log entry
0709 12:24:39.093155 (+762741us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:39.093201 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.093288 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.589261 (+495973us) raft_consensus.cc:1685] finished
0709 12:24:39.589287 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.589439 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":745059,"threads_started":1,"wal-append.queue_time_us":870780}
W20260709 12:24:39.666518 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 54086us
W20260709 12:24:39.794600 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 178458us
I20260709 12:24:39.828131 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:39.612228 22876 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.721s	user 0.006s	sys 0.006s
W20260709 12:24:39.828364 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44550.7us
I20260709 12:24:39.786127 18771 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:39.595448 22788 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:39.711293 22908 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:24:39.839048 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:39.845090 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 257335us
I20260709 12:24:39.845693 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:39.712002 22896 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.149s	user 0.021s	sys 0.005s
I20260709 12:24:39.852202 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:39.854522 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 494489us
I20260709 12:24:39.855813 18764 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:39.856513 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:39.857314 18768 raft_consensus.cc:2376] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10. Re-sending same reply.
I20260709 12:24:39.626241 22721 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:39.858981 22939 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 12:24:39.859103 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.860103 18764 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:24:39.860725 22937 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.338s	user 0.000s	sys 0.000s
I20260709 12:24:39.861096 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.861519 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:39.861871 18764 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:39.862182 18767 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.862596 22896 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.864385 22856 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:39.865123 22896 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:39.863088 22965 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:24:39.867254 22951 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:24:39.867440 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.666064 22956 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.869513 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:39.685279 22381 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:39.868206 18764 raft_consensus.cc:2376] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11. Re-sending same reply.
I20260709 12:24:39.869997 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:39.715929 22942 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 12:24:39.918329 18767 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:39.718336 22830 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:39.612574 22075 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.861433 22966 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:24:39.858214 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:39.881508 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 100089us
I20260709 12:24:39.856726 18773 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:39.854621 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:39.886788 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47840.2us
I20260709 12:24:39.889999 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:39.685675 22943 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:24:39.705960 22903 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:39.838864 22941 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:24:39.881992 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:39.881067 22856 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.879506 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:39.914031 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2221) took 1072 ms. Trace:
I20260709 12:24:39.870040 22956 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.852519 22924 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:39.686045 22822 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:39.933137 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:39.826854 22800 raft_consensus.cc:2764] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:24:39.838523 22548 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:39.934783 18764 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:39.941376 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 680) took 1091 ms. Trace:
W20260709 12:24:39.862262 22952 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:24:39.860709 22721 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:39.934645 22538 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:39.630798 22948 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.311s
I20260709 12:24:39.667690 22851 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:39.937208 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:39.965726 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107618us
W20260709 12:24:39.942189 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60327.7us
I20260709 12:24:39.870570 22904 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:39.783757 22917 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:39.942708 19491 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:39.943246 18773 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:39.974748 18737 leader_election.cc:400] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:39.975370 22958 raft_consensus.cc:2764] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:24:39.975934 22973 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:24:39.977119 22901 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:39.882720 22876 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:39.955747 18888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.017s	sys 0.029s
I20260709 12:24:39.712090 22764 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.247s
I20260709 12:24:39.978453 18767 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:40.007275 18771 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:39.938457 18772 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:39.965771 18845 rpcz_store.cc:276] 0709 12:24:38.849948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.850075 (+   127us) service_pool.cc:224] Handling call
0709 12:24:38.850489 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.899670 (+ 49181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.899703 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.900263 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:24:39.243894 (+343631us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:39.243957 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.244061 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.941130 (+697069us) raft_consensus.cc:1685] finished
0709 12:24:39.941154 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.941312 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48742,"raft.queue_time_us":50034,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":343226,"threads_started":1,"wal-append.queue_time_us":601523}
I20260709 12:24:39.945587 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:40.100149 18888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.021s	sys 0.035s
I20260709 12:24:39.939441 18768 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:39.964023 18766 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:40.080096 18764 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:40.021404 18770 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:40.145246 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 659) took 1035 ms. Trace:
I20260709 12:24:40.147078 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:40.153123 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:39.955101 22381 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:40.163371 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 661) took 1052 ms. Trace:
I20260709 12:24:39.936064 22830 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:40.148466 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 202983us
I20260709 12:24:40.154618 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 669) took 1042 ms. Trace:
I20260709 12:24:40.151983 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 663) took 1041 ms. Trace:
I20260709 12:24:40.162070 18767 rpcz_store.cc:276] 0709 12:24:39.109926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.928806 (+818880us) service_pool.cc:224] Handling call
0709 12:24:39.929119 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.144789 (+215670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.145159 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:39.985090 22921 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 12:24:40.146239 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2151) took 1203 ms. Trace:
W20260709 12:24:40.160861 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 223728us
I20260709 12:24:39.966291 22823 raft_consensus.cc:993] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:40.215744 18772 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:40.217587 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:39.957406 22877 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:40.198503 22962 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:40.197811 22381 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.147284 22486 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.175642 22827 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.175899 22764 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:40.059610 22800 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:40.089790 22924 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:40.201236 22972 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 12:24:39.951152 22905 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:39.942798 18913 rpcz_store.cc:276] 0709 12:24:38.841815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.900746 (+ 58931us) service_pool.cc:224] Handling call
0709 12:24:38.908383 (+  7637us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:38.946726 (+ 38343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.946757 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:38.968219 (+ 21462us) log.cc:844] Serialized 52 byte log entry
0709 12:24:39.454780 (+486561us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:39.501993 (+ 47213us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.514987 (+ 12994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.515065 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.715684 (+200619us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b4800062358. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:24:39.870830 (+155146us) raft_consensus.cc:1685] finished
0709 12:24:39.913776 (+ 42946us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.913967 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43430,"prepare.queue_time_us":46862,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3538,"raft.queue_time_us":84329,"raft.run_cpu_time_us":10627,"raft.run_wall_time_us":777286,"spinlock_wait_cycles":9347840,"thread_start_us":374401,"threads_started":1,"wal-append.queue_time_us":602762}
I20260709 12:24:40.150522 22851 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:39.942167 22856 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.202576 22918 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:40.165735 22538 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:39.966434 22548 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.151080 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:40.245962 22900 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.174093 18764 rpcz_store.cc:276] 0709 12:24:39.110965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.984022 (+873057us) service_pool.cc:224] Handling call
0709 12:24:40.057009 (+ 72987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.151720 (+ 94711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.151919 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.145442 18737 leader_election.cc:403] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.197600 22970 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.258165 22968 raft_consensus.cc:1081] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
W20260709 12:24:40.284693 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 310105us
I20260709 12:24:40.167850 18773 rpcz_store.cc:276] 0709 12:24:39.110474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.942596 (+832122us) service_pool.cc:224] Handling call
0709 12:24:39.942902 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.162941 (+220039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.163283 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.288617 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1929) took 1091 ms. Trace:
I20260709 12:24:40.289142 18773 rpcz_store.cc:276] 0709 12:24:39.197026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.287430 (+1090404us) service_pool.cc:224] Handling call
0709 12:24:40.287882 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.288137 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.288176 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.288250 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:40.288308 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.288383 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.288536 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.173987 18770 rpcz_store.cc:276] 0709 12:24:39.112431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.977322 (+864891us) service_pool.cc:224] Handling call
0709 12:24:39.977688 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.154071 (+176383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.154531 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:39.952980 22956 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:39.998981 22855 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:39.936730 22964 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:40.296195 22855 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.216274 18839 rpcz_store.cc:276] 0709 12:24:38.943338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.943553 (+   215us) service_pool.cc:224] Handling call
0709 12:24:40.146044 (+1202491us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400205654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:40.146177 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361022720}
I20260709 12:24:40.296413 22964 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.104466 22904 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:40.297742 22904 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.298631 22855 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.298800 22987 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:40.299494 22987 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:40.299990 22987 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.222697 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:40.226184 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:40.305037 18916 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.305455 18918 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 6: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:40.306967 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:40.308471 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:40.171357 22722 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.310698 22722 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.311285 22722 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.172528 22917 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:39.959311 22822 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:40.315459 22964 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:40.315954 22822 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:40.236789 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 672) took 1123 ms. Trace:
I20260709 12:24:40.318619 18772 rpcz_store.cc:276] 0709 12:24:39.113160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.853396 (+740236us) service_pool.cc:224] Handling call
0709 12:24:40.236708 (+383312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.148524 22848 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:40.237000 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 410011us
I20260709 12:24:40.322747 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:40.199035 22903 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.239841 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:40.323465 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:40.324190 18841 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.326917 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:40.327816 18847 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:40.330989 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:40.331983 18843 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:40.243952 18922 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:40.333352 18922 pending_rounds.cc:85] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 3
I20260709 12:24:40.333698 18922 pending_rounds.cc:107] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:40.334005 18922 raft_consensus.cc:2889] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:40.335938 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:40.336912 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.234123 22948 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:40.338099 22948 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.341303 22948 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.265273 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:40.253119 22958 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.342041 22948 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.342849 22958 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.343293 22948 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.344475 18913 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:40.345472 22958 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.345897 18918 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.257903 22894 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:40.351150 22894 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:40.352520 22894 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.233125 22921 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.356650 22921 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:40.279704 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 128673us
I20260709 12:24:40.359002 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:40.359589 22904 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.360641 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:39.942517 22963 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:40.243952 18919 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:40.364276 22963 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:40.364812 22963 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:40.365486 18916 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:40.368181 22921 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:40.369024 22921 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.366036 22963 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.336880 18922 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:39.954412 22075 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.374924 22822 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.346131 22958 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:40.203553 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:40.348345 22948 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.376680 18769 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:40.376982 22948 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:40.376665 22958 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.380290 18922 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:40.381953 22958 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.383285 18773 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:40.383308 22904 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:40.362269 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:40.385854 22822 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:40.398609 22958 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:40.258271 22962 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:40.411939 18839 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:40.268085 22918 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:40.419144 18764 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:40.253115 22486 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.435591 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:40.277204 22548 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:40.408003 22921 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.263770 22800 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.261538 22764 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.440069 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:40.683588 22538 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.561113 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:40.555078 18918 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:40.438753 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 683) took 1276 ms. Trace:
W20260709 12:24:40.447121 19456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.010s	sys 0.047s
I20260709 12:24:40.546442 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1927) took 1424 ms. Trace:
W20260709 12:24:40.688395 19456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.017s	sys 0.054s
W20260709 12:24:40.689165 19456 leader_election.cc:336] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.165s (SENT)
I20260709 12:24:40.459991 18841 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:40.688532 18768 rpcz_store.cc:276] 0709 12:24:39.122167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.161512 (+1039345us) service_pool.cc:224] Handling call
0709 12:24:40.169384 (+  7872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.169703 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:40.260834 (+ 91131us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.545851 (+285017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.545933 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:40.546016 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.546132 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.546321 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":193710,"prepare.queue_time_us":141243,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":137458,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":53979,"thread_start_us":170673,"threads_started":2,"wal-append.queue_time_us":350705}
W20260709 12:24:40.690882 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 473548us
I20260709 12:24:40.541572 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1925) took 1424 ms. Trace:
I20260709 12:24:40.465063 18847 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
W20260709 12:24:40.546835 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 199961us
I20260709 12:24:40.687276 18764 rpcz_store.cc:276] 0709 12:24:39.165580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.272018 (+1106438us) service_pool.cc:224] Handling call
0709 12:24:40.410347 (+138329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.438329 (+ 27982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.438669 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:40.695333 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 491815us
I20260709 12:24:40.541926 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:40.697572 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:40.690035 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:40.701321 18739 leader_election.cc:400] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:40.692112 18771 rpcz_store.cc:276] 0709 12:24:39.116847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.145087 (+1028240us) service_pool.cc:224] Handling call
0709 12:24:40.145430 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.145645 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:40.356582 (+210937us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.541113 (+184531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.541194 (+    81us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:40.541260 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.541346 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.541501 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166418,"prepare.queue_time_us":165039,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":168413,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":26822,"thread_start_us":152136,"threads_started":2,"wal-append.queue_time_us":15979}
I20260709 12:24:40.701844 18739 leader_election.cc:403] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.701857 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:40.699765 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 157928us
I20260709 12:24:40.704573 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:40.703531 19456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.886s (SENT) [suppressed 38 similar messages]
W20260709 12:24:40.677840 22983 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:24:40.713869 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:40.416514 22822 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:40.588488 22980 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:24:40.587833 22971 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
W20260709 12:24:40.586584 22977 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 12:24:40.587275 22978 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.316s	user 0.000s	sys 0.000s
I20260709 12:24:40.740676 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:40.741724 18919 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:40.714171 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:40.442601 22918 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.558486 22960 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.721581 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:40.722707 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:40.555290 22827 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.558835 22904 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:40.699226 22903 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.417968 22976 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:40.585523 22967 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:40.719696 22901 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:40.710033 22917 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:40.715170 22855 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:40.706067 22695 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:40.745700 22905 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.711018 22746 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:40.714907 22963 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:40.710047 22964 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:40.746800 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:40.747257 18738 leader_election.cc:400] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
I20260709 12:24:40.786830 22903 raft_consensus.cc:2764] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:40.581275 22900 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 12:24:40.762843 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:40.787673 19491 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:40.471460 22851 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.725155 22822 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.749437 22995 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:40.833972 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:40.753916 22960 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.855450 18738 leader_election.cc:403] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.717185 22712 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:40.855544 19492 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:40.859197 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 96479.9us
I20260709 12:24:40.738510 22962 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.867938 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2378) took 1335 ms. Trace:
W20260709 12:24:40.811568 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.764374 22917 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.756848 22827 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.885097 18846 rpcz_store.cc:276] 0709 12:24:39.532420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.547183 (+ 14763us) service_pool.cc:224] Handling call
0709 12:24:39.547646 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:39.583975 (+ 36329us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:39.584010 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:39.613631 (+ 29621us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.000695 (+387064us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:40.000757 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.000842 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:40.867673 (+866831us) raft_consensus.cc:1685] finished
0709 12:24:40.867695 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.867856 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44775,"raft.queue_time_us":191,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":13722,"thread_start_us":314534,"threads_started":1,"wal-append.queue_time_us":612260}
I20260709 12:24:40.879485 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:40.887867 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 184385us
I20260709 12:24:40.854480 22856 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:40.867285 22963 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:40.888952 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 141838us
I20260709 12:24:40.871474 22695 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:40.793726 22905 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.899134 18738 leader_election.cc:400] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
I20260709 12:24:40.902339 18738 leader_election.cc:403] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.903308 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:40.906428 22722 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.004s
I20260709 12:24:40.792905 22967 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.861625 22964 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.909463 18738 leader_election.cc:400] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:24:40.915642 18738 leader_election.cc:403] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.895078 22903 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
I20260709 12:24:40.893198 22851 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.900023 22695 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.877986 22995 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.910774 22901 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.937254 18917 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.910965 22904 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:40.928498 22695 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:40.949361 22905 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:40.950007 22905 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:24:40.909937 22722 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:40.952253 22722 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:40.951925 22963 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:40.930191 22712 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:40.957989 18917 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:40.942292 22800 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:40.960965 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51592.7us
I20260709 12:24:41.014977 18738 leader_election.cc:400] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
I20260709 12:24:41.015573 18738 leader_election.cc:403] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.964044 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.016629 19488 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:41.011904 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:41.019307 19490 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.940336 22903 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.026050 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:40.967150 23002 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:24:40.960508 22987 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.660s	user 0.011s	sys 0.001s
I20260709 12:24:41.029376 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.039335 19487 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:41.026940 22712 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.036589 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:41.037294 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:40.958323 22548 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.056474 18738 leader_election.cc:400] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11.
I20260709 12:24:41.057896 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.059665 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.061465 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.063165 19490 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:41.040244 22904 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:41.056054 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.071085 19487 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:41.046064 22905 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:41.056874 23000 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 12:24:41.071947 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:41.070040 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.047201 22967 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.060662 22486 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.052918 22764 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.041149 22987 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:41.089286 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 164407us
W20260709 12:24:41.087440 19456 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.625s (SENT)
I20260709 12:24:41.034346 22903 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.167690 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.085302 22904 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.088677 22905 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.161167 22967 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.184456 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:41.185693 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 102131us
W20260709 12:24:41.186348 19456 leader_election.cc:336] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.654s (SENT)
W20260709 12:24:41.187172 19456 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.718s (SENT)
I20260709 12:24:41.187901 19492 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:41.199136 18916 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:41.188509 19456 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.045s (SENT)
W20260709 12:24:41.177374 23002 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:24:41.166942 22800 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.191083 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.210081 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.210888 18764 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:41.211927 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.212533 18764 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.212565 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:41.191253 18886 leader_election.cc:336] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.233s (SENT)
I20260709 12:24:41.171363 22960 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:41.201972 19456 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.632s (SENT)
I20260709 12:24:41.189844 22886 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.181654 22822 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.215898 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.215274 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:41.193019 23013 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.202728 23007 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:41.258314 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67079.9us
I20260709 12:24:41.282647 22963 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.283605 22963 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:41.295114 23014 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:24:41.297546 22712 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10.
W20260709 12:24:41.274773 19456 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.731s (SENT)
I20260709 12:24:41.275157 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1928) took 2142 ms. Trace:
I20260709 12:24:41.305718 18767 rpcz_store.cc:276] 0709 12:24:39.132724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.222338 (+1089614us) service_pool.cc:224] Handling call
0709 12:24:40.222746 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:40.223122 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.223166 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:40.236410 (+ 13244us) log.cc:844] Serialized 52 byte log entry
0709 12:24:40.584097 (+347687us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:40.718720 (+134623us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.722290 (+  3570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.722425 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.274922 (+552497us) raft_consensus.cc:1685] finished
0709 12:24:41.274945 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.275086 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18436,"prepare.queue_time_us":21995,"prepare.run_wall_time_us":3404,"raft.queue_time_us":15378,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":17009,"spinlock_wait_cycles":28995840,"thread_start_us":317797,"threads_started":1,"wal-append.queue_time_us":508766}
I20260709 12:24:41.308624 22995 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.309051 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.309914 18767 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:41.267781 23004 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.257s	user 0.000s	sys 0.002s
W20260709 12:24:41.305735 22830 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.090s	user 0.006s	sys 0.006s
I20260709 12:24:41.312724 22830 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.315986 22830 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.271153 23013 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.320097 18764 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:41.311597 22695 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.323110 18767 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:41.193238 22967 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.320977 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2477) took 2420 ms. Trace:
I20260709 12:24:41.327785 18769 rpcz_store.cc:276] 0709 12:24:38.900369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.927333 (+1026964us) service_pool.cc:224] Handling call
0709 12:24:39.927685 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.377243 (+449558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.320714 (+943471us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54000aebd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:41.320915 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031770368}
I20260709 12:24:41.331426 18769 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:41.333798 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.334816 18918 raft_consensus.cc:2410] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:24:41.335049 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.335979 18764 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:41.345193 22974 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:41.345772 22974 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:41.347038 22967 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.348408 18913 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:41.334619 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.260167 22960 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.217801 22800 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.358896 22788 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:41.363029 22788 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.363469 22788 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:41.366748 22974 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.368428 22974 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.368906 22905 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.369758 22905 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.370946 22831 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:41.371402 22831 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:41.332011 23003 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 12:24:41.324700 22827 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.332845 22995 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.380120 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.379534 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.387555 18768 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:41.331604 22962 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.389539 22788 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.399958 22800 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.400780 22903 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.404902 22901 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8.
I20260709 12:24:41.411474 22712 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.372305 22831 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.361924 22964 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:41.418269 22950 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.251s	user 0.000s	sys 0.006s
I20260709 12:24:41.448828 18913 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:41.449925 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 378090us
I20260709 12:24:41.423823 22548 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.400098 22695 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.440511 22962 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.454351 22831 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.440955 22995 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.446744 22712 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.461433 22901 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:41.481801 18772 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:41.488602 22962 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.488850 22712 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.491039 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:41.496708 22851 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.003s
I20260709 12:24:41.512455 22933 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.491174 22901 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.516868 22075 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.517275 22901 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:41.515573 23020 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:24:41.519687 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.520177 22788 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.521607 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:41.525846 18739 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.927s (SENT)
I20260709 12:24:41.533715 23013 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.535908 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:41.536244 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.536957 18919 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:41.543009 22695 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:41.543519 22854 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:41.558805 22695 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:41.559222 22886 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:41.536326 22995 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.585832 22857 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.559944 22967 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:24:41.587275 22905 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.603644 22819 raft_consensus.cc:993] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:41.604327 22819 raft_consensus.cc:1081] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:41.608119 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 815) took 1348 ms. Trace:
I20260709 12:24:41.608886 18922 rpcz_store.cc:276] 0709 12:24:40.259825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.394420 (+134595us) service_pool.cc:224] Handling call
0709 12:24:40.394860 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.720277 (+325417us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:40.729400 (+  9123us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.911929 (+182529us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.912005 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:40.912078 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.607838 (+695760us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54003b4554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:41.607893 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.608049 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2760,"prepare.queue_time_us":9462,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":42,"raft.queue_time_us":9571,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3493,"spinlock_wait_cycles":747883264,"thread_start_us":179311,"threads_started":1,"wal-append.queue_time_us":280674}
I20260709 12:24:41.588423 22857 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.597213 22824 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:41.612751 22918 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.003s
I20260709 12:24:41.613256 22918 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.615502 22918 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.617873 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:41.618213 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.621025 18764 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:41.622073 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.624047 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.625543 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.626557 22075 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:41.627076 22075 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.627415 22075 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.622684 23013 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:41.628240 23013 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:41.628352 22857 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.612835 22855 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:41.623502 22824 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.629144 23013 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.626199 22901 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:41.629153 22855 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:41.631561 22855 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.632645 22855 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.636729 22075 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.637662 22901 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:24:41.641381 23025 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:24:41.644608 18738 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.933s (SENT)
I20260709 12:24:41.645077 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.646929 22976 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.648710 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 812) took 1404 ms. Trace:
I20260709 12:24:41.649108 18916 rpcz_store.cc:276] 0709 12:24:40.243992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.381835 (+137843us) service_pool.cc:224] Handling call
0709 12:24:40.382511 (+   676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.199857 (+817346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.648469 (+448612us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54000f6254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:41.648646 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877357312}
I20260709 12:24:41.651667 18921 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.651204 22901 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.653959 22901 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:41.655812 18765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2483) took 2753 ms (client timeout 2233 ms). Trace:
W20260709 12:24:41.656277 18765 rpcz_store.cc:269] 0709 12:24:38.902139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.089315 (+187176us) service_pool.cc:224] Handling call
0709 12:24:41.655554 (+2566239us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54001b12d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:41.655697 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878511872}
I20260709 12:24:41.657375 22901 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.657594 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.658680 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.659176 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 818) took 2756 ms. Trace:
I20260709 12:24:41.659356 18764 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:41.639789 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.660045 22900 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:41.660364 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.660637 22900 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:41.661060 18764 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:41.660955 22901 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:41.661899 22901 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.661593 22900 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.662873 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1931) took 2382 ms. Trace:
I20260709 12:24:41.662802 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.663419 18770 rpcz_store.cc:276] 0709 12:24:39.280480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.294960 (+1014480us) service_pool.cc:224] Handling call
0709 12:24:40.295435 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.324365 (+ 28930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.324415 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.324474 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:40.324522 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.662631 (+1338109us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54002a1a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:41.662677 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.662817 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65875712}
I20260709 12:24:41.664848 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.665535 18765 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:41.665987 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.665469 18770 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:41.660431 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.666862 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.667588 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.668126 18765 raft_consensus.cc:2376] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11. Re-sending same reply.
I20260709 12:24:41.665491 19490 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:24:41.670099 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.670363 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.670742 19490 raft_consensus.cc:1813] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.670938 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.671351 19490 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 9 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:41.671175 18770 raft_consensus.cc:2376] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11. Re-sending same reply.
I20260709 12:24:41.671620 18768 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:41.672271 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.666685 19489 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
I20260709 12:24:41.659559 19484 rpcz_store.cc:276] 0709 12:24:38.903008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.909562 (+  6554us) service_pool.cc:224] Handling call
0709 12:24:38.909884 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.973854 (+ 63970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.973903 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.974566 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 12:24:39.565098 (+590532us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:39.565141 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.565226 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.654309 (+2089083us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b24002f8808. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357d249c4 00007f3357d22acb 00007f3357edddc9 00007f3357edda55 00007f3357edcfb0 00007f335ab53488 00007f335ab53be8 00007f335ab2b398 00007f335ab2676a 00007f335ab25bb6
0709 12:24:41.658842 (+  4533us) raft_consensus.cc:1685] finished
0709 12:24:41.658866 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.659096 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58272,"raft.queue_time_us":56684,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7230,"spinlock_wait_cycles":11587840,"thread_start_us":456134,"threads_started":1,"wal-append.queue_time_us":1095334}
I20260709 12:24:41.676616 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.676615 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.677585 18916 raft_consensus.cc:2410] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:24:41.678077 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.662106 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.678721 18765 raft_consensus.cc:2376] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10. Re-sending same reply.
I20260709 12:24:41.679167 18764 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.679646 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.696365 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:41.696930 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.697154 18916 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.697152 22075 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.693775 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.698835 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.699064 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:41.699647 19490 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:41.706144 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:41.663398 22900 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.662806 22901 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.715495 18916 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:41.703814 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.725426 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.726534 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:41.727002 18770 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:41.716176 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.727890 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.722916 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.729810 18768 raft_consensus.cc:2376] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12. Re-sending same reply.
I20260709 12:24:41.729977 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.730749 18770 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:41.730865 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.731721 18768 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:41.730893 22712 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:41.732635 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.733513 22712 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:41.733767 18768 raft_consensus.cc:2376] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11. Re-sending same reply.
I20260709 12:24:41.734634 22712 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.735101 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.736045 18768 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:41.709123 22922 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:24:41.736991 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.738432 22486 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.739043 22486 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.739528 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.732422 22905 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:41.732584 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.740777 23005 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:41.741237 23005 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:41.741418 18767 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:41.741654 23005 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.742479 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.743652 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.744168 18767 raft_consensus.cc:1813] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.744598 18767 raft_consensus.cc:2368] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10.
I20260709 12:24:41.746987 18921 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:41.747372 18767 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:41.747846 22930 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:41.748322 22930 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.748708 22930 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.750111 19484 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:24:41.750504 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.751674 22933 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.752360 18767 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:24:41.752605 22933 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.753191 22963 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.755069 22933 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.751542 22788 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:41.755735 22788 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.756161 22788 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.756484 22917 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.709085 22976 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:41.758739 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 684) took 1436 ms (client timeout 1664 ms). Trace:
W20260709 12:24:41.759191 18839 rpcz_store.cc:269] 0709 12:24:40.322315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.322469 (+   154us) service_pool.cc:224] Handling call
0709 12:24:41.758565 (+1436096us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b5400125054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:41.758676 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203370240}
I20260709 12:24:41.751519 22958 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:41.758427 22976 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.761379 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.696342 22974 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:41.766182 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 90736us
I20260709 12:24:41.731691 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.767257 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.768455 19484 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:41.715839 22948 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:41.771974 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:41.773363 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:41.777101 18764 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:41.776518 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:41.779628 18886 leader_election.cc:400] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10.
I20260709 12:24:41.780107 18886 leader_election.cc:403] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:41.771389 19490 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:41.762125 22905 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.780745 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:41.781901 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.763962 22958 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:41.784713 19456 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:41.787045 18767 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:41.785995 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:41.788159 18770 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:41.783476 22831 raft_consensus.cc:2764] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:24:41.790580 22886 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:41.794972 23013 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.795496 22886 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:41.795838 23013 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.796490 22886 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.798085 18768 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:41.788676 22854 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:41.798856 22854 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.790864 22964 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.799311 22854 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:41.799626 22964 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:41.800457 22993 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.934s	user 0.003s	sys 0.000s
I20260709 12:24:41.776911 22948 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.783797 22888 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:41.781474 22963 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.782905 22933 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.806059 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1926) took 2688 ms. Trace:
I20260709 12:24:41.806538 18766 rpcz_store.cc:276] 0709 12:24:39.117152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.151777 (+1034625us) service_pool.cc:224] Handling call
0709 12:24:40.207815 (+ 56038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.209125 (+  1310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.209156 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.222160 (+ 13004us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.502860 (+280700us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:40.502933 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.503035 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.799790 (+1296755us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:41.802803 (+  3013us) raft_consensus.cc:1685] finished
0709 12:24:41.802824 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.805984 (+  3160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":16600,"spinlock_wait_cycles":7600896,"thread_start_us":237324,"threads_started":1,"wal-append.queue_time_us":531313}
I20260709 12:24:41.789757 22958 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:41.813230 18770 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:41.774808 22974 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.820935 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.819387 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.804276 22948 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.822824 18770 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:41.823019 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2214) took 2983 ms. Trace:
I20260709 12:24:41.788056 22905 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.823431 18920 rpcz_store.cc:276] 0709 12:24:38.835058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.836171 (+  1113us) service_pool.cc:224] Handling call
0709 12:24:38.836475 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.783466 (+946991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.817747 (+2034281us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b5400032ad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:41.817948 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791415040}
I20260709 12:24:41.817021 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.829535 18767 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:41.827837 18770 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 12:24:41.827519 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.830355 18770 pending_rounds.cc:85] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 7
I20260709 12:24:41.833738 18770 pending_rounds.cc:107] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:24:41.834082 18770 raft_consensus.cc:2889] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:41.820674 22888 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:41.842291 18764 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:41.847026 22888 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.850955 22974 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:41.851452 23022 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 12:24:41.854673 22963 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:41.854880 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 787) took 1134 ms. Trace:
I20260709 12:24:41.855348 19491 rpcz_store.cc:276] 0709 12:24:40.721017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.721190 (+   173us) service_pool.cc:224] Handling call
0709 12:24:41.854697 (+1133507us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b54004812d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:41.854815 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80538368}
I20260709 12:24:41.855386 22963 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:41.860507 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.820325 22967 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:24:41.865505 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:41.867112 22922 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.869290 22905 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.842340 22855 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.869797 22922 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:41.870330 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.870682 18914 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:41.872334 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:41.832255 22964 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.873317 18842 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:24:41.874187 18846 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:41.868219 22976 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:41.878765 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.836637 22827 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:41.868705 22987 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.876633 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.879104 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.887784 18839 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:41.879987 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:41.888092 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:41.888270 18913 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:41.879926 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.884130 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.890487 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.891119 18839 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:41.888782 18847 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:41.894750 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.886250 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.896952 18765 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:41.889776 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.900089 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.900955 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.903916 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 685) took 1581 ms. Trace:
I20260709 12:24:41.904150 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.904351 18845 rpcz_store.cc:276] 0709 12:24:40.322730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.323494 (+   764us) service_pool.cc:224] Handling call
0709 12:24:40.323816 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.720212 (+396396us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:40.739127 (+ 18915us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.859340 (+120213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.859402 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:40.859452 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.903648 (+1044196us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54001081d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:41.903694 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.903858 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28752,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":2116,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4890,"spinlock_wait_cycles":910993280,"thread_start_us":119293,"threads_started":1,"wal-append.queue_time_us":184910}
I20260709 12:24:41.908944 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.909456 18847 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:41.910593 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.911407 19492 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:41.913705 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2238) took 1691 ms. Trace:
I20260709 12:24:41.915046 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1930) took 2662 ms. Trace:
I20260709 12:24:41.914276 18915 rpcz_store.cc:276] 0709 12:24:40.221937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.222618 (+   681us) service_pool.cc:224] Handling call
0709 12:24:40.247223 (+ 24605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.366708 (+119485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.366758 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.366822 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:40.366898 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.913441 (+1546543us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400334854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:41.913491 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.913648 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274086144}
I20260709 12:24:41.915614 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.915493 18773 rpcz_store.cc:276] 0709 12:24:39.252340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.290335 (+1037995us) service_pool.cc:224] Handling call
0709 12:24:40.317486 (+ 27151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.396094 (+ 78608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.914829 (+1518735us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b54001c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:41.914985 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150635776}
I20260709 12:24:41.916385 18913 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:41.911059 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.918984 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.919811 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:41.920822 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.921754 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.922212 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.923767 18914 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:41.924422 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:41.925026 18918 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:41.926342 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.888232 22905 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.927400 22905 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.929886 22905 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.934254 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.881472 22800 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.870187 22855 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.942724 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.952728 18847 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:24:41.939683 18814 connection.cc:256] RPC call timeout handler was delayed by -1.0376758479997079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 12:24:41.943902 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:41.900094 22922 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.944789 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:41.900301 22608 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:41.948835 18737 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.955942 18843 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:24:41.936127 18917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2258) took 1193 ms (client timeout 1532 ms). Trace:
I20260709 12:24:41.931149 22924 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:41.966938 18917 rpcz_store.cc:269] 0709 12:24:40.722227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.722420 (+   193us) service_pool.cc:224] Handling call
0709 12:24:41.915164 (+1192744us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540027d8d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:41.915270 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429100416}
I20260709 12:24:41.945331 22712 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:41.968410 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:41.903292 22964 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:41.970644 22930 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.972007 18916 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 7: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:41.969832 22964 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.973193 22930 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.936700 22827 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:41.974344 22964 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:41.975091 18915 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:41.974905 22827 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:41.971414 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:41.976666 18917 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:41.850181 22901 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:41.956971 18839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:41.979050 18839 raft_consensus.cc:606] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:41.979429 18839 raft_consensus.cc:614] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:41.965245 22511 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:24:41.983448 22901 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:41.984683 23005 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:41.985922 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.986660 22608 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.987139 22608 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.966281 18918 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:41.990854 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:41.991395 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:41.935911 22960 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:41.994277 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45549.7us
I20260709 12:24:41.995533 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:41.998834 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:42.005244 18917 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:42.000548 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.936941 22974 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:42.009076 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:41.941411 22963 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:42.016352 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:42.016641 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:41.935619 23017 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:42.017735 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:42.018253 18921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2233) took 2465 ms (client timeout 1653 ms). Trace:
I20260709 12:24:41.950701 22987 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:42.030094 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:42.044703 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44287.7us
I20260709 12:24:42.047014 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:42.049012 18921 rpcz_store.cc:269] 0709 12:24:39.552602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.552717 (+   115us) service_pool.cc:224] Handling call
0709 12:24:42.018010 (+2465293us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5400034dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:42.018134 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4652073344}
I20260709 12:24:42.046185 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:42.010119 22960 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.096946 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:42.097384 19486 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:42.024190 22900 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.955313 22800 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:42.100756 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:42.026553 22712 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:42.103616 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:42.108711 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:41.965688 22995 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:24:42.109397 18918 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:42.109412 18773 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:42.115447 22075 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:42.116039 22075 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:42.114290 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.123684 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:42.126366 19491 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 6.
I20260709 12:24:42.126731 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:42.127990 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:42.048090 22974 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.105456 22960 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:42.106628 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 140678us
I20260709 12:24:42.108050 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:42.141642 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:42.142438 18914 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:42.009388 22854 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.131032 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:42.149179 18770 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:42.023936 22819 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:24:42.050148 23017 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.100674 22816 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:42.118131 22995 consensus_queue.cc:1243] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:42.171952 23043 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:42.174114 23038 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:42.011090 22851 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 12:24:42.147536 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:42.257902 18766 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.150629 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:42.258966 19484 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:42.052620 22905 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:42.144369 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:42.146963 22511 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:42.134467 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:42.257284 22075 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:42.276925 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 247771us
W20260709 12:24:42.279300 18812 connection.cc:256] RPC call timeout handler was delayed by -1.455544811999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 12:24:42.137137 22987 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.281152 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 146784us
I20260709 12:24:42.280895 22075 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:42.281966 22075 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.282378 22075 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:42.283074 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:42.283540 18812 connection.cc:256] RPC call timeout handler was delayed by -1.32971756500001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 12:24:42.284427 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.285207 18812 connection.cc:256] RPC call timeout handler was delayed by -1.1720448119999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
I20260709 12:24:42.263159 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:42.285974 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:42.286809 18812 connection.cc:256] RPC call timeout handler was delayed by -1.0163855409996359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 12:24:42.288795 18916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54084
I20260709 12:24:42.289709 18916 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.146003 22924 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:42.298682 22917 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:42.290220 18916 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.111804 22900 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.312245 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:42.313010 18773 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:42.314010 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:42.159534 23017 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:42.314961 18773 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:42.236048 22974 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:42.316119 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:42.178159 22816 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:42.318502 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:42.343334 18764 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:42.344568 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:42.345829 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:42.176054 23005 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:42.318212 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 203078us
I20260709 12:24:42.331499 18914 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
W20260709 12:24:42.355396 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 92381.3us
I20260709 12:24:42.310176 22901 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:42.324373 22963 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.375608 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:42.378808 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.381282 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.384017 18916 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:42.386224 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.391026 18844 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:42.387322 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.392275 18839 raft_consensus.cc:1813] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:42.392879 18839 raft_consensus.cc:2368] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10.
I20260709 12:24:42.390271 18842 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:42.400226 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:42.400949 18914 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.402908 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.327090 23044 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:42.421330 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.314500 22987 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.424141 18766 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:24:42.434547 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.435822 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.436764 18843 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
W20260709 12:24:42.438884 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 294615us
I20260709 12:24:42.442852 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:42.448765 18914 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:42.440635 22075 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:42.447178 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.448486 18913 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:42.422078 22824 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.449622 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:42.458784 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.459489 18846 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 6.
W20260709 12:24:42.459391 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 102981us
I20260709 12:24:42.436242 22855 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:42.453233 18913 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:24:42.450929 18766 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:42.470049 22075 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:42.406503 22963 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.422997 23044 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:42.496555 22933 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.684s	user 0.004s	sys 0.005s
I20260709 12:24:42.496865 22924 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:42.501266 22608 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.001s
W20260709 12:24:42.503597 22788 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.747s	user 0.011s	sys 0.000s
W20260709 12:24:42.455152 23042 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:42.462330 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:42.543597 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 526985us
I20260709 12:24:42.545583 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:42.486310 22992 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
I20260709 12:24:42.547955 18845 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:42.453164 22816 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:42.474327 22905 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:42.561136 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.562702 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.562975 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.563498 18841 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:42.562702 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.563856 18842 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:42.461647 22824 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.593252 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:42.594260 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.597492 18845 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:42.551129 22933 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10.
I20260709 12:24:42.598788 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.548832 22800 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:42.556953 22854 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:42.556118 22511 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:42.608772 18914 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:42.548030 22788 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:42.613445 22948 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.780s	user 0.006s	sys 0.003s
I20260709 12:24:42.615929 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 711) took 1025 ms. Trace:
I20260709 12:24:42.590185 23048 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:42.644238 23048 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.644681 23048 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:42.547957 22608 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.646297 19487 raft_consensus.cc:2368] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
I20260709 12:24:42.647614 22608 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:42.648280 22608 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.648941 22608 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.600203 22712 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.625567 23017 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:42.630000 22854 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:42.629840 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:42.631374 22486 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:42.631906 22824 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:42.632795 22963 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:42.621292 22958 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.000s
I20260709 12:24:42.633225 22900 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:42.634249 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.626924 18769 rpcz_store.cc:276] 0709 12:24:41.590696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.873782 (+283086us) service_pool.cc:224] Handling call
0709 12:24:41.874053 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.883054 (+  9001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.883086 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.883577 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.284210 (+400633us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b18003dc540. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:24:42.409062 (+124852us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:42.445709 (+ 36647us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.446006 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.446109 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:42.615538 (+169429us) raft_consensus.cc:1685] finished
0709 12:24:42.615666 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.615845 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35514,"prepare.queue_time_us":39034,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2000,"raft.queue_time_us":41728,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5061,"spinlock_wait_cycles":32031232,"thread_start_us":124302,"threads_started":1,"wal-append.queue_time_us":601759}
I20260709 12:24:42.635155 18845 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:24:42.635782 23049 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:24:42.636897 23065 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:42.636994 18841 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:24:42.638813 18842 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:42.639947 18846 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:24:42.640416 22511 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.641412 18843 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:42.638909 22905 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:42.643603 22976 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:42.624986 19492 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:42.658793 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.663959 19484 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:42.665575 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.677767 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:42.691622 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:42.654594 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.657856 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:42.665319 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:42.695472 18839 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:42.668193 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:42.653080 18916 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:42.696816 18840 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:42.649240 18914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54084
I20260709 12:24:42.698062 18914 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.698612 18914 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:42.719918 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:42.732736 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.009s	sys 0.019s
W20260709 12:24:42.752337 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.011s	sys 0.020s
W20260709 12:24:42.752777 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 668806us
I20260709 12:24:42.652871 22608 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:42.720674 22824 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:42.656454 23017 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:42.758787 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:42.683216 22987 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:42.756078 18916 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:42.662596 22854 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:42.650985 22788 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:42.770929 22854 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.772511 22819 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:42.775131 19484 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:42.777895 23070 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.778553 23070 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.781145 23070 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:42.783037 18914 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:42.785902 18914 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:42.786031 23013 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:42.751199 23057 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:42.678445 22948 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:42.671568 22486 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:24:42.653432 22712 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.666994 22958 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:42.753732 23056 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:42.941545 22848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.056s	sys 0.055s
I20260709 12:24:43.048871 22712 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:43.021198 22974 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.669s	user 0.018s	sys 0.000s
I20260709 12:24:43.022589 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 714) took 1431 ms. Trace:
I20260709 12:24:43.050741 18771 rpcz_store.cc:276] 0709 12:24:41.591617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.914327 (+322710us) service_pool.cc:224] Handling call
0709 12:24:41.953124 (+ 38797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.962485 (+  9361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.962533 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:42.027330 (+ 64797us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.599084 (+571754us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:42.641648 (+ 42564us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.643293 (+  1645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.652909 (+  9616us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.022304 (+369395us) raft_consensus.cc:1685] finished
0709 12:24:43.022329 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.022517 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8853,"prepare.queue_time_us":42035,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":12962,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":21401,"thread_start_us":469007,"threads_started":1,"wal-append.queue_time_us":700865}
W20260709 12:24:43.024647 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 304755us
I20260709 12:24:43.053197 18839 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
W20260709 12:24:43.025977 22960 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.862s	user 0.018s	sys 0.001s
I20260709 12:24:43.052883 22948 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:42.671916 23065 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.054674 23055 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.055308 23055 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:43.055871 23051 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.601s	user 0.003s	sys 0.000s
I20260709 12:24:43.056762 23065 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:42.726719 22900 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:24:43.057821 23055 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:43.030212 22855 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.031184 18919 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:42.807569 22824 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:43.033134 22976 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.034781 22886 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.814306 23017 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 12:24:42.804247 23070 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.813475 22695 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.038189 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 281743us
W20260709 12:24:43.040777 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.052661 22958 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:43.042205 23013 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.052423 23056 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.042339 23071 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.087649 22976 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.042953 18769 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:43.043745 18913 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:43.044219 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2256) took 1087 ms. Trace:
I20260709 12:24:43.045497 23048 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.054039 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:43.058635 18764 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:24:42.873689 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.101236 19487 raft_consensus.cc:2410] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:24:43.048972 22848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.058s	sys 0.058s
I20260709 12:24:43.041182 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:43.088410 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:43.098834 18918 rpcz_store.cc:276] 0709 12:24:41.956828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.992331 (+ 35503us) service_pool.cc:224] Handling call
0709 12:24:42.814176 (+821845us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400032fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:43.044118 (+229942us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247731072}
I20260709 12:24:43.096052 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:43.103153 18773 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:43.105435 18768 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:43.089010 23066 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.106343 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:43.106696 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2272) took 1173 ms. Trace:
I20260709 12:24:43.108307 18767 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:43.108721 18915 rpcz_store.cc:276] 0709 12:24:41.933757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.933937 (+   180us) service_pool.cc:224] Handling call
0709 12:24:43.106517 (+1172580us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b5400334854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:43.106635 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91870080}
I20260709 12:24:43.054077 22960 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.050779 22974 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.099045 23079 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:24:43.135097 23041 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:43.135680 23041 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.130791 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:43.084437 22855 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.136090 23041 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.163563 18773 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:43.167366 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:43.168776 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:43.170382 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:43.169010 22905 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:43.096205 23056 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:43.173667 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 712783us
I20260709 12:24:43.174824 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:43.176049 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:43.185019 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 821) took 1303 ms. Trace:
I20260709 12:24:43.189563 18921 raft_consensus.cc:2368] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7.
I20260709 12:24:43.136879 23067 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:43.094676 23013 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:43.192171 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61537.3us
I20260709 12:24:43.192090 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:43.091864 23070 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:43.200459 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 96054.5us
I20260709 12:24:43.192675 18917 raft_consensus.cc:2368] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
W20260709 12:24:43.196173 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58823.5us
I20260709 12:24:43.197649 18918 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:43.097196 22695 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.199306 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:43.089102 22886 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.134121 22808 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:24:43.185549 18919 rpcz_store.cc:276] 0709 12:24:41.881119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.881650 (+   531us) service_pool.cc:224] Handling call
0709 12:24:41.881958 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.074544 (+1192586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.184730 (+110186us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400335c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:43.184948 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642509056}
I20260709 12:24:43.204646 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:43.205001 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 817) took 1340 ms. Trace:
I20260709 12:24:43.205482 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:43.191552 22712 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:43.209487 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:43.191323 22917 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:43.219887 18914 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:43.203126 22987 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:43.250003 18915 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:43.198498 22788 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:43.246618 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:43.256721 18918 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:43.199479 22824 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.191777 22900 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:24:43.202979 22924 raft_consensus.cc:2764] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:43.218437 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:43.244472 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:43.251200 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46629.6us
I20260709 12:24:43.282174 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:43.201359 22905 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:43.272121 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:43.214933 22964 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.206944 22958 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.274976 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:43.218767 18920 rpcz_store.cc:276] 0709 12:24:41.864505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.864694 (+   189us) service_pool.cc:224] Handling call
0709 12:24:41.865021 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.865262 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:42.100977 (+235715us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.055298 (+954321us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:43.103868 (+ 48570us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b18003d1b60. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:24:43.204639 (+100771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.204697 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:43.204753 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.204819 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.204946 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91605,"prepare.queue_time_us":400883,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":829765,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":19655,"spinlock_wait_cycles":38187648,"thread_start_us":504122,"threads_started":3,"wal-append.queue_time_us":335598}
I20260709 12:24:43.258172 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:43.284662 18915 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:43.213083 23067 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:43.289242 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:43.287384 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 98370us
I20260709 12:24:43.248678 23078 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:43.292874 23078 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:43.276172 22788 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:43.219451 22712 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.294358 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:43.294574 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:43.247514 23056 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.214699 22800 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.248440 22917 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.299523 18920 raft_consensus.cc:2410] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:43.255962 22987 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.255509 22831 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:24:43.305349 18914 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:43.353747 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 151937us
W20260709 12:24:43.409291 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 233367us
I20260709 12:24:43.410197 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:43.413642 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 119144us
W20260709 12:24:43.362531 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 176239us
I20260709 12:24:43.293879 22901 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:43.096757 23071 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.215317 23069 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 12:24:43.290050 22967 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.149s
I20260709 12:24:43.410669 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:43.299105 23043 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:43.293655 23078 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:43.298951 22712 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.418617 22788 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:43.113687 23066 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.411473 22987 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.358376 22976 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:43.428510 22800 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.370293 23086 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:43.457031 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:43.429348 22901 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.414412 23067 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:43.440132 23085 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:43.439901 22511 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:43.472820 23048 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.455096 22917 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.296152 22958 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.477216 22976 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.452158 22905 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.296898 22964 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.419221 23056 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.456252 22930 raft_consensus.cc:2764] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:43.481585 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:43.481323 22960 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:43.491111 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:43.470501 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 174638us
I20260709 12:24:43.492033 22511 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.482380 22901 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:43.518671 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 102818us
I20260709 12:24:43.521275 18769 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.522148 23071 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:43.522536 22827 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:43.514806 23085 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:43.523319 22827 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:43.523770 23085 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.524390 22827 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.527328 22886 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.527091 23067 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.529335 23057 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:43.529788 23057 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:43.533023 23087 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:43.519997 22976 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:43.533744 23081 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:24:43.515681 22855 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:43.470142 23043 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:43.524968 23044 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:43.552716 22511 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:43.587062 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 266940us
I20260709 12:24:43.495494 23088 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:43.514725 23098 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:43.460280 23082 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:24:43.493264 22900 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.588797 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:43.773350 18769 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:43.773785 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:43.775573 19485 pending_rounds.cc:85] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 6
I20260709 12:24:43.775951 19485 pending_rounds.cc:107] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:24:43.776214 19485 raft_consensus.cc:2889] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:43.776650 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:43.776904 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:43.777379 19490 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.589617 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:43.779073 19491 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:43.779464 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 827) took 1320 ms. Trace:
W20260709 12:24:43.734539 19458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.004s	sys 0.004s
W20260709 12:24:43.780943 19458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.005s
I20260709 12:24:43.779891 18916 rpcz_store.cc:276] 0709 12:24:42.459355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.770057 (+310702us) service_pool.cc:224] Handling call
0709 12:24:42.770465 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.193585 (+423120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.193620 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.194217 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.362099 (+167882us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:43.362179 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.362259 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.779232 (+416973us) raft_consensus.cc:1685] finished
0709 12:24:43.779256 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.779394 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":422694,"raft.queue_time_us":431973,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2976,"thread_start_us":167332,"threads_started":1,"wal-append.queue_time_us":259913}
I20260709 12:24:43.613550 19487 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:24:43.619447 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:43.784409 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:43.618594 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.791705 18772 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:43.793049 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:43.793823 18772 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
W20260709 12:24:43.781534 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 578522us
I20260709 12:24:43.812170 18916 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:43.812446 19490 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
W20260709 12:24:43.815330 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 301121us
I20260709 12:24:43.800995 18918 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.818286 18918 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:24:43.821784 18919 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:43.825484 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:43.702962 22964 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:43.680096 23013 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.839808 18915 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:43.840442 18918 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:43.797425 22695 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.783574 22800 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:43.650527 23070 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.783573 22962 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.797142 22933 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:43.802542 23044 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:43.872179 23044 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.876902 22918 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:43.745764 23103 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.877668 22918 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:43.877912 23103 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.878021 22962 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.878620 22918 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.880296 23103 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.863632 23056 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.869444 22917 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.881208 22976 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.881467 22962 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:43.773387 22788 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.882687 22917 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.795377 22901 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.870639 23043 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.857091 22855 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.642027 23100 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:43.876946 23071 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.894264 23071 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.897610 23071 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.890533 23100 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.843456 23095 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.884994 23066 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:43.804247 22900 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:43.988708 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.021s
W20260709 12:24:44.117174 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.008s	sys 0.022s
I20260709 12:24:43.990433 18766 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:43.598644 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:43.999354 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 182853us
I20260709 12:24:43.999553 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:44.119516 22900 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.120153 18770 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:44.121726 23041 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.929s	user 0.021s	sys 0.000s
I20260709 12:24:43.794934 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:44.122499 23041 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.123373 18772 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:44.012504 18918 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:43.650619 23057 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.804062 23098 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:43.911164 23099 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.131924 23099 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:43.997944 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:44.075286 23082 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:44.134946 18771 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:44.138839 22987 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.009s
I20260709 12:24:44.139551 22987 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.147838 23098 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.149958 23099 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.155937 23084 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.156880 23084 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.160121 23084 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.167582 22486 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:44.170691 23082 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:44.171877 23100 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:43.883947 22788 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.175832 22824 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:44.177537 22857 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:44.177978 22857 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:44.179813 18919 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.179522 22857 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:44.184389 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110863us
I20260709 12:24:43.902323 22855 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.189558 22855 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.096217 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:43.910753 22958 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.115285 22901 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:43.929890 23095 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.197120 18771 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:44.199502 18770 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:44.302450 23099 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.304684 22900 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:44.305559 22900 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.307057 22848 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.308331 22900 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.307910 22848 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.311066 22848 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.310989 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 825) took 2363 ms. Trace:
I20260709 12:24:44.312014 18913 rpcz_store.cc:276] 0709 12:24:41.947294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.480299 (+533005us) service_pool.cc:224] Handling call
0709 12:24:43.043393 (+563094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.098689 (+ 55296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.310435 (+1211746us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400032fd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:44.310732 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294073216}
I20260709 12:24:44.314606 22958 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:44.315138 18917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2251) took 2379 ms (client timeout 2238 ms). Trace:
I20260709 12:24:44.315838 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.316749 18918 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:44.315548 22958 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.322752 18772 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
W20260709 12:24:44.317863 18917 rpcz_store.cc:269] 0709 12:24:41.935912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.045788 (+109876us) service_pool.cc:224] Handling call
0709 12:24:44.314626 (+2268838us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400336154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:44.314876 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2520560384}
W20260709 12:24:44.328074 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 694981us
I20260709 12:24:44.328609 22958 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:44.338989 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.340072 18917 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:44.342478 22974 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:44.347886 18769 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.013s
I20260709 12:24:44.348455 18769 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:44.215992 23013 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:44.352420 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:44.346200 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:44.357905 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:44.366820 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.367383 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.367890 18918 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:44.375735 23095 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.384837 23082 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:44.384923 18917 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:44.388792 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.394455 18770 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:44.393393 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:44.390161 23128 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.252s	user 0.000s	sys 0.002s
I20260709 12:24:44.408650 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.409704 18920 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:44.415015 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 131131us
I20260709 12:24:44.416136 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:44.419237 23013 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:44.420511 22511 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.002s
I20260709 12:24:44.420979 22511 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:44.426729 22712 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.012s
I20260709 12:24:44.427275 22712 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.429744 22712 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.435521 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:44.435909 22918 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.441241 23044 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:44.442898 18916 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:44.443604 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:44.444422 18840 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:44.445526 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:44.446470 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:44.447119 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:44.447383 18843 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.447548 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:44.449057 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:44.444458 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.452565 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.454610 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.454948 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:44.456248 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.457643 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.458653 18915 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:44.458847 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.464803 19491 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:44.460593 23071 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:44.462263 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:44.467070 22808 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:44.467624 22808 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:44.467929 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:44.468961 23132 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:24:44.468889 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.469489 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.470105 18915 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:44.471153 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.471483 22511 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:44.472210 18915 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:44.475016 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.476033 18843 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:44.476701 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:44.477877 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.489989 22857 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:44.497617 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 81679us
I20260709 12:24:44.422204 23013 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:44.498467 19457 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.664s (SENT)
I20260709 12:24:44.502274 22987 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:44.504639 23099 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:44.505694 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:44.526090 18921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2261) took 2454 ms (client timeout 2174 ms). Trace:
I20260709 12:24:44.468026 22808 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:44.540566 18917 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:44.538089 22901 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.543936 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:44.540869 18921 rpcz_store.cc:269] 0709 12:24:42.071264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.100413 (+ 29149us) service_pool.cc:224] Handling call
0709 12:24:44.525562 (+2425149us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400335254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:44.525861 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2488526080}
I20260709 12:24:44.544571 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.560782 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:44.568704 18918 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:44.584635 18920 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
W20260709 12:24:44.589491 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.588006 19491 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:44.582598 18843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:44.594000 18843 raft_consensus.cc:606] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:44.594583 18843 raft_consensus.cc:614] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:44.595608 18920 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:44.598490 22948 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.597892 22901 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.599407 22712 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.599169 22948 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.600018 22712 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.569964 23013 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.608143 18916 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:24:44.613247 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.612201 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:44.582893 23099 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:44.613884 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 284204us
I20260709 12:24:44.618644 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:44.625290 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 241713us
I20260709 12:24:44.623412 23017 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:44.628314 23098 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.628829 23017 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.629187 23098 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.632591 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:44.638240 22917 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.638787 22948 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:44.638988 22917 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.641458 18767 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:44.641556 22917 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:44.644508 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.646433 23017 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.646864 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.647687 19485 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:44.647583 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:44.648638 23017 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.649570 23017 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.667728 18916 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:44.678999 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:44.682833 19484 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:44.693333 18917 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:44.702152 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.713874 18772 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:44.726136 18770 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:44.727638 18915 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:44.689570 22901 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.731901 19492 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:44.669268 23099 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.733631 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2525) took 1131 ms. Trace:
I20260709 12:24:44.683238 23013 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.735754 18916 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.738803 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:44.718770 23098 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.740909 18770 rpcz_store.cc:276] 0709 12:24:43.596301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.320047 (+723746us) service_pool.cc:224] Handling call
0709 12:24:44.727401 (+407354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.762971 18771 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:44.772274 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:44.760629 22712 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:44.786135 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 172278us
W20260709 12:24:44.793355 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 227066us
I20260709 12:24:44.804167 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.803970 23125 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.804952 23102 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:44.803167 23112 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:44.818670 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.820225 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:44.821587 23125 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.824263 23125 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:44.825881 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45569.3us
I20260709 12:24:44.820853 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:44.832135 18914 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:24:44.833537 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 264918us
I20260709 12:24:44.834686 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.825963 23102 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.836993 23057 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:44.839697 23078 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.366s	user 0.018s	sys 0.002s
I20260709 12:24:44.840555 18921 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:44.840283 23078 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.843175 23102 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.843878 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 725) took 1364 ms. Trace:
I20260709 12:24:44.844235 23078 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.844308 18766 rpcz_store.cc:276] 0709 12:24:43.479356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.479529 (+   173us) service_pool.cc:224] Handling call
0709 12:24:43.489616 (+ 10087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.118233 (+628617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.843481 (+725248us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54001793d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:44.843753 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150060416}
I20260709 12:24:44.853231 22819 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:44.857944 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.859058 19490 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:24:44.861408 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:44.856819 23125 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:44.878595 23125 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:44.879181 23125 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:44.882889 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69919.8us
I20260709 12:24:44.884897 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:44.886086 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:44.862494 23099 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.865792 22712 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.898350 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:44.906356 23078 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:44.907270 23078 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.907770 23078 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:44.908038 23041 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:44.910775 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2270) took 1085 ms. Trace:
I20260709 12:24:44.912353 23017 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.913734 19490 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:44.914634 23069 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:44.915712 23069 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:44.916189 23069 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:44.916332 23043 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:24:44.917362 23069 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.918538 22918 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:24:44.919448 23102 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:44.921064 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:44.896097 22712 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:44.923087 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60124.3us
I20260709 12:24:44.911218 18919 rpcz_store.cc:276] 0709 12:24:43.825732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.825936 (+   204us) service_pool.cc:224] Handling call
0709 12:24:43.826356 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.180350 (+353994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.910430 (+730080us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540027e7d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:44.910705 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811893632}
I20260709 12:24:44.928463 23017 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:44.929008 23017 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:44.929448 23017 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.931866 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:44.932753 18770 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:44.933436 22918 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:44.933470 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:44.933820 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:44.934077 22918 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:44.934600 18766 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:44.935237 22918 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.936549 23102 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:44.937808 23102 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:44.946875 23013 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:44.947611 23017 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:44.948676 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:44.950667 23017 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:44.952149 23017 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:44.950537 18766 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:44.952086 18887 leader_election.cc:400] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10.
I20260709 12:24:44.888408 22819 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:24:44.957842 22819 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:44.958261 22819 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:44.958979 23089 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:44.958931 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:44.959825 18769 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:44.955173 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52456us
I20260709 12:24:44.963559 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:44.927424 22712 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.961313 23089 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:44.970892 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.964612 23099 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.972986 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:44.973706 19490 raft_consensus.cc:1813] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Handling vote request from an unknown peer 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:44.974501 22905 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:44.975507 23142 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.165s	user 0.003s	sys 0.001s
I20260709 12:24:44.969481 23041 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:24:44.976423 23043 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:44.978799 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:44.978852 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:44.986137 19486 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.986690 18766 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:44.981282 23099 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.984892 19490 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:44.988924 18667 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:44.984180 23069 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:45.000639 19491 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
W20260709 12:24:44.999847 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.959348 22819 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.003937 22819 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.005259 23041 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.007232 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:44.991386 22918 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:44.993836 23099 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:45.014932 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63096.3us
I20260709 12:24:45.017946 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:45.019256 18770 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:24:45.020092 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:45.021296 18766 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:45.013257 23112 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:45.030890 23112 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.031358 23112 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:45.014510 22511 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:24:45.027727 18767 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:45.030072 22816 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:45.023494 19458 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:45.006119 23041 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:45.039944 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 61296.5us
I20260709 12:24:45.045701 18918 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:45.039206 22816 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:45.047108 23071 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:45.047645 23071 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:45.048075 23071 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:45.048259 22816 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.049785 22816 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.015009 23063 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:24:45.051126 23013 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.051702 23013 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.054062 23013 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.056521 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:45.016429 23043 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:24:45.051162 23063 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:45.063501 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:45.067559 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.071449 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.070188 19490 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:45.054916 23102 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:45.060930 23063 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:45.087903 23063 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.089362 23063 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:45.090723 23066 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:24:45.090968 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58985.3us
I20260709 12:24:45.083079 23102 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.081070 18667 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 7 to 9, term changed from 6 to 7, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3), VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 7 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.070335 23053 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.086669 23017 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.094234 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:45.105794 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.095827 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:45.106827 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 113426us
I20260709 12:24:45.109331 18769 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:45.109969 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:45.045691 23089 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.114707 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:45.114502 23013 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:45.117300 22924 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:24:45.117837 19491 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
W20260709 12:24:45.118817 19457 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.536s (SENT)
I20260709 12:24:45.119375 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:45.117641 23013 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.116976 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:45.122150 18769 raft_consensus.cc:2368] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11.
I20260709 12:24:45.120535 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:45.112138 23098 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:45.125067 18667 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 6 to 7, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 7 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.111687 23053 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.140552 18767 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:45.141368 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:45.165472 23041 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.174449 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:45.175431 18769 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:45.122562 23013 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:45.179301 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.172560 19491 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:45.137732 18667 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 5 to 7, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 7 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:45.189980 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 95942.9us
I20260709 12:24:45.172245 23150 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:24:45.198098 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 84484us
W20260709 12:24:45.186362 22857 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.005s
I20260709 12:24:45.173789 23149 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.135517 23078 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.201308 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:45.209398 18667 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 5 to 6, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 6 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:45.212232 18668 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 288) took 19070 ms (client timeout 15000 ms). Trace:
I20260709 12:24:45.213055 18667 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 3 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 6 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.215736 18667 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:24:45.219126 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 153407us
I20260709 12:24:45.218348 18667 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 4 to 5, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 5 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:45.223380 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104616us
I20260709 12:24:45.221413 18667 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 3 to 6, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:45.229380 18667 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 5 to 8, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 8 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:45.231752 18667 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 8 to 10, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 10 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:45.243606 18667 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:45.207792 23089 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.281697 19486 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:24:45.291966 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 94290.3us
I20260709 12:24:45.256117 18667 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 5 to 7, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:24:45.265597 19457 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.581s (SENT)
I20260709 12:24:45.284368 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.436905 18918 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:45.300097 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:45.256122 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48833.4us
W20260709 12:24:45.292809 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 90079.5us
I20260709 12:24:45.199975 23150 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:45.282964 23148 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 12:24:45.446911 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 236602us
I20260709 12:24:45.292096 22924 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:45.303298 23017 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:45.307340 23078 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.287056 23102 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.267088 22905 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:45.262955 23041 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.448669 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.425860 23066 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:45.455013 19490 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:45.438045 23098 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:45.453419 18667 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 4 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 6 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:45.458743 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:45.277793 23099 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.308637 23112 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.265054 23125 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.467470 18814 leader_election.cc:400] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
I20260709 12:24:45.451110 22511 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.464694 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.473356 18814 leader_election.cc:403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:45.464234 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:45.477195 18918 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.462188 23041 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.480633 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:45.465070 22808 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.897s	user 0.013s	sys 0.001s
I20260709 12:24:45.256716 23053 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.494767 19490 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:24:45.489600 18771 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:45.487016 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.492983 22511 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.498700 23099 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:45.499507 22511 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:45.499935 18667 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 6 to 7, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 7 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.500766 23112 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.460291 22816 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:24:45.475705 23098 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:45.212728 18668 rpcz_store.cc:269] 0709 12:24:26.141623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.142523 (+   900us) service_pool.cc:224] Handling call
0709 12:24:45.211944 (+19069421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:38.094540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:38.095208 (+   668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:38.095269 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:24:38.095294 (+    25us) tablet.cc:662] Decoding operations
0709 12:24:38.096787 (+  1493us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:38.096895 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:38.096921 (+    26us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:24:38.098161 (+  1240us) tablet.cc:701] Row locks acquired
0709 12:24:38.098217 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:24:38.161810 (+ 63593us) write_op.cc:270] Start()
0709 12:24:38.305767 (+143957us) write_op.cc:276] Timestamp: P: 1783599878098324 usec, L: 0
0709 12:24:38.310577 (+  4810us) op_driver.cc:348] REPLICATION: starting
0709 12:24:38.528059 (+217482us) log.cc:844] Serialized 5844 byte log entry
0709 12:24:39.977390 (+1449331us) op_driver.cc:464] REPLICATION: finished
0709 12:24:40.291181 (+313791us) write_op.cc:301] APPLY: starting
0709 12:24:40.291319 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:40.887394 (+596075us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:40.893069 (+  5675us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:41.365241 (+472172us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:41.365577 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:24:41.365626 (+    49us) write_op.cc:312] APPLY: finished
0709 12:24:41.366051 (+   425us) log.cc:844] Serialized 139 byte log entry
0709 12:24:41.451088 (+ 85037us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.451287 (+   199us) write_op.cc:454] Released schema lock
0709 12:24:41.451345 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:41.451833 (+   488us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.451864 (+    31us) write_op.cc:454] Released schema lock
0709 12:24:41.850839 (+398975us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
Metrics: {"mutex_wait_us":2298971,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":313474,"apply.run_cpu_time_us":41343,"apply.run_wall_time_us":1160641,"cfile_cache_hit":58,"cfile_cache_hit_bytes":60697,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":1657,"lbm_reads_lt_1ms":12,"num_ops":15,"prepare.queue_time_us":326645,"prepare.run_cpu_time_us":56889,"prepare.run_wall_time_us":673655,"raft.queue_time_us":992978,"raft.run_cpu_time_us":34374,"raft.run_wall_time_us":307156,"replication_time_us":1666585,"spinlock_wait_cycles":13861632,"thread_start_us":991096,"threads_started":5,"wal-append.queue_time_us":308686,"wal-append.run_cpu_time_us":61801,"wal-append.run_wall_time_us":3513732}]]}
I20260709 12:24:45.505137 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.505766 23098 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.505971 18919 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
W20260709 12:24:45.506853 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.507434 18814 leader_election.cc:400] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 6 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7.
I20260709 12:24:45.507874 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:45.478479 23017 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:45.494132 23152 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.511050 18921 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:45.498842 23041 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:45.489848 23060 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:45.530647 18922 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:24:45.494578 22930 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:45.468111 23071 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.502317 18667 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 4 to 5, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:24:45.547271 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 281691us
I20260709 12:24:45.551391 18918 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:45.517781 22511 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:45.549114 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.553023 22819 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:24:45.558246 18914 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:45.251324 23149 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.558462 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.559137 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:45.527777 23017 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:45.534291 23060 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:45.562669 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.558718 22816 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:45.563321 23150 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.564276 23057 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:45.564863 23102 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:45.565457 22854 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:24:45.557652 22511 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:45.567653 18667 catalog_manager.cc:5697] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:45.566056 23078 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:24:45.571853 19490 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:45.605324 18919 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:45.577904 23060 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.526337 22808 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:45.581670 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.587847 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 287834us
W20260709 12:24:45.613835 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.589217 19486 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:45.552627 22930 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.566610 23098 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:45.596032 23149 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:45.629629 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:45.630407 19491 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:45.596546 22819 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:45.597148 22816 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.643774 18769 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:45.644129 18771 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:45.644291 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.597036 23017 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:45.602046 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.578115 22918 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.004s
W20260709 12:24:45.606542 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 157785us
I20260709 12:24:45.520380 22905 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:45.609279 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.525683 23099 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:24:45.612352 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:45.603055 22511 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:45.616043 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:45.623739 22854 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:45.624202 18767 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:45.580123 23053 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:24:45.625783 23063 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.003s
I20260709 12:24:45.606325 23071 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:45.626264 23098 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:45.632639 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70992.8us
I20260709 12:24:45.636103 22924 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:45.647953 18771 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:45.648687 18770 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:45.649083 18768 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 14. Ops: []
I20260709 12:24:45.651948 18773 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:45.652537 22930 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.653120 18765 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:24:45.643077 22819 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:45.655755 22816 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.655784 22808 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.658905 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:45.702798 19490 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:45.672871 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:45.622867 22900 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:45.709292 22608 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:24:45.645977 23069 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:45.688330 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:45.712144 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 91620.4us
I20260709 12:24:45.714484 18915 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.690774 19486 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:45.693066 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.717546 18773 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:45.680699 19492 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:45.679335 23150 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:45.701815 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:45.705458 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.709398 22918 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:45.719151 18770 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:45.724007 18765 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:24:45.746493 23153 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:24:45.747581 23166 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.748279 23166 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.701470 22905 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.752449 22905 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:45.710311 22900 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.713025 23125 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:45.714120 23069 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:45.775233 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57471.4us
I20260709 12:24:45.770278 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:45.779810 22857 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:45.756827 23156 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:24:45.780260 23152 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
I20260709 12:24:45.780383 22857 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:45.783699 19457 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.630s (SENT)
I20260709 12:24:45.780256 18768 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:45.787986 18773 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:45.736187 22816 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.738044 22918 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:45.772161 19456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.289s (SENT) [suppressed 55 similar messages]
I20260709 12:24:45.796824 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:45.802937 18765 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
W20260709 12:24:45.804093 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.810910 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 122427us
I20260709 12:24:45.738711 23078 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:24:45.811971 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:45.802748 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3561850630003391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 12:24:45.825997 18770 raft_consensus.cc:2410] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:24:45.832888 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60750.4us
I20260709 12:24:45.850829 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:45.852533 19491 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:24:45.837762 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:45.856029 18773 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:45.860852 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:45.861431 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:45.863922 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:45.864892 18839 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:24:45.840201 22712 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.867s	user 0.014s	sys 0.009s
I20260709 12:24:45.836141 23156 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:45.839385 23166 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:45.818321 23098 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.902350 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:45.907096 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 138916us
W20260709 12:24:45.915179 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 161783us
I20260709 12:24:45.819692 23168 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:24:45.854437 23053 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:24:45.851125 22816 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.883608 23156 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.834767 22819 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.942325 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:45.947082 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:45.948001 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:45.834206 22924 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:45.953995 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.954192 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:45.851766 23069 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:45.883769 22712 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.960436 23172 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:45.967571 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 106731us
I20260709 12:24:45.996208 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:45.998296 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.998636 18847 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:45.936111 22930 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:45.876142 22857 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:45.940634 23156 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:45.902880 23166 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:24:45.886163 22918 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.027802 18840 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:24:46.037212 18886 connection.cc:256] RPC call timeout handler was delayed by -1.0369231069998932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 12:24:46.008443 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:46.037748 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:46.028424 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 199250us
I20260709 12:24:46.044512 18921 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:46.045789 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:46.028862 18769 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:46.037740 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:46.047760 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:46.051893 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.005908 22930 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:46.006160 23078 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.067914 18915 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:46.069233 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:46.069257 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.073652 19484 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:46.070465 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:46.072381 18739 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:46.049260 23017 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:45.997573 23172 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.065578 23099 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.090871 18921 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:46.072541 22930 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:46.107316 18848 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:46.081947 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:46.110054 18920 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:46.104792 18739 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.082173 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.084924 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.086592 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.123859 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.125000 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:46.082283 22857 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:46.131538 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.132866 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.138470 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.084295 22816 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.140949 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.106882 23017 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:46.087620 23172 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.169093 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.170109 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.175977 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.169843 18841 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:46.177093 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.180523 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.186718 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.081647 23186 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:24:46.190088 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.196832 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.105852 23099 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.082788 23078 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.083818 23169 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 12:24:46.150764 22900 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:46.198626 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75333us
I20260709 12:24:46.196960 18842 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:46.089506 23183 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:24:46.164397 22905 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:46.087494 23060 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.199430 23165 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.178560 23112 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:46.208689 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.195509 23125 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:46.216348 23125 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.216815 23125 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:46.217324 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.216230 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.219625 23158 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:46.201736 22924 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:46.208665 23089 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.949s	user 0.011s	sys 0.003s
I20260709 12:24:46.214859 22900 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:46.238740 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.211735 22905 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.239907 18848 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:46.225358 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.229516 22924 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.248497 23017 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.251224 23192 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:46.251747 23192 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:46.220254 23158 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.252875 23192 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.219657 23169 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:24:46.226683 22712 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:46.254573 23182 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.255224 23182 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:46.257429 23013 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.065s	user 0.011s	sys 0.002s
I20260709 12:24:46.270970 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.271524 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.271993 18845 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:24:46.279300 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.262012 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.279832 18917 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:46.279845 18913 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:46.299989 18840 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:46.300352 18841 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:46.306923 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.308116 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.258368 23176 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
W20260709 12:24:46.312963 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 135935us
W20260709 12:24:46.269141 23177 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.273s	user 0.004s	sys 0.000s
I20260709 12:24:46.319948 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.315562 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.304279 18913 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:46.262467 22900 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.241370 23112 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:46.366612 18846 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:46.262467 23169 raft_consensus.cc:2764] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:46.259990 23066 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:46.290983 22905 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:46.336329 22511 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.640s	user 0.005s	sys 0.009s
I20260709 12:24:46.338783 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.340525 22930 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.257579 23182 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.364411 23078 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.311990 23013 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.366938 18843 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:46.305258 22712 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.311828 23192 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:46.375885 18845 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
W20260709 12:24:46.342850 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80869.9us
I20260709 12:24:46.279137 22924 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:46.387161 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.399120 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.399861 22924 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:46.400066 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:46.400132 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.395363 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.366926 22900 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.400406 22924 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:46.377442 18913 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.401265 18914 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:46.408023 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.412034 18841 raft_consensus.cc:2376] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8. Re-sending same reply.
I20260709 12:24:46.402340 18840 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:46.364427 23158 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.378208 23066 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:46.383741 22511 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.486377 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.472092 18913 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:46.418339 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.472255 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 97244.4us
W20260709 12:24:46.455144 18844 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
I20260709 12:24:46.414601 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.393627 23186 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:46.506480 18844 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:46.467763 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:46.402904 23078 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.433336 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:46.415634 18738 connection.cc:256] RPC call timeout handler was delayed by -1.1850430639997285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:24:46.518556 18738 connection.cc:256] RPC call timeout handler was delayed by -1.182332390999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 12:24:46.519065 18738 connection.cc:256] RPC call timeout handler was delayed by -1.1001310639999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 12:24:46.521979 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.523299 18841 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:24:46.523571 18844 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 10 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:24:46.408177 23182 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:46.530673 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.531605 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 295054us
W20260709 12:24:46.527679 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 268607us
I20260709 12:24:46.534814 18840 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:46.401125 22712 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.538326 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.492046 22930 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.434584 23060 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:46.489398 23165 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:46.434007 23013 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.538223 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.539553 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.492589 23099 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:46.530189 23186 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:46.541554 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.544842 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:46.540601 18845 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:46.428694 23112 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.534999 23168 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:46.548430 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.435354 23203 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 12:24:46.556819 18919 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.556730 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.530891 23125 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.560042 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.561472 18844 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:46.562790 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.563519 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.563905 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 350038us
W20260709 12:24:46.564172 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 101646us
I20260709 12:24:46.567149 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.570695 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.539155 23078 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.571574 18845 raft_consensus.cc:2376] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12. Re-sending same reply.
I20260709 12:24:46.574572 18846 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:46.578126 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.579660 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.579792 18840 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:46.580919 23066 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.582331 23066 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:46.548072 22924 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.588260 22930 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.588841 22930 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.589752 23060 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:46.585515 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.592803 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.593384 18841 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:24:46.594611 18913 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:24:46.584332 23125 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:46.594231 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.604537 18913 pending_rounds.cc:85] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 4
I20260709 12:24:46.622653 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.623914 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.627605 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.565779 23168 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:46.628706 18887 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.529s (SENT)
I20260709 12:24:46.639463 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.640419 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:46.642539 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67694.8us
I20260709 12:24:46.643262 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.643847 22511 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:46.643926 18845 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:46.644984 22808 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:46.645293 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.645538 22808 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:46.648854 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.649513 18846 raft_consensus.cc:2376] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9. Re-sending same reply.
I20260709 12:24:46.650424 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.643767 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:46.651566 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.651968 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:46.652696 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.653218 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:46.653882 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.652346 23186 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.643293 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:46.644822 23198 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:46.645071 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.623955 18913 pending_rounds.cc:107] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:24:46.656688 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.659425 18913 raft_consensus.cc:2889] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:46.656852 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.623412 23156 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.001s
I20260709 12:24:46.660812 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:46.662250 18841 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 9: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:46.662506 18846 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:46.662765 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 134881us
I20260709 12:24:46.640888 23017 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:46.676357 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.680846 18846 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:46.677569 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.659931 23174 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.650573 22808 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.679277 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.679966 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.694471 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:46.682994 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:46.659914 23182 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:46.690459 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.965s (SENT)
W20260709 12:24:46.702350 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.710336 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:46.683202 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.673828 23156 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:46.709620 18841 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:46.758280 18920 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:24:46.908794 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.773411 18766 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: []
W20260709 12:24:46.762933 19456 leader_election.cc:336] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.663s (SENT)
I20260709 12:24:46.711913 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:46.807680 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:46.890276 18767 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:46.924964 18913 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:46.908685 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:46.727878 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.757879 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:46.928337 18768 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:46.926839 18772 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:46.893425 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:46.896098 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:46.902498 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 208133us
I20260709 12:24:46.727659 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.926673 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 297974us
I20260709 12:24:46.931286 18845 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:46.794168 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.807680 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:46.680166 23198 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:46.932763 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:46.696336 23212 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:46.931510 18887 leader_election.cc:336] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.603s (SENT)
I20260709 12:24:46.928409 18840 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 10 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260709 12:24:46.944051 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 253667us
W20260709 12:24:46.946523 19457 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.574s (SENT)
I20260709 12:24:46.944198 18770 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:46.947769 18915 raft_consensus.cc:2368] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11.
I20260709 12:24:46.727506 22808 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.948025 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:46.734660 23216 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:46.952665 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.948925 18772 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:46.953336 18841 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:46.949003 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.716084 23159 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:46.958110 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.959407 18846 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:46.772873 23089 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.961112 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.962198 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.962839 19457 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.528s (SENT)
I20260709 12:24:46.963269 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:46.963426 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 200561us
W20260709 12:24:46.964689 19456 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.753s (SENT)
W20260709 12:24:46.965483 19456 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.598s (SENT)
I20260709 12:24:46.712255 23017 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:46.961207 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:46.969657 18768 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:46.971132 18773 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:24:46.971294 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:46.972052 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:46.972819 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:46.961179 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:46.974334 18767 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:46.721395 23196 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.259s
I20260709 12:24:46.975368 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:46.698534 23174 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:46.977257 19457 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.661s (SENT)
I20260709 12:24:46.977797 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:46.978768 23174 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:46.979084 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.753s (SENT)
I20260709 12:24:46.979460 23174 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:46.979602 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:46.980279 23174 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:24:46.980733 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49261.1us
W20260709 12:24:46.981520 18887 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.668s (SENT)
I20260709 12:24:46.981953 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:46.962667 23078 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.982767 22930 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:46.982298 23017 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.983428 22930 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:46.983629 22905 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.004s
I20260709 12:24:46.984432 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.984225 22905 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.985045 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:46.985837 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.986620 23169 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:24:46.983780 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.679s (SENT)
I20260709 12:24:46.987206 23169 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:46.784389 22900 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:46.971652 18773 pending_rounds.cc:85] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 8
I20260709 12:24:46.988436 18773 pending_rounds.cc:107] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:24:46.988744 18773 raft_consensus.cc:2889] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:46.989096 18773 pending_rounds.cc:107] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:24:46.989351 18773 raft_consensus.cc:2889] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:46.987334 18840 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.990070 22900 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:46.990839 22712 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:46.987229 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:46.991871 23182 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:46.992715 23216 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:46.988232 23169 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:46.993253 18887 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.774s (SENT)
W20260709 12:24:46.993534 23192 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.585s	user 0.000s	sys 0.009s
I20260709 12:24:46.993826 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:46.995270 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.995362 18887 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.783s (SENT)
I20260709 12:24:46.995901 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:46.987478 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.987408 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:46.996835 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 63296.4us
I20260709 12:24:46.986497 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:46.997681 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.003228 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.007345 18913 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:47.008627 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:46.961561 23185 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:47.016265 18913 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:24:47.016702 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:47.018111 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.000749 22905 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:47.024380 18812 leader_election.cc:400] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9.
I20260709 12:24:47.027199 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:46.787367 23168 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.030064 18840 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
W20260709 12:24:47.033066 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.822s (SENT)
I20260709 12:24:47.033988 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.034755 18840 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:47.031416 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:47.003348 22930 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:46.956310 23212 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.036413 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.015244 23192 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:46.997279 23089 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:47.038357 18840 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:47.039891 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.014880 23185 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:47.011037 23182 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:47.044597 18919 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:47.049932 18840 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: [8.4-9.5]
I20260709 12:24:47.055358 18764 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:47.057299 23200 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.620s	user 0.008s	sys 0.007s
I20260709 12:24:47.048403 23185 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:47.064489 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:47.076206 18840 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
W20260709 12:24:47.076570 18887 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.923s (SENT)
I20260709 12:24:47.040843 23192 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:47.078909 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:47.050884 22924 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:47.084682 18840 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:24:47.086481 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.093207 18840 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:47.098246 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.099097 18841 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:24:47.082830 23192 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:47.044709 23198 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:47.102664 18887 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.948s (SENT)
W20260709 12:24:47.106946 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.106186 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.115502 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 855) took 1045 ms. Trace:
I20260709 12:24:47.116115 18915 rpcz_store.cc:276] 0709 12:24:46.069685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.102501 (+ 32816us) service_pool.cc:224] Handling call
0709 12:24:47.115208 (+1012707us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b540027ddd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:47.115415 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889849728}
I20260709 12:24:47.118701 23156 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:47.103531 18840 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:24:47.121043 19457 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.585s (SENT)
I20260709 12:24:47.121719 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.120384 18841 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:24:47.092238 23159 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:47.081146 23182 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:24:47.130657 18841 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:47.133049 19457 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.598s (SENT)
I20260709 12:24:47.133913 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:47.137651 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 101301us
W20260709 12:24:47.145197 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.142150 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:47.157364 19457 leader_election.cc:336] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.948s (SENT)
I20260709 12:24:47.159173 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.130657 23163 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:47.139673 23160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.017s	sys 0.027s
I20260709 12:24:47.170624 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:47.193895 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44419.1us
I20260709 12:24:47.177220 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.110618 23226 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:24:47.144783 23063 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:47.176456 22900 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.173679 23160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.017s	sys 0.027s
I20260709 12:24:47.203435 18841 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:47.208571 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.221190 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:47.195796 23066 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.610s	user 0.004s	sys 0.009s
W20260709 12:24:47.225152 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 86667.7us
I20260709 12:24:47.226938 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.198359 22511 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:47.198230 22712 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:47.232281 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.232725 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.233584 18841 raft_consensus.cc:1813] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Handling vote request from an unknown peer 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:47.230369 18840 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:24:47.230597 23098 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:47.234299 18840 pending_rounds.cc:85] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 3
I20260709 12:24:47.235270 18840 pending_rounds.cc:107] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:24:47.235589 18840 raft_consensus.cc:2889] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:47.202780 23231 raft_consensus.cc:2764] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:47.235603 18841 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:47.234752 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.223832 23071 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:47.227696 22905 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:24:47.231040 23229 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:24:47.243726 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:47.236207 23210 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.525s	user 0.000s	sys 0.002s
I20260709 12:24:47.207015 22900 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.230463 23203 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:47.256350 18887 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.608s (SENT)
I20260709 12:24:47.242259 23071 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:47.244870 23212 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:47.260495 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.237169 23013 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 12:24:47.264909 18887 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.997s (SENT)
I20260709 12:24:47.253120 23089 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:47.238510 22712 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.276022 23071 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.279556 23013 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:24:47.281750 23219 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.358s	user 0.000s	sys 0.005s
I20260709 12:24:47.264513 23238 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:47.296557 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.303269 22712 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:47.303946 23234 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:47.304243 23071 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:47.304458 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.305240 18847 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:47.305768 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2432) took 1046 ms. Trace:
I20260709 12:24:47.306938 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2423) took 1108 ms. Trace:
W20260709 12:24:47.307060 23228 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:24:47.298731 23013 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:47.307391 18848 rpcz_store.cc:276] 0709 12:24:46.198271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.198476 (+   205us) service_pool.cc:224] Handling call
0709 12:24:47.306723 (+1108247us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b540041c3d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:47.306843 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55122176}
I20260709 12:24:47.308609 23013 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:47.311564 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.311658 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1985) took 1555 ms. Trace:
I20260709 12:24:47.312111 18764 rpcz_store.cc:276] 0709 12:24:45.756409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.763158 (+  6749us) service_pool.cc:224] Handling call
0709 12:24:45.790291 (+ 27133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.055833 (+1265542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.310791 (+254958us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b540012ad20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8ea02 00007f335af8add6 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:24:47.311373 (+   582us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540002d354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:47.311583 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2856718336}
W20260709 12:24:47.315398 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56982us
W20260709 12:24:47.315973 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 225408us
I20260709 12:24:47.317276 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2294) took 1284 ms. Trace:
I20260709 12:24:47.317695 18921 rpcz_store.cc:276] 0709 12:24:46.033281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.070135 (+ 36854us) service_pool.cc:224] Handling call
0709 12:24:47.317065 (+1246930us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54000f5854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:47.317183 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29801344}
I20260709 12:24:47.318460 22924 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:47.319442 23175 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.286s	user 0.003s	sys 0.000s
I20260709 12:24:47.319599 22924 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.320446 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 1972) took 1673 ms. Trace:
I20260709 12:24:47.320847 18769 rpcz_store.cc:276] 0709 12:24:45.647538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.647682 (+   144us) service_pool.cc:224] Handling call
0709 12:24:45.648004 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.048616 (+400612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.320167 (+1271551us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54001c2854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:47.320375 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847789440}
W20260709 12:24:47.321930 23183 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:24:47.321992 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:47.322688 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2284) took 1399 ms. Trace:
I20260709 12:24:47.323043 18914 rpcz_store.cc:276] 0709 12:24:45.923116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.941398 (+ 18282us) service_pool.cc:224] Handling call
0709 12:24:45.992068 (+ 50670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.410204 (+418136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.322419 (+912215us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540011fdd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:47.322613 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940607872}
W20260709 12:24:47.316344 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.028s (SENT)
I20260709 12:24:47.293404 23238 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.324319 23238 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:47.326478 23185 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:47.326555 23159 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:47.328083 23159 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:47.328998 23185 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:47.330374 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.331856 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:47.333060 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:47.339788 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:47.340809 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.342507 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.343518 19484 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:47.343885 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:47.346295 18844 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:47.354579 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 128367us
I20260709 12:24:47.354359 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:47.306104 18847 rpcz_store.cc:276] 0709 12:24:46.259729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.304127 (+1044398us) service_pool.cc:224] Handling call
0709 12:24:47.305703 (+  1576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.370523 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:47.370714 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:47.375476 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:47.377743 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:47.378698 19486 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:47.381788 19487 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:47.339605 23098 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.383375 19484 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:47.355966 23183 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:47.403255 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:47.404280 19486 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:47.409718 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.409852 19457 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.125s (SENT)
I20260709 12:24:47.402237 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:47.412962 18846 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:47.368278 23089 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:24:47.415452 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.416896 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 100599us
W20260709 12:24:47.417474 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 173848us
I20260709 12:24:47.370167 23182 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:24:47.422847 18887 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.039s (SENT)
I20260709 12:24:47.420217 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:47.426218 19458 leader_election.cc:400] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11.
I20260709 12:24:47.426610 19458 leader_election.cc:403] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:24:47.425603 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.392922 23192 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:47.396258 23098 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:47.469995 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 858) took 1319 ms. Trace:
W20260709 12:24:47.471036 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45468.7us
I20260709 12:24:47.468833 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:47.419032 23089 consensus_queue.cc:1243] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:47.472285 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.427068 23060 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:24:47.476975 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52992.9us
W20260709 12:24:47.480692 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.484223 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74404.9us
I20260709 12:24:47.484345 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:47.438599 23169 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:47.508206 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.509382 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.511333 18913 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
W20260709 12:24:47.489135 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 101394us
I20260709 12:24:47.434262 23041 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.470698 18918 rpcz_store.cc:276] 0709 12:24:46.150201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.468735 (+1318534us) service_pool.cc:224] Handling call
0709 12:24:47.469203 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.469506 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.469546 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.469610 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:47.469662 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.469739 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.469909 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:47.515106 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.522229 23041 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.525544 23041 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:47.512567 23060 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:47.527186 23060 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.504849 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:47.531294 23246 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:24:47.483688 23241 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:47.532410 23241 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.532809 23241 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:47.533237 22900 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:47.534778 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:47.536051 19488 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:47.536463 22608 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:24:47.509264 23157 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
W20260709 12:24:47.554057 19457 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.893s (SENT)
I20260709 12:24:47.554548 23098 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:47.554776 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:47.555722 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.501868 19486 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:47.433563 22808 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:24:47.427908 23017 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.505780 23066 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:47.563314 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:47.491447 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 73825.2us
I20260709 12:24:47.427012 23212 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:24:47.604090 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:47.608918 19490 raft_consensus.cc:1813] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:47.609408 18887 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.048s (SENT)
I20260709 12:24:47.609675 19490 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:47.610637 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:47.604833 22511 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:47.617429 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.618013 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 103295us
I20260709 12:24:47.611428 19488 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
W20260709 12:24:47.627235 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.513677 23169 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:47.642216 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 72504.9us
I20260709 12:24:47.645437 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2438) took 1357 ms. Trace:
I20260709 12:24:47.605159 23063 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11.
I20260709 12:24:47.663148 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:47.663457 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:47.673786 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:47.664395 23112 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.665069 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:47.665347 18765 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:47.663173 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:47.682526 18769 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
W20260709 12:24:47.682593 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 73231.9us
I20260709 12:24:47.665912 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:47.666715 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 790) took 1637 ms. Trace:
I20260709 12:24:47.664266 18917 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:47.683657 19491 rpcz_store.cc:276] 0709 12:24:46.029847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.030115 (+   268us) service_pool.cc:224] Handling call
0709 12:24:46.397316 (+367201us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b5800106598. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66eee 000000000036eb39 00007f335feda1e0 00007f335ffa30c4 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:24:46.397620 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:47.325175 (+927555us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b18004213c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af83bfb 00007f335af8e64b
0709 12:24:47.325331 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.325357 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:47.326044 (+   687us) log.cc:844] Serialized 26 byte log entry
0709 12:24:47.417481 (+ 91437us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:47.417523 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.417593 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.666436 (+248843us) raft_consensus.cc:1685] finished
0709 12:24:47.666461 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.666620 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2769,"raft.queue_time_us":130654,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":11375,"spinlock_wait_cycles":10662784,"thread_start_us":198058,"threads_started":2,"wal-append.queue_time_us":337301}
I20260709 12:24:47.688444 18766 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:47.667131 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:47.670572 23196 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:47.671272 23182 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:47.622654 23017 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.673885 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:47.673776 19483 raft_consensus.cc:2410] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:24:47.677819 18771 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:47.664217 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:47.678453 18772 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
W20260709 12:24:47.683286 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.100s (SENT)
I20260709 12:24:47.647748 18845 rpcz_store.cc:276] 0709 12:24:46.261447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.032779 (+771332us) service_pool.cc:224] Handling call
0709 12:24:47.043693 (+ 10914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.051590 (+  7897us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:47.197138 (+145548us) log.cc:844] Serialized 14 byte log entry
0709 12:24:47.417413 (+220275us) log.cc:844] Serialized 14 byte log entry
0709 12:24:47.617396 (+199983us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b18003bd6a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:24:47.618936 (+  1540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.618994 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:47.619035 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.619104 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.619238 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10524,"prepare.queue_time_us":204642,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":1786,"raft.queue_time_us":250810,"raft.run_wall_time_us":6427,"spinlock_wait_cycles":184324480,"thread_start_us":262226,"threads_started":2,"wal-append.queue_time_us":318066}
I20260709 12:24:47.640205 22900 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.645252 23169 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:47.741710 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:47.755035 18769 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:47.824790 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.825498 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.552765 23238 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:47.836419 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 455449us
W20260709 12:24:47.852780 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.872068 18773 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:47.835214 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:47.872826 18765 raft_consensus.cc:1813] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.873509 18765 raft_consensus.cc:2410] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:47.881932 18917 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:47.883741 18764 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
W20260709 12:24:47.888331 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.912034 18771 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 12:24:47.913165 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 226533us
W20260709 12:24:47.919770 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.925472 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:47.952191 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:47.793917 23196 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:47.976468 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.977540 23250 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.338s	user 0.000s	sys 0.000s
I20260709 12:24:47.831118 22900 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.731503 23089 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.219s
I20260709 12:24:47.693408 23112 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:47.982372 22511 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:47.792891 23182 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.019021 18767 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:48.020915 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 402142us
W20260709 12:24:48.031317 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.038262 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.051143 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.064003 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.069964 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.069169 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 385873us
I20260709 12:24:48.076845 23238 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:48.079246 23196 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.080165 23226 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:48.081497 23226 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:24:48.083504 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.086555 23182 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:48.025712 23192 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:48.086274 18767 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
W20260709 12:24:48.071727 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.111s (SENT)
I20260709 12:24:48.114146 22900 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:48.114758 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:48.114913 22900 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:48.116513 23182 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:48.116695 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45031.9us
W20260709 12:24:48.117455 18887 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.136s (SENT)
I20260709 12:24:48.117877 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:48.120048 18843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2406) took 2293 ms (client timeout 1608 ms). Trace:
W20260709 12:24:48.120610 18843 rpcz_store.cc:269] 0709 12:24:45.826804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.827013 (+   209us) service_pool.cc:224] Handling call
0709 12:24:48.119780 (+2292767us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540041afd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:48.119930 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185037184}
I20260709 12:24:48.151754 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:48.160723 23231 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:48.161345 23231 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.136134 23226 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:48.164333 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46910.2us
I20260709 12:24:48.164047 23150 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.149192 23192 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:48.163610 23260 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:48.173910 23160 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.187240 23150 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.173394 23098 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.211410 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:48.212493 18914 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:48.195748 23260 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:48.216499 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 264445us
I20260709 12:24:48.217839 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.188642 23169 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.220561 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:48.221403 18914 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:48.217555 23255 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:48.213966 23192 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.219722 23241 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.686s	user 0.014s	sys 0.000s
W20260709 12:24:48.233418 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 208408us
I20260709 12:24:48.231678 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:48.216899 22808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.016s
I20260709 12:24:48.162375 23231 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.214130 23098 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.225320 23255 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:24:48.247834 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.246969 18843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
W20260709 12:24:48.239202 22808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.017s
I20260709 12:24:48.229238 22900 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:48.236123 23013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.012s
I20260709 12:24:48.249321 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.206236 23160 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:48.252538 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.252120 18843 raft_consensus.cc:606] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.257313 18843 raft_consensus.cc:614] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:48.257170 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46518.2us
W20260709 12:24:48.258355 18887 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.369s (SENT)
W20260709 12:24:48.255434 23013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.005s	sys 0.012s
I20260709 12:24:48.241093 23174 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:48.261107 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.268273 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.269105 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.261664 23273 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:48.237864 23241 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.271656 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.272570 18845 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:48.273311 18844 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:24:48.285632 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:48.278177 18887 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.695s (SENT)
I20260709 12:24:48.286492 18841 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 7.
I20260709 12:24:48.255770 22900 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:48.248492 23057 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:24:48.291817 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 366451us
I20260709 12:24:48.292539 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:24:48.294111 23262 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:24:48.287987 22900 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:48.295377 23263 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:24:48.296269 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.296557 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.236701 23192 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.305824 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.310825 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.312446 23255 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.262001 23231 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:48.313459 23150 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.259312 23272 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:24:48.259436 23260 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.326917 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.328924 23241 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.333766 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:48.334815 23255 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.336892 23098 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:48.320648 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:48.321246 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.327111 23260 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:48.314754 23013 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:48.354000 22819 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:48.317080 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.355938 23078 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:48.357048 23078 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:48.357441 23272 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:48.357988 23272 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.359673 22918 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.359287 23272 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.360987 23272 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:48.362658 23150 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:48.363226 23150 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.357463 23078 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.364566 23078 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:48.364387 23150 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.365981 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:48.366212 23150 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:48.367203 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:48.368036 18921 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:48.370549 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.366473 22808 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.384217 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 106103us
W20260709 12:24:48.385401 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 68410us
I20260709 12:24:48.386914 18768 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:24:48.393024 19490 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
W20260709 12:24:48.396476 18887 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.802s (SENT)
I20260709 12:24:48.397027 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:48.397775 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:48.403244 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:48.411806 18919 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:24:48.413775 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.387691 23166 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.417032 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:48.422235 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:48.424382 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:48.405670 23069 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:48.371588 22808 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:48.435460 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50102.4us
W20260709 12:24:48.446543 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.451269 19484 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:24:48.451887 19484 pending_rounds.cc:85] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 7
I20260709 12:24:48.452210 19484 pending_rounds.cc:107] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:24:48.452525 19484 raft_consensus.cc:2889] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:48.454281 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.423885 23156 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.457453 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:48.465914 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:48.467521 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 218362us
I20260709 12:24:48.467697 18919 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 12:24:48.469017 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.471405 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.473934 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 868) took 1043 ms. Trace:
I20260709 12:24:48.474437 18913 rpcz_store.cc:276] 0709 12:24:47.430192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.430521 (+   329us) service_pool.cc:224] Handling call
0709 12:24:48.473733 (+1043212us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54003b4554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:48.473863 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88944000}
I20260709 12:24:48.418695 23041 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:24:48.427546 23166 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.419090 23226 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:48.481200 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 856) took 2407 ms. Trace:
I20260709 12:24:48.483892 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:48.483929 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:48.485653 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.486200 18812 connection.cc:256] RPC call timeout handler was delayed by -2.0431590180000967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 12:24:48.486515 18812 connection.cc:256] RPC call timeout handler was delayed by -2.0215590180000618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 12:24:48.486747 18812 connection.cc:256] RPC call timeout handler was delayed by -1.9540590179999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 12:24:48.486987 18812 connection.cc:256] RPC call timeout handler was delayed by -1.90005901800032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260709 12:24:48.487272 18812 connection.cc:256] RPC call timeout handler was delayed by -1.7029590180000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 12:24:48.487560 18812 connection.cc:256] RPC call timeout handler was delayed by -1.6534590179999213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 12:24:48.482682 18916 rpcz_store.cc:276] 0709 12:24:46.069978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.227872 (+157894us) service_pool.cc:224] Handling call
0709 12:24:47.324159 (+1096287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.324381 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.324413 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.324487 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:47.324560 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.324635 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.477151 (+1152516us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000f5850. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:48.477278 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494191488}
I20260709 12:24:48.443198 23214 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:48.492575 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.495884 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:48.496048 23226 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:48.496549 23226 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.497521 23226 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.498956 23089 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:48.501132 18812 leader_election.cc:400] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11.
I20260709 12:24:48.502409 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.503551 23089 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.476205 23279 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:24:48.511118 23279 consensus_queue.cc:1243] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:48.511806 23279 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:48.512135 23279 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.523931 18914 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:24:48.485047 23264 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.528966 23043 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:48.530753 23259 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.536283 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52433.2us
I20260709 12:24:48.489509 23192 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:48.493064 23274 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.542670 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.544946 18842 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:48.501163 22808 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.546638 23102 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.614871 18920 raft_consensus.cc:1217] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Deduplicated request from leader. Original: 5.7->[6.8-6.8]   Dedup: 6.8->[]
I20260709 12:24:48.539213 23260 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:24:48.615461 18920 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:48.547039 23043 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:24:48.555751 23258 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.622875 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.623314 23278 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:48.624023 23268 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:24:48.625262 23242 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:48.617264 23102 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.629592 18843 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
W20260709 12:24:48.634243 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.614897 23071 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.643357 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.615015 23261 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.644153 23066 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.647414 23066 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:48.649741 23281 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:24:48.652084 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 799) took 1284 ms. Trace:
I20260709 12:24:48.652611 19483 rpcz_store.cc:276] 0709 12:24:47.367972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.411838 (+ 43866us) service_pool.cc:224] Handling call
0709 12:24:48.651806 (+1239968us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400562a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:48.651988 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326915456}
I20260709 12:24:48.664089 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.666971 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:48.641912 23242 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.688946 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.548020 23274 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.652873 23258 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.650182 23112 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:48.653494 23261 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.697247 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:48.690881 18847 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:48.680742 23278 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:48.699244 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 167307us
I20260709 12:24:48.512997 23279 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.701833 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.548609 23264 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.542984 23259 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.693248 23013 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:48.646337 23071 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.715052 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2300) took 1070 ms. Trace:
I20260709 12:24:48.698283 22905 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.718369 18921 raft_consensus.cc:2410] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:48.722071 18919 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:48.722254 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.700690 23098 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:48.719138 18918 rpcz_store.cc:276] 0709 12:24:47.644723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.646634 (+  1911us) service_pool.cc:224] Handling call
0709 12:24:47.646954 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:47.681717 (+ 34763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.681774 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:47.695080 (+ 13306us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.217473 (+522393us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:48.218709 (+  1236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.218789 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.714730 (+495941us) raft_consensus.cc:1685] finished
0709 12:24:48.714764 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.714959 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19616,"raft.queue_time_us":23313,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":41236,"thread_start_us":265932,"threads_started":1,"wal-append.queue_time_us":590520}
I20260709 12:24:48.701648 23278 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:48.708711 23273 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:48.727980 23273 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:48.728448 23078 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.730667 23078 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:48.728467 23273 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:48.731755 23261 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.733309 23258 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:48.734982 23274 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.726936 23278 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.740340 23273 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.742756 23273 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.743422 23273 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:48.743906 23071 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.748695 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.750305 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.752483 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.710804 23013 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.755053 18839 raft_consensus.cc:2410] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:48.727331 23242 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.756443 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:48.709486 23112 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:24:48.767674 22918 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:48.767791 23242 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.768360 23112 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:48.771950 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:48.772615 19485 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.772791 19484 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: []
W20260709 12:24:48.773907 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.758906 23102 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.759469 23273 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.763934 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.765592 18847 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:48.775508 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:48.760792 23098 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:48.763042 23013 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:48.762903 22819 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.803902 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:48.803435 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.804915 19483 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:48.809250 19488 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:48.818086 18767 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:48.798966 23293 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:24:48.821784 22905 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:48.825639 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.826362 23293 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:48.826680 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.810889 23260 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:48.826812 23293 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.826416 18771 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:48.829011 23293 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.830473 23293 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:48.836185 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.837016 18771 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
W20260709 12:24:48.822953 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59109.1us
I20260709 12:24:48.839165 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.839910 18771 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:48.840437 19485 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:48.840065 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.842020 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:48.842953 18771 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.844527 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:48.844954 18773 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:48.845153 18770 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:48.846120 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.846839 18772 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:48.858908 18844 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 12:24:48.852088 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:48.861248 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.858963 18771 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:48.861924 18844 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:48.868170 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:48.868829 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.869143 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:48.869377 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2412) took 2969 ms (client timeout 1677 ms). Trace:
I20260709 12:24:48.869961 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.870810 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.871385 18772 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:48.871480 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.872215 23273 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:48.872607 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.869796 18840 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:48.873247 18844 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:48.873893 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.874691 18764 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:48.873948 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.875042 23259 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.808578 22819 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.876668 18840 raft_consensus.cc:2410] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:48.817075 23078 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:48.876369 23272 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:48.877079 23078 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:48.877526 23078 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.877712 23272 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:48.878103 23272 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.879428 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.879602 23071 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:48.879091 23272 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.880077 18841 raft_consensus.cc:2376] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10. Re-sending same reply.
I20260709 12:24:48.880236 23071 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.880726 23272 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.881068 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.881681 18841 raft_consensus.cc:2376] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11. Re-sending same reply.
I20260709 12:24:48.868877 18773 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.843470 23278 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.885681 23278 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.872645 23017 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:48.869768 18839 rpcz_store.cc:269] 0709 12:24:45.899959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.906883 (+  6924us) service_pool.cc:224] Handling call
0709 12:24:48.869159 (+2962276us) spinlock_profiling.cc:243] Waited 2.81 s on lock 0x7b5400285354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:48.869307 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6452747008}
I20260709 12:24:48.814023 23098 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:48.890715 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.891031 23098 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:48.891490 18839 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:48.893338 23098 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:48.814108 23298 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:48.850059 23264 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:48.894980 23071 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:48.848852 23238 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:48.874133 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.901032 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:48.902819 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:48.903625 18921 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.899407 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.899478 18844 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:24:48.907114 18914 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:48.907709 18887 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.818s (SENT)
W20260709 12:24:48.908588 18887 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.822s (SENT)
W20260709 12:24:48.907320 22900 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.006s
I20260709 12:24:48.910100 22900 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:48.902937 18773 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:48.905099 18839 raft_consensus.cc:2376] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8. Re-sending same reply.
W20260709 12:24:48.934827 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.972471 18921 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:48.914651 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.912887 18918 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:48.974229 18841 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:48.974113 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:48.920820 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:48.975132 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54448.7us
I20260709 12:24:48.975617 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:48.924666 18770 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:48.978142 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:48.914415 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:48.883005 22905 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:48.926769 18920 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:48.943481 22900 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:48.987042 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:48.987804 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.987926 18920 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
W20260709 12:24:48.980037 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65753.1us
I20260709 12:24:48.980260 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:48.898244 23238 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:48.981138 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.000409 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.002861 18913 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:49.004248 18841 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:49.004956 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:48.992841 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.006316 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:24:48.990250 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 206583us
I20260709 12:24:48.989616 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:49.010665 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.011881 18921 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:48.987531 23279 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.981762 23302 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.012365 23112 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:49.034343 18771 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:24:49.036284 18844 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:49.036593 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.989890 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.015362 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:49.007217 18839 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:48.981942 23242 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:49.038380 18841 raft_consensus.cc:2376] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9. Re-sending same reply.
I20260709 12:24:49.028717 23078 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.017616 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:48.912236 23013 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.025972 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.026659 23185 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:49.028000 18886 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:49.013563 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.029574 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:48.988214 23286 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.037467 18771 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:49.041116 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.062716 18841 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:49.063773 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.017010 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.042176 18917 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:49.045030 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.031046 23272 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:49.048753 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:49.030706 23264 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.007658 23198 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:49.049750 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.052114 18921 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:49.070941 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.071970 18921 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:49.074465 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.047288 18770 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:49.031581 23302 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.069202 22930 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.064821 18764 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
W20260709 12:24:49.067174 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.068008 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.078675 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:49.069871 18918 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:48.984773 23260 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:24:49.090271 18769 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:24:49.092031 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.084517 18918 pending_rounds.cc:85] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 4
I20260709 12:24:49.085381 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.092864 18918 pending_rounds.cc:107] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:49.093190 18918 raft_consensus.cc:2889] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.084947 18766 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:49.089942 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.084947 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.069114 23159 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:24:49.049317 23242 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:49.096486 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.061937 23286 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:49.067188 23272 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.099195 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:49.102941 18738 connection.cc:256] RPC call timeout handler was delayed by -1.4242160720000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:24:49.120466 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.121272 18769 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:49.122910 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.123653 18769 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:49.100467 23078 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.081480 23160 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.097643 23185 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:24:49.105960 23242 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.077839 23264 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.108150 23013 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:49.108385 22918 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.119096 23071 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:49.108609 23259 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.108151 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.109714 23265 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:49.097990 23238 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.078469 23302 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:49.167232 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 59134.7us
I20260709 12:24:49.169243 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.114063 23066 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.081895 23196 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:49.115098 23286 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.116473 23272 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:49.136325 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.183877 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.101981 18844 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:49.149497 18769 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:24:49.188951 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.152174 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2305) took 1505 ms. Trace:
I20260709 12:24:49.190596 18917 rpcz_store.cc:276] 0709 12:24:47.646354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.951643 (+305289us) service_pool.cc:224] Handling call
0709 12:24:47.992927 (+ 41284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.065503 (+1072576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.151766 (+ 86263us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540027e7d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:49.152078 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412594432}
I20260709 12:24:49.078855 23198 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.195648 23198 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:49.142040 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:49.178113 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:49.153007 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76713.6us
I20260709 12:24:49.196740 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:49.197104 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55175.4us
I20260709 12:24:49.198562 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.200879 23198 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.203814 23198 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:49.200074 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.205583 18769 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:49.207154 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.208743 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:49.182240 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.213150 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:49.214994 18844 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:49.125456 23159 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:24:49.216380 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.216567 18769 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.218190 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.219067 23259 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:49.219259 23102 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:49.219659 23259 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.219735 23102 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.220167 23259 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.220235 23102 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.222003 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.221801 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:49.155956 23265 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:49.223747 23258 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:49.223657 23260 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:49.179253 23160 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:49.225538 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.225843 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:49.236192 18844 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.212453 23089 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:49.229043 23293 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:49.232059 23303 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:49.243079 23293 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.246737 23303 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.245411 23296 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:49.246829 23293 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.247318 23169 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:49.247505 23303 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:49.247545 23296 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.249959 23296 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.184681 23078 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:24:49.244692 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:49.176968 23071 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.263073 18769 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:49.265005 18844 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:49.230844 22918 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:49.266782 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.271651 18844 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:49.231238 23258 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:49.301190 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:49.300334 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:49.302764 18844 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.313598 23264 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:49.299417 23258 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:49.320603 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2549) took 1662 ms. Trace:
I20260709 12:24:49.321152 18768 rpcz_store.cc:276] 0709 12:24:47.658083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.658250 (+   167us) service_pool.cc:224] Handling call
0709 12:24:47.691527 (+ 33277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.394062 (+702535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.320265 (+926203us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54001c1954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:49.320513 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590045568}
I20260709 12:24:49.326176 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2240) took 1056 ms. Trace:
I20260709 12:24:49.326663 18843 rpcz_store.cc:276] 0709 12:24:48.269880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.295902 (+ 26022us) service_pool.cc:224] Handling call
0709 12:24:49.326001 (+1030099us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400381154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:49.326108 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715939712}
I20260709 12:24:49.327834 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:49.328410 18843 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.335750 23071 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:49.341282 23071 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:49.341719 23293 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.342000 23071 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.338245 18843 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:49.344568 23071 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.345521 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.268970 23078 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:24:49.349608 23078 consensus_queue.cc:1243] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:49.349956 23258 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.348034 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.352057 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.350139 23078 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:49.347440 23293 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.356549 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:49.357213 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:49.358316 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:49.359156 18769 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.367395 23089 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.368222 23089 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.267570 23260 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:49.371670 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 186218us
I20260709 12:24:49.373322 18839 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
W20260709 12:24:49.374023 18738 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.073s (SENT)
I20260709 12:24:49.354784 23258 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.386164 18844 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:49.377902 18843 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:49.299474 22918 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:49.390718 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.391064 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.396690 18845 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:24:49.380721 23260 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:49.400381 23309 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:24:49.410467 18839 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:24:49.417984 18846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2210) took 2416 ms (client timeout 2132 ms). Trace:
W20260709 12:24:49.418659 18846 rpcz_store.cc:269] 0709 12:24:47.001953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.008040 (+  6087us) service_pool.cc:224] Handling call
0709 12:24:49.417670 (+2409630us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54001090d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:49.417869 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878745472}
I20260709 12:24:49.388125 23259 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.415707 23089 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:49.410297 23260 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.431974 18769 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
W20260709 12:24:49.435846 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 237880us
I20260709 12:24:49.413177 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.442554 18846 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:49.443035 18769 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:49.444201 22905 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.444485 18769 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:49.445746 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.390362 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.390677 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.388403 23174 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.448100 18916 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:49.412313 22918 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:49.449882 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59293.2us
I20260709 12:24:49.391098 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.451679 18844 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:49.455531 18769 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:49.459596 23319 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:24:49.461998 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.453491 23071 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:49.457726 22854 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:24:49.472632 23259 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:49.451165 23102 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.475026 18843 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:49.476186 23098 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.476914 23098 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.480135 22819 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:49.480393 23098 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:49.482458 18842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2426) took 3241 ms (client timeout 1948 ms). Trace:
W20260709 12:24:49.482936 18842 rpcz_store.cc:269] 0709 12:24:46.241016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.241287 (+   271us) service_pool.cc:224] Handling call
0709 12:24:49.482221 (+3240934us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54003269d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:49.482358 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5159261440}
I20260709 12:24:49.473825 23260 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.461236 23112 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.495605 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.497257 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.497937 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.498442 18918 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:49.500288 23156 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:49.500187 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.500998 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.500787 23156 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:49.465312 22900 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.501855 18917 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:49.503310 23156 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.504540 23156 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:49.507480 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:49.507866 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56228.7us
I20260709 12:24:49.508438 18767 raft_consensus.cc:2410] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:24:49.509749 18767 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:49.510026 23317 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:49.511119 23182 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:49.511492 23182 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:49.512506 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2236) took 1243 ms. Trace:
I20260709 12:24:49.512356 23182 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.512867 18847 rpcz_store.cc:276] 0709 12:24:48.268786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.328008 (+ 59222us) service_pool.cc:224] Handling call
0709 12:24:48.328363 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.780872 (+452509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.512208 (+731336us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540041aad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:49.512411 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833378176}
I20260709 12:24:49.486826 22854 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:24:49.517704 18847 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:24:49.518285 18847 pending_rounds.cc:85] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 5
I20260709 12:24:49.518569 18847 pending_rounds.cc:107] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:24:49.518833 18847 raft_consensus.cc:2889] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.453329 23174 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.520403 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:49.532569 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:49.529220 22900 raft_consensus.cc:2764] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:49.534024 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.465652 23066 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:24:49.464286 23296 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.561007 18845 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:49.559427 23303 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.563329 18845 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:49.563459 18765 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:49.547109 18767 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:24:49.548264 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.545665 23186 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.549038 23102 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.514125 23302 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.543836 23311 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:49.530241 23272 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.574092 23186 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:49.576946 23186 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.579452 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:49.555967 18843 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:49.584213 23302 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.585354 23296 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.585772 23198 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:49.589102 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:24:49.580647 23290 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.878s	user 0.003s	sys 0.003s
W20260709 12:24:49.592770 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.553005 23174 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.556643 23286 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.582787 23261 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:24:49.620316 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 124784us
W20260709 12:24:49.599512 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.622893 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.595724 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:49.624048 23198 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:49.571614 23303 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:49.579061 23272 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:49.624926 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2321) took 1445 ms. Trace:
I20260709 12:24:49.626658 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.627450 18917 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:49.628311 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:49.626088 18915 rpcz_store.cc:276] 0709 12:24:48.179697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.374650 (+194953us) service_pool.cc:224] Handling call
0709 12:24:48.402820 (+ 28170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.473934 (+ 71114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.473965 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.474674 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.548446 (+ 73772us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:48.548490 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.548557 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.579997 (+1031440us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:49.616640 (+ 36643us) raft_consensus.cc:1685] finished
0709 12:24:49.616668 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.624854 (+  8186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9245,"raft.queue_time_us":25913,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10483,"spinlock_wait_cycles":10938112,"thread_start_us":101825,"threads_started":2,"wal-append.queue_time_us":155240}
I20260709 12:24:49.630721 18922 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:49.631316 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.630959 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 168004us
I20260709 12:24:49.633000 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:49.622187 23317 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:49.636976 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:49.622534 23261 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:49.638386 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:49.639633 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:49.625597 23198 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:49.648075 18887 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.677s (SENT)
I20260709 12:24:49.635967 22924 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:49.655891 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:49.657124 23319 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.658552 23166 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:49.663097 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:49.651095 23303 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:49.652609 23264 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:49.652796 23302 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 12:24:49.665017 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.666575 23112 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:49.639350 23311 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:49.681195 23311 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:49.681710 23311 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:49.640993 23317 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:49.672113 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.688881 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66084.1us
I20260709 12:24:49.689795 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:49.690078 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.673887 19490 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:49.691191 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.692260 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.692862 18920 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.640254 23169 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:49.675740 19488 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:49.700809 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:49.701454 18771 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.642122 23198 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:49.671454 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:49.702700 19485 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:24:49.678263 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.704211 18921 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:49.687263 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.635691 23174 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:49.707623 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.707697 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:49.708660 18845 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:49.708860 18765 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.707506 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:49.710813 18770 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.693459 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.700034 18915 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:49.705569 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:49.706070 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.716328 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.717377 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:49.717576 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:49.718071 19483 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:49.718029 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.718219 18764 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.716717 18770 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:49.677141 23150 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:49.709546 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:49.721611 18771 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:49.722604 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:49.720516 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.682369 23238 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.684182 22900 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:49.747465 23265 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.748605 23265 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:49.724818 23168 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.718019 23169 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:49.725201 22918 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.705560 23303 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:49.751739 23303 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.694020 23264 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:49.732385 23286 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:49.754479 23264 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.756876 23182 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.758755 18768 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:24:49.684728 22924 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:49.761044 22924 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.726356 19488 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:24:49.762923 19488 pending_rounds.cc:85] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 8
I20260709 12:24:49.763186 19488 pending_rounds.cc:107] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:24:49.763455 19488 raft_consensus.cc:2889] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.703904 23166 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:24:49.728649 23226 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.718567 23185 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:24:49.733095 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:49.709764 23261 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:49.727182 23112 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:49.717762 23319 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:49.720932 23313 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:24:49.736763 23317 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.721730 23272 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.739687 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.784479 18840 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:49.742969 18839 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:24:49.786600 18839 pending_rounds.cc:85] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 7
I20260709 12:24:49.786904 18839 pending_rounds.cc:107] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:24:49.787211 18839 raft_consensus.cc:2889] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.689720 23260 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:49.750281 23169 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:49.735002 23150 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:49.729100 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:49.765296 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:49.765657 18843 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:49.767400 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:49.768100 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44705us
I20260709 12:24:49.771109 18765 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:49.773473 18920 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
W20260709 12:24:49.774744 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54299.8us
I20260709 12:24:49.776530 23066 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:49.777249 23166 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:49.778148 23185 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:24:49.789181 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.779532 23293 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.790246 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:49.799176 18845 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:49.828926 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:49.804047 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.793253 22918 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:49.805646 23308 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.510s	user 0.003s	sys 0.001s
I20260709 12:24:49.806155 22900 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:49.922245 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 232646us
I20260709 12:24:49.790642 23071 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:49.783785 23212 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.782490 23286 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:49.815685 23261 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.825124 18764 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:49.831069 18844 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:24:49.802098 23102 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.889846 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:49.942087 19485 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:24:49.891775 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:49.905396 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76540.7us
I20260709 12:24:49.807523 22930 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:49.923489 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:49.932082 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:49.918829 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114851us
I20260709 12:24:50.202735 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:50.019182 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.178267 23186 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260709 12:24:49.821691 23066 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:49.922972 23057 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:50.031251 18920 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:50.219424 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:49.903813 22918 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.828748 23166 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:50.043296 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 119870us
I20260709 12:24:50.233353 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:50.235363 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:50.044865 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:49.827651 23185 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:49.934020 23212 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.835098 23313 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 12:24:49.895025 23296 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 12:24:50.060261 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:50.243741 18914 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:24:50.066524 18671 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:50.068794 23323 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:24:50.257328 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:50.072139 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2003) took 1045 ms. Trace:
I20260709 12:24:50.033166 23102 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.926528 23293 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.052021 23259 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.261976 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:50.049892 22905 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:24:50.075863 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.057185 23302 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.939107 23071 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.052603 23286 consensus_queue.cc:1243] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:50.054833 23168 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:50.075351 22854 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.243543 23212 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.084930 23272 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.113698 18667 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 278) took 23912 ms (client timeout 15000 ms). Trace:
I20260709 12:24:50.114915 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:50.122422 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c18380178684f0e93b10d0c7a912d02 with delete_type TABLET_DATA_TOMBSTONED (TS 1e2529a8cff04207bb1b07c108e16983 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:33726
I20260709 12:24:50.125085 23258 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:50.104321 23196 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.120666 23329 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260709 12:24:50.138150 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 206138us
I20260709 12:24:50.142810 23336 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:50.144061 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:50.409780 19492 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:50.144316 19485 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:50.144811 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:50.174352 19487 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:50.176194 19490 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:49.944453 22930 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:49.933287 23260 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:24:50.224217 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.225065 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 340204us
I20260709 12:24:50.217679 23078 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.258240 18773 rpcz_store.cc:276] 0709 12:24:49.026789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.027588 (+   799us) service_pool.cc:224] Handling call
0709 12:24:49.027886 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.028279 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.028306 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:49.028778 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:24:49.092184 (+ 63406us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:49.092227 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.092295 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.761421 (+669126us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:50.071844 (+310423us) raft_consensus.cc:1685] finished
0709 12:24:50.071868 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.072067 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7270,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":6991,"spinlock_wait_cycles":9581312,"thread_start_us":63016,"threads_started":1,"wal-append.queue_time_us":182043}
W20260709 12:24:50.267266 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.267195 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.392962 23226 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.002s
I20260709 12:24:50.237936 22918 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.230641 23089 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:24:50.260989 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.033128 23150 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.243908 23013 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:50.243091 23265 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:50.465020 18841 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:50.246277 23303 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:50.262908 23102 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.272418 23057 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.374264 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 154954us
I20260709 12:24:50.231657 23186 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.402734 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:50.314193 23340 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:24:50.459829 23334 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:24:50.413862 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:50.274284 23259 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.426452 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2245) took 1504 ms. Trace:
I20260709 12:24:50.493979 18848 rpcz_store.cc:276] 0709 12:24:48.921869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.038516 (+116647us) service_pool.cc:224] Handling call
0709 12:24:50.418302 (+1379786us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003287d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:50.426355 (+  8053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2674446208}
I20260709 12:24:50.440969 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:50.445444 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:50.496119 19485 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:50.460812 18671 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 6 to 7, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 7 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:50.454783 23258 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.485282 23238 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.739s	user 0.014s	sys 0.001s
I20260709 12:24:50.391331 22900 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.315238 22854 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.336877 23272 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.428051 23348 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:50.459268 23279 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:24:50.391512 23298 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:24:50.486081 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:50.341655 22905 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.391744 23302 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:24:50.409579 23112 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:24:50.462946 23346 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:50.465934 23296 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.335088 23185 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.536556 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:50.343572 23166 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:50.407217 23311 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.725s	user 0.020s	sys 0.000s
W20260709 12:24:50.315845 18667 rpcz_store.cc:269] 0709 12:24:26.200858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.201132 (+   274us) service_pool.cc:224] Handling call
0709 12:24:26.283432 (+ 82300us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b5400030890. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e67640 00007f3360d3e846 00007f3360e4890e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc 00007f335f308392 00007f33592c648c 00007f33592c58c6
0709 12:24:50.113579 (+23830147us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:46.222922 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:46.235094 (+ 12172us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:46.235154 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:24:46.235172 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:46.332502 (+ 97330us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:46.332583 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:46.332616 (+    33us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:24:46.334012 (+  1396us) tablet.cc:701] Row locks acquired
0709 12:24:46.334058 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:24:46.334278 (+   220us) write_op.cc:270] Start()
0709 12:24:46.384154 (+ 49876us) write_op.cc:276] Timestamp: P: 1783599886334200 usec, L: 0
0709 12:24:46.384202 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 12:24:46.425886 (+ 41684us) log.cc:844] Serialized 6661 byte log entry
0709 12:24:47.207141 (+781255us) op_driver.cc:464] REPLICATION: finished
0709 12:24:47.665457 (+458316us) write_op.cc:301] APPLY: starting
0709 12:24:47.665568 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:48.079901 (+414333us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:48.080042 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:48.546293 (+466251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:48.647209 (+100916us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:24:48.647259 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:48.647751 (+   492us) log.cc:844] Serialized 156 byte log entry
0709 12:24:48.721523 (+ 73772us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:48.738992 (+ 17469us) write_op.cc:454] Released schema lock
0709 12:24:48.739078 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:48.739569 (+   491us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:48.739600 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":603141,"reported_tablets":50,"spinlock_wait_cycles":10026752,"child_traces":[["op",{"apply.queue_time_us":421193,"apply.run_cpu_time_us":41700,"apply.run_wall_time_us":1074108,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75289,"num_ops":17,"prepare.queue_time_us":236279,"prepare.run_cpu_time_us":61727,"prepare.run_wall_time_us":686809,"raft.queue_time_us":113452,"raft.run_cpu_time_us":14079,"raft.run_wall_time_us":229005,"replication_time_us":819080,"thread_start_us":711005,"threads_started":5,"wal-append.queue_time_us":668796,"wal-append.run_cpu_time_us":29539,"wal-append.run_wall_time_us":2215044}]]}
I20260709 12:24:50.562321 18842 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:24:50.639802 18842 pending_rounds.cc:85] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 4
I20260709 12:24:50.640102 18842 pending_rounds.cc:107] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:24:50.640342 18842 raft_consensus.cc:2889] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.313349 23168 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.343859 23066 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:50.506911 23198 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.783s	user 0.012s	sys 0.000s
I20260709 12:24:50.574959 18921 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:50.580124 19485 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
W20260709 12:24:50.544173 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 54392.6us
I20260709 12:24:50.947714 23186 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:50.948763 18886 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.809s (SENT) [suppressed 37 similar messages]
I20260709 12:24:50.949688 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2335) took 1242 ms. Trace:
W20260709 12:24:50.593379 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 190758us
I20260709 12:24:50.949939 18916 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:50.950585 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:50.951853 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:50.953006 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:50.423836 23336 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.454775 23078 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.954099 23350 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:50.955322 23347 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:50.955719 23347 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:50.956243 23336 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:50.956499 23078 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:50.597975 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 92815.8us
I20260709 12:24:50.951874 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 891) took 1170 ms. Trace:
I20260709 12:24:50.958163 23343 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:24:50.959017 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.597898 23089 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:50.959837 23345 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:50.957928 18916 rpcz_store.cc:276] 0709 12:24:49.781055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.781536 (+   481us) service_pool.cc:224] Handling call
0709 12:24:50.949642 (+1168106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.950555 (+   913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.951609 (+  1054us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000f5850. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:50.951785 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662615424}
I20260709 12:24:50.960772 23089 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.962034 23363 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:50.568943 18671 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 5 to 6, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 6 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:50.956568 23347 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.622516 19484 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:50.964385 23347 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:50.530165 23226 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.965363 23226 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.966486 18921 rpcz_store.cc:276] 0709 12:24:49.707247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.707388 (+   141us) service_pool.cc:224] Handling call
0709 12:24:50.949476 (+1242088us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54000f5854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:50.949629 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991758208}
I20260709 12:24:50.967749 23226 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:50.537097 23339 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:50.968735 23339 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.970678 23369 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:50.971486 23369 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:50.491329 23057 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.893802 22918 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.973865 23057 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:50.676081 23337 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
W20260709 12:24:50.877259 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.974700 22918 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:50.618539 22905 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.676564 22854 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:50.888252 23344 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.975952 23260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.030s	sys 0.025s
W20260709 12:24:50.674153 23351 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:24:50.671768 23355 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:24:51.033782 23260 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:51.037144 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 842) took 1239 ms. Trace:
I20260709 12:24:51.036870 23260 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.039534 18671 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:51.043774 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2486) took 1354 ms. Trace:
W20260709 12:24:51.044013 23358 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.060s	user 0.005s	sys 0.011s
I20260709 12:24:51.041741 18671 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:24:51.045337 23362 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.057s	user 0.000s	sys 0.003s
I20260709 12:24:51.044291 18839 rpcz_store.cc:276] 0709 12:24:49.691593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.796178 (+104585us) service_pool.cc:224] Handling call
0709 12:24:49.829032 (+ 32854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.839402 (+ 10370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.839441 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:49.889767 (+ 50326us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.098913 (+209146us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:50.393624 (+294711us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.412186 (+ 18562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.412268 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.043508 (+631240us) raft_consensus.cc:1685] finished
0709 12:24:51.043531 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.043699 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74334,"prepare.queue_time_us":463557,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":101980,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":36722,"thread_start_us":404403,"threads_started":2,"wal-append.queue_time_us":295719}
I20260709 12:24:51.048481 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:51.032617 23319 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.010s	sys 0.011s
I20260709 12:24:50.612977 23352 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.672785 23333 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:24:50.769667 19492 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
W20260709 12:24:50.824600 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.059002 23319 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.010s	sys 0.011s
I20260709 12:24:50.680002 23071 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:50.640570 23296 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:50.737082 23182 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.980s	user 0.013s	sys 0.000s
I20260709 12:24:50.671600 23298 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:50.672855 23265 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.412632 23196 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.692683 23238 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:24:50.767009 23185 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:50.604378 23348 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.668911 23166 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.689607 23150 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:50.751362 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.865172 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.119527 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.797600 23327 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.718s	user 0.004s	sys 0.002s
I20260709 12:24:50.528848 22930 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.804540 23356 tablet_replica.cc:333] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:24:50.662706 19489 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:24:50.729882 23338 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.421s	user 0.001s	sys 0.001s
W20260709 12:24:50.924834 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.820513 23261 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.003s
I20260709 12:24:50.671012 23168 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:50.684878 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2251) took 1583 ms. Trace:
I20260709 12:24:51.136101 18842 rpcz_store.cc:276] 0709 12:24:49.101489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.486721 (+385232us) service_pool.cc:224] Handling call
0709 12:24:49.496595 (+  9874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.640931 (+1144336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.684623 (+ 43692us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540041b4d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:50.684809 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395187072}
I20260709 12:24:50.565250 22900 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.728421 23279 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.681274 23156 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:50.771282 23259 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:50.663694 23311 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.150087 23311 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:50.678673 23198 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:50.538815 23258 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.152310 23198 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:51.152561 23258 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:50.746263 18841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2476) took 1723 ms (client timeout 1809 ms). Trace:
W20260709 12:24:51.153201 18841 rpcz_store.cc:269] 0709 12:24:49.023268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.063508 (+ 40240us) service_pool.cc:224] Handling call
0709 12:24:50.745956 (+1682448us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:50.746153 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3220920192}
I20260709 12:24:50.674681 23242 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:51.154206 23242 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:51.155272 23242 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.156427 23242 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.945031 23066 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:50.542451 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47356.2us
I20260709 12:24:50.956885 23112 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:51.163159 23112 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.163764 23112 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.167732 23336 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:51.169054 23336 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:50.962563 23363 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.865121 23102 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:50.971632 23339 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:50.998855 23212 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.005s
I20260709 12:24:51.045749 18671 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.169437 23336 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:50.669534 23366 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:50.679113 23272 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:50.622164 23346 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:51.082293 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 596250us
I20260709 12:24:51.197845 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.198305 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.198586 19484 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
W20260709 12:24:51.083292 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.010s
W20260709 12:24:51.199155 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.007s	sys 0.010s
W20260709 12:24:50.675173 23330 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 12:24:51.088177 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.094507 23369 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:51.104944 18738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.007s	sys 0.006s
W20260709 12:24:51.210351 18738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.007s	sys 0.006s
W20260709 12:24:51.210759 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 818884us
W20260709 12:24:51.108803 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.002s	sys 0.011s
W20260709 12:24:51.211911 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.002s	sys 0.011s
I20260709 12:24:51.004621 23344 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.112519 18847 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:24:51.103418 23303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.011s
I20260709 12:24:51.087847 23340 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:51.124946 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.127172 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:51.106772 23013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.013s	sys 0.006s
I20260709 12:24:51.107276 22924 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.130784 18915 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.133435 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:51.107337 23298 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:24:51.109611 23317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.289s	user 0.017s	sys 0.000s
W20260709 12:24:51.137194 19456 leader_election.cc:336] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.786s (SENT)
W20260709 12:24:51.144083 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.279036 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:51.242355 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44142.5us
W20260709 12:24:51.280066 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 142952us
I20260709 12:24:51.245983 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.146739 23279 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.147482 23156 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:51.288758 18736 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.007s	sys 0.009s
W20260709 12:24:51.289280 18736 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.007s	sys 0.009s
I20260709 12:24:51.170730 18920 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:51.171494 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.290892 18921 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:51.292440 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.293052 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.172457 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.295876 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:51.296686 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:51.238006 23303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.000s	sys 0.011s
I20260709 12:24:50.672266 23293 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:51.176448 23112 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:51.192910 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.193617 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:51.139678 23325 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.010s	sys 0.008s
W20260709 12:24:51.303896 23325 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.011s	sys 0.008s
I20260709 12:24:51.304117 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2249) took 2205 ms. Trace:
I20260709 12:24:51.198176 23212 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.304591 18846 rpcz_store.cc:276] 0709 12:24:49.098541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.449871 (+351330us) service_pool.cc:224] Handling call
0709 12:24:49.454934 (+  5063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.455273 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.455303 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:49.455762 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:24:49.626959 (+171197us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:49.627527 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.627594 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.771539 (+1143945us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:51.284399 (+512860us) raft_consensus.cc:1685] finished
0709 12:24:51.284422 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.304039 (+ 19617us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1459,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3585,"spinlock_wait_cycles":20987776,"thread_start_us":152134,"threads_started":1,"wal-append.queue_time_us":344053}
I20260709 12:24:51.110879 23265 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.308143 23265 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.134927 23186 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.308954 23186 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.311484 23186 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:51.200323 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.312373 23212 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.283901 23272 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.313542 23272 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.315230 23303 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:51.286325 23168 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:51.316545 23168 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:51.317004 22905 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.316640 23303 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.239593 23369 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.320461 23369 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.321519 23374 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:51.322328 23374 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.324811 23374 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:51.102773 23352 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.327230 23259 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.327574 18920 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:24:51.327888 23259 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.328809 23352 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.179286 23363 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:51.241565 18917 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:24:51.240507 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.329867 18917 pending_rounds.cc:85] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 4
I20260709 12:24:51.330233 18917 pending_rounds.cc:107] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:24:51.330569 18917 raft_consensus.cc:2889] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:51.331398 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 131159us
I20260709 12:24:51.207593 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:51.273715 18764 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:51.285544 18918 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:51.277863 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:51.225642 23264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.028s	sys 0.031s
W20260709 12:24:51.270592 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 137240us
I20260709 12:24:51.298523 22854 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:51.299669 23196 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:51.353823 22918 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.354431 23325 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:51.354624 22918 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.355804 23325 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:51.356297 23325 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:51.037575 19488 rpcz_store.cc:276] 0709 12:24:49.797689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.797849 (+   160us) service_pool.cc:224] Handling call
0709 12:24:49.806448 (+  8599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.338827 (+532379us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:50.393129 (+ 54302us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.980485 (+587356us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.981595 (+  1110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.981660 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:50.981736 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.036396 (+ 54660us) spinlock_profiling.cc:243] Waited 900 us on lock 0x7b180046af80. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419
0709 12:24:51.036889 (+   493us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400590e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:51.036935 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.037082 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63118,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":263953,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":34464,"spinlock_wait_cycles":1177350528,"thread_start_us":586437,"threads_started":2,"wal-append.queue_time_us":580229}
I20260709 12:24:51.321586 23368 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:51.359570 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:51.360132 23370 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.359692 23368 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.360769 23370 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.361577 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.363569 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.260113 23169 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:51.278756 23317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.466s	user 0.018s	sys 0.000s
I20260709 12:24:51.343448 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:51.332765 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 125306us
I20260709 12:24:51.384223 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:51.347023 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49857.3us
W20260709 12:24:51.178962 18919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.002s	sys 0.019s
W20260709 12:24:51.388736 18919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.002s	sys 0.019s
I20260709 12:24:51.389911 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2343) took 1278 ms. Trace:
I20260709 12:24:51.294183 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:51.349277 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68966.1us
W20260709 12:24:51.352231 18887 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.514s (SENT)
I20260709 12:24:51.364370 18918 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
W20260709 12:24:51.394547 18886 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.514s (SENT)
I20260709 12:24:51.277671 23089 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:51.395279 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:51.395589 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:51.396281 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44120.9us
I20260709 12:24:51.353853 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:51.316439 23272 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:51.343588 23264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.028s	sys 0.032s
I20260709 12:24:51.390434 18919 rpcz_store.cc:276] 0709 12:24:50.111187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.111344 (+   157us) service_pool.cc:224] Handling call
0709 12:24:50.123378 (+ 12034us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:50.315597 (+192219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.315646 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:50.333194 (+ 17548us) log.cc:844] Serialized 52 byte log entry
0709 12:24:51.389378 (+1056184us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:51.389447 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.389563 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.389642 (+    79us) raft_consensus.cc:1685] finished
0709 12:24:51.389665 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.389851 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54818,"raft.queue_time_us":211758,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":58752,"thread_start_us":1160837,"threads_started":2,"wal-append.queue_time_us":937578}
I20260709 12:24:51.371400 23348 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:51.371694 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.373885 23356 raft_consensus.cc:2243] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:51.260056 23366 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:51.419251 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.419984 18765 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:51.282366 23298 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:51.380561 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.317728 23168 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:51.271211 23013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.014s	sys 0.007s
I20260709 12:24:51.404253 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.408398 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:51.291486 23261 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:51.357453 23325 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.332346 23375 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:51.374298 23338 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:51.410334 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:51.414458 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.364763 22854 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.320489 22900 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.365267 22905 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:51.374588 23364 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.404588 23112 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.405159 23374 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:51.450060 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.484813 18764 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:51.450706 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.411391 23196 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.458233 18921 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:51.463754 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.486897 18765 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:51.487708 23356 raft_consensus.cc:2272] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:51.488839 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 122658us
I20260709 12:24:51.456578 23369 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:51.457206 23259 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:51.471385 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:51.479457 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.288569 22924 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.417742 23089 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:51.491888 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.451500 23013 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:51.469699 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59475.1us
I20260709 12:24:51.459805 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:51.520552 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.563265 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.406736 23169 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:51.523327 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.520296 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.527153 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:51.468416 22854 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:51.482371 23374 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:51.548501 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.523151 22930 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:51.577729 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.489624 23112 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.559355 18914 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:51.417022 23336 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.525777 23370 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:51.458129 23156 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.568238 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.620883 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.533869 18915 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
W20260709 12:24:51.569362 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 109649us
I20260709 12:24:51.571857 19484 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:51.484007 23325 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:51.530419 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2485) took 1841 ms. Trace:
I20260709 12:24:51.624318 18840 rpcz_store.cc:276] 0709 12:24:49.689205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.785295 (+ 96090us) service_pool.cc:224] Handling call
0709 12:24:49.785685 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:49.786124 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.786154 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:49.794857 (+  8703us) log.cc:844] Serialized 52 byte log entry
0709 12:24:50.098576 (+303719us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:50.163629 (+ 65053us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.536267 (+372638us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b180045d8a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:24:50.536494 (+   227us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.612777 (+ 76283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.612867 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.530122 (+917255us) raft_consensus.cc:1685] finished
0709 12:24:51.530150 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.530328 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":370652,"prepare.queue_time_us":535690,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":103,"raft.queue_time_us":114764,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":23180,"spinlock_wait_cycles":3500416,"thread_start_us":176073,"threads_started":1,"wal-append.queue_time_us":388793}
I20260709 12:24:51.573938 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:51.629498 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55662.1us
I20260709 12:24:51.519325 23368 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:51.582854 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 164505us
I20260709 12:24:51.467427 23260 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.588616 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:51.582489 23347 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.007s
I20260709 12:24:51.591708 23361 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:51.592967 23385 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:51.578876 23376 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:51.596580 23378 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:24:51.530675 23366 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.606662 23169 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:51.611263 23196 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:51.611464 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.482143 23340 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.619738 18916 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:51.621860 18769 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:51.633922 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:51.663924 23319 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:51.643743 23348 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:51.642189 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.404943 23346 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.690636 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.690768 23346 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:51.574893 23374 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:51.683038 23303 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:51.691723 23303 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.483773 23364 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.693861 23303 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.694171 23364 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.646167 18840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:51.579448 23259 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:51.653916 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:51.460561 23375 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.655200 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.655954 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:51.656667 18812 connection.cc:256] RPC call timeout handler was delayed by -1.7805884569997943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 12:24:51.660050 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.702240 18843 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:51.662338 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:51.702978 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3197884569999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 12:24:51.703456 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.704188 18843 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:51.704917 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.704962 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.662660 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.663081 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.660223 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:51.706108 19487 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:51.604013 22918 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:51.671967 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2256) took 2483 ms. Trace:
I20260709 12:24:51.710732 18847 rpcz_store.cc:276] 0709 12:24:49.181031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.519768 (+338737us) service_pool.cc:224] Handling call
0709 12:24:50.746821 (+1227053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.216647 (+469826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.413401 (+196754us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:51.660617 (+247216us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400381650. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:51.664672 (+  4055us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3619099648}
W20260709 12:24:51.711236 23066 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:24:51.712095 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.712723 18847 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:24:51.666311 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 280773us
I20260709 12:24:51.672130 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.662333 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:51.673022 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.665045 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.645773 22900 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:51.618655 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.680058 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46264.7us
I20260709 12:24:51.718359 18844 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:51.634586 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.638064 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:51.663764 23381 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:24:51.662545 23089 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.730926 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.731732 23381 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:51.732132 23381 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:51.732952 22918 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.732239 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.683044 23169 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:51.682102 23319 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:51.683856 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.742345 18768 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:51.685237 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.685708 18770 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:51.665918 23368 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.689960 18767 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:51.690919 18772 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:24:51.644353 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55839.8us
I20260709 12:24:51.591006 23102 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:51.676457 23372 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.758882 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.760577 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:51.694703 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.725766 22900 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.675477 23336 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.658929 23260 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.700717 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.702109 18841 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:51.706053 18845 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.660952 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.663846 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.707500 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.709604 23376 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:51.713405 19491 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:24:51.712095 23150 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.578s	user 0.002s	sys 0.009s
I20260709 12:24:51.645102 23242 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:51.698694 23259 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.680354 23279 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.682533 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.745590 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:51.749711 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.873497 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:51.756352 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.673260 22905 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:51.766882 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:51.875108 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 129591us
I20260709 12:24:51.762115 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:51.875578 18768 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.876132 18770 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:51.680220 23196 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.715166 23370 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:51.788435 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.792336 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.879541 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.880323 18847 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:51.739331 23303 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.798972 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:51.883100 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 126861us
I20260709 12:24:51.884029 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.819347 18764 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:51.820667 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.885356 18841 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:51.886649 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.887697 18841 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:51.817739 18839 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:51.719563 23066 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:51.758671 23198 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
W20260709 12:24:51.826149 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.897745 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 143229us
W20260709 12:24:51.899782 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.899910 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.719259 23272 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:51.906931 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.740322 23361 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.863061 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:51.750236 23319 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.770153 23352 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:51.869076 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 168447us
I20260709 12:24:51.941313 18768 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:51.869293 18840 raft_consensus.cc:606] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.945967 18768 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:24:51.946254 18840 raft_consensus.cc:614] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:51.741564 23169 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:51.945996 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:51.758085 23174 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:51.664991 23344 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:51.876762 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.877218 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:51.875111 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 140053us
I20260709 12:24:51.792119 23102 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.681133 23013 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.793111 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:51.961745 23166 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.827s	user 0.007s	sys 0.003s
I20260709 12:24:51.892449 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:51.962407 23398 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:51.964346 19491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 814) took 1824 ms (client timeout 1690 ms). Trace:
W20260709 12:24:51.964823 19491 rpcz_store.cc:269] 0709 12:24:50.140180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.140561 (+   381us) service_pool.cc:224] Handling call
0709 12:24:51.964102 (+1823541us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400788554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:51.964220 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2995511680}
I20260709 12:24:51.965529 23398 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:51.874609 23259 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:51.908095 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.908589 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.966866 18841 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:51.966982 18847 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:51.967905 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.968070 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.759682 23347 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 12:24:51.968595 18841 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:51.969267 23347 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:51.969594 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:51.923666 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:51.888607 22905 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.924404 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:51.906350 23066 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.869894 23376 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.785938 23368 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.949915 23373 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.932251 23238 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.932924 23279 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.913947 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:52.053598 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 139731us
I20260709 12:24:52.054658 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:51.875370 23242 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:51.943830 18845 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:24:51.915320 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:51.894326 23226 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:51.910728 23348 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.917023 23272 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:51.910435 23112 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.956127 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2339) took 1911 ms. Trace:
I20260709 12:24:52.088419 18915 rpcz_store.cc:276] 0709 12:24:50.044728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.100349 (+ 55621us) service_pool.cc:224] Handling call
0709 12:24:51.955937 (+1855588us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:51.956060 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1821782784}
W20260709 12:24:51.956992 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80347.8us
W20260709 12:24:52.090595 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.914342 23370 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:51.962742 18770 raft_consensus.cc:2376] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12. Re-sending same reply.
I20260709 12:24:52.104228 19491 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:52.104604 18770 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:51.900671 18921 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:24:51.969724 23347 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:51.922866 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.122957 18772 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:52.123564 18764 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:51.971009 18841 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.965936 23359 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:51.976286 18768 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:51.966002 23398 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.958595 18844 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:51.942444 23296 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.942129 23317 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:51.893975 23303 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.002205 23260 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:51.949823 23169 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:51.931491 23356 ts_tablet_manager.cc:1916] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:51.786518 23372 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.021296 18767 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:51.936883 23361 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:51.980531 23401 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:24:52.174006 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 264679us
I20260709 12:24:52.033339 18913 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:24:52.174858 18913 pending_rounds.cc:85] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 6
I20260709 12:24:52.175236 18913 pending_rounds.cc:107] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:24:52.175642 18913 raft_consensus.cc:2889] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:52.033460 18766 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:52.034855 23368 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.039927 22854 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.040642 23156 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:52.052497 18839 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:52.062933 19457 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.168s (SENT)
I20260709 12:24:52.180428 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:52.077164 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 124302us
I20260709 12:24:52.078807 18843 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:52.183525 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.079983 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:52.074025 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:52.097415 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.185181 18845 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:52.186302 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.187170 18845 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
W20260709 12:24:52.110934 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.122498 18770 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:51.979333 23102 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.079022 23264 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:52.201082 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127145us
I20260709 12:24:52.149457 18847 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
W20260709 12:24:52.156248 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 210322us
I20260709 12:24:52.203620 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.203977 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:52.204563 18845 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 7.
I20260709 12:24:52.205873 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.156345 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:52.160456 18841 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:52.208128 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:52.208959 18841 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:52.082064 23279 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.125247 23348 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.156035 23317 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.103506 23370 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:52.031512 23259 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.147114 23398 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:52.181411 18769 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:52.230151 18841 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:24:52.199617 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 136756us
W20260709 12:24:52.232409 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.232777 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.184417 18843 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:52.234522 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.235354 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.235324 18841 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:52.236202 18844 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:52.237006 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.083048 22918 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:52.087875 23374 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.167168 23242 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:52.213773 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.207937 23325 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 12:24:52.171063 23196 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.216605 18771 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:24:52.216940 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.249675 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.180480 23393 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.227099 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:52.237440 18844 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:52.241298 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.170333 23376 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.179740 23013 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.233866 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:52.207641 23401 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.246124 18922 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:52.275970 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.222301 23112 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:52.291471 18842 raft_consensus.cc:2368] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14.
I20260709 12:24:52.252971 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:52.249727 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:52.253958 23363 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.916s	user 0.016s	sys 0.002s
I20260709 12:24:52.255561 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:52.297672 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63909us
I20260709 12:24:52.215807 22930 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:52.298614 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45730.2us
I20260709 12:24:52.216286 23352 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:52.256372 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:52.209355 23346 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:52.248250 23186 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:52.216151 23264 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.224227 23339 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.276028 22918 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:24:52.267477 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.324198 18914 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:52.294095 23013 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.263846 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.268100 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.325663 18915 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:52.276954 18920 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:52.326560 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.282618 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:52.215555 23399 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:52.243727 23344 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.277997 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:52.335444 19487 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:52.293479 18843 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:52.299271 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:52.224227 23302 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:24:52.300470 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:52.215715 22900 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.312973 19485 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:52.309949 23340 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.300623 23363 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.314720 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.319644 18845 raft_consensus.cc:2376] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10. Re-sending same reply.
I20260709 12:24:52.277711 23325 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:52.226213 23370 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:52.321398 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.306571 22930 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:52.328641 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46113.6us
W20260709 12:24:52.329192 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 82373.4us
I20260709 12:24:52.331367 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.483848 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.484571 18767 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:24:52.332029 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.485531 18768 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:52.486564 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.487269 18768 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:24:52.333003 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.208896 23347 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.299932 22905 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.307246 23174 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:24:52.382128 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.461130 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.268280 23393 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.478773 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:52.488931 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.498585 18920 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:24:52.472404 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.329378 23066 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.515136 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:52.523725 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45071.5us
I20260709 12:24:52.524688 18768 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:52.525815 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:52.516561 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 217350us
W20260709 12:24:52.517684 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 217265us
I20260709 12:24:52.527542 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:52.481729 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:52.532992 18773 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:52.527541 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:52.527267 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:52.521512 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.322149 23346 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.536092 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:52.538264 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:52.323148 23186 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.540427 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.459724 23411 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:52.498277 22930 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:52.511416 23174 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:52.387316 23344 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.546614 23368 raft_consensus.cc:2764] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:52.540109 23412 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:52.547283 23303 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.295966 23401 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.545528 18767 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 8: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:52.530083 22905 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.556197 23066 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:52.534147 23258 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:52.568804 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.346225 23399 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.577029 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.580282 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.555744 23411 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.601523 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.601706 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.489287 23340 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.558775 23212 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:52.590474 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:52.679291 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.593142 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.680882 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.540823 23376 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:24:52.599399 23258 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:24:52.584467 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 274341us
I20260709 12:24:52.562306 22924 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.566910 23174 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:52.606597 23279 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.575276 23359 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:52.574120 23414 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.571444 22854 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.578780 23260 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:52.572818 23417 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:52.595919 23406 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 12:24:52.583079 23112 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:52.611426 18918 raft_consensus.cc:2410] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:52.555328 23272 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.681031 18764 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
W20260709 12:24:52.579792 23319 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.001s
W20260709 12:24:52.682016 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.684620 23427 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:52.685902 23408 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:24:52.686765 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.733054 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:52.603185 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.582671 23418 raft_consensus.cc:2764] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:52.604737 23066 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:52.751888 23363 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.751822 23066 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.757611 23375 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:52.760044 18773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 766) took 1548 ms (client timeout 1786 ms). Trace:
W20260709 12:24:52.760597 18773 rpcz_store.cc:269] 0709 12:24:51.211548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.214543 (+  2995us) service_pool.cc:224] Handling call
0709 12:24:52.759763 (+1545220us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002a1054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:52.759944 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2766811392}
I20260709 12:24:52.763600 23376 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:52.764225 23376 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.765349 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.766026 18768 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:52.767023 23346 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.727890 23417 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.769644 23417 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:52.713344 23264 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:52.721055 23260 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.770633 23260 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:52.770973 23425 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:24:52.771680 23319 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.773937 23319 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.775086 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.712095 23359 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:52.775799 18764 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:52.776151 23359 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:52.779170 23344 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:52.783586 23340 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:52.786584 23336 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.990s	user 0.002s	sys 0.011s
I20260709 12:24:52.787348 19484 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:52.787707 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2589) took 1087 ms. Trace:
I20260709 12:24:52.788174 18769 rpcz_store.cc:276] 0709 12:24:51.700075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.876926 (+176851us) service_pool.cc:224] Handling call
0709 12:24:52.787535 (+910609us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540029d1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:52.787644 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526023552}
I20260709 12:24:52.789105 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 852) took 1111 ms. Trace:
I20260709 12:24:52.789587 19484 rpcz_store.cc:276] 0709 12:24:51.677577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.677744 (+   167us) service_pool.cc:224] Handling call
0709 12:24:52.788894 (+1111150us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540062b6d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:52.789037 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2520451840}
I20260709 12:24:52.795686 23272 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:52.796346 23272 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.796886 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:52.797614 19488 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:52.798378 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2268) took 1149 ms. Trace:
I20260709 12:24:52.798584 23272 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.703302 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.798802 18843 rpcz_store.cc:276] 0709 12:24:51.648817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.336975 (+688158us) service_pool.cc:224] Handling call
0709 12:24:52.337438 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.337980 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:52.338025 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.338676 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.676438 (+337762us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:52.676497 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.676598 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.798169 (+121571us) raft_consensus.cc:1685] finished
0709 12:24:52.798191 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.798314 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26343,"raft.queue_time_us":108,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":115519,"thread_start_us":337379,"threads_started":1,"wal-append.queue_time_us":395290}
I20260709 12:24:52.801405 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.611330 23411 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:52.654628 23348 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:52.668644 23296 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:52.715102 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.715008 23414 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:52.717254 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.675927 23317 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:52.675999 23102 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.682761 23259 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.686985 23374 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.722254 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2266) took 1073 ms. Trace:
I20260709 12:24:52.704252 23258 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:52.748972 23410 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:24:52.750236 22854 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:24:52.585592 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 103945us
I20260709 12:24:52.802220 18843 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:24:52.803613 18768 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:24:52.805944 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 323421us
I20260709 12:24:52.836244 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:52.836899 18768 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:52.811764 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:52.837775 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.813267 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:52.838657 18917 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:52.595362 22905 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.848721 22905 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.849996 18769 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:24:52.850958 23419 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:24:52.851974 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.852674 18769 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:52.815440 18846 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:52.855136 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.815907 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:52.819916 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.857738 23298 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.397s	user 0.011s	sys 0.000s
W20260709 12:24:52.859081 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.820493 23296 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.859021 23298 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.861351 23296 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.815440 23112 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:52.884461 23112 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.730180 23424 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.836244 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:52.834955 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:52.854036 23156 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 12:24:52.823086 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:52.887466 18772 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:52.819571 23376 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.890082 18843 raft_consensus.cc:2410] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:52.823647 18841 rpcz_store.cc:276] 0709 12:24:51.648317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.250552 (+602235us) service_pool.cc:224] Handling call
0709 12:24:52.251153 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.251652 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.251696 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.264146 (+ 12450us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.496074 (+231928us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:52.721475 (+225401us) log.cc:844] Serialized 14 byte log entry
0709 12:24:52.721800 (+   325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.721907 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.721965 (+    58us) raft_consensus.cc:1685] finished
0709 12:24:52.721986 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.722167 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9422,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":53988,"thread_start_us":338136,"threads_started":2,"wal-append.queue_time_us":260517}
I20260709 12:24:52.867268 23348 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:52.890784 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55959.1us
I20260709 12:24:52.869644 18765 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:52.870177 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51636 (request call id 19) took 1218 ms. Trace:
I20260709 12:24:52.871047 23399 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:52.873759 23392 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.909s	user 0.000s	sys 0.015s
I20260709 12:24:52.832150 23186 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:52.857878 22854 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.876210 23401 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.876494 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:52.918625 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.821755 23414 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.853961 18769 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:24:52.863854 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:52.892529 18840 rpcz_store.cc:276] 0709 12:24:51.645050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.645998 (+   948us) service_pool.cc:224] Handling call
0709 12:24:52.862997 (+1216999us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400205654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af85853 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:52.863109 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392531328}
I20260709 12:24:52.926151 18840 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:24:52.927085 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 741) took 1209 ms. Trace:
W20260709 12:24:52.927512 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63737.4us
I20260709 12:24:52.927525 18840 rpcz_store.cc:276] 0709 12:24:51.717600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.925587 (+1207987us) service_pool.cc:224] Handling call
0709 12:24:52.925932 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.926722 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.927005 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.897260 18768 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:52.897758 18917 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:52.891749 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:52.909417 18913 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:52.911111 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.834034 23013 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:52.909428 23424 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:52.912485 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:52.877879 18766 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2569) took 1194 ms (client timeout 1514 ms). Trace:
I20260709 12:24:52.919665 18772 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:52.922861 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:52.940604 18766 rpcz_store.cc:269] 0709 12:24:51.683761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.683894 (+   133us) service_pool.cc:224] Handling call
0709 12:24:52.875229 (+1191335us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54002a1a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:52.877812 (+  2583us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622541568}
I20260709 12:24:52.941252 18841 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:52.942675 18841 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:24:52.943257 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 744) took 1224 ms. Trace:
I20260709 12:24:52.943455 23298 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:52.943586 18841 rpcz_store.cc:276] 0709 12:24:51.718438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.942067 (+1223629us) service_pool.cc:224] Handling call
0709 12:24:52.942467 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.943025 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.943201 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.945056 18841 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:24:52.945611 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 745) took 1226 ms. Trace:
I20260709 12:24:52.928783 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:52.947930 23169 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.012s
I20260709 12:24:52.947933 23434 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:52.948501 23169 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.945976 18841 rpcz_store.cc:276] 0709 12:24:51.718977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.944446 (+1225469us) service_pool.cc:224] Handling call
0709 12:24:52.944841 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.945372 (+   531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.945560 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.913435 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:52.950902 19491 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:52.951153 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.952544 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:52.908987 23264 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:52.953316 23264 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:52.936232 23156 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.954583 23156 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.954785 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:52.954996 23156 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.955432 18770 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:52.957340 23381 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.954107 18772 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:52.960377 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:52.935071 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:52.930487 18840 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:52.857802 23174 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.920501 23348 consensus_queue.cc:1243] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:52.970782 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 743) took 1249 ms. Trace:
W20260709 12:24:52.971699 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 151209us
I20260709 12:24:52.971380 18840 rpcz_store.cc:276] 0709 12:24:51.718171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.929784 (+1211613us) service_pool.cc:224] Handling call
0709 12:24:52.930300 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.966967 (+ 36667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.967271 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.974848 18840 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:24:52.926256 23376 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:52.975975 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 747) took 1256 ms. Trace:
I20260709 12:24:52.976438 18840 rpcz_store.cc:276] 0709 12:24:51.719705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.974215 (+1254510us) service_pool.cc:224] Handling call
0709 12:24:52.974606 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.975684 (+  1078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.975905 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.978009 18840 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:52.969439 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:52.979519 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:52.970470 23434 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:52.981652 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:52.933550 23186 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:52.999941 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2493) took 1275 ms. Trace:
I20260709 12:24:52.999414 18770 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:24:53.000581 18847 rpcz_store.cc:276] 0709 12:24:51.724419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.967793 (+243374us) service_pool.cc:224] Handling call
0709 12:24:52.999644 (+1031851us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003db154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:52.999851 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415390976}
W20260709 12:24:53.003567 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 476343us
I20260709 12:24:53.002974 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2491) took 1281 ms. Trace:
I20260709 12:24:53.014549 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:53.015779 18921 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:53.012351 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:53.014249 18840 rpcz_store.cc:276] 0709 12:24:51.721693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.977357 (+1255664us) service_pool.cc:224] Handling call
0709 12:24:52.977658 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.002588 (+ 24930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.002890 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.973919 23259 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:52.982112 23376 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.976891 23381 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:53.012933 23366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.015s	sys 0.015s
I20260709 12:24:53.024260 18847 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:53.036134 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:53.036383 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2492) took 1314 ms. Trace:
I20260709 12:24:53.036921 18847 rpcz_store.cc:276] 0709 12:24:51.724095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.002115 (+1278020us) service_pool.cc:224] Handling call
0709 12:24:53.024077 (+ 21962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.036121 (+ 12044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.036323 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.981505 23102 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:53.023020 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:53.019556 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2494) took 1294 ms. Trace:
I20260709 12:24:53.040730 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.041528 18840 rpcz_store.cc:276] 0709 12:24:51.724715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.017847 (+1293132us) service_pool.cc:224] Handling call
0709 12:24:53.018593 (+   746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.019066 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.019106 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.019171 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:53.019241 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.019322 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.019475 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8112}
W20260709 12:24:53.029739 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48571.1us
I20260709 12:24:52.954283 23264 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:52.975668 23319 consensus_queue.cc:1175] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e2529a8cff04207bb1b07c108e16983" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: [11.9-11.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:53.033602 23359 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:52.995870 23424 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.047844 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.017053 23296 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:53.027652 23376 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:53.040710 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:53.016752 23375 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.997975 23434 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:53.051127 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:53.038501 23366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.016s	sys 0.016s
I20260709 12:24:53.057035 23359 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:53.060791 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.025430 23013 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:53.059659 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:53.029312 23169 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:53.067948 18847 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:53.068706 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.035897 23242 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:53.071084 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.072362 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:53.068118 23398 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.000s
I20260709 12:24:53.074271 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:53.076258 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.062822 23259 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:53.077435 18840 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:24:53.066074 23375 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:53.104425 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 749) took 1384 ms (client timeout 1721 ms). Trace:
I20260709 12:24:53.104347 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 754) took 1028 ms. Trace:
I20260709 12:24:53.107661 18845 rpcz_store.cc:276] 0709 12:24:52.075785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.205517 (+129732us) service_pool.cc:224] Handling call
0709 12:24:53.104154 (+898637us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b5400125054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.104280 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211363712}
I20260709 12:24:53.081302 23405 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:53.081804 22900 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:53.072962 23363 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:53.077164 22930 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 12:24:53.082885 23169 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.156359 22930 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.156567 23169 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.085340 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:53.158859 22930 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.159050 18921 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:53.086795 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:53.160051 18920 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:53.087097 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:53.087332 23366 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.161101 18916 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:53.055083 23438 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:53.163204 23438 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:53.068532 23336 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:53.107470 18839 rpcz_store.cc:269] 0709 12:24:51.720227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.906614 (+186387us) service_pool.cc:224] Handling call
0709 12:24:53.104230 (+1197616us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400071054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.104366 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330759424}
I20260709 12:24:53.075755 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:53.108891 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:53.077500 23359 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.094966 18847 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:24:53.110615 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 740) took 1393 ms. Trace:
W20260709 12:24:53.160594 23370 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.007s
I20260709 12:24:53.072445 23174 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.069552 23013 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:53.144464 22854 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.187037 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:53.136852 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.153594 23434 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.075911 23279 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:53.070063 23102 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:53.167124 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:53.184906 23366 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:53.196763 18839 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:24:53.197265 23366 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.197710 23366 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:53.197870 19485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 825) took 1860 ms (client timeout 2237 ms). Trace:
I20260709 12:24:53.198058 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:53.168241 23336 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:53.168834 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:53.173364 23396 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.222s	user 0.002s	sys 0.000s
W20260709 12:24:53.176219 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.109732 23375 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.109771 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:53.178620 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:53.179123 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 103448us
I20260709 12:24:53.178123 18843 rpcz_store.cc:276] 0709 12:24:51.717322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.921420 (+1204098us) service_pool.cc:224] Handling call
0709 12:24:52.921962 (+   542us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:52.925710 (+  3748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.925753 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:52.935968 (+ 10215us) log.cc:844] Serialized 52 byte log entry
0709 12:24:53.017377 (+ 81409us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:53.034785 (+ 17408us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.035160 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.035331 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.035401 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.110345 (+ 74944us) raft_consensus.cc:1685] finished
0709 12:24:53.110368 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.110549 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3231,"prepare.queue_time_us":64872,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":1979,"raft.queue_time_us":27270,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":26937,"spinlock_wait_cycles":80466176,"thread_start_us":80714,"threads_started":1,"wal-append.queue_time_us":115929}
I20260709 12:24:53.207536 18843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
W20260709 12:24:53.208141 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.073196 23242 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.181784 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.209728 18920 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:24:53.158975 23372 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:53.217082 23242 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:53.221043 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.164203 23438 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.075259 23404 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.192150 23415 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.189711 23013 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:53.195410 18848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2262) took 1548 ms (client timeout 1797 ms). Trace:
I20260709 12:24:53.196457 23258 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.168123 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:53.166760 22900 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.199826 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:53.198365 19485 rpcz_store.cc:269] 0709 12:24:51.337438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.338075 (+   637us) service_pool.cc:224] Handling call
0709 12:24:53.197713 (+1859638us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54006ffc54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.197810 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977488256}
I20260709 12:24:53.079274 23156 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.080708 23398 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.204864 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:53.236877 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2496) took 1511 ms. Trace:
I20260709 12:24:53.208782 18843 raft_consensus.cc:606] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.153956 23411 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.211167 23089 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:53.211500 23376 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.213245 23279 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:53.213596 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.247516 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.214172 23364 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:53.188308 23169 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.222719 18847 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:53.225211 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.222254 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.253502 18767 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:53.223368 23401 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:53.229228 18848 rpcz_store.cc:269] 0709 12:24:51.647079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.653750 (+  6671us) service_pool.cc:224] Handling call
0709 12:24:53.195183 (+1541433us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540041c8d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.195339 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3000307072}
I20260709 12:24:53.236476 18839 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:53.237366 18845 rpcz_store.cc:276] 0709 12:24:51.725259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.236160 (+1510901us) service_pool.cc:224] Handling call
0709 12:24:53.236400 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.236558 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.236581 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.236619 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:53.236649 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.236700 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.236819 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.260970 18845 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:24:53.261181 19487 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:53.261767 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2511) took 1185 ms. Trace:
I20260709 12:24:53.245311 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2267) took 1596 ms. Trace:
I20260709 12:24:53.236877 22900 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:53.264117 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:53.188633 23370 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.272953 18845 rpcz_store.cc:276] 0709 12:24:52.076149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.260397 (+1184248us) service_pool.cc:224] Handling call
0709 12:24:53.260748 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.261443 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.261710 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.261222 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:53.244251 23347 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.286816 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:53.262295 18844 rpcz_store.cc:276] 0709 12:24:51.648571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.252703 (+604132us) service_pool.cc:224] Handling call
0709 12:24:52.294644 (+ 41941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.298692 (+  4048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.298726 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.299213 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.571979 (+272766us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:52.715491 (+143512us) log.cc:844] Serialized 14 byte log entry
0709 12:24:52.715826 (+   335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.715934 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.088300 (+372366us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b1800348340. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:53.244883 (+156583us) raft_consensus.cc:1685] finished
0709 12:24:53.245019 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.245227 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3620,"prepare.queue_time_us":267650,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":6719,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":17948,"spinlock_wait_cycles":6488960,"thread_start_us":372197,"threads_started":2,"wal-append.queue_time_us":413392}
I20260709 12:24:53.263621 23212 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:53.276590 23373 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:53.274538 23401 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.278738 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:53.315076 19492 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:53.277199 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:53.275260 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2498) took 1549 ms. Trace:
W20260709 12:24:53.316630 18738 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.666s (SENT)
I20260709 12:24:53.317219 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.317822 19487 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:53.295296 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:53.318676 18845 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:53.298069 19484 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:24:53.320024 19484 pending_rounds.cc:85] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 8
I20260709 12:24:53.315716 18839 rpcz_store.cc:276] 0709 12:24:51.725756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.235996 (+1510240us) service_pool.cc:224] Handling call
0709 12:24:53.236313 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.264825 (+ 28512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.275191 (+ 10366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.320338 19484 pending_rounds.cc:107] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:24:53.253945 23352 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:53.320629 19484 raft_consensus.cc:2889] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:53.315944 23374 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:24:53.283169 23440 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:24:53.250939 23442 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.235039 23415 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:53.361397 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 136253us
W20260709 12:24:53.394225 18771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2572) took 1709 ms (client timeout 1690 ms). Trace:
W20260709 12:24:53.293053 23260 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.004s
W20260709 12:24:53.395974 18771 rpcz_store.cc:269] 0709 12:24:51.684862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.684972 (+   110us) service_pool.cc:224] Handling call
0709 12:24:53.394011 (+1709039us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540029ccd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.394154 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088097152}
I20260709 12:24:53.398607 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:53.446101 19483 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:53.409978 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:53.321422 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:53.456082 19491 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:53.456619 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:53.316717 23212 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:53.299916 23398 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.322038 23393 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.290887 23156 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.297498 23258 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.321313 23399 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.288995 23356 ts_tablet_manager.cc:1929] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.8
I20260709 12:24:53.481608 23212 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.488125 23356 log.cc:1199] T 6c18380178684f0e93b10d0c7a912d02 P 1e2529a8cff04207bb1b07c108e16983: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/wals/6c18380178684f0e93b10d0c7a912d02
I20260709 12:24:53.488005 23399 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.489861 23356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33726 (request call id 92) took 3400 ms. Trace:
I20260709 12:24:53.297742 22900 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:53.458595 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:53.495906 18842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2260) took 1849 ms (client timeout 1666 ms). Trace:
I20260709 12:24:53.493173 19487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
W20260709 12:24:53.512573 19456 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.122s (SENT)
I20260709 12:24:53.392584 23409 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:53.383694 23421 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.363322 23373 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:53.457129 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47287.3us
I20260709 12:24:53.383036 23089 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:53.295398 23370 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.313328 23259 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.171s
I20260709 12:24:53.513226 19487 raft_consensus.cc:606] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:53.512307 18842 rpcz_store.cc:269] 0709 12:24:51.646482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.646608 (+   126us) service_pool.cc:224] Handling call
0709 12:24:53.495532 (+1848924us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54003278d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.495787 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237205888}
I20260709 12:24:53.514992 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:53.457662 19492 raft_consensus.cc:2368] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:24:53.524811 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.289108 23242 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.194s
I20260709 12:24:53.408551 23374 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:53.508379 19491 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:24:53.525408 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.527661 19488 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
W20260709 12:24:53.530553 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 583405us
I20260709 12:24:53.531318 19483 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:24:53.535115 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 218517us
I20260709 12:24:53.536288 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:53.537894 18738 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.797s (SENT)
I20260709 12:24:53.539106 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2275) took 1063 ms. Trace:
I20260709 12:24:53.480901 23442 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:53.496997 23403 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.936s	user 0.002s	sys 0.002s
W20260709 12:24:53.492887 23414 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.001s
I20260709 12:24:53.541465 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:53.541175 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.546532 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:53.491292 23399 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.553102 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:53.551469 18842 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:24:53.447975 23260 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.525878 23089 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:53.553315 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:53.564146 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:53.561496 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2281) took 1083 ms. Trace:
I20260709 12:24:53.565999 18842 rpcz_store.cc:276] 0709 12:24:52.477792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.544102 (+1066310us) service_pool.cc:224] Handling call
0709 12:24:53.550952 (+  6850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.561209 (+ 10257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.561430 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.540681 23156 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.549909 23442 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.550942 23437 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:24:53.576749 23442 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:53.577346 18842 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:53.578599 23391 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:53.558877 23169 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:53.580698 23260 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.547605 23102 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.274217 23336 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.455935 23352 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:24:53.552597 23370 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:53.553717 23272 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:53.585793 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2031) took 1083 ms. Trace:
I20260709 12:24:53.574765 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:53.582000 18846 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:53.544546 23434 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:53.563499 23298 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:53.565688 23348 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:53.529277 23212 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.529058 23421 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.568065 23089 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.547801 23393 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:24:53.602715 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:53.600344 18764 rpcz_store.cc:276] 0709 12:24:52.502747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.806694 (+303947us) service_pool.cc:224] Handling call
0709 12:24:52.827499 (+ 20805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.855814 (+ 28315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.855844 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.856395 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.994782 (+138387us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:53.067880 (+ 73098us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.071212 (+  3332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.071330 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.585479 (+514149us) raft_consensus.cc:1685] finished
0709 12:24:53.585510 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.585709 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75047,"prepare.queue_time_us":31832,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":35317,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":1600,"thread_start_us":175680,"threads_started":2,"wal-append.queue_time_us":298356}
W20260709 12:24:53.602972 23369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.689s	user 0.000s	sys 0.016s
I20260709 12:24:53.569450 23405 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:24:53.601025 23156 raft_consensus.cc:2764] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:24:53.611123 23405 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:53.611547 23405 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:53.553853 23414 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.612457 23405 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.613799 23405 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.613809 23414 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.615609 23434 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:53.616804 23450 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:24:53.623802 23361 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.625487 23376 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:53.625168 23375 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.566408 23264 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:24:53.628690 23264 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:53.629511 23421 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.630963 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2024) took 1296 ms. Trace:
I20260709 12:24:53.631448 18767 rpcz_store.cc:276] 0709 12:24:52.334757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.703024 (+368267us) service_pool.cc:224] Handling call
0709 12:24:53.630738 (+927714us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.630898 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032675712}
I20260709 12:24:53.634533 23212 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.609059 23348 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:53.569770 22930 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:24:53.637063 22930 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:53.637531 22930 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:53.638763 23196 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:53.639261 23196 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:53.638624 22930 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.640309 22930 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.641633 18847 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:53.642984 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2505) took 1915 ms. Trace:
I20260709 12:24:53.635967 23348 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.643338 18847 rpcz_store.cc:276] 0709 12:24:51.727772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.252225 (+1524453us) service_pool.cc:224] Handling call
0709 12:24:53.252535 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.642100 (+389565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.642716 (+   616us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54003be554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:53.642919 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894361984}
I20260709 12:24:53.640071 23196 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.569535 23168 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:24:53.653625 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:53.667141 18767 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:53.652037 23369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.736s	user 0.000s	sys 0.017s
I20260709 12:24:53.490311 23356 rpcz_store.cc:276] 0709 12:24:50.098585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.117742 (+ 19157us) service_pool.cc:224] Handling call
0709 12:24:50.803786 (+686044us) ts_tablet_manager.cc:1151] Deleting tablet 6c18380178684f0e93b10d0c7a912d02
0709 12:24:50.803924 (+   138us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:24:53.149480 (+2345556us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:53.288780 (+139300us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:53.489746 (+200966us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88941,"tablet-delete.queue_time_us":452331,"thread_start_us":126440,"threads_started":1}
I20260709 12:24:53.680518 18847 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:53.683972 23296 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.685310 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2277) took 1208 ms. Trace:
I20260709 12:24:53.703501 18846 rpcz_store.cc:276] 0709 12:24:52.476700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.854800 (+378100us) service_pool.cc:224] Handling call
0709 12:24:53.685068 (+830268us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54003bd654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.685240 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669836672}
I20260709 12:24:53.690522 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:53.686079 23404 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:53.697260 18767 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
W20260709 12:24:53.698947 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 75719us
W20260709 12:24:53.701238 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 184161us
I20260709 12:24:53.707293 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:53.672607 23375 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.708406 18737 leader_election.cc:400] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
W20260709 12:24:53.773002 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 65390.5us
I20260709 12:24:53.774422 18737 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:53.774808 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:53.775489 18766 raft_consensus.cc:2376] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10. Re-sending same reply.
W20260709 12:24:53.698786 23366 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260709 12:24:53.777925 23366 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.780303 23366 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.676040 23393 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.781090 23393 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.782455 23196 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.783356 23393 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:53.783694 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:53.784480 18843 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:53.784498 18771 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:53.706153 23296 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.746027 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet 6c18380178684f0e93b10d0c7a912d02 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:24:53.787554 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:53.788322 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:53.789206 18913 pending_rounds.cc:85] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
I20260709 12:24:53.789572 18913 pending_rounds.cc:107] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:24:53.789990 18913 raft_consensus.cc:2889] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:53.746260 23455 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:24:53.790655 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:53.746641 23339 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.799604 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:53.799775 23339 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.750808 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:53.539619 18844 rpcz_store.cc:276] 0709 12:24:52.476121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.325243 (+849122us) service_pool.cc:224] Handling call
0709 12:24:53.325768 (+   525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.326052 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:53.408799 (+ 82747us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.538580 (+129781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.538708 (+   128us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:53.538770 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.538871 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.539030 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64531,"prepare.queue_time_us":122166,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":3907,"thread_start_us":125465,"threads_started":1}
I20260709 12:24:53.815632 19491 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:24:53.826936 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.759018 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:53.827666 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.827857 18920 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:53.760450 18917 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:53.767153 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 746) took 2047 ms. Trace:
I20260709 12:24:53.829810 18841 rpcz_store.cc:276] 0709 12:24:51.719452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.949797 (+1230345us) service_pool.cc:224] Handling call
0709 12:24:52.999845 (+ 50048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.000118 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.000158 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.000220 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:53.000280 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.000365 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.766837 (+766472us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54003db150. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.767056 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114247552}
I20260709 12:24:53.770619 23198 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:53.698264 23411 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.781219 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:53.785002 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:53.699718 23415 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:53.791060 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:53.790656 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.853945 19487 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:53.792052 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:53.580766 23374 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.792832 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:53.793896 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:53.794008 18656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48108.1us
I20260709 12:24:53.793605 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:53.796260 23460 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:53.799026 22900 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.752102 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2356) took 1471 ms. Trace:
W20260709 12:24:53.837913 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44926.7us
I20260709 12:24:53.851321 19483 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:53.705312 23401 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:53.859069 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:53.784127 23393 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:53.882961 18766 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:53.872095 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:53.879087 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 85569us
I20260709 12:24:53.864420 18915 rpcz_store.cc:276] 0709 12:24:52.281086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.327474 (+ 46388us) service_pool.cc:224] Handling call
0709 12:24:52.327765 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.327985 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:52.388250 (+ 60265us) log.cc:844] Serialized 14 byte log entry
0709 12:24:52.677794 (+289544us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.751221 (+1073427us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b18003debe0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f335ab41d70 00007f335ab35293 00007f335ab2acea 00007f335ab2b23a 00007f335af95a2a 00007f335afa50bf 00007f335afa5038
0709 12:24:53.751557 (+   336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.751637 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:53.751718 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.751823 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.752007 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1012440,"prepare.queue_time_us":186038,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":93,"raft.queue_time_us":125026,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":278,"spinlock_wait_cycles":3857152,"thread_start_us":286749,"threads_started":2,"wal-append.queue_time_us":267505}
I20260709 12:24:53.884335 19487 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
W20260709 12:24:53.891590 19457 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.837s (SENT)
I20260709 12:24:53.893173 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:53.893584 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:53.894740 18767 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:53.898293 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:53.898612 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:53.904443 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:53.905193 19484 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:53.834406 23339 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:53.602448 23373 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:53.857467 23264 raft_consensus.cc:476] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 12:24:53.924826 19483 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:53.743502 23463 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:53.917263 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:53.889137 23393 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:53.908769 23423 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:53.919886 23460 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:53.873432 23168 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:24:53.925648 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2495) took 2200 ms. Trace:
I20260709 12:24:53.929209 18771 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:53.908077 23363 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:24:53.904465 22900 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:53.906159 23359 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.001s
I20260709 12:24:53.922895 23369 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:53.941059 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:53.943554 18840 rpcz_store.cc:276] 0709 12:24:51.724996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.052682 (+1327686us) service_pool.cc:224] Handling call
0709 12:24:53.053090 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.079771 (+ 26681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.925321 (+845550us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b540041afd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:53.925569 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55369088}
I20260709 12:24:53.935165 23393 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:53.930529 23264 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.915089 23456 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:24:53.949556 23463 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:53.955037 23369 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.976902 23442 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.950982 22900 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.936257 23415 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:24:53.964129 23359 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:53.983048 23451 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.392s	user 0.000s	sys 0.004s
W20260709 12:24:53.982191 23013 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.000s
I20260709 12:24:53.988072 22900 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:53.989315 23013 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:53.984815 23369 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:53.992731 18765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 782) took 2376 ms (client timeout 2122 ms). Trace:
W20260709 12:24:53.993368 18765 rpcz_store.cc:269] 0709 12:24:51.616577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.634257 (+ 17680us) service_pool.cc:224] Handling call
0709 12:24:53.992379 (+2358122us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540029dbd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:53.992549 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609724672}
I20260709 12:24:53.984550 23463 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:54.000125 18920 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:54.000703 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:54.001704 18771 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:24:54.003561 18765 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:24:54.016000 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:53.983250 23264 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:54.025236 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 166283us
I20260709 12:24:54.029531 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:54.035228 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:54.036691 23434 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:54.037146 23434 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.037519 23434 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.043386 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:54.044329 18773 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:54.045579 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:54.046329 18765 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.049741 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.050830 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.051769 18770 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 12:24:54.046345 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:54.054963 23169 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:54.056983 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:54.060479 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.020593 23013 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:54.065538 18773 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:54.067502 18917 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:24:54.068141 18917 pending_rounds.cc:85] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 8
I20260709 12:24:54.068482 18917 pending_rounds.cc:107] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:24:54.068847 18917 raft_consensus.cc:2889] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:54.072167 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:54.074062 18765 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:54.058048 23169 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:54.092440 23414 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:54.093261 23414 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.093735 23414 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:54.098899 23298 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:54.099472 23298 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:54.100515 23298 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.104627 23198 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:54.105399 23198 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.109709 23414 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.118969 23414 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:54.102136 23298 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:54.225899 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2502) took 2499 ms. Trace:
I20260709 12:24:54.226454 18843 rpcz_store.cc:276] 0709 12:24:51.726959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.242983 (+1516024us) service_pool.cc:224] Handling call
0709 12:24:53.243317 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.785239 (+541922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.225643 (+440404us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54003bd154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:54.225830 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244110080}
I20260709 12:24:54.082057 23169 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.230298 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2512) took 2153 ms. Trace:
I20260709 12:24:54.230423 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.073542 23089 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.256495 18915 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:54.257804 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.252655 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2278) took 1775 ms. Trace:
I20260709 12:24:54.260763 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.144341 23339 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:24:54.230947 18848 rpcz_store.cc:276] 0709 12:24:52.076460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.313431 (+1236971us) service_pool.cc:224] Handling call
0709 12:24:53.313803 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.314239 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.314269 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.319580 (+  5311us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.541781 (+222201us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:53.556567 (+ 14786us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.229609 (+673042us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b1800122560. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:24:54.229847 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.229944 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.229998 (+    54us) raft_consensus.cc:1685] finished
0709 12:24:54.230091 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.230233 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16711,"prepare.queue_time_us":16800,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":4030,"raft.queue_time_us":2333,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":63431,"spinlock_wait_cycles":13940352,"thread_start_us":153107,"threads_started":1,"wal-append.queue_time_us":245507}
I20260709 12:24:54.074636 22930 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:24:54.235381 18917 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:24:54.237221 23272 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:54.232586 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:54.245509 22918 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:54.246593 23466 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:24:54.030925 23463 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.247437 23468 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.248325 23427 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.250612 23260 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:54.280539 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.285450 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.296038 18916 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:54.290525 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.253850 23169 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:54.265128 23364 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.306424 23442 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:54.309223 23434 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.295428 23168 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:54.310781 23168 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:54.313877 23168 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.315553 23168 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:54.320050 19492 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:54.320372 19488 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:54.264071 23469 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:24:54.336339 23319 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:24:54.336512 23296 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.003s
I20260709 12:24:54.347780 23296 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.336935 23272 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.288631 22918 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.339155 23089 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:54.300114 23427 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.332588 23264 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:54.341764 23348 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.002s
I20260709 12:24:54.297381 23468 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.311607 23364 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.323069 23198 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.353725 23319 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:54.361894 23405 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.008s
I20260709 12:24:54.373543 23434 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:54.373994 23468 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.374001 23427 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:54.426542 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:54.428532 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 171315us
W20260709 12:24:54.430039 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 876840us
I20260709 12:24:54.431572 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:54.433276 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:54.240648 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2279) took 1763 ms. Trace:
I20260709 12:24:54.435459 18839 rpcz_store.cc:276] 0709 12:24:52.477222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.326258 (+849036us) service_pool.cc:224] Handling call
0709 12:24:53.326687 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.326952 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:53.532325 (+205373us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.240296 (+707971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.240347 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.240400 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.240467 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.240586 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":547170,"prepare.queue_time_us":191700,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":418475,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":82,"thread_start_us":374337,"threads_started":2,"wal-append.queue_time_us":410614}
I20260709 12:24:54.438194 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2286) took 1397 ms. Trace:
I20260709 12:24:54.439145 18842 rpcz_store.cc:276] 0709 12:24:53.042824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.579443 (+536619us) service_pool.cc:224] Handling call
0709 12:24:53.579789 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.232906 (+653117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.232939 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.233475 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.435864 (+202389us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:54.436739 (+   875us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.437210 (+   471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.437381 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.437463 (+    82us) raft_consensus.cc:1685] finished
0709 12:24:54.437483 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.437829 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":652691,"raft.queue_time_us":654421,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":192587,"threads_started":1,"wal-append.queue_time_us":125293}
I20260709 12:24:54.241772 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2294) took 1065 ms. Trace:
W20260709 12:24:54.442664 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.260612 18845 rpcz_store.cc:276] 0709 12:24:52.476972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.321225 (+844253us) service_pool.cc:224] Handling call
0709 12:24:53.321551 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.322012 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:53.390830 (+ 68818us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.597488 (+206658us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.609675 (+ 12187us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.609859 (+   184us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:53.646875 (+ 37016us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.238268 (+591393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.238361 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.252324 (+ 13963us) raft_consensus.cc:1685] finished
0709 12:24:54.252358 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.252559 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":591609,"prepare.queue_time_us":162904,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":4314,"raft.queue_time_us":630090,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":23790,"thread_start_us":69597,"threads_started":1,"wal-append.queue_time_us":221821}
I20260709 12:24:54.447412 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.449726 18918 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:54.450111 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.451359 18915 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:54.452953 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.453440 19483 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:54.454134 18917 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:54.455133 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.490481 18919 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.491878 18920 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:54.456416 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:54.495241 19488 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:24:54.498294 22905 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:54.459197 22900 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.462914 23013 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:54.535516 23013 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.463587 22918 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.464215 23089 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:54.539111 23089 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:54.539932 23089 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.467000 23260 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:54.471652 23296 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:54.463596 23102 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:24:54.543936 23102 consensus_queue.cc:1243] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:54.546739 22905 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.534253 22900 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:54.556535 23013 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.500684 18917 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:54.500555 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.559041 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:54.503110 18764 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:54.560776 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:54.503875 18915 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:54.477447 23319 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.504913 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.563405 23298 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:54.460055 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:54.569034 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.574115 23264 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:24:54.579576 22930 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:54.473999 23198 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:54.457973 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:54.514624 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 81734.9us
I20260709 12:24:54.505501 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.520833 23259 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:54.527748 23261 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:54.583446 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:54.584116 23259 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.585911 18845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:54.586720 23296 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:54.586967 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:54.587409 23296 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:54.563129 18913 raft_consensus.cc:2410] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:24:54.584029 23261 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.589028 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:54.589987 18839 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:54.527748 23196 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.745s	user 0.013s	sys 0.004s
I20260709 12:24:54.591307 18922 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:54.591734 18841 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:54.588795 23296 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.592988 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:54.594554 23261 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:54.596982 23261 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:54.598624 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:54.442040 18847 rpcz_store.cc:276] 0709 12:24:53.176554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.701643 (+525089us) service_pool.cc:224] Handling call
0709 12:24:53.702067 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.702350 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:53.740743 (+ 38393us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.947545 (+206802us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b1800247ea0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:24:53.951832 (+  4287us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.241390 (+289558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.241452 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:54.241506 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.241581 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.241709 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":361179,"prepare.queue_time_us":249207,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":111,"raft.queue_time_us":311457,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":183,"spinlock_wait_cycles":99730688}
I20260709 12:24:54.588114 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:54.600756 23260 raft_consensus.cc:993] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:54.601881 23242 raft_consensus.cc:1081] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:24:54.602943 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.603216 18913 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:24:54.600747 18848 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.587046 18845 raft_consensus.cc:606] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:54.604279 18845 raft_consensus.cc:614] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:54.604430 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.583483 18918 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:54.606280 18842 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:54.607484 18839 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:54.601881 23259 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.609858 18913 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [8.5-12.7]
I20260709 12:24:54.610742 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.611490 18917 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.613749 23261 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:54.621680 18848 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:54.621713 23261 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.629086 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:54.636413 23102 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:54.629154 19484 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:54.637351 23102 consensus_queue.cc:1243] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:54.629842 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:54.638935 23102 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:54.639362 23102 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:54.633220 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:54.641755 18768 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:54.635440 23259 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:24:54.642215 23013 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:54.643424 22918 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:54.640741 23102 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.643857 22918 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:54.644807 23102 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:54.645267 23013 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:54.645038 22918 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.640756 18773 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:54.634143 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:54.648663 19492 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.646871 23311 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:54.652742 23311 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:54.653987 23311 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.655262 23311 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:54.645664 23013 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:54.628012 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:54.646800 22918 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.661505 19492 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:54.663108 23013 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.673285 23013 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.627003 23261 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:54.674932 22905 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:54.674690 18848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:24:54.676095 18848 raft_consensus.cc:606] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:54.676713 18848 raft_consensus.cc:614] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:54.667637 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 85332.9us
I20260709 12:24:54.678359 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:54.678699 23261 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:54.630895 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.679332 23261 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:54.665745 23168 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.678341 22930 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:54.680462 23168 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.636505 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.359643 23348 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.684777 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:54.685123 23347 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:54.685588 23347 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:54.686822 23347 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.688254 18916 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:54.690052 22930 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:54.690558 22930 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.690893 22930 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:54.692560 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.677690 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:54.722894 19484 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:54.723887 18919 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:54.724634 18914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54084
I20260709 12:24:54.724248 23347 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:54.682029 23261 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.670279 18917 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:54.757138 23168 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.773455 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:54.781601 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:54.790046 18914 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:54.790611 18914 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.776041 23348 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:54.767514 23479 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:54.793936 18773 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:54.800388 18764 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:54.813228 23479 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:54.813578 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 136056us
W20260709 12:24:54.813902 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 581307us
I20260709 12:24:54.814916 23437 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:54.815312 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:54.815522 23437 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:54.816790 23437 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.817507 23456 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:54.817929 23466 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:54.818536 23456 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:54.819715 23456 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:24:54.814199 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44107.8us
I20260709 12:24:54.820636 23456 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:54.821123 23456 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:54.813935 23479 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:54.823032 23479 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.823698 23442 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:54.825001 23479 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.824685 23442 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.827865 23376 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:54.828598 23376 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:54.832717 23458 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.046s	user 0.000s	sys 0.005s
I20260709 12:24:54.833639 23375 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:54.834584 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:54.835309 23375 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.836373 23261 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.837944 23482 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:54.835657 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 249575us
I20260709 12:24:54.838718 23482 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.812428 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:54.844067 23364 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:54.844218 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.845157 18917 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:54.847185 18919 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:24:54.849509 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:54.838847 23375 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:54.851081 23311 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:54.851845 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:54.852243 23311 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:54.852522 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.852988 23434 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:54.854141 23414 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:54.854648 23414 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:54.855098 23427 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:54.855448 23484 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:54.855592 23427 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:54.856972 23427 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.859476 23427 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.842079 23482 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:54.836486 23169 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.526s	user 0.015s	sys 0.002s
I20260709 12:24:54.864778 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:54.871505 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:54.872288 23442 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.872726 18666 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 10, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 10 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:24:54.870307 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.872161 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:54.872308 19488 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
W20260709 12:24:54.884364 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 182573us
I20260709 12:24:54.903198 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:54.904664 19484 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:54.904976 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:54.905917 23496 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:24:54.907006 23238 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.907620 23238 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.911478 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:54.913688 18772 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:54.916543 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:54.917933 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:54.919199 23493 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:24:54.919459 23089 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:54.922045 23089 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.855113 23414 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:54.922719 18671 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 164) took 31210 ms (client timeout 15000 ms). Trace:
I20260709 12:24:54.917893 18764 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:24:54.923563 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 108409us
W20260709 12:24:54.924052 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.924713 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:54.925027 23376 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.926633 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:54.927287 23463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.008s
I20260709 12:24:54.876236 23434 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:54.931529 23348 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:54.935005 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:54.941860 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:54.942485 23156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.012s	sys 0.000s
I20260709 12:24:54.904168 18919 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:54.941809 18772 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:54.910252 23238 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:54.942967 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:54.969846 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.945627 18914 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:54.874677 18666 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:54.989077 18771 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:24:54.983870 23463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.009s
I20260709 12:24:54.989117 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:54.977875 23442 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:55.009687 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:54.986675 23156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.012s	sys 0.001s
I20260709 12:24:55.022886 18773 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:55.010229 18766 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:54.944233 23482 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:24:54.884075 23169 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.010982 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:55.022876 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:55.048138 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58128.6us
I20260709 12:24:55.025892 23296 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.083583 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.108579 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53335.5us
I20260709 12:24:55.060390 23013 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:55.065337 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.065811 23311 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.120266 23438 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:55.060124 23437 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.123659 23401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.004s	sys 0.014s
I20260709 12:24:55.124056 23415 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.124289 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.124536 23411 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:55.125034 18921 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:55.126071 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.124354 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.129292 18666 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 9, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 9 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:55.052832 23442 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.114213 23013 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:55.117918 23102 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.200188 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.195050 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49049.9us
I20260709 12:24:55.195555 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.044299 23456 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:55.198634 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 49577.7us
W20260709 12:24:55.136189 23401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.004s	sys 0.015s
I20260709 12:24:55.120983 23438 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.143666 23196 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:24:55.213871 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 227369us
I20260709 12:24:55.202244 18839 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:54.945631 18671 rpcz_store.cc:269] 0709 12:24:23.711144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.712118 (+   974us) service_pool.cc:224] Handling call
0709 12:24:24.179869 (+467751us) spinlock_profiling.cc:243] Waited 9.45 ms on lock 0x7b5400030890. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e670b2 00007f3360de0759 00007f3360d78a76 00007f3360d49d58 00007f3360e4804e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc
0709 12:24:54.920826 (+30740957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:51.701867 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:51.721744 (+ 19877us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:51.721783 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:24:51.721800 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:51.722647 (+   847us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:51.722733 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:51.722762 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:24:51.723310 (+   548us) tablet.cc:701] Row locks acquired
0709 12:24:51.723327 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:24:51.723465 (+   138us) write_op.cc:270] Start()
0709 12:24:51.723583 (+   118us) write_op.cc:276] Timestamp: P: 1783599891723418 usec, L: 0
0709 12:24:51.723607 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:24:51.724308 (+   701us) log.cc:844] Serialized 2416 byte log entry
0709 12:24:52.471467 (+747159us) op_driver.cc:464] REPLICATION: finished
0709 12:24:52.955579 (+484112us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335e9c1ef0
0709 12:24:53.154771 (+199192us) write_op.cc:301] APPLY: starting
0709 12:24:53.165002 (+ 10231us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:53.172365 (+  7363us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:53.172392 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:53.677512 (+505120us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:53.771270 (+ 93758us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:24:53.771376 (+   106us) write_op.cc:312] APPLY: finished
0709 12:24:53.771816 (+   440us) log.cc:844] Serialized 65 byte log entry
0709 12:24:53.979732 (+207916us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.979875 (+   143us) write_op.cc:454] Released schema lock
0709 12:24:53.979926 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:53.980425 (+   499us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.980463 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":291977,"reported_tablets":32,"spinlock_wait_cycles":21739904,"child_traces":[["op",{"apply.queue_time_us":577124,"apply.run_cpu_time_us":24687,"apply.run_wall_time_us":873768,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":374137,"prepare.run_cpu_time_us":9105,"prepare.run_wall_time_us":106404,"raft.queue_time_us":314949,"raft.run_cpu_time_us":29943,"raft.run_wall_time_us":725522,"replication_time_us":606116,"spinlock_wait_cycles":8655744,"thread_start_us":1197754,"threads_started":5,"wal-append.queue_time_us":354547,"wal-append.run_cpu_time_us":36916,"wal-append.run_wall_time_us":2389411}]]}
I20260709 12:24:55.143174 23479 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.211930 23369 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.151s	user 0.020s	sys 0.000s
I20260709 12:24:55.215688 19487 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:55.299980 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.439646 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.323880 18846 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:55.195605 23259 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.444022 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.444530 23259 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:55.447451 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.326004 23491 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 12:24:55.300235 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56086.9us
I20260709 12:24:55.279912 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.202911 23013 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.442710 23369 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.443377 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2366) took 1186 ms. Trace:
I20260709 12:24:55.443897 18922 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:24:55.325661 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:55.448251 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49773.9us
I20260709 12:24:55.117043 22930 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.298138 23238 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:55.281136 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.461293 18848 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.449467 18845 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.299604 23261 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.450948 18847 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:55.291745 23490 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:24:55.210080 23460 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:24:55.301831 23500 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:24:55.231383 23411 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:55.145153 23296 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.214026 23415 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.437505 23456 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:55.213613 23393 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.245s	user 0.014s	sys 0.003s
I20260709 12:24:55.458173 18921 rpcz_store.cc:276] 0709 12:24:54.257070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.257392 (+   322us) service_pool.cc:224] Handling call
0709 12:24:55.443069 (+1185677us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54000f6c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:55.443280 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797500288}
W20260709 12:24:55.467557 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.441309 23196 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:55.466743 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:55.474656 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.300550 23468 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.159s
I20260709 12:24:55.493222 18844 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:24:55.279537 23102 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.280292 23311 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.483856 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.458335 23169 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:55.485472 18769 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:55.121946 23434 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.151249 23437 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:55.323200 23505 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:24:55.503486 23476 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:24:55.504766 23369 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.490365 23427 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:24:55.517906 23442 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:55.518456 23508 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:24:55.479616 23375 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.456777 23479 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:55.511595 23504 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:24:55.485054 23259 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.571691 18843 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:55.488703 23261 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.549705 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.571041 23507 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:24:55.575362 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 249865us
I20260709 12:24:55.576707 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 932) took 1059 ms. Trace:
I20260709 12:24:55.531013 23238 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.594105 23463 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:55.594767 23463 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:55.595855 23463 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.597246 23463 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:55.598775 23411 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.490051 18666 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.607813 23102 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.608712 23311 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:55.609745 23414 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.661s	user 0.014s	sys 0.001s
I20260709 12:24:55.610383 23414 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.572125 23427 consensus_queue.cc:1243] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:24:55.615209 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:55.616433 23296 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.617228 23339 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:55.617835 23339 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.583151 23375 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.618227 23339 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:55.620147 23483 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:55.623198 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.624037 18844 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:55.582767 18920 rpcz_store.cc:276] 0709 12:24:54.510723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.511925 (+  1202us) service_pool.cc:224] Handling call
0709 12:24:54.512587 (+   662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.513283 (+   696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.513316 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.514008 (+   692us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.780343 (+266335us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:54.780397 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.780502 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.569638 (+789136us) raft_consensus.cc:1685] finished
0709 12:24:55.569668 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.569849 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58294,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":177,"thread_start_us":265863,"threads_started":1,"wal-append.queue_time_us":471844}
I20260709 12:24:55.544293 23393 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.605321 18666 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 9, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 9 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.674695 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:55.675479 18666 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 10, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 10 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:55.676275 23339 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.677296 18666 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:55.678490 23437 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.679889 18847 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:24:55.676703 23393 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:55.682806 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 194894us
I20260709 12:24:55.539032 23460 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.684617 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.686326 18847 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:55.614311 23414 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.580681 23507 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:24:55.693770 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 249276us
I20260709 12:24:55.698253 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.698741 19487 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:55.699308 18844 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:24:55.684675 23375 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.711009 18848 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:55.707576 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.712908 18840 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:55.714015 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.687209 23102 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:55.690770 23339 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:55.719497 18847 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:55.717124 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.698602 23507 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:55.721717 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 517216us
I20260709 12:24:55.722913 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.721961 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:24:55.722136 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 270522us
I20260709 12:24:55.723217 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.724351 18848 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:55.691496 23437 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.724433 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.731982 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:55.734014 19487 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:55.734861 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 247522us
I20260709 12:24:55.719244 23476 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.739261 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:55.762925 18920 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:55.762646 23476 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.721771 23363 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:55.763978 23363 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.765403 23476 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:55.739686 23404 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.740137 23415 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.740242 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:55.740878 22930 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.741096 23479 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.742515 23460 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.766326 23363 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.733882 23393 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:55.743407 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.776973 18846 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:55.777323 23404 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.778158 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.779780 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.780333 23404 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.780710 18846 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:55.744282 23369 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:55.744513 23102 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.781885 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.753716 23238 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.735553 23375 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:55.756170 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:55.757022 22905 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:55.757241 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:55.757668 23168 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:55.760598 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.776414 23261 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:55.783360 19491 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:55.796777 18848 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:24:55.798246 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.799899 18840 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:24:55.786078 18842 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:55.786836 19487 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:24:55.746574 18666 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 8, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 8 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:55.802129 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.803201 18841 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.806669 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.809093 23404 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:55.801225 23479 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:55.781446 23369 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.817307 18846 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:55.819211 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.821583 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:55.821852 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65815us
I20260709 12:24:55.818235 23168 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.828967 18842 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.830471 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:55.830629 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 73507.3us
I20260709 12:24:55.835140 18845 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:55.836689 18839 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
W20260709 12:24:55.839138 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 96576.3us
I20260709 12:24:55.838346 22905 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.842726 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:55.815155 23375 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:55.849082 22905 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.843835 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.853024 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:55.855340 18846 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:55.850301 22930 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:55.815410 23437 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.857151 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:55.864220 19483 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:55.865893 18844 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.867748 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.868394 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:55.872040 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:55.869045 23404 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:55.890223 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:55.892705 23375 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.895218 23168 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.864948 22930 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.896270 22905 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.869204 23393 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:24:55.897804 23404 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:24:55.901362 23520 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:24:55.843869 18666 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:55.917505 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2622) took 1044 ms. Trace:
I20260709 12:24:55.919162 23347 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:55.909330 23369 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.922115 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:55.923650 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.947485 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.924639 18848 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:24:55.884682 19457 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.721s (SENT)
I20260709 12:24:55.924103 18844 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:55.928695 18846 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:55.905850 23507 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.949775 23404 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:55.951623 23507 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.951395 18666 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.952361 19492 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:55.953153 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:55.954136 23517 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:24:55.954963 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72667.6us
I20260709 12:24:55.955940 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:55.956539 19457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.933s (SENT) [suppressed 33 similar messages]
I20260709 12:24:55.956743 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:55.958012 22905 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:55.958819 18848 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:24:55.946746 18769 rpcz_store.cc:276] 0709 12:24:54.873565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.883109 (+  9544us) service_pool.cc:224] Handling call
0709 12:24:55.917279 (+1034170us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54001c2354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:55.917432 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323085568}
I20260709 12:24:55.960225 18848 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:24:55.928205 18841 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:55.910961 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:55.929994 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45403us
I20260709 12:24:55.939268 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:55.938053 23415 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:55.940282 23393 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:55.907806 23482 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.910527 23336 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.980386 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:55.911346 23437 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:55.948252 19487 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:55.977221 18842 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:55.921936 23438 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:55.982309 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:55.988706 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:55.953423 18666 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: config changed from index 3 to 5, term changed from 5 to 10, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to <none>, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:55.962317 23347 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:55.994688 19491 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:24:55.998222 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:55.996462 23482 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.004154 23482 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.004750 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.005259 23347 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.005832 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:55.976670 23393 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:56.009276 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.011077 19487 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:56.021082 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.013295 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.022253 18921 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:56.019508 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.025261 18918 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:56.021816 18920 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:56.010958 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.007612 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.022176 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:56.013995 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.027523 18916 raft_consensus.cc:2410] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:24:56.025578 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.010224 23013 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.000s
I20260709 12:24:56.034669 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.034909 19486 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:56.035414 18915 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:56.036583 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.030287 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.033231 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.033465 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.010468 23393 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.041232 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.041527 18917 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:56.042057 18916 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:55.985431 23369 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:24:56.006335 23373 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:56.029847 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.044225 18920 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:24:56.006699 23347 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.021763 23438 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:56.043627 23363 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:56.031277 23468 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:24:56.051926 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74213.7us
I20260709 12:24:56.054629 23238 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:56.044797 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.046792 23415 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:56.046602 23375 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.057984 23196 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.034718 23013 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.046607 23168 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:55.986953 23336 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.062253 23519 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:56.031944 23264 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.082355 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.073082 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.054638 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.064380 23468 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:56.070726 22905 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:24:56.070211 23363 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.083829 23468 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:56.086910 23523 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:56.086992 23363 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.087581 23523 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.088207 23523 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:56.087777 23468 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.088204 23264 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.089171 23089 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:56.089607 23363 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.078703 23375 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.090821 23264 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:56.092196 23336 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.092311 23375 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.092923 23375 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.093281 19483 raft_consensus.cc:2410] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:56.093500 23375 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.094677 23196 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.094877 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:56.095774 23482 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:56.095825 23375 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.096271 23482 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.096514 23375 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.097285 23483 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:56.097404 23238 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.097929 23483 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:56.097971 23238 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.099130 23483 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.100410 23238 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:56.096285 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.096748 23482 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.102808 18840 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
W20260709 12:24:56.103332 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.096616 23437 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:24:56.086122 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.081579 22930 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:56.097309 23375 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.112257 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.112761 23375 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.113229 18919 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:56.109191 23363 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:56.114959 23363 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:56.115233 23393 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.115983 23363 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.122665 23013 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.123340 23469 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:56.124679 23469 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:56.128113 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.134529 23479 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:24:56.135885 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49832.6us
I20260709 12:24:56.138002 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.141260 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.141860 18919 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:24:56.109511 23089 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:56.143610 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48812.8us
I20260709 12:24:56.145951 18914 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:56.150374 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.151219 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.155787 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.153401 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.156813 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.157758 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54084 (request call id 2392) took 1512 ms. Trace:
W20260709 12:24:56.158206 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.134719 23494 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:24:56.138870 23437 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.158129 18914 rpcz_store.cc:276] 0709 12:24:54.635691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.680070 (+ 44379us) service_pool.cc:224] Handling call
0709 12:24:55.719290 (+1039220us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b540027c9d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af82a3d 00007f335ff52cd0 00007f33594d7254 00007f33594d71e2 00007f33594d7111 00007f33594d708c 00007f33594d6342 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:56.117105 (+397815us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4c0014b300. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359257a20 00007f3359268a29 00007f335926913f 00007f335922d2ab 00007f335925af3c 00007f335925b3fe 00007f33594e888b 00007f335aee7495 00007f335af3830f 00007f335af82a55 00007f335ff52cd0
0709 12:24:56.147601 (+ 30496us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":210,"spinlock_wait_cycles":130080896}
I20260709 12:24:56.137180 23479 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:56.165764 23536 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:56.145205 23401 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.149588 23089 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.150867 23468 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.178772 23401 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.182919 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.165999 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.172649 23013 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.197986 19486 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:56.198555 23402 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:56.180788 23479 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.199033 23402 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.199421 23402 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.199524 23479 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.201244 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.201920 18920 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:56.202813 23369 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.205696 18913 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:56.206755 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.208055 23438 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:56.208505 23438 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.208912 23438 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.212392 18916 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:56.220409 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 761) took 1017 ms. Trace:
I20260709 12:24:56.220896 18843 rpcz_store.cc:276] 0709 12:24:55.202796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.230011 (+ 27215us) service_pool.cc:224] Handling call
0709 12:24:55.296963 (+ 66952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.572154 (+275191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.220135 (+647981us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400125054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:56.220337 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617176832}
W20260709 12:24:56.186772 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.169639 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:56.189994 23531 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.210s	user 0.005s	sys 0.000s
I20260709 12:24:56.070356 18666 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 9, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 9 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:56.178938 23089 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.166846 23168 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:24:56.193202 23401 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:56.195365 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 195140us
I20260709 12:24:56.224500 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:56.226773 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 57225.8us
W20260709 12:24:56.202816 23528 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:24:56.239105 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:56.233753 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.167661 23469 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:56.265549 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.267679 18773 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:24:56.269511 18766 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [8.5-12.7]
I20260709 12:24:56.231670 23536 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.232206 23437 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.278442 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.257817 23519 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:56.281649 18772 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:56.260303 23196 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:56.286500 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.287147 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.237046 23494 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 12:24:56.289016 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49979.7us
I20260709 12:24:56.272879 23401 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.288383 23112 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:56.279479 23415 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.290376 23539 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.291365 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.327796 18917 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:56.292205 23102 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:56.293072 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:56.335305 18914 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:56.280292 23437 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.297024 18773 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:56.298050 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:56.298177 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.298902 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.346779 18920 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:56.347272 18913 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:24:56.299448 23296 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:56.300103 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.352185 18919 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:56.300192 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.353192 18764 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:56.301254 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.302462 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.302955 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.303939 23013 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:56.304644 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:56.355504 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.232615 23238 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:24:56.305750 18772 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.309140 18666 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:56.281471 23519 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.285390 23196 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:56.321849 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:56.334177 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.295295 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.336890 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.340369 23402 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.343436 23523 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.350024 18771 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:56.364622 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.370445 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.373602 18769 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:24:56.374711 18917 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:56.378317 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.379550 18773 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:56.350340 23347 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.388655 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.382848 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:56.389402 18764 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:56.351408 23296 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:56.368405 23519 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.400271 18772 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:24:56.335011 22905 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:24:56.406196 18914 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:24:56.325001 23401 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:56.409814 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59746.5us
I20260709 12:24:56.412227 23296 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.416213 18772 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:56.357625 23102 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:24:56.397960 23539 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.347944 23112 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.361732 23415 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.372236 23438 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:56.449923 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 128157us
I20260709 12:24:56.450968 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.438001 23539 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:56.454533 23539 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.434576 23536 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:56.398164 23347 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.475814 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.482908 18770 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:56.496373 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:56.497545 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.497959 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 46041.2us
I20260709 12:24:56.481122 23238 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.497248 18769 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:56.509377 18772 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:56.506433 23545 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:56.513168 23545 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.492779 23296 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.513639 23545 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.519378 18767 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:56.489710 23089 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.523967 23375 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.526826 23438 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.527859 23375 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.529666 23112 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:56.529796 23089 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.531791 23347 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:56.532510 23401 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:56.533291 23437 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.535025 23415 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.522571 23238 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:56.523406 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.464200 23196 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.551681 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.555415 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.498809 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.558794 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.559496 18767 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:56.564918 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:56.473755 18666 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 11, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 11 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.546710 23415 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:24:56.571851 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73124.2us
I20260709 12:24:56.574720 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.575471 18769 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:56.575935 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.576567 18917 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:56.576613 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.582548 23549 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.570943 23196 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.586526 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.586716 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.587383 18765 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:56.587524 18846 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:56.588354 23402 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.590545 23347 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.591121 23347 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.593369 23347 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:56.591153 18666 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:56.594941 23523 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.595906 23238 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.595607 18666 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 10, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 10 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:56.597764 23415 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.599161 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.600443 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:56.597361 18666 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.602829 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.566283 23112 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:56.605954 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.626691 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.577626 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:56.588241 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.632835 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.633354 18772 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:56.633805 18842 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:56.621213 23519 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:56.622591 23482 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.001s
I20260709 12:24:56.622283 18666 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 11, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 11 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.626374 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.627897 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.642246 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.645814 18845 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:56.645951 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.629285 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.646600 18847 raft_consensus.cc:2376] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11. Re-sending same reply.
I20260709 12:24:56.646864 18840 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:56.640995 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.644485 18842 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:56.641686 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.645349 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.649230 18843 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:56.646205 18921 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:24:56.571585 23525 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.634611 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.650914 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.656648 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.657348 19491 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:56.647859 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.657684 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.659467 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.661044 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.658667 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.618196 23415 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.664870 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:56.665092 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 59945.6us
I20260709 12:24:56.672757 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.673776 18921 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:24:56.658036 18839 raft_consensus.cc:2376] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11. Re-sending same reply.
I20260709 12:24:56.677776 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.678272 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.678507 18772 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.679003 18845 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:24:56.679052 18916 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:56.679279 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:56.681526 18919 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.677516 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:56.686730 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.659196 23539 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.689431 23415 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:56.690114 23415 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:56.691164 23539 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.692931 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:56.698020 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.702842 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:56.703543 18916 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.691246 23415 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.710801 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.711108 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.712116 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.705010 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.749341 18916 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:56.766151 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:24:56.730675 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.713860 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.766983 18917 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:56.767518 18766 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:56.716060 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.714104 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.715570 18846 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:56.770120 18847 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:24:56.716480 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.729585 18769 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:56.720173 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.679095 23238 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:56.712476 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.714308 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.776067 18770 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:56.776350 18842 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
W20260709 12:24:56.772374 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 67459.1us
I20260709 12:24:56.713050 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.779016 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:56.727959 18765 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:24:56.730145 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:56.669061 23373 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.665791 22905 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:56.772665 18841 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:56.780223 23539 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:56.799471 23539 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.800064 23539 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:56.779923 18765 pending_rounds.cc:85] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 10
I20260709 12:24:56.802713 18765 pending_rounds.cc:107] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:24:56.803122 18765 raft_consensus.cc:2889] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:56.669416 23393 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:56.712678 23340 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:56.817940 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.818902 18841 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:56.819988 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.820919 18841 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:24:56.821772 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.815701 23393 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.823201 23393 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:56.823833 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.779069 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:56.788961 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58928.8us
I20260709 12:24:56.826802 18841 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:56.827736 23340 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:56.828809 23340 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:56.829130 23340 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:56.829214 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.829842 18841 raft_consensus.cc:2376] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10. Re-sending same reply.
I20260709 12:24:56.790565 23347 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.830761 23347 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:56.830760 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.831410 23347 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.831621 18841 raft_consensus.cc:2376] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10. Re-sending same reply.
I20260709 12:24:56.832556 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.790761 23112 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.724776 18666 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:56.833702 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.834307 23549 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:56.835035 23549 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:56.835283 18666 catalog_manager.cc:5697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:56.834553 18841 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:56.836012 23549 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.837297 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.836971 18666 catalog_manager.cc:5697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 2 to 8, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 8 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.791343 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:56.838670 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 59728.9us
W20260709 12:24:56.839020 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47787.6us
I20260709 12:24:56.839994 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.840304 18841 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:56.788755 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.840912 23468 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:56.841184 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74786.6us
I20260709 12:24:56.841557 23196 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:56.841298 22930 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:56.842165 23196 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:56.843415 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.843232 23196 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.845834 18765 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:56.847823 23468 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.847987 18843 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:24:56.848356 23468 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.849318 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.729559 23545 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.654309 23482 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.826193 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.925776 18845 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.679838 23264 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:56.791882 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.926653 23264 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.792048 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.927170 23264 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.927222 23347 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.811151 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:56.846287 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.928794 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:56.716933 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.929944 18848 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:56.850791 23469 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:56.930945 18914 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:56.830073 23340 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.852180 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.931702 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.717679 23519 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:56.854925 18666 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 12, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 12 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:56.783816 23238 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.779471 18768 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.714748 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.858834 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.862993 19492 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:24:56.939754 18844 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.858379 18841 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:24:56.872555 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:56.879139 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.944504 18772 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:56.895751 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.897158 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:56.971786 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.876480 18919 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:56.900125 18916 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:56.893718 18917 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:24:56.902505 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:56.973635 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:24:56.906296 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 291661us
I20260709 12:24:56.974701 18770 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:24:56.975741 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.901088 18920 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:56.916105 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:56.916179 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.921679 18922 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:24:56.979282 18922 pending_rounds.cc:85] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 10
I20260709 12:24:56.914448 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.844458 22930 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:56.922428 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.901743 23542 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:56.935882 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.980567 18846 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:56.981231 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.981572 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.982069 18847 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:56.982754 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 60500.8us
I20260709 12:24:56.984169 23363 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.984568 18846 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:56.984758 23363 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:56.986050 18846 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:56.955853 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.986831 18765 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:56.956132 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.988420 23363 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:56.963272 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.967914 18842 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:56.990010 18841 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:24:56.969848 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.991539 18841 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:56.992296 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:56.992626 18843 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 8: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:56.993009 18765 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:24:56.994175 23542 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:56.995098 23542 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.970084 18845 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:24:56.979648 18922 pending_rounds.cc:107] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:24:56.996248 18922 raft_consensus.cc:2889] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:56.979974 22930 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:56.997964 23542 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:56.999382 23542 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.946822 18840 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:57.000054 23542 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.998622 22930 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:56.930569 19483 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:57.007128 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:56.940855 23238 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:56.945032 23479 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.015019 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:57.020509 18765 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 12:24:56.955960 23112 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.003896 22930 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:56.955397 23523 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 12:24:57.029780 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.040307 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:57.058444 18842 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:57.063454 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.016775 23261 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:57.052021 18772 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:57.071188 18844 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:24:57.082356 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.083480 18765 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:24:57.089955 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:57.112003 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.027804 23438 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:57.125427 18766 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:57.126811 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:57.128988 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.129364 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:57.130151 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:57.130884 18764 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:57.125991 18915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.024s
I20260709 12:24:57.067589 23340 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:57.132735 18915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.024s
I20260709 12:24:57.137187 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.153007 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:57.154075 18769 raft_consensus.cc:2376] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13. Re-sending same reply.
I20260709 12:24:57.040169 23112 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:57.163040 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.164328 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.157189 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.027127 23479 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:57.175776 18844 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:57.180929 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:56.991766 23525 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:57.026502 23401 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:24:56.991109 23373 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:57.195683 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:57.197515 18843 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:24:57.167399 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.010686 23534 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:24:57.182964 18770 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:57.183388 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:56.947660 18666 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 5 to 8, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 8 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.191424 18845 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:57.193578 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:57.209584 18772 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:57.209908 18766 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:57.210638 18914 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:57.183645 23476 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:57.215570 18772 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:57.217760 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:57.218436 18771 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.195458 23469 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:57.221024 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:57.224336 18844 raft_consensus.cc:2410] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:57.221540 18766 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:24:57.227072 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 213799us
I20260709 12:24:57.226962 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.213447 23542 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:57.212677 23347 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:57.215782 23476 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:57.241560 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:57.262861 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.264423 23089 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:57.265842 23554 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:24:57.266554 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.267480 18666 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:57.268522 23296 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:57.268739 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.269191 18666 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 7, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:57.269896 23102 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:57.270891 23556 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:24:57.272029 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.273325 23102 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.275503 23102 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:57.278282 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.278975 23476 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:57.281294 23482 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:57.281440 23476 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.283303 23482 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:57.283702 23482 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:24:57.286146 23557 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
W20260709 12:24:57.286517 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.310351 23102 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.242559 23549 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:24:57.312014 23468 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:57.320493 23563 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:24:57.325510 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47366.9us
I20260709 12:24:57.326467 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.327440 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:57.328287 18914 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:57.329046 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 87593.6us
I20260709 12:24:57.330926 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.249346 18764 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
W20260709 12:24:57.338141 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 352778us
I20260709 12:24:57.243337 23534 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:57.364210 18913 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:57.364007 23534 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:57.366369 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:57.368196 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:57.369251 18921 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:24:57.341540 23548 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:24:57.359476 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:57.385789 23468 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:57.387965 23468 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.388489 23468 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:57.390034 23539 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
I20260709 12:24:57.354815 23523 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.327370 23549 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.436897 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:57.437937 18917 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:57.360229 23476 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:57.356698 23401 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.310351 23393 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:57.455639 23539 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:57.454116 23438 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:57.449443 23545 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:57.451969 23468 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:57.463129 23523 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:57.465662 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.452828 23482 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:57.472993 23534 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:57.473242 23393 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:57.473977 18767 raft_consensus.cc:2368] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12.
W20260709 12:24:57.482115 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.510602 18887 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.509s (SENT)
I20260709 12:24:57.511103 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:57.488425 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:57.511876 18771 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 8.
I20260709 12:24:57.513481 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:57.514147 18770 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:57.520884 18887 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.529s (SENT)
I20260709 12:24:57.523911 23539 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:57.526911 23482 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.500828 23296 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.536172 23523 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:57.536842 23523 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:57.536423 23438 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:57.537798 23523 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:57.491134 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:57.492012 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 298518us
I20260709 12:24:57.500784 23112 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:57.436348 23261 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:57.502835 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:57.547953 18768 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.002s
I20260709 12:24:57.550000 18765 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:57.550287 18768 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:24:57.548831 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:57.564365 23566 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:57.568744 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.648s (SENT)
I20260709 12:24:57.569244 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:57.570652 18841 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.010s
W20260709 12:24:57.571188 18841 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.003s	sys 0.010s
I20260709 12:24:57.581432 18770 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
W20260709 12:24:57.588594 19457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.005s	sys 0.008s
W20260709 12:24:57.589440 19457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.006s	sys 0.008s
I20260709 12:24:57.532091 23576 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:24:57.564913 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:57.567516 23476 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:57.595253 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:57.567904 23112 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.643046 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:57.657485 19488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.001s	sys 0.016s
W20260709 12:24:57.659901 19488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.001s	sys 0.017s
I20260709 12:24:57.589916 23566 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:57.641889 23238 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.009s
W20260709 12:24:57.666173 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71022.1us
I20260709 12:24:57.616842 23476 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:57.669306 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 242790us
I20260709 12:24:57.672084 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:57.672851 18913 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
W20260709 12:24:57.676406 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 310108us
I20260709 12:24:57.677217 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.678632 23539 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:57.679095 23539 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:57.679448 23539 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:57.701886 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.704355 23102 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:24:57.742182 18847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.012s	sys 0.041s
W20260709 12:24:57.648304 19485 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.014s	sys 0.003s
I20260709 12:24:57.751307 19486 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:57.642949 22930 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.656234 19483 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:24:57.662861 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 896) took 1067 ms. Trace:
I20260709 12:24:57.667100 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:57.743623 18847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.012s	sys 0.042s
W20260709 12:24:57.752425 19485 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.014s	sys 0.004s
I20260709 12:24:57.755267 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:57.882090 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.804033 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 247064us
W20260709 12:24:57.843206 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 352145us
W20260709 12:24:57.901566 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.786s (SENT)
I20260709 12:24:57.902279 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:57.824596 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:57.903055 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:57.753490 18917 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:57.805655 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:24:57.799432 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 121058us
W20260709 12:24:57.800186 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 125498us
I20260709 12:24:57.802256 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:24:57.667698 23264 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.740s	user 0.014s	sys 0.000s
I20260709 12:24:57.647938 23469 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:57.919093 18914 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:57.784874 23539 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:57.920363 23581 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.896196 19488 rpcz_store.cc:276] 0709 12:24:56.595186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.646489 (+ 51303us) service_pool.cc:224] Handling call
0709 12:24:56.678348 (+ 31859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.678671 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:24:57.112187 (+433516us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.662489 (+550302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:57.662547 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:57.662601 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.662674 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.662800 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1014,"prepare.queue_time_us":567389,"raft.queue_time_us":132823,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6349,"spinlock_wait_cycles":178562688,"thread_start_us":942755,"threads_started":2}
I20260709 12:24:57.916257 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:57.927538 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:57.924763 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 118876us
I20260709 12:24:57.934015 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.751722 23476 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:57.833165 23571 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 12:24:57.787457 23519 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:24:57.941183 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 274154us
I20260709 12:24:57.941965 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.944667 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.945269 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:57.916895 23373 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:57.973368 23581 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:57.973858 23373 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:57.955622 18887 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.817s (SENT)
I20260709 12:24:57.974196 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:57.974772 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:57.922374 23539 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:57.975770 23373 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:57.976176 23112 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.978503 23340 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:57.649539 18666 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 9, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 9 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:24:57.973917 23581 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:57.668921 23549 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.273s
I20260709 12:24:57.912204 23566 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.984934 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:57.832512 23102 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.907119 23583 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:57.986963 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.938807 23196 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.923347 23545 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:57.952600 23525 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.989725 19483 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:24:57.979853 23573 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:24:57.993436 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 82648.7us
I20260709 12:24:57.992936 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2324) took 1033 ms. Trace:
I20260709 12:24:57.751551 23238 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:57.981181 23468 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.669169 23261 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:57.984807 22930 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.986115 23519 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:58.010648 23588 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.021498 23588 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.021826 23519 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:58.019665 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 77811.5us
I20260709 12:24:57.984614 23581 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.024863 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:57.924105 23264 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.026958 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:58.027442 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:58.007457 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:57.991992 23369 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:24:58.010566 23460 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:24:58.010783 23393 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:24:57.998404 23583 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:58.030809 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 92253.4us
I20260709 12:24:58.034617 18848 raft_consensus.cc:2368] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:24:58.002410 23340 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:58.004096 23401 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:57.995477 23102 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:58.050565 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 194360us
I20260709 12:24:58.043180 23438 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:58.030550 23402 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:58.004048 23545 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.062882 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2556) took 1333 ms. Trace:
I20260709 12:24:58.063287 18847 rpcz_store.cc:276] 0709 12:24:56.726165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.982795 (+256630us) service_pool.cc:224] Handling call
0709 12:24:56.983165 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:56.985836 (+  2671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.985875 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:56.986545 (+   670us) log.cc:844] Serialized 52 byte log entry
0709 12:24:57.197271 (+210726us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:57.907748 (+710477us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.918085 (+ 10337us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.944568 (+ 26483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.944682 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.059226 (+114544us) raft_consensus.cc:1685] finished
0709 12:24:58.059260 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.059486 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31096,"prepare.queue_time_us":170441,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":73064,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":34416,"spinlock_wait_cycles":16039168,"thread_start_us":892122,"threads_started":2,"wal-append.queue_time_us":514290}
W20260709 12:24:58.065778 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 66698.6us
I20260709 12:24:58.056403 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:58.067512 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:58.069060 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:58.069734 18846 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:58.068629 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:58.053268 23112 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:58.085151 23112 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:58.085371 23102 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:58.052772 23594 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:24:58.086103 23112 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.087500 23112 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.086022 23600 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.051324 23401 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:58.091327 23401 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.078969 23340 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.077777 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:58.095065 18845 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:58.094909 23340 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.052944 23438 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:58.102490 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:58.080089 18847 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:58.081496 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:58.082474 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75155.4us
I20260709 12:24:58.104419 18770 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:58.083782 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:58.084627 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:58.105103 18771 raft_consensus.cc:2376] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13. Re-sending same reply.
I20260709 12:24:58.098948 18840 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:58.066612 22930 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.105207 18773 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:58.056161 23402 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:58.104563 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:58.106909 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54722.7us
I20260709 12:24:58.081456 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:58.030725 23469 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.116818 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:58.127573 23613 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:58.127839 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:58.129904 23569 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:58.103297 18915 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:58.061614 23584 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:58.073868 23590 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.113768 23438 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:58.122545 23595 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.169030 23595 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.169525 23595 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:58.123122 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.181s (SENT)
I20260709 12:24:58.123577 18764 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:58.128196 23613 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:58.130607 23347 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.171238 23613 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.112797 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:58.060915 23013 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:24:58.133512 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:58.174446 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:58.170791 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:58.186729 18845 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:58.118819 23402 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:58.077201 23519 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.195214 23519 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:58.196007 23519 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:58.196971 23613 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.198820 23347 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.199652 23347 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.200022 23613 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:58.138775 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.105s (SENT)
I20260709 12:24:58.203513 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:58.074071 23549 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:24:58.130332 23569 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.232563 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:58.136332 23584 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.130282 23479 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:58.197414 23519 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:58.231066 23571 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:24:58.133291 22930 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.228092 23494 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.135589 23600 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
W20260709 12:24:58.230867 23605 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 12:24:58.343197 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 104419us
I20260709 12:24:58.352284 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:58.353948 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 214467us
W20260709 12:24:58.344113 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 231386us
I20260709 12:24:58.355670 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:58.217460 23615 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.238044 23569 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.240077 23584 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:58.073632 18666 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 12, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 12 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:24:58.451124 18765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2641) took 1312 ms (client timeout 1749 ms). Trace:
I20260709 12:24:58.345969 23479 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:58.504235 18767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2080) took 1554 ms (client timeout 1845 ms). Trace:
I20260709 12:24:58.375540 23013 consensus_queue.cc:1243] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:58.240295 23613 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.198s
I20260709 12:24:58.228247 23597 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.249s
I20260709 12:24:58.368605 23238 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:58.375682 23615 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.381409 23566 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:24:58.549012 18765 rpcz_store.cc:269] 0709 12:24:57.099505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.111678 (+ 12173us) service_pool.cc:224] Handling call
0709 12:24:58.411705 (+1300027us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54001793d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:58.411846 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005188480}
W20260709 12:24:58.632495 23606 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:24:58.554714 18767 rpcz_store.cc:269] 0709 12:24:56.882997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.883211 (+   214us) service_pool.cc:224] Handling call
0709 12:24:58.412159 (+1528948us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540036b5d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:58.437664 (+ 25505us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154929920}
I20260709 12:24:58.330629 23577 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.173s
I20260709 12:24:58.634454 23238 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:58.634891 23238 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:58.635624 22930 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:58.635717 23238 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.637372 23238 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:58.640832 23373 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.000s
I20260709 12:24:58.641343 23373 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.642696 18770 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:24:58.580989 23622 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:24:58.348407 23393 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.157s
I20260709 12:24:58.584952 23623 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:58.351974 23494 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:58.587766 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.595404 23617 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:24:58.596061 23340 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:58.503824 23523 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:58.597617 18666 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 10, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 10 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:24:58.599756 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 460999us
I20260709 12:24:58.607388 23583 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:58.608319 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 485212us
W20260709 12:24:58.729597 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.247s (SENT)
W20260709 12:24:58.610033 23607 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 12:24:58.614948 23347 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:58.438127 23595 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.619410 23543 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:58.690618 23482 consensus_meta.cc:287] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.163s	user 0.014s	sys 0.000s
I20260709 12:24:58.623487 23549 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.627158 23584 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.632371 23615 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:58.579639 23609 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.203s	user 0.000s	sys 0.004s
I20260709 12:24:58.382372 23476 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.704448 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:58.705644 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:58.719621 23545 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:58.730218 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:58.676163 23566 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:58.692377 22930 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.763068 18765 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:58.706593 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:58.796391 23594 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:58.796885 23594 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:58.801884 23566 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.805271 18918 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:24:58.804383 23584 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:58.714216 23469 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:58.694167 23616 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.762480 18767 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:24:58.816699 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 87153.8us
I20260709 12:24:58.821935 22930 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.759765 23549 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.837591 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2426) took 1510 ms. Trace:
I20260709 12:24:58.711323 23623 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.825543 23534 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.838240 18922 rpcz_store.cc:276] 0709 12:24:57.327441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.327561 (+   120us) service_pool.cc:224] Handling call
0709 12:24:57.365250 (+ 37689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.450046 (+ 84796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.450087 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.457686 (+  7599us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.979806 (+522120us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:57.979862 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.980037 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.837267 (+857230us) raft_consensus.cc:1685] finished
0709 12:24:58.837298 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.837497 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23718,"raft.queue_time_us":51233,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":7093,"thread_start_us":466587,"threads_started":1,"wal-append.queue_time_us":633131}
I20260709 12:24:58.827091 23469 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:58.864372 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.005s	sys 0.018s
W20260709 12:24:58.874330 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.005s	sys 0.018s
W20260709 12:24:58.863386 23402 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.005s
W20260709 12:24:58.878155 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 525931us
W20260709 12:24:58.860625 23581 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.835s	user 0.009s	sys 0.016s
I20260709 12:24:58.880801 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:58.878516 18737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.016s
W20260709 12:24:58.883860 18737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.010s	sys 0.016s
W20260709 12:24:58.884369 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 519350us
W20260709 12:24:58.874795 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.017s
W20260709 12:24:58.886899 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.007s	sys 0.017s
W20260709 12:24:58.887274 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 531709us
I20260709 12:24:58.888849 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:24:58.874475 23369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.014s	sys 0.017s
I20260709 12:24:58.862702 23620 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:58.901202 18811 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.016s	sys 0.012s
W20260709 12:24:58.901654 18811 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.016s	sys 0.012s
I20260709 12:24:58.894035 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:58.828753 18666 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 10, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 10 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:58.893088 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:58.905704 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:58.895603 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 190120us
I20260709 12:24:58.880918 23347 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:58.912297 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:58.912979 19483 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:58.897152 23525 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.894s	user 0.017s	sys 0.000s
I20260709 12:24:58.897765 19492 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:58.899183 23543 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:58.899629 23618 raft_consensus.cc:2764] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:58.900655 23089 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.834899 23584 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:24:58.926384 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:58.902974 19491 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:24:58.887341 23373 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:58.903501 23369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.014s	sys 0.018s
I20260709 12:24:58.894788 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:58.898344 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:58.935298 23636 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.936641 18812 leader_election.cc:400] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12.
I20260709 12:24:58.937067 18812 leader_election.cc:403] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:58.912812 23616 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:58.922747 23639 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.862139 23534 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.939328 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:58.922578 23525 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.886962 23402 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.903406 23583 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:24:58.941350 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46708.4us
I20260709 12:24:58.917332 23628 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:24:58.917343 23469 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:58.891026 23581 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.959826 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:58.913883 23597 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:24:58.945279 23616 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:58.964907 23564 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.736s	user 0.007s	sys 0.000s
I20260709 12:24:58.967527 23534 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:58.968417 23569 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.012s
I20260709 12:24:58.968773 23628 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:58.974328 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:58.944136 23089 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12.
I20260709 12:24:58.975140 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:58.979287 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 160268us
W20260709 12:24:58.995000 18887 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.750s (SENT)
I20260709 12:24:58.995481 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:58.980288 23641 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:58.975077 19483 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:24:58.924665 23347 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.947961 23369 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.980384 23618 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.999634 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:58.961198 23482 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:59.000640 18847 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:59.001087 19488 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:58.991453 19486 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:59.000514 19489 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:59.003156 18765 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 12:24:58.981057 23619 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:24:59.004350 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.005316 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.005941 18767 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.007429 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:58.999763 23238 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:59.011008 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.012456 18765 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:58.930629 23543 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:58.981496 23595 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:59.008224 22930 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.013432 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:59.013767 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.013844 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.020881 18916 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.021495 18764 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:24:59.015252 23402 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:58.981302 23616 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.011690 23525 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:59.023113 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.052392 18847 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:59.052088 23525 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.053054 19489 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:59.053962 18847 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:24:59.024636 18922 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.025386 18919 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:59.055548 23583 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.025671 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.055735 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.056116 23583 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.057017 23102 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.057632 23373 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.057543 23102 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.055178 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:24:59.055159 18887 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.816s (SENT)
W20260709 12:24:59.033641 23438 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.864s	user 0.018s	sys 0.000s
I20260709 12:24:59.033834 23347 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.035071 18844 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:59.067209 18844 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:59.035326 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.004487 23641 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.036077 23620 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:59.036196 23549 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:58.964803 23634 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:24:59.007177 23482 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:59.075232 23482 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.075399 23641 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.003772 23369 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:59.055557 23363 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:59.078701 23369 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.078940 23363 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:59.079547 23494 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.079989 23363 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.080799 23621 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:59.081102 23363 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.081297 23621 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:58.993081 23569 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.066018 22930 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.083315 22930 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.084236 23569 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:59.008860 23618 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:59.084794 18848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2553) took 2362 ms (client timeout 2753 ms). Trace:
W20260709 12:24:59.085217 18848 rpcz_store.cc:269] 0709 12:24:56.724892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.956552 (+231660us) service_pool.cc:224] Handling call
0709 12:24:59.084548 (+2127996us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003269d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:59.084700 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330218240}
I20260709 12:24:59.085602 23588 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.036948 18666 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 5 to 10, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 10 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:59.087245 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.088266 18844 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.089396 18844 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:58.950170 23639 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.021138 23238 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:59.040261 23632 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:24:59.040194 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.039680 23543 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.041194 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:59.041424 18916 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:59.044126 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.044625 18765 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:24:59.040786 23623 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.054558 23525 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.123499 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.063187 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:59.068156 18845 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.068240 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.072178 23620 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.082325 23621 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:59.017951 23112 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.930s	user 0.011s	sys 0.003s
I20260709 12:24:59.036087 23628 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:57.997509 18841 rpcz_store.cc:276] 0709 12:24:56.960016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.994669 (+ 34653us) service_pool.cc:224] Handling call
0709 12:24:56.995097 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.995310 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:57.571653 (+576343us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.991875 (+420222us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.992547 (+   672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:57.992597 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:57.992643 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.992714 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.992869 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":370946,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":6110,"spinlock_wait_cycles":8876416,"thread_start_us":989360,"threads_started":2}
I20260709 12:24:59.149979 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.149040 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.150995 18841 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:24:59.151392 18840 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:59.051359 18843 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:59.103091 18914 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
W20260709 12:24:59.105717 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.113034 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.095877 23102 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:59.098199 23624 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.474s	user 0.002s	sys 0.000s
I20260709 12:24:59.114259 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:59.152384 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.155637 18841 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.122102 18767 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:24:59.140784 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.157089 18848 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:59.148013 18844 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:24:59.158150 18844 pending_rounds.cc:85] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 11
I20260709 12:24:59.158404 18844 pending_rounds.cc:107] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:24:59.158689 18844 raft_consensus.cc:2889] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:59.159734 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.114382 23583 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.164287 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.165366 18847 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:59.165927 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.129652 23238 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.168650 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.070536 23438 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.178196 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.175475 18844 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:59.156445 23549 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.087383 18666 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:24:59.176928 18848 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:59.184203 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:59.185600 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.187594 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:59.193351 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.174566 18845 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:59.159298 23543 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.159582 23588 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.156304 23641 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:59.180100 18921 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
W20260709 12:24:59.181897 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 126774us
I20260709 12:24:59.194573 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.201323 18844 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:24:59.198268 18887 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.859s (SENT)
I20260709 12:24:59.202023 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:59.199885 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.200490 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.188418 23621 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.195432 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.203125 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.191656 23618 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.199806 23401 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.203986 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.203308 18841 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:59.204461 23640 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.206239 18848 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:24:59.192719 23089 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:59.213116 18887 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.892s (SENT)
I20260709 12:24:59.217154 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:59.217301 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.207923 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:59.215993 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.192287 23581 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.197412 23102 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:59.219612 18841 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:59.220825 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2653) took 1133 ms. Trace:
I20260709 12:24:59.221292 18768 rpcz_store.cc:276] 0709 12:24:58.081749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.082049 (+   300us) service_pool.cc:224] Handling call
0709 12:24:58.082360 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.121610 (+ 39250us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:58.121652 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.122224 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.250158 (+127934us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:58.250221 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.250323 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.097460 (+847137us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:59.210830 (+113370us) raft_consensus.cc:1685] finished
0709 12:24:59.210851 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.215556 (+  4705us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98458,"raft.queue_time_us":123538,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":16744,"spinlock_wait_cycles":54442752,"thread_start_us":148202,"threads_started":2,"wal-append.queue_time_us":199142}
I20260709 12:24:59.207901 23641 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.225035 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.225765 18768 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:24:59.226620 22930 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.218806 23628 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.223641 23618 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:59.209134 23636 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.208873 23639 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.191802 23549 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.218585 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:59.237038 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.239964 23089 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:59.240734 23089 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:59.242040 23089 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.252971 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.254025 18771 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:24:59.209424 23494 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:24:59.254323 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:24:59.258534 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45455.5us
I20260709 12:24:59.207170 23578 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:24:59.262090 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.209002 23543 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.263219 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:59.265511 18887 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.753s (SENT)
I20260709 12:24:59.262339 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:59.253242 22930 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.273324 23549 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.278992 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.287086 18768 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:24:59.233429 23615 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.298496 23089 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:59.299088 23089 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.299538 23089 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.223220 23640 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.308887 23597 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:59.309252 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.312165 23615 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.261233 23238 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:59.314782 18840 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:59.316988 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:59.274009 23588 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.306090 23640 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.330958 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.331284 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:59.332485 23582 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:59.332615 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.274493 23296 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:59.324991 23562 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:24:59.273195 23543 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.347923 23597 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:59.348407 23597 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:24:59.349542 23656 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:24:59.349412 23597 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.335093 23296 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.350919 23296 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.353657 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.335628 23549 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:59.354678 23549 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.355123 23549 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.335427 23582 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:59.342803 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.361580 18768 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:24:59.346966 23562 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:59.263883 23369 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.358933 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:59.364332 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.365051 18768 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.328033 23347 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:24:59.369539 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.372396 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.372834 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.363930 23628 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:59.377903 18765 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:24:59.378469 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.373327 23347 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.376441 23597 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.395385 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.358517 23588 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.372713 23562 consensus_queue.cc:1243] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:59.393805 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.377764 23469 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:59.402796 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.383282 23468 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:59.377295 23438 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:59.404237 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.408236 18916 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:24:59.408911 18768 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:24:59.373994 23618 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:59.379017 23566 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:24:59.406746 23460 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.432528 23460 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.412268 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.391273 23628 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:59.435753 18844 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.419963 18846 raft_consensus.cc:2376] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12. Re-sending same reply.
I20260709 12:24:59.399369 23347 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:59.428745 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:59.441332 23586 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.421s	user 0.027s	sys 0.019s
I20260709 12:24:59.440899 23628 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.441784 23566 consensus_queue.cc:1243] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:59.442368 23566 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:59.442704 23566 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:59.443490 23566 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.444775 23566 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.445364 23469 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:59.447616 23620 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.448326 23460 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.446429 23469 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.451180 23620 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.409885 23569 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.466144 18844 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:59.460256 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:59.470468 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.437595 23482 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.473778 23482 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:59.477523 23369 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.478487 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 785) took 2797 ms. Trace:
I20260709 12:24:59.481161 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.478931 18839 rpcz_store.cc:276] 0709 12:24:56.680679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.680822 (+   143us) service_pool.cc:224] Handling call
0709 12:24:56.713084 (+ 32262us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:56.713562 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:57.168236 (+454674us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.559428 (+391192us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:57.560286 (+   858us) log.cc:844] Serialized 52 byte log entry
0709 12:24:57.560494 (+   208us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:24:57.560758 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.583776 (+ 23018us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.591131 (+  7355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.591216 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.440685 (+1849469us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:59.478191 (+ 37506us) raft_consensus.cc:1685] finished
0709 12:24:59.478217 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.478365 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41554,"prepare.queue_time_us":649960,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":146,"raft.queue_time_us":35966,"raft.run_cpu_time_us":682,"raft.run_wall_time_us":75276,"spinlock_wait_cycles":14074240,"thread_start_us":789906,"threads_started":2,"wal-append.queue_time_us":776010}
I20260709 12:24:59.437026 23468 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.486696 23662 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:59.470059 23569 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.485381 23620 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:59.499925 23296 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.500389 23620 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:59.501091 23620 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.498086 23662 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:59.503636 18845 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:59.503407 23662 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.481843 23640 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:24:59.506433 18914 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:24:59.511327 23569 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.484823 23460 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:59.512609 23460 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:24:59.513936 23460 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.479020 23616 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.497967 23089 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.517872 18917 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:59.518127 18841 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:59.518913 23616 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:24:59.498338 23468 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:24:59.519764 19492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 865) took 1566 ms (client timeout 1652 ms). Trace:
I20260709 12:24:59.522684 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.523370 18769 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.525552 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.526484 18767 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:59.520243 19492 rpcz_store.cc:269] 0709 12:24:57.952924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.973885 (+ 20961us) service_pool.cc:224] Handling call
0709 12:24:59.519557 (+1545672us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b540044d754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:59.519670 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792280448}
I20260709 12:24:59.520257 23089 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:59.540138 23608 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.943s	user 0.000s	sys 0.003s
I20260709 12:24:59.520530 23296 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.542526 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 901) took 2563 ms. Trace:
I20260709 12:24:59.542996 19485 rpcz_store.cc:276] 0709 12:24:56.978769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.979003 (+   234us) service_pool.cc:224] Handling call
0709 12:24:56.979387 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:57.012854 (+ 33467us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:57.851936 (+839082us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800348e80. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:24:57.907597 (+ 55661us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.012075 (+104478us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:58.041081 (+ 29006us) log.cc:844] Serialized 52 byte log entry
0709 12:24:58.041258 (+   177us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:58.042229 (+   971us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.042484 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.042583 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.539446 (+1496863us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:24:59.542223 (+  2777us) raft_consensus.cc:1685] finished
0709 12:24:59.542246 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.542433 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68555,"prepare.queue_time_us":1011152,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":65,"raft.queue_time_us":56782,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":11606,"spinlock_wait_cycles":138579456,"thread_start_us":926695,"threads_started":2,"wal-append.queue_time_us":454979}
I20260709 12:24:59.536785 23618 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.575196 23264 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.582281 18769 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:24:59.586026 18767 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:24:59.590703 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.593698 23545 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.594105 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.602121 18814 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.589583 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:59.607148 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:59.604481 23613 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:24:59.617877 23102 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.638465 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.642302 18767 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:24:59.643289 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.644223 23363 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:59.619975 23545 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:59.646466 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.650979 18767 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:24:59.590684 23620 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.652701 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.653012 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.653630 18772 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:59.653764 18768 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:24:59.640538 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.620446 23636 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:59.618746 23543 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:59.657037 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:24:59.660202 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:24:59.662062 23667 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:59.639657 23089 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.641677 23102 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.669723 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.638767 23642 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.672191 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.676052 18772 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.672591 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.677214 18767 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:59.667932 23618 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:59.675535 23089 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.686831 23549 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.708077 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.709409 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.686467 23543 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:59.676236 23102 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.713912 18768 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:59.718129 18768 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:24:59.718343 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.719051 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.719311 18768 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:59.719574 18847 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.719653 18846 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.726449 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.728443 18845 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:24:59.688042 23595 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:59.732630 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.734683 18844 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:59.741479 18846 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:24:59.743098 23089 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.745623 23545 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:59.746924 23581 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:59.749348 23581 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:24:59.750409 23581 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.751657 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.752110 23581 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.753079 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.745182 23549 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.755098 18915 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:59.755932 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2433) took 1694 ms. Trace:
I20260709 12:24:59.754348 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:59.757064 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.757305 23576 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.757876 23576 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.756544 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:59.731771 23595 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:24:59.682935 23642 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.714604 23543 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:24:59.773301 23543 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.732194 23594 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.824823 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.825824 18766 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:59.826421 23642 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:24:59.826598 18913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2430) took 2038 ms (client timeout 1963 ms). Trace:
I20260709 12:24:59.827114 23642 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.827642 23642 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.756287 18918 rpcz_store.cc:276] 0709 12:24:58.061149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.061333 (+   184us) service_pool.cc:224] Handling call
0709 12:24:58.076254 (+ 14921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.805814 (+729560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.755658 (+949844us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b5400155754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:24:59.755874 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675933952}
I20260709 12:24:59.829923 23642 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.831135 23476 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:24:59.831974 23668 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.006s
I20260709 12:24:59.842273 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.843209 23482 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:59.843411 18773 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.847162 23625 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.847754 23625 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:24:59.849100 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.849589 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.849471 23363 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.850023 23625 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.829468 23595 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:24:59.861562 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.862947 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.863838 18916 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:59.863168 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:24:59.827126 18913 rpcz_store.cc:269] 0709 12:24:57.787776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.787985 (+   209us) service_pool.cc:224] Handling call
0709 12:24:59.764463 (+1976478us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400334d54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:24:59.826528 (+ 62065us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380455808}
I20260709 12:24:59.857386 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:59.867528 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:24:59.869068 18773 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:24:59.870600 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.871665 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.869104 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.745482 18844 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:24:59.850579 23340 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:24:59.875006 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 116615us
I20260709 12:24:59.875478 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.876240 19483 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:24:59.877043 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.880237 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.880493 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:24:59.881007 18768 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:24:59.881234 18773 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:59.882814 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.883641 18766 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.747556 18846 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:59.887208 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:24:59.888926 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.876817 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:24:59.891311 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:24:59.891748 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.895689 18772 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:24:59.897300 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.897531 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:24:59.898336 23597 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:59.898783 23597 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.898954 23677 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:59.899123 23597 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.899573 23677 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:24:59.899524 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.900346 18841 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:59.900630 23677 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.901878 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.902491 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.903137 18768 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:59.903972 18841 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.906433 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.906692 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:24:59.907176 18845 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:24:59.900288 18846 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:59.907959 23597 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.912047 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.914001 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.915902 23678 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:59.916985 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.935953 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:24:59.892876 23340 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.923583 23640 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:59.893512 23112 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:59.924249 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.941617 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.924525 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.924639 23576 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:24:59.925884 23347 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:24:59.926534 23599 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:59.927052 19487 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:59.886783 23594 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.856094 22930 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.825316 23620 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.928721 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.959272 18841 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:24:59.959518 19492 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:24:59.929723 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.931841 18771 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:59.933075 18845 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:59.960420 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:24:59.933075 18847 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:24:59.960691 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:24:59.893268 23670 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.167s	user 0.000s	sys 0.006s
I20260709 12:24:59.944167 23369 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:59.937225 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:24:59.870519 23402 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:24:59.894625 23595 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.969127 18919 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:24:59.966055 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.999631 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.967489 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.991770 18918 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:00.001000 18914 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:24:59.996263 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.945839 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.006546 18839 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:24:59.946645 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:59.955485 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:24:59.956920 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:24:59.850168 23363 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:24:59.961370 18840 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.917115 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.944480 23112 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:24:59.941339 23640 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:00.012918 18913 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:00.007074 18846 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:25:00.018065 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 88413.7us
I20260709 12:25:00.019608 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:24:59.982333 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:00.027237 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45058.8us
W20260709 12:25:00.027940 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81430us
I20260709 12:25:00.030179 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:24:59.963315 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:00.035790 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 118745us
I20260709 12:25:00.037467 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:59.962564 23599 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:25:00.092923 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 62866.1us
W20260709 12:25:00.094285 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 166581us
W20260709 12:25:00.095384 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 67332.8us
I20260709 12:25:00.098237 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:59.950982 23642 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 12:25:00.105643 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 139683us
I20260709 12:24:59.953286 23576 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:25:00.047247 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.107867 18914 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:00.108018 18845 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:00.048679 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:00.109354 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60811.6us
I20260709 12:25:00.110074 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:24:59.993906 23641 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:24:59.995545 23597 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.100385 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.111864 18847 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:00.112555 23597 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:00.113224 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:00.113876 23597 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.948505 23102 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.018620 23640 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:00.122030 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.017980 23112 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:00.019459 23636 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:00.036228 23476 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:00.035631 23482 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:00.143450 23636 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.026738 23590 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:00.132076 18840 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:00.045881 23678 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:00.148669 18840 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:25:00.149901 23102 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.150738 23635 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:00.151741 23635 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:00.152088 23635 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:00.152992 23635 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.115558 23196 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:00.154788 23196 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:00.155862 23196 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.161893 18770 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:00.095752 23616 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:00.166680 23616 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.167092 23616 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:00.135177 23576 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:59.998912 23545 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.173084 23613 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:00.137775 19455 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.17.40.62:43633, user_credentials={real_user=slave}} blocked reactor thread for 55370.1us
I20260709 12:25:00.138944 23340 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.101989 23599 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:25:00.144544 23674 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:25:00.108593 23469 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:00.021843 23402 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.178612 18915 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:25:00.184868 18766 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:00.185149 18920 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:00.178072 18841 raft_consensus.cc:2368] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11.
I20260709 12:25:00.192457 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:24:59.964294 22930 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.177630 23620 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:00.205040 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:00.128342 23628 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:25:00.197543 23642 raft_consensus.cc:2764] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:00.196738 23469 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:00.218571 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 186139us
I20260709 12:25:00.189747 23635 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:00.223606 23469 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:00.239861 23590 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:00.242615 18845 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:00.248507 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 248963us
I20260709 12:25:00.230320 23628 consensus_queue.cc:1243] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:25:00.320684 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.242297 23347 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:00.366561 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:25:00.317739 23621 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:00.363511 23369 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:00.369393 23543 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.006s
I20260709 12:25:00.369570 23621 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.369915 23543 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.370198 23369 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.372121 23543 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:00.372224 23621 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:00.373435 23676 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:00.375140 18845 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:00.380124 18845 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:00.224488 23599 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.387576 23599 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:00.415120 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 320362us
W20260709 12:25:00.431931 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 321908us
I20260709 12:25:00.434852 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:00.437937 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 188034us
I20260709 12:25:00.444451 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:00.450667 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.458709 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:00.459014 19486 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:00.459427 19489 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:00.461500 19486 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:00.441044 23620 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.481995 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:00.449903 23583 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:00.493398 19488 raft_consensus.cc:2376] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9. Re-sending same reply.
I20260709 12:25:00.463102 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:00.440291 23347 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:00.471347 23340 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.442894 23566 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:25:00.479156 23402 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:00.481428 23363 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.484817 23620 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.543584 23576 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:00.544217 23576 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.545310 23620 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.511873 22930 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.546630 23576 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:00.546928 23588 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.537693 23347 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:00.551013 23347 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.552809 23597 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:00.553174 23347 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.553462 23597 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:00.555529 23581 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.005s
I20260709 12:25:00.500982 23693 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:00.558736 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2427) took 1180 ms. Trace:
I20260709 12:25:00.562362 18919 rpcz_store.cc:276] 0709 12:24:59.377968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.378134 (+   166us) service_pool.cc:224] Handling call
0709 12:25:00.558413 (+1180279us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54000e4054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:00.558635 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356327296}
I20260709 12:25:00.545646 23697 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:00.538677 23635 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:00.511510 23340 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:00.578461 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 470344us
I20260709 12:25:00.562170 23693 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:00.558456 23196 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:25:00.553967 23112 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.600919 19489 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:00.577472 23635 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.562747 23469 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.601483 23640 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.609279 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2091) took 1604 ms. Trace:
I20260709 12:25:00.610718 23640 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.612252 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:00.613140 23695 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:00.613646 23695 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:00.613807 23264 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:00.614885 23264 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.615052 23695 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.622046 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:00.616986 23581 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:00.623571 23581 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.624639 18919 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:00.626827 23581 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:00.626928 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:00.627939 18917 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:00.630550 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:00.609889 18770 rpcz_store.cc:276] 0709 12:24:59.005199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.006663 (+  1464us) service_pool.cc:224] Handling call
0709 12:24:59.015844 (+  9181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.162523 (+1146679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.609000 (+446477us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:00.609204 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634444544}
I20260709 12:25:00.642918 23678 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:00.643482 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 438543us
I20260709 12:25:00.644168 23678 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:00.644377 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:00.646605 23238 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:00.648252 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:00.656225 23581 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:00.658595 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.659492 19489 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:00.662078 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:00.662683 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:00.663393 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:00.665271 23578 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:00.665807 23578 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:00.666761 23578 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.670322 23576 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:00.671200 23576 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:00.672180 23402 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:00.672552 23402 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:00.673432 23402 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.674564 23402 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:00.675511 23640 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:00.676080 23640 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.677137 23594 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.677657 23594 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.678807 23620 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.679334 23620 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.681830 23620 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:00.678267 23640 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:00.689508 19487 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:00.690793 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.690975 23594 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:00.691851 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.692505 19492 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:00.693737 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.694300 19492 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:00.694753 23264 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.696830 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:00.697506 19492 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:00.699898 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.700555 23628 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:00.700824 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:00.701095 23628 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.701673 23196 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:00.703394 23628 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:00.705420 18886 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:00.705605 19492 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:00.706732 23566 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:00.707844 23196 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:00.708392 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:00.708694 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:00.706252 23264 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:00.713146 18773 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:00.599952 23693 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:00.607420 23635 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:00.724210 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:00.727928 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.736642 18846 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:25:00.577258 23697 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.730285 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.583387 23597 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.731980 18839 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:00.708904 23594 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:25:00.735390 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.748384 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.757004 18845 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:00.725755 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 250769us
I20260709 12:25:00.738696 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:00.758579 18844 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:00.761139 19457 leader_election.cc:400] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11.
I20260709 12:25:00.762480 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:00.742014 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.746114 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.750097 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.767642 19492 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:00.725793 23678 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.731155 23620 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:00.782596 23620 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.782927 23597 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:00.755836 23642 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:00.777347 18913 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:00.778020 23697 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:00.778236 23476 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:00.778703 23678 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.779556 18844 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:00.783059 23620 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:00.775696 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:00.818440 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45852.9us
I20260709 12:25:00.731165 23583 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:00.759011 23566 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:00.819532 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:00.828382 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 52809.1us
I20260709 12:25:00.831756 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:00.842481 23369 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:00.842949 23369 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.843426 23369 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.845753 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:00.847697 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:00.831817 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:00.833398 23460 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:00.822505 23642 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:00.839327 23701 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 12:25:00.841338 23703 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:25:00.794657 23576 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 12:25:00.834282 23705 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:25:00.820763 18666 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.153s	user 0.022s	sys 0.026s
I20260709 12:25:00.791841 23261 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:00.854051 19488 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:00.876179 18922 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:00.855862 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:00.856343 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.856598 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:00.858456 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.877856 18919 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:00.859385 23714 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:00.860526 23469 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:00.861351 23340 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:00.792761 23476 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:00.852432 23697 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:00.874894 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:00.867851 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.871361 23683 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 12:25:00.893649 18846 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:00.884400 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:00.880646 18666 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.217s	user 0.023s	sys 0.027s
I20260709 12:25:00.871977 23640 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:00.901301 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.892642 23697 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.896322 23706 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:00.898490 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:00.910880 18846 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:00.875219 23261 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:00.882514 23714 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.916036 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:00.919193 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:00.920343 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:00.871591 23639 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:00.890637 23566 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:00.933314 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:00.921602 18770 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:00.888917 23580 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:25:00.885807 23296 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:25:00.934473 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:00.934827 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:00.952009 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2348) took 1046 ms. Trace:
I20260709 12:25:00.932900 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:00.933692 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:00.943461 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:00.977849 18917 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:00.924400 18773 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:00.948263 19487 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:25:00.917758 23261 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.918195 23264 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.950662 23369 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.994850 23264 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.997277 23369 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:00.946069 23476 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.918038 23714 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:00.978269 23710 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:00.954214 23669 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.128s	user 0.004s	sys 0.011s
I20260709 12:25:00.914345 23706 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.910023 23588 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.979081 19487 pending_rounds.cc:85] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 9
I20260709 12:25:01.019033 19487 pending_rounds.cc:107] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:25:00.934048 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:00.980197 18922 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:25:00.909787 23697 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:00.918187 23583 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:00.947333 23590 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.975687 18843 rpcz_store.cc:276] 0709 12:24:59.905661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.905810 (+   149us) service_pool.cc:224] Handling call
0709 12:24:59.906179 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:59.906622 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.906652 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:59.907278 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 12:25:00.250633 (+343355us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:00.366123 (+115490us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.648827 (+282704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.648905 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.951652 (+302747us) raft_consensus.cc:1685] finished
0709 12:25:00.951695 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.951926 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282398,"prepare.queue_time_us":115249,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":285291,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":178,"thread_start_us":342914,"threads_started":1,"wal-append.queue_time_us":569044}
I20260709 12:25:00.977569 23635 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:00.989116 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 800) took 1070 ms. Trace:
I20260709 12:25:01.019425 19487 raft_consensus.cc:2889] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:00.922062 23640 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:00.952958 23692 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:01.038023 18840 rpcz_store.cc:276] 0709 12:24:59.918344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.149870 (+231526us) service_pool.cc:224] Handling call
0709 12:25:00.150369 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.177108 (+ 26739us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:00.201763 (+ 24655us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.642593 (+440830us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b18004121e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f335ee5f58f 00007f3357e9e571 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd
0709 12:25:00.653606 (+ 11013us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.654096 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.654254 (+   158us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:00.654292 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.654380 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.988790 (+334410us) raft_consensus.cc:1685] finished
0709 12:25:00.988899 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.989046 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190954,"prepare.queue_time_us":26140,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":187221,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":10950,"spinlock_wait_cycles":11745280,"thread_start_us":268950,"threads_started":1,"wal-append.queue_time_us":373415}
I20260709 12:25:01.031685 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2432) took 1176 ms. Trace:
W20260709 12:25:00.994011 23599 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.004s
I20260709 12:25:00.955209 23639 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.032214 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:01.034265 18773 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:00.969646 23112 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:01.059832 19487 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:01.036791 18738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.039s	sys 0.057s
I20260709 12:25:01.041064 18769 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:01.062791 18738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.039s	sys 0.057s
W20260709 12:25:01.019375 23595 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.997s	user 0.015s	sys 0.000s
I20260709 12:25:00.976660 23708 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:00.998008 23264 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:01.063405 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 600364us
I20260709 12:25:01.095211 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:01.049583 18916 rpcz_store.cc:276] 0709 12:24:59.855080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.876208 (+ 21128us) service_pool.cc:224] Handling call
0709 12:24:59.876509 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.876753 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.876792 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.545108 (+668316us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b2c001538c8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:25:00.545568 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.875126 (+329558us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:00.875160 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.875226 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.020165 (+144939us) raft_consensus.cc:1685] finished
0709 12:25:01.020195 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.031613 (+ 11418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28726144,"thread_start_us":329145,"threads_started":1,"wal-append.queue_time_us":365235}
I20260709 12:25:01.018584 23618 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:01.019685 23706 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:01.084255 19484 raft_consensus.cc:606] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:01.097537 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:01.099318 19484 raft_consensus.cc:614] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:01.062144 23692 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:01.103161 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:01.104326 18922 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:01.092857 18764 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:01.108130 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2347) took 1211 ms. Trace:
I20260709 12:25:01.108520 18848 rpcz_store.cc:276] 0709 12:24:59.897012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.904710 (+  7698us) service_pool.cc:224] Handling call
0709 12:24:59.904998 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.905216 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:00.690077 (+784861us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b18003bfc80. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf
0709 12:25:00.690226 (+   149us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.107793 (+417567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.107841 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:01.107890 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.107958 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.108073 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68292,"prepare.queue_time_us":95652,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"spinlock_wait_cycles":126821632,"thread_start_us":471338,"threads_started":2}
I20260709 12:25:01.107246 23618 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:01.114198 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:01.115497 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 793) took 2097 ms. Trace:
I20260709 12:25:01.119657 18842 rpcz_store.cc:276] 0709 12:24:59.018329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.018466 (+   137us) service_pool.cc:224] Handling call
0709 12:24:59.018782 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.019134 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.019165 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.022970 (+  3805us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.501160 (+478190us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b18000e86c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:24:59.620209 (+119049us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:59.620271 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.620346 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.953902 (+1333556us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b2400112ec8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357d249c4 00007f3357d22acb 00007f3357edddc9 00007f3357edda55 00007f3357edd09d 00007f335ab0f10e 00007f335ab2688c 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221
0709 12:25:01.115282 (+161380us) raft_consensus.cc:1685] finished
0709 12:25:01.115304 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.115435 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":520,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":187953792,"thread_start_us":118814,"threads_started":1,"wal-append.queue_time_us":688359}
I20260709 12:25:00.934623 23642 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.093333 23708 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:01.126747 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 230342us
I20260709 12:25:01.033193 23588 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.098199 23712 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:25:01.131557 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 212435us
I20260709 12:25:01.060532 23347 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:25:01.048676 23590 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.134066 18922 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:01.133498 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:01.115026 23112 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:01.122041 23690 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:01.143136 23618 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.144838 23618 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:01.082333 23639 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.128670 23662 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:25:01.123533 23102 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.151602 18919 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:01.151360 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:01.158586 23196 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:01.129498 23678 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.129068 23708 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:01.152128 23616 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.985s	user 0.014s	sys 0.000s
I20260709 12:25:01.161402 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:01.130743 23549 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:25:01.158588 23264 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:25:01.113153 23566 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.173704 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:01.152776 23112 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:01.213138 19487 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:01.233817 18913 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:25:01.243983 18913 pending_rounds.cc:85] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
I20260709 12:25:01.174347 18922 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.244365 18913 pending_rounds.cc:107] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:01.216848 18915 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:01.244968 18913 raft_consensus.cc:2889] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:01.229111 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:01.238152 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:01.250073 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:01.223690 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:01.254006 18919 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
W20260709 12:25:01.226789 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.260210 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 131600us
I20260709 12:25:01.263437 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.263809 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:01.264165 18839 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:01.264494 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.265157 18842 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:01.266637 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.269009 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:01.269644 18842 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:01.191067 23717 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:01.271683 18773 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:01.292148 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:01.272382 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:01.290162 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.231565 23590 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.244287 23714 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.275729 19492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:25:01.299544 18765 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:01.204878 23340 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.207481 22930 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:01.299842 18764 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:01.321372 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:01.321811 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47636.6us
I20260709 12:25:01.302508 19492 raft_consensus.cc:606] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:01.322646 19492 raft_consensus.cc:614] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:01.247248 23112 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.313308 18842 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:01.207398 23588 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.315544 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:01.319439 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 158313us
I20260709 12:25:01.249025 23662 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:01.230432 23363 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:01.322216 18840 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:01.173696 23710 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.130s
I20260709 12:25:01.244215 23196 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:01.172058 23102 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.272681 23636 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:01.219841 23261 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.288026 23726 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:01.273473 23576 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.356871 18917 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:01.303750 23238 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.175495 23640 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:01.341696 23693 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.000s
I20260709 12:25:01.334427 23628 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.337188 23296 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:25:01.256311 23696 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:25:01.253614 23616 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.373659 23595 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:01.339097 23112 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:01.303249 23678 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:25:01.272204 23596 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:25:01.364487 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:01.410876 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46536.8us
I20260709 12:25:01.411749 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:01.369903 23620 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 12:25:01.314260 23677 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:25:01.390018 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 135825us
I20260709 12:25:01.335239 23340 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.433943 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:01.439957 23741 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:01.440872 23741 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:01.441576 23340 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.320945 22930 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:01.443145 22930 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.444660 22930 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:01.399261 19486 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:01.448457 23741 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:01.449182 23741 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.449662 23741 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.353549 23363 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.375394 23726 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:01.381222 23635 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:01.429145 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 123635us
I20260709 12:25:01.364684 23590 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:01.466104 19489 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:01.394755 23710 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.460875 18921 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:01.385134 23636 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.410115 23089 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.431845 23596 consensus_queue.cc:1243] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:25:01.392611 23576 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.428779 23678 consensus_queue.cc:1243] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:01.393513 23238 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.395630 23347 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.505910 23347 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.508545 23347 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:01.465590 23719 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:25:01.453833 23707 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:01.453641 23264 consensus_queue.cc:1243] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:01.469062 23726 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:01.511288 23616 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:01.480075 23710 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.515758 23261 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.517346 23710 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.518987 23596 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.519583 23596 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.480525 23340 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:25:01.488521 23089 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.484609 23636 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.525134 23636 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.526041 23596 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:01.465181 23402 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.396227 23693 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.399699 23628 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.453393 23620 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:01.544499 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110722us
I20260709 12:25:01.536496 18844 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:01.546241 18848 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:01.548273 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:01.532012 23714 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.530066 23438 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:01.525379 23089 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.555743 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:01.560789 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:01.564020 18922 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:01.565429 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:01.547876 23713 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:01.557274 23635 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:01.557281 23677 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.566572 23735 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:01.543789 23581 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:01.567111 23102 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:01.567157 23714 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:01.545159 23402 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.467072 23196 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.568199 23696 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:01.569140 23731 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 12:25:01.570075 23732 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:25:01.570297 23476 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:01.574677 23621 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:01.575024 23689 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.575366 23724 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:01.544312 23733 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.575610 23693 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:01.576014 23712 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.576380 23620 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:01.577692 23628 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.684605 23102 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:01.651621 23724 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.685163 23102 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:01.627007 23706 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.001s
I20260709 12:25:01.686187 23706 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.687271 23102 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:01.541356 23680 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:25:01.598649 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 128640us
I20260709 12:25:01.688597 23706 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.555600 23710 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.689966 23710 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.692088 23710 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.581317 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:01.694657 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:01.695222 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.695403 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.695539 18845 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.695925 18843 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:01.575610 23238 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.708209 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:01.700784 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:01.591997 23595 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:01.600459 23735 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.614269 23581 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:01.575670 23438 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:01.620620 23697 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.583s	user 0.002s	sys 0.010s
I20260709 12:25:01.668390 23576 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.601771 23677 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.666939 23733 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.650521 23689 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.635910 23621 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:01.671552 23597 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.888s	user 0.011s	sys 0.002s
I20260709 12:25:01.671320 23745 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:01.682011 23615 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:01.683054 23692 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.684026 23635 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.684355 23708 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.695973 18839 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:01.604583 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:01.850947 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:01.697013 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.851907 18843 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:01.852432 18848 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:01.593956 23588 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.856534 23588 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.859174 23588 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.699842 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:01.710004 19487 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:01.822640 23640 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.698616 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:01.715245 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:01.717818 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:01.869899 18765 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:01.871117 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:01.709262 19485 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:01.720248 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:01.722692 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:01.736200 18915 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:01.875401 18915 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:01.742980 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:01.869733 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.881497 18922 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:01.748919 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:01.751724 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 991) took 1133 ms. Trace:
W20260709 12:25:01.751886 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.758579 23693 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.778625 23741 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.781208 23639 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.786715 18845 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:01.787809 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:01.790077 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:01.792680 18770 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:01.668408 23402 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:01.795452 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:01.807546 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:01.712983 23710 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.709112 23628 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.821381 23749 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:01.723412 23735 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.067627 18764 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:01.693329 23112 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.835312 18914 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:01.854481 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.854699 18841 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:01.851608 19489 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:01.855964 23734 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.253s	user 0.000s	sys 0.003s
I20260709 12:25:01.709942 18847 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:02.073203 18918 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:01.865406 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:02.080211 18842 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:02.081478 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:01.867211 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:01.708703 23712 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.883601 18921 rpcz_store.cc:276] 0709 12:25:00.618802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.625832 (+  7030us) service_pool.cc:224] Handling call
0709 12:25:00.626329 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.471031 (+844702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.751343 (+280312us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:01.751632 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918421248}
I20260709 12:25:02.079238 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:02.014849 23438 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:01.923344 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:01.841029 23549 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.834491 23615 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:01.799489 23697 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:01.925743 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 227191us
I20260709 12:25:01.969971 18839 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:01.975672 18768 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:01.978799 18772 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:01.861254 23635 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.878829 23595 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.924355 23640 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.839331 23745 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:01.825296 23102 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:25:02.209050 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.209851 18767 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:01.939628 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:02.016664 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2450) took 1082 ms. Trace:
I20260709 12:25:01.994091 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.036212 18916 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
W20260709 12:25:02.038328 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.048246 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 122946us
I20260709 12:25:02.033205 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.032682 18917 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:02.015983 23708 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:02.010054 22930 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.005s
I20260709 12:25:02.018159 23581 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:02.055083 23543 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:02.012120 23726 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.005s
W20260709 12:25:02.011495 23751 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:25:01.993110 23363 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:02.072551 18843 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:01.876204 18915 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:01.938128 23693 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:02.092844 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.069854 23692 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:02.068261 23669 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.188s	user 0.000s	sys 0.003s
I20260709 12:25:02.007066 23677 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:02.136493 18848 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:02.093874 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.095329 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.137157 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.053606 23724 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:02.087090 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:02.146441 19456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.513s (SENT) [suppressed 22 similar messages]
I20260709 12:25:02.147073 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:02.162926 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:02.066325 23636 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:25:02.068441 23588 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:02.171739 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:02.179850 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2444) took 1247 ms. Trace:
I20260709 12:25:02.187392 18913 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:02.188566 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.192749 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2448) took 1259 ms. Trace:
I20260709 12:25:02.071830 23749 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:02.202878 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:02.066104 23196 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:02.068755 23710 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:02.071614 23628 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:02.729281 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:02.777979 18916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2448) took 1223 ms (client timeout 1608 ms). Trace:
I20260709 12:25:02.778604 18764 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:02.778684 18916 rpcz_store.cc:269] 0709 12:25:01.581750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.795092 (+213342us) service_pool.cc:224] Handling call
0709 12:25:02.777904 (+982812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.777140 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:02.780109 19487 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:02.780351 18767 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:02.789366 18915 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.789875 18771 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:25:02.789395 18765 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:02.780925 18914 rpcz_store.cc:276] 0709 12:25:00.933579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.933826 (+   247us) service_pool.cc:224] Handling call
0709 12:25:02.177626 (+1243800us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54000f6c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:02.192613 (+ 14987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874574720}
I20260709 12:25:02.789791 18922 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:02.792106 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2444) took 1239 ms. Trace:
I20260709 12:25:02.268544 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2124) took 1244 ms. Trace:
I20260709 12:25:02.789966 18918 rpcz_store.cc:276] 0709 12:25:00.932337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.932617 (+   280us) service_pool.cc:224] Handling call
0709 12:25:02.179548 (+1246931us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003255d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:02.179751 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2520753920}
I20260709 12:25:02.780997 18769 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:02.210800 18920 rpcz_store.cc:276] 0709 12:25:00.934195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.934616 (+   421us) service_pool.cc:224] Handling call
0709 12:25:00.934952 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.974475 (+ 39523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.974524 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.986561 (+ 12037us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.239560 (+252999us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b18003f7720. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:25:01.677278 (+437718us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:01.677311 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.677383 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.016343 (+338960us) raft_consensus.cc:1685] finished
0709 12:25:02.016366 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.016594 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38968,"raft.queue_time_us":44403,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":15861,"spinlock_wait_cycles":64395648,"thread_start_us":392052,"threads_started":1,"wal-append.queue_time_us":836529}
I20260709 12:25:02.781091 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:02.799223 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.800036 18916 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:02.800558 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2445) took 1247 ms. Trace:
I20260709 12:25:02.800895 18916 rpcz_store.cc:276] 0709 12:25:01.553487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.798871 (+1245384us) service_pool.cc:224] Handling call
0709 12:25:02.800495 (+  1624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.806229 18773 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:02.807750 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2691) took 1012 ms. Trace:
I20260709 12:25:02.809232 18842 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
W20260709 12:25:02.785816 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 457998us
I20260709 12:25:02.814097 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:02.793468 18921 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.814970 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.816021 18768 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:02.816749 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2681) took 1024 ms. Trace:
I20260709 12:25:02.817203 18768 rpcz_store.cc:276] 0709 12:25:01.792295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.814592 (+1022297us) service_pool.cc:224] Handling call
0709 12:25:02.816657 (+  2065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.819478 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:02.819567 18767 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:02.884179 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2687) took 1090 ms. Trace:
I20260709 12:25:02.884685 18767 rpcz_store.cc:276] 0709 12:25:01.793827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.210548 (+416721us) service_pool.cc:224] Handling call
0709 12:25:02.884084 (+673536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.436272 23438 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.437s
I20260709 12:25:02.821844 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2684) took 1028 ms. Trace:
I20260709 12:25:02.792559 18922 rpcz_store.cc:276] 0709 12:25:01.553150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.983433 (+430283us) service_pool.cc:224] Handling call
0709 12:25:02.792042 (+808609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.793308 18770 rpcz_store.cc:276] 0709 12:25:01.024204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.024533 (+   329us) service_pool.cc:224] Handling call
0709 12:25:01.046984 (+ 22451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.036230 (+989246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.146247 (+110017us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b540038b6a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8ea02 00007f335af8add6 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:25:02.267528 (+121281us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540017a7d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:02.268480 (+   952us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737031808}
I20260709 12:25:02.840523 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:02.840834 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.841538 18919 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:25:02.841971 18845 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:02.891295 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.889333 18769 rpcz_store.cc:276] 0709 12:25:01.793058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.092456 (+299398us) service_pool.cc:224] Handling call
0709 12:25:02.821755 (+729299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.839381 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.808327 18773 rpcz_store.cc:276] 0709 12:25:01.795713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.091216 (+295503us) service_pool.cc:224] Handling call
0709 12:25:02.807564 (+716348us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:02.753549 23752 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.655s	user 0.001s	sys 0.001s
I20260709 12:25:02.161623 23680 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.849148 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:02.852586 18766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.000s	sys 0.023s
I20260709 12:25:02.863288 23363 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:02.866943 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.435879 23576 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:02.840281 23757 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.690s	user 0.000s	sys 0.002s
I20260709 12:25:02.869153 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.923295 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.923946 18920 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:02.924264 18770 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:02.323693 23615 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:02.728714 23745 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:02.670276 23697 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:02.211452 23733 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:02.181753 23476 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:02.710736 23642 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.723894 23112 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:02.592725 23756 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.793798 23543 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.196099 23639 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:02.565099 23729 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.528843 23597 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:02.389813 23640 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:02.877753 18915 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:25:02.158442 23549 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:02.851174 23677 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:02.879822 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:02.869210 23760 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:25:02.848408 22930 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:02.881421 18847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.019s	sys 0.021s
I20260709 12:25:02.948099 23697 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:02.777415 18772 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.625s	user 0.012s	sys 0.006s
I20260709 12:25:02.892488 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2686) took 1098 ms. Trace:
I20260709 12:25:02.978811 18772 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:02.916472 23680 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:02.894618 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.890846 18914 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:02.984014 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2469) took 1304 ms. Trace:
I20260709 12:25:02.984498 18914 rpcz_store.cc:276] 0709 12:25:01.679413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.840559 (+1161146us) service_pool.cc:224] Handling call
0709 12:25:02.983934 (+143375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.985765 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.898947 18771 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:02.987365 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2140) took 1188 ms. Trace:
W20260709 12:25:02.904897 18846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.012s	sys 0.012s
W20260709 12:25:02.988480 18846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.013s	sys 0.013s
I20260709 12:25:02.905524 18768 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:02.989627 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2689) took 1195 ms. Trace:
I20260709 12:25:02.989821 18844 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:02.907450 18766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.001s	sys 0.023s
W20260709 12:25:02.850109 18840 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.013s	sys 0.006s
I20260709 12:25:02.908094 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:02.904012 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:02.990846 18840 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.014s	sys 0.006s
I20260709 12:25:02.910086 18916 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:02.891291 23734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.022s	sys 0.009s
I20260709 12:25:02.915818 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:02.850795 23726 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:02.924489 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2446) took 1370 ms. Trace:
I20260709 12:25:02.991673 18920 rpcz_store.cc:276] 0709 12:25:01.553772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.799724 (+1245952us) service_pool.cc:224] Handling call
0709 12:25:02.924416 (+124692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.870626 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.993422 18918 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:02.993511 18769 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:02.994104 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2472) took 1313 ms. Trace:
I20260709 12:25:02.994643 18918 rpcz_store.cc:276] 0709 12:25:01.680265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.841440 (+1161175us) service_pool.cc:224] Handling call
0709 12:25:02.994017 (+152577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.924676 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 844) took 1128 ms. Trace:
I20260709 12:25:02.839872 23196 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:02.848148 23588 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:02.926067 18765 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:25:02.996150 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2471) took 1316 ms. Trace:
I20260709 12:25:02.996543 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2680) took 1204 ms. Trace:
W20260709 12:25:02.931967 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.932446 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 151416us
I20260709 12:25:02.997193 18764 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:02.929085 23636 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.928146 23635 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:02.959112 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 796229us
I20260709 12:25:02.999884 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 852) took 1149 ms. Trace:
I20260709 12:25:02.971765 23677 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.000324 18773 rpcz_store.cc:276] 0709 12:25:01.850350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.898076 (+1047726us) service_pool.cc:224] Handling call
0709 12:25:02.999821 (+101745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.000765 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:02.963898 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 817444us
I20260709 12:25:03.001370 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.965202 18915 pending_rounds.cc:85] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
I20260709 12:25:02.932435 23708 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.002966 23774 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:03.003600 23774 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:02.945851 23615 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:02.926568 23576 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:02.975375 18847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.019s	sys 0.021s
I20260709 12:25:02.853562 23581 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:02.925179 23363 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.008088 23772 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:02.978955 18767 rpcz_store.cc:276] 0709 12:25:01.793554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.890889 (+1097335us) service_pool.cc:224] Handling call
0709 12:25:02.892402 (+  1513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.009814 23363 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:02.979465 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2675) took 1192 ms. Trace:
I20260709 12:25:03.010711 23773 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:03.010887 18772 rpcz_store.cc:276] 0709 12:25:01.787325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.787510 (+   185us) service_pool.cc:224] Handling call
0709 12:25:02.979400 (+1191890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.011346 23773 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:02.956837 23543 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.002351 18915 pending_rounds.cc:107] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:03.015257 18915 raft_consensus.cc:2889] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.016189 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2460) took 1804 ms. Trace:
I20260709 12:25:03.016502 18915 rpcz_store.cc:276] 0709 12:25:01.211552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.245727 (+ 34175us) service_pool.cc:224] Handling call
0709 12:25:01.246000 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.736024 (+490024us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400160920. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8d1c0 00007f335af8e231 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c
0709 12:25:03.015838 (+1279814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.016115 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609547520}
I20260709 12:25:03.017894 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.996543 18922 rpcz_store.cc:276] 0709 12:25:01.680005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.889092 (+1209087us) service_pool.cc:224] Handling call
0709 12:25:02.996073 (+106981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.021322 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:03.022060 18922 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:03.022497 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 1009) took 1322 ms. Trace:
I20260709 12:25:03.022778 18922 rpcz_store.cc:276] 0709 12:25:01.699876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.021041 (+1321165us) service_pool.cc:224] Handling call
0709 12:25:03.022441 (+  1400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.973994 23112 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.996893 18765 rpcz_store.cc:276] 0709 12:25:01.792042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.840190 (+1048148us) service_pool.cc:224] Handling call
0709 12:25:02.996476 (+156286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.023907 23112 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.024335 23112 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.025902 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.998968 18914 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:02.987757 18771 rpcz_store.cc:276] 0709 12:25:01.799107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.838933 (+1039826us) service_pool.cc:224] Handling call
0709 12:25:02.987297 (+148364us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:03.018632 23694 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:25:03.026814 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2456) took 1187 ms. Trace:
I20260709 12:25:03.027170 18914 rpcz_store.cc:276] 0709 12:25:01.839893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.985405 (+1145512us) service_pool.cc:224] Handling call
0709 12:25:03.026749 (+ 41344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.027642 18771 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 12:25:03.028095 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:03.028340 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 846) took 1226 ms. Trace:
I20260709 12:25:03.028748 18914 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:03.028676 18771 rpcz_store.cc:276] 0709 12:25:01.802872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.027059 (+1224187us) service_pool.cc:224] Handling call
0709 12:25:03.027401 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:03.028068 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.028285 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.029282 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2468) took 1350 ms. Trace:
I20260709 12:25:03.029597 18914 rpcz_store.cc:276] 0709 12:25:01.679106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.027862 (+1348756us) service_pool.cc:224] Handling call
0709 12:25:03.029214 (+  1352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.891326 18919 pending_rounds.cc:85] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 6
I20260709 12:25:03.030565 18919 pending_rounds.cc:107] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:03.030821 18919 raft_consensus.cc:2889] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.013805 23773 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:02.990026 18768 rpcz_store.cc:276] 0709 12:25:01.794628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.819064 (+1024436us) service_pool.cc:224] Handling call
0709 12:25:02.989559 (+170495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.034952 23773 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:03.035466 23773 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:03.036428 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 848) took 1232 ms. Trace:
I20260709 12:25:03.037010 18768 rpcz_store.cc:276] 0709 12:25:01.804748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.035274 (+1230526us) service_pool.cc:224] Handling call
0709 12:25:03.035699 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.035963 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.036001 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.036061 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:03.036107 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.036193 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.036351 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.030177 18771 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:25:03.039028 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 847) took 1235 ms. Trace:
I20260709 12:25:03.036484 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:03.020315 23774 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:02.996166 18770 rpcz_store.cc:276] 0709 12:25:01.796101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.896465 (+1100364us) service_pool.cc:224] Handling call
0709 12:25:02.924616 (+ 28151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.040248 18914 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.023609 23576 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:02.997889 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2679) took 1206 ms. Trace:
I20260709 12:25:03.019363 18767 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:03.041834 18764 rpcz_store.cc:276] 0709 12:25:01.791766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.977930 (+1186164us) service_pool.cc:224] Handling call
0709 12:25:02.996869 (+ 18939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.997623 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.997833 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.042236 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2683) took 1249 ms. Trace:
I20260709 12:25:03.042676 18767 rpcz_store.cc:276] 0709 12:25:01.792814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.018615 (+1225801us) service_pool.cc:224] Handling call
0709 12:25:03.019059 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.041959 (+ 22900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.042181 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.043533 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2141) took 1220 ms. Trace:
I20260709 12:25:03.043880 18764 rpcz_store.cc:276] 0709 12:25:01.822891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.042666 (+1219775us) service_pool.cc:224] Handling call
0709 12:25:03.043031 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.043227 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.043251 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.043300 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:03.043336 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.043388 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.043483 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.045423 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 849) took 1240 ms. Trace:
I20260709 12:25:03.036754 23773 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.046729 18764 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:03.047343 23773 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.056286 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:03.039760 18771 rpcz_store.cc:276] 0709 12:25:01.803828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.029652 (+1225824us) service_pool.cc:224] Handling call
0709 12:25:03.029974 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.038690 (+  8716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.038968 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.061957 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:03.063539 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2455) took 1226 ms. Trace:
I20260709 12:25:03.063916 18916 rpcz_store.cc:276] 0709 12:25:01.837024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.061650 (+1224626us) service_pool.cc:224] Handling call
0709 12:25:03.063462 (+  1812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.046079 18768 rpcz_store.cc:276] 0709 12:25:01.805571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.038313 (+1232742us) service_pool.cc:224] Handling call
0709 12:25:03.044675 (+  6362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.044927 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.044966 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.045026 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:03.045104 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.045204 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.045347 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.949596 23476 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:02.997078 23734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.022s	sys 0.010s
I20260709 12:25:02.954041 23642 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.074159 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.957500 23756 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.075847 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:02.969916 23639 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:02.981105 23778 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.082162 23628 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.085980 23581 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.087316 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1000) took 1769 ms. Trace:
I20260709 12:25:02.980674 22930 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.092868 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:03.103149 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2460) took 1028 ms. Trace:
I20260709 12:25:03.117111 18920 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:03.117060 18918 rpcz_store.cc:276] 0709 12:25:02.074827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.002334 (+927507us) service_pool.cc:224] Handling call
0709 12:25:03.103062 (+100728us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.118147 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2466) took 1543 ms. Trace:
I20260709 12:25:03.060566 23677 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:02.973767 23729 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.118572 18920 rpcz_store.cc:276] 0709 12:25:01.574441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.061376 (+1486935us) service_pool.cc:224] Handling call
0709 12:25:03.118080 (+ 56704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.111581 19491 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:25:03.111397 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 297379us
I20260709 12:25:03.112953 18922 rpcz_store.cc:276] 0709 12:25:01.318132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.076946 (+1758814us) service_pool.cc:224] Handling call
0709 12:25:03.086763 (+  9817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.086962 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.087013 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.087057 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:03.087091 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.087146 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.087255 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.970341 23597 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.110693 18915 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:02.985435 23697 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.077230 23710 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.122421 18770 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:03.124846 18765 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:03.131116 18922 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:25:03.129186 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 128484us
I20260709 12:25:03.126014 18914 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:03.121201 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:03.136461 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:03.137406 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:03.137514 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:03.138456 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 939) took 1585 ms. Trace:
I20260709 12:25:03.139638 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1003) took 1736 ms. Trace:
W20260709 12:25:03.143790 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 147150us
I20260709 12:25:03.161298 19492 rpcz_store.cc:276] 0709 12:25:01.543800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.543953 (+   153us) service_pool.cc:224] Handling call
0709 12:25:01.544353 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.555735 (+ 11382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.555768 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.592584 (+ 36816us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.823003 (+230419us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:01.823049 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.823247 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.129069 (+1305822us) raft_consensus.cc:1685] finished
0709 12:25:03.129102 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.129326 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24836,"raft.queue_time_us":13977,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":20179,"thread_start_us":200912,"threads_started":1,"wal-append.queue_time_us":1123310}
I20260709 12:25:03.128259 23621 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.163759 18768 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:25:03.140658 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 86590.1us
I20260709 12:25:03.066871 23708 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.142707 18920 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:03.170876 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1002) took 1852 ms. Trace:
I20260709 12:25:03.171295 18920 rpcz_store.cc:276] 0709 12:25:01.318776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.119311 (+1800535us) service_pool.cc:224] Handling call
0709 12:25:03.142447 (+ 23136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.170573 (+ 28126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.170811 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:03.146507 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 149098us
I20260709 12:25:03.150925 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:03.072211 23636 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.121553 23693 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.133424 23778 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:03.159874 19456 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:03.138475 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2457) took 1292 ms. Trace:
I20260709 12:25:03.161855 18922 rpcz_store.cc:276] 0709 12:25:01.398464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.127254 (+1728790us) service_pool.cc:224] Handling call
0709 12:25:03.130624 (+  3370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.134345 (+  3721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.134618 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.168144 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:03.169006 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:03.141836 23628 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.173437 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:03.148115 23363 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.177846 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 999) took 1860 ms. Trace:
I20260709 12:25:03.154263 23777 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:03.185987 18917 rpcz_store.cc:276] 0709 12:25:01.317818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.381914 (+ 64096us) service_pool.cc:224] Handling call
0709 12:25:01.382365 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.797539 (+1415174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.177544 (+380005us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54003539d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:03.177782 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249867136}
I20260709 12:25:03.179046 19492 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:03.121132 23581 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.148252 23710 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:03.174688 23689 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:03.169442 18886 connection.cc:256] RPC call timeout handler was delayed by -1.0856979810005214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 12:25:03.183024 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:03.165089 23640 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:03.184077 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:03.186764 18916 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:03.177150 18914 rpcz_store.cc:276] 0709 12:25:01.846296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.030188 (+1183892us) service_pool.cc:224] Handling call
0709 12:25:03.138339 (+108151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.188083 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:03.148485 23595 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.188834 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:03.190011 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1005) took 1707 ms. Trace:
I20260709 12:25:03.189976 19490 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:03.246526 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2143) took 1411 ms. Trace:
I20260709 12:25:03.297356 18920 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:03.298149 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1004) took 1816 ms. Trace:
I20260709 12:25:03.296883 18917 rpcz_store.cc:276] 0709 12:25:01.482255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.189177 (+1706922us) service_pool.cc:224] Handling call
0709 12:25:03.189473 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.189669 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.189698 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.189742 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:03.189775 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.189842 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.189951 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.299255 18920 rpcz_store.cc:276] 0709 12:25:01.481858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.190284 (+1708426us) service_pool.cc:224] Handling call
0709 12:25:03.297078 (+106794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.297899 (+   821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.298089 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.300523 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1008) took 1763 ms. Trace:
I20260709 12:25:03.301317 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2465) took 1727 ms. Trace:
I20260709 12:25:03.183007 23749 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:03.190634 18921 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
W20260709 12:25:03.285836 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.196012 23639 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.202603 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:03.286939 23710 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.193575 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:03.291399 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1007) took 1757 ms. Trace:
I20260709 12:25:03.318069 18768 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:03.289903 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 105909us
I20260709 12:25:03.318549 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:03.288786 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 102141us
I20260709 12:25:03.320226 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:03.320802 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.191383 18771 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:03.323135 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:03.293771 23789 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:25:03.294039 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:03.289870 19488 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:03.325500 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:03.326344 18768 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:03.318001 18914 rpcz_store.cc:276] 0709 12:25:01.534138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.290575 (+1756437us) service_pool.cc:224] Handling call
0709 12:25:03.290912 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.291090 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.291113 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.291156 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:03.291185 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.291236 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.291343 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.330332 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:03.314204 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:03.194643 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.301903 18920 rpcz_store.cc:276] 0709 12:25:01.574110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.300252 (+1726142us) service_pool.cc:224] Handling call
0709 12:25:03.300651 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.300881 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.300920 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.300978 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:03.301024 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.301096 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.301230 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.300909 18917 rpcz_store.cc:276] 0709 12:25:01.537688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.299713 (+1762025us) service_pool.cc:224] Handling call
0709 12:25:03.300031 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.300211 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.300235 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.300279 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:03.300308 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.300360 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.300467 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.336784 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2452) took 1753 ms. Trace:
I20260709 12:25:03.321111 18769 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:25:03.184697 23615 raft_consensus.cc:2764] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:03.297742 18767 rpcz_store.cc:276] 0709 12:25:01.835582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.043381 (+1207799us) service_pool.cc:224] Handling call
0709 12:25:03.043686 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:03.044078 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.044107 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:03.045010 (+   903us) log.cc:844] Serialized 52 byte log entry
0709 12:25:03.171803 (+126793us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:03.171852 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.171973 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.246168 (+ 74195us) raft_consensus.cc:1685] finished
0709 12:25:03.246200 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.246444 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":126353,"threads_started":1,"wal-append.queue_time_us":189956}
I20260709 12:25:03.337319 18917 rpcz_store.cc:276] 0709 12:25:01.582892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.335729 (+1752837us) service_pool.cc:224] Handling call
0709 12:25:03.336097 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.336341 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.336379 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.336435 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:03.336490 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.336565 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.336707 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:03.313441 18921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2450) took 1731 ms (client timeout 1784 ms). Trace:
W20260709 12:25:03.349107 18921 rpcz_store.cc:269] 0709 12:25:01.582368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.169032 (+586664us) service_pool.cc:224] Handling call
0709 12:25:03.313365 (+1144333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.350031 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2453) took 1757 ms. Trace:
I20260709 12:25:03.238288 23780 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:03.181325 23782 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.189584 23733 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:03.363215 18914 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:03.233496 23636 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.187215 23786 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.350666 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2454) took 1755 ms. Trace:
I20260709 12:25:03.350456 18917 rpcz_store.cc:276] 0709 12:25:01.592619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.349180 (+1756561us) service_pool.cc:224] Handling call
0709 12:25:03.349515 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.349696 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.349720 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.349759 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:03.349812 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.349863 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.349977 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.373397 18921 rpcz_store.cc:276] 0709 12:25:01.595516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.349832 (+1754316us) service_pool.cc:224] Handling call
0709 12:25:03.350127 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.350324 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.350348 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.350412 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:03.350450 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.350505 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.350611 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.374648 18917 pending_rounds.cc:85] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 4
I20260709 12:25:03.375025 18917 pending_rounds.cc:107] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 12:25:03.375324 18917 raft_consensus.cc:2889] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.375650 18917 pending_rounds.cc:107] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 12:25:03.375926 18917 raft_consensus.cc:2889] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.178802 23112 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.227537 23597 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.236049 23708 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.234341 23476 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.349493 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:03.296125 23640 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.197923 23788 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.234583 23777 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:03.229585 23729 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.236707 23697 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.235287 23549 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:03.231231 23726 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:03.295499 23595 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.196980 22930 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.238024 23642 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.239286 23196 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.183825 23776 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.422863 23712 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:03.424379 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2458) took 1568 ms. Trace:
I20260709 12:25:03.459317 23576 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:03.459939 23576 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:03.459625 18916 rpcz_store.cc:276] 0709 12:25:01.855798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.423123 (+1567325us) service_pool.cc:224] Handling call
0709 12:25:03.423645 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.423929 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.423967 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.424026 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:03.424070 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.424155 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.424300 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.464465 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2459) took 1393 ms. Trace:
I20260709 12:25:03.464903 18922 rpcz_store.cc:276] 0709 12:25:02.070809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.463540 (+1392731us) service_pool.cc:224] Handling call
0709 12:25:03.463892 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.464100 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.464128 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.464185 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:03.464227 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.464284 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.464398 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.426275 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2464) took 1273 ms. Trace:
I20260709 12:25:03.469534 18915 rpcz_store.cc:276] 0709 12:25:02.153077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.017541 (+864464us) service_pool.cc:224] Handling call
0709 12:25:03.426050 (+408509us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b5400181854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:03.426201 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206209280}
W20260709 12:25:03.427858 23735 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.341s	user 0.014s	sys 0.000s
I20260709 12:25:03.471518 23735 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.472718 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1010) took 1408 ms. Trace:
I20260709 12:25:03.473120 18916 rpcz_store.cc:276] 0709 12:25:02.064165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.461430 (+1397265us) service_pool.cc:224] Handling call
0709 12:25:03.461819 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.462059 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.462092 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.462145 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:03.462192 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.462255 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.462383 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.420533 23773 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.475075 23773 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.475440 23773 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:03.479691 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.480690 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:03.427991 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 851) took 1610 ms. Trace:
I20260709 12:25:03.342821 23581 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.316887 23635 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.353973 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:03.489214 18768 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:03.380355 18914 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:03.380470 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:03.374249 23749 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:03.454813 23776 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.433614 23595 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.348297 23693 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:03.445070 23764 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.535s	user 0.004s	sys 0.000s
I20260709 12:25:03.493113 23693 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.494091 23776 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:03.187611 23628 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:03.446486 23766 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.476s	user 0.000s	sys 0.004s
W20260709 12:25:03.447532 23769 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.377s	user 0.000s	sys 0.002s
I20260709 12:25:03.495945 23693 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.239913 23543 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.388136 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2470) took 1708 ms. Trace:
I20260709 12:25:03.435110 23710 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.354854 23689 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:03.497558 23635 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.197539 23438 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.167s
I20260709 12:25:03.497933 23689 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.360397 23780 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:03.405937 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2461) took 2194 ms. Trace:
W20260709 12:25:03.401374 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 79748.5us
W20260709 12:25:03.409561 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60135.4us
I20260709 12:25:03.410889 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2139) took 1616 ms. Trace:
I20260709 12:25:03.411455 18773 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:03.372943 23639 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:03.431680 23588 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.522449 23639 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.523160 23735 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.525075 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 811) took 1836 ms. Trace:
I20260709 12:25:03.491947 23692 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:25:03.448542 23783 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 12:25:03.528079 23756 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.410912 23788 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.528936 23788 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.430274 23726 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 12:25:03.529907 23726 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:03.530380 23726 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:03.531411 23726 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.376247 23782 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.397703 23792 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:25:03.503469 23581 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:03.408941 23640 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:03.398758 23708 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.384838 23786 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.376102 23733 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.394033 23615 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:25:03.451000 18844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2606) took 1600 ms (client timeout 1940 ms). Trace:
I20260709 12:25:03.491835 23749 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:03.439105 23768 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.479s	user 0.003s	sys 0.000s
I20260709 12:25:03.496328 23628 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:03.358193 23774 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.436790 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2464) took 2224 ms. Trace:
I20260709 12:25:03.496917 18921 rpcz_store.cc:276] 0709 12:25:01.679729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.375181 (+1695452us) service_pool.cc:224] Handling call
0709 12:25:03.387447 (+ 12266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.387691 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.387729 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.387789 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:03.387832 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.387902 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.388050 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.483315 18770 rpcz_store.cc:276] 0709 12:25:01.817641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.040746 (+1223105us) service_pool.cc:224] Handling call
0709 12:25:03.041070 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.134061 (+ 92991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.427716 (+293655us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b540025fb54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:03.427918 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186556288}
W20260709 12:25:03.433532 19491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 895) took 1686 ms (client timeout 2034 ms). Trace:
I20260709 12:25:03.484360 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:03.410307 23778 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:03.525200 23639 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:03.411185 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:03.520891 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.525779 18840 rpcz_store.cc:276] 0709 12:25:01.688497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.692596 (+  4099us) service_pool.cc:224] Handling call
0709 12:25:01.692989 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:01.693401 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.693431 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:01.717268 (+ 23837us) log.cc:844] Serialized 52 byte log entry
0709 12:25:02.070004 (+352736us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:02.991243 (+921239us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.991452 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.991519 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.444345 (+452826us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:03.499339 (+ 54994us) raft_consensus.cc:1685] finished
0709 12:25:03.524758 (+ 25419us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.524983 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145220,"prepare.queue_time_us":513985,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":100517,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":8606,"spinlock_wait_cycles":495812992,"thread_start_us":1121207,"threads_started":2,"wal-append.queue_time_us":1063728}
I20260709 12:25:03.535600 18772 rpcz_store.cc:276] 0709 12:25:01.794152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.011915 (+1217763us) service_pool.cc:224] Handling call
0709 12:25:03.012408 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.012881 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.012925 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.013660 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.174422 (+160762us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:03.174473 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.174553 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.410635 (+236082us) raft_consensus.cc:1685] finished
0709 12:25:03.410658 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.410823 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7634,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"thread_start_us":160264,"threads_started":1,"wal-append.queue_time_us":227010}
I20260709 12:25:03.540617 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:03.551920 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.544780 23581 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:03.966320 18888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.012s	sys 0.023s
I20260709 12:25:03.607836 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 891) took 1869 ms. Trace:
I20260709 12:25:03.559082 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 845) took 1762 ms. Trace:
I20260709 12:25:03.995115 18765 rpcz_store.cc:276] 0709 12:25:01.801573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.024132 (+1222559us) service_pool.cc:224] Handling call
0709 12:25:03.024468 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.133829 (+109361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.558778 (+424949us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540002d354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:03.559008 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230187904}
I20260709 12:25:03.822947 19490 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:25:03.703135 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1001) took 2384 ms. Trace:
W20260709 12:25:03.998731 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.823513 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:03.448206 23112 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:03.999584 18913 rpcz_store.cc:276] 0709 12:25:01.211814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.274997 (+ 63183us) service_pool.cc:224] Handling call
0709 12:25:02.177899 (+902902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.777732 (+599833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.405565 (+627833us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54000f6c50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:03.405801 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965601536}
I20260709 12:25:03.558199 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2137) took 1835 ms. Trace:
I20260709 12:25:03.997710 19490 pending_rounds.cc:85] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 10
I20260709 12:25:04.002465 19490 pending_rounds.cc:107] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:25:03.997295 18919 rpcz_store.cc:276] 0709 12:25:01.212590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.357623 (+145033us) service_pool.cc:224] Handling call
0709 12:25:01.358061 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.031236 (+1673175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.436496 (+405260us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540027c9d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:03.436712 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3410537728}
I20260709 12:25:03.674083 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2682) took 1881 ms. Trace:
I20260709 12:25:04.002950 19490 raft_consensus.cc:2889] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:04.003255 18773 rpcz_store.cc:276] 0709 12:25:01.792562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.001248 (+1208686us) service_pool.cc:224] Handling call
0709 12:25:03.411281 (+410033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.541229 (+129948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.673771 (+132542us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54000af0d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:03.673990 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776219392}
W20260709 12:25:03.930146 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.994524 18888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.014s	sys 0.023s
W20260709 12:25:03.820248 18798 heartbeater.cc:646] Failed to heartbeat to 127.17.40.62:43633 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.40.62:43633 timed out after 15.000s (SENT)
W20260709 12:25:04.001084 19491 rpcz_store.cc:269] 0709 12:25:01.747509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.748580 (+  1071us) service_pool.cc:224] Handling call
0709 12:25:03.433364 (+1684784us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54005c17d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:03.433467 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2766739712}
W20260709 12:25:04.018553 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 534245us
I20260709 12:25:04.019984 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:03.997854 18918 rpcz_store.cc:276] 0709 12:25:01.318468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.118451 (+1799983us) service_pool.cc:224] Handling call
0709 12:25:03.426357 (+307906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.428502 (+  2145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.428532 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:03.428575 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:03.428605 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.428663 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.702836 (+274173us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400181850. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:03.703033 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666682624}
W20260709 12:25:03.829035 23677 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.003s
I20260709 12:25:03.455973 23680 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:03.532864 23780 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:04.001444 18766 rpcz_store.cc:276] 0709 12:25:01.723207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.723502 (+   295us) service_pool.cc:224] Handling call
0709 12:25:01.723887 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:01.942197 (+218310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.030970 (+ 88773us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:02.085308 (+ 54338us) log.cc:844] Serialized 52 byte log entry
0709 12:25:02.990866 (+905558us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:02.990905 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.446916 (+456011us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:03.557636 (+110720us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54000ebad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:03.557722 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.557791 (+    69us) raft_consensus.cc:1685] finished
0709 12:25:03.557813 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.558101 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":24552,"spinlock_wait_cycles":547186816,"thread_start_us":806329,"threads_started":1,"wal-append.queue_time_us":806173}
W20260709 12:25:04.018064 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 606879us
I20260709 12:25:04.030093 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:03.998574 18844 rpcz_store.cc:269] 0709 12:25:01.850491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.850636 (+   145us) service_pool.cc:224] Handling call
0709 12:25:03.450765 (+1600129us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540041c3d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:03.450915 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617262976}
I20260709 12:25:03.994575 19484 rpcz_store.cc:276] 0709 12:25:01.738212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.738791 (+   579us) service_pool.cc:224] Handling call
0709 12:25:01.874094 (+135303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.874557 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.874589 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.091309 (+216720us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.408509 (+317200us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:02.408574 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.408730 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.445821 (+1037091us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:03.496740 (+ 50919us) raft_consensus.cc:1685] finished
0709 12:25:03.496765 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.607574 (+110809us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001f4850. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:03.607760 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17493,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":39925,"spinlock_wait_cycles":649769728,"thread_start_us":316710,"threads_started":1,"wal-append.queue_time_us":841955}
I20260709 12:25:03.556712 23678 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:04.031484 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 490987us
I20260709 12:25:04.017179 23749 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.969851 23795 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:03.959491 23596 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.997170 23543 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:03.808357 23792 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:04.050606 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:03.551978 23726 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.429817 23777 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.038409 23692 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:04.027743 23621 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:04.110639 23621 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:04.111220 23782 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.068611 23786 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.112259 23566 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:04.113080 23566 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:04.113229 23782 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:04.027560 23756 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:04.063167 23771 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.986s	user 0.003s	sys 0.000s
I20260709 12:25:03.762523 23773 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:04.100652 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50145.4us
I20260709 12:25:04.122099 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:04.123528 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:04.125772 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:04.105232 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.097663 23795 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:03.998040 23774 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:04.178740 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53021.2us
I20260709 12:25:04.033382 23677 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:03.766794 23754 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:04.023890 23708 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:04.030314 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.016s	sys 0.009s
W20260709 12:25:04.203318 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.016s	sys 0.009s
I20260709 12:25:04.203040 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2613) took 2350 ms. Trace:
I20260709 12:25:04.204263 18847 rpcz_store.cc:276] 0709 12:25:01.853075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.142455 (+289380us) service_pool.cc:224] Handling call
0709 12:25:02.142853 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.164985 (+ 22132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.165030 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.165784 (+   754us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.006774 (+840990us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:03.006822 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.006889 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.438478 (+431589us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:04.191277 (+752799us) raft_consensus.cc:1685] finished
0709 12:25:04.191317 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.202955 (+ 11638us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32247,"raft.queue_time_us":21959,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":32715,"spinlock_wait_cycles":364658432,"thread_start_us":840427,"threads_started":1,"wal-append.queue_time_us":793263}
W20260709 12:25:04.190653 18920 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.002s	sys 0.014s
I20260709 12:25:04.191579 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2612) took 2338 ms. Trace:
W20260709 12:25:04.209849 18920 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.002s	sys 0.015s
I20260709 12:25:04.111296 23621 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:04.191946 18738 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.007s	sys 0.010s
W20260709 12:25:04.200361 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.041s	sys 0.054s
W20260709 12:25:04.216279 18738 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.008s	sys 0.010s
W20260709 12:25:04.216326 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.042s	sys 0.054s
W20260709 12:25:04.216755 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 882453us
W20260709 12:25:04.216765 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 897139us
W20260709 12:25:04.217826 18922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.009s	sys 0.004s
W20260709 12:25:04.218226 18922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.009s	sys 0.004s
I20260709 12:25:04.217833 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:04.218863 19456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.000s	sys 0.019s
W20260709 12:25:04.219147 19456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.000s	sys 0.019s
W20260709 12:25:04.219381 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 1.03875e+06us
I20260709 12:25:04.115070 23756 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:04.208181 18846 rpcz_store.cc:276] 0709 12:25:01.852685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.144277 (+291592us) service_pool.cc:224] Handling call
0709 12:25:02.182917 (+ 38640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.183236 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.183275 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.216468 (+ 33193us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.988994 (+772526us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:02.989055 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.989156 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.808566 (+819410us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:04.120811 (+312245us) raft_consensus.cc:1685] finished
0709 12:25:04.120845 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.191482 (+ 70637us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28690688,"thread_start_us":643403,"threads_started":1,"wal-append.queue_time_us":709440}
W20260709 12:25:04.191828 23770 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.230s	user 0.003s	sys 0.018s
I20260709 12:25:04.227177 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:04.227743 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:04.230682 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:04.182657 23774 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.188097 23741 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:04.202793 23640 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.001s
I20260709 12:25:04.106654 23596 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.191205 23747 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:04.091393 23678 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.242012 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:04.244033 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:04.245728 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:04.285794 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:04.191339 23689 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.250955 19484 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:04.263844 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:04.047864 23576 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.127823 23792 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.267028 23640 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.281322 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:04.266870 18915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.003s	sys 0.016s
I20260709 12:25:04.238334 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:04.234762 23756 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.192101 23628 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:04.247387 23770 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.003s	sys 0.018s
I20260709 12:25:04.258451 23639 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:04.287052 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:04.289142 19490 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:04.328771 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.011s	sys 0.010s
I20260709 12:25:04.235262 23786 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:04.285799 18846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:25:04.293782 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:04.114338 23566 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:04.314725 18915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.005s	sys 0.016s
W20260709 12:25:04.318776 18917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.058s	sys 0.117s
I20260709 12:25:04.305320 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:04.255205 23741 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.344833 23741 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.341847 23786 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.346843 23639 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.329941 18921 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:04.349309 23639 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.329497 18846 raft_consensus.cc:606] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:04.355785 18846 raft_consensus.cc:614] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:04.341651 18917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.058s	sys 0.117s
I20260709 12:25:04.342131 18918 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.347186 23786 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:04.330716 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.329167 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.011s	sys 0.010s
I20260709 12:25:04.350288 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:04.354662 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 116410us
W20260709 12:25:04.359309 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 1.18584e+06us
I20260709 12:25:04.359579 18914 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:25:04.293829 23576 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:04.262044 23680 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:25:04.292415 23689 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:04.308300 23628 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.300133 23795 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.296614 23792 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.396433 23792 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:04.397207 23792 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:04.303653 23640 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.312297 23615 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:04.394985 23581 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:04.368805 23799 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:04.373365 23588 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:04.379756 23680 consensus_queue.cc:1243] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:04.375144 23639 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.375527 23543 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:04.366765 23756 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.212030 23778 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.381661 23628 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:04.402233 23689 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:04.413228 23793 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.412990 23795 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:04.476341 23788 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.947s	user 0.014s	sys 0.000s
I20260709 12:25:04.438796 23799 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:04.502223 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.484527 23795 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:04.467465 23733 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.508462 23733 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.508973 23733 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.298714 23797 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.189s
I20260709 12:25:04.329489 23798 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.179s
I20260709 12:25:04.285916 23796 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.230s
I20260709 12:25:04.260633 23779 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.243s
I20260709 12:25:04.529856 23596 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.530242 23708 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.531967 23708 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.476006 23639 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.534646 23756 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.535496 23639 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.536369 23588 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:04.536139 23628 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.536847 23588 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:04.539507 23733 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.540380 23689 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.542557 23677 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.495249 23635 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.475142 23543 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:04.544970 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.433511 23615 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.545409 18919 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:25:04.550112 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.563077 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.564065 18773 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:25:04.574780 18766 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:04.532536 23708 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.223403 23754 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.488371 23793 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.581544 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:04.594076 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.595312 18766 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:04.595968 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.596794 18772 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:04.598354 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:04.598950 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.599565 18772 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:04.599640 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:04.505743 23788 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.601126 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.547724 23635 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:04.624038 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.626101 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.627339 18766 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:04.630430 18765 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:04.634583 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.635792 18765 raft_consensus.cc:2410] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:04.620800 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2462) took 2490 ms. Trace:
I20260709 12:25:04.637707 18922 rpcz_store.cc:276] 0709 12:25:02.130433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.465887 (+1335454us) service_pool.cc:224] Handling call
0709 12:25:03.466210 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.474166 (+  7956us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:04.218619 (+744453us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.620416 (+401797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.620473 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:04.620526 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.620597 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.620731 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":995334,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":1145460,"threads_started":2}
I20260709 12:25:04.638810 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.639848 18773 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:04.640601 18772 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:04.648274 19458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.022s	sys 0.043s
W20260709 12:25:04.648801 19458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.022s	sys 0.043s
W20260709 12:25:04.649498 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 653476us
I20260709 12:25:04.580502 23628 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:04.598218 23797 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:04.604872 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.550261 23780 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.657622 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:04.648825 23635 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.601593 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:04.530452 23795 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.620823 23799 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.691684 23799 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.695541 23774 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.698077 23774 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:04.672876 18773 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:25:04.650020 23112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.009s	sys 0.041s
I20260709 12:25:04.600292 23786 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.704679 18918 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:04.652858 23678 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.699560 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:04.676340 23628 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:04.699977 23798 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:04.706274 23112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.009s	sys 0.042s
W20260709 12:25:04.724867 18737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.009s	sys 0.025s
W20260709 12:25:04.740640 18737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.010s	sys 0.025s
W20260709 12:25:04.741071 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 701916us
W20260709 12:25:04.745978 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46502.1us
W20260709 12:25:04.675149 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73646.2us
I20260709 12:25:04.709787 23797 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:25:04.735983 23796 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:04.755256 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.012s	sys 0.024s
I20260709 12:25:04.734799 23733 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:04.765874 18888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.008s	sys 0.019s
W20260709 12:25:04.761262 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.012s	sys 0.024s
I20260709 12:25:04.748052 23726 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:04.766364 18888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.008s	sys 0.019s
W20260709 12:25:04.782250 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.769411 18920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.010s
W20260709 12:25:04.798928 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.055s	sys 0.138s
W20260709 12:25:04.801402 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.055s	sys 0.138s
W20260709 12:25:04.801265 18920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.011s	sys 0.011s
W20260709 12:25:04.769877 19457 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.038s	sys 0.100s
W20260709 12:25:04.805229 19457 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.039s	sys 0.100s
W20260709 12:25:04.771395 18887 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.011s
I20260709 12:25:04.806545 18847 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:04.806756 18887 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.009s	sys 0.011s
W20260709 12:25:04.770689 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 740641us
W20260709 12:25:04.807497 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 983888us
W20260709 12:25:04.808100 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 554955us
I20260709 12:25:04.810570 23628 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:04.810791 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:04.811429 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:04.811204 23628 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.813730 23628 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.814889 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:04.816262 18847 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:04.818487 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:04.819332 18922 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:04.819165 18847 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.783701 23726 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:04.824534 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:04.824122 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:04.826646 18846 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:04.826851 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:04.824676 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:04.828145 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:04.825836 18842 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:04.822080 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:04.768298 23733 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:04.828253 18845 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:04.829408 18843 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:04.793519 23543 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:04.830046 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 468391us
I20260709 12:25:04.795606 23796 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:04.841775 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:05.323360 18813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.009s	sys 0.002s
W20260709 12:25:05.450778 18813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.010s	sys 0.002s
I20260709 12:25:05.451895 23615 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.452838 23615 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.453493 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 629121us
I20260709 12:25:04.835259 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:05.339874 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.343302 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.837615 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 71850.2us
I20260709 12:25:05.468564 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.468900 23566 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:05.343693 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.346312 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:05.346755 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.347561 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.348358 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:05.367601 18847 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.025s
W20260709 12:25:04.981990 18913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.008s	sys 0.007s
W20260709 12:25:05.370852 18918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.003s	sys 0.002s
I20260709 12:25:04.831602 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2451) took 3249 ms. Trace:
W20260709 12:25:04.981232 18921 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.004s	sys 0.012s
W20260709 12:25:05.527266 18921 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.005s	sys 0.012s
W20260709 12:25:05.383399 19456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.019s	sys 0.021s
W20260709 12:25:05.527957 19456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.019s	sys 0.021s
W20260709 12:25:05.528380 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 1.16868e+06us
W20260709 12:25:04.841054 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.387634 19489 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:05.389192 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:05.535881 19491 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.390038 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.538751 23780 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.390774 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:04.862501 23543 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.540176 23795 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:04.951783 23640 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.035s	sys 0.056s
I20260709 12:25:05.540302 23543 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:05.541545 23640 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.040s	sys 0.087s
I20260709 12:25:04.806090 23678 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.551661 23822 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:05.552917 23543 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.817986 23708 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.978644 23726 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:04.817308 23747 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:04.802110 23754 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:04.912420 23773 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:04.829170 23786 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:04.831338 23788 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:04.828732 23793 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.560153 23747 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:04.947988 23808 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 12:25:05.562036 23826 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:25:05.475574 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.472771 18848 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.000s	sys 0.017s
W20260709 12:25:05.563865 18848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.000s	sys 0.017s
I20260709 12:25:05.471202 18839 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:05.470343 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.453751 23615 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:05.506675 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:05.508783 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 618312us
W20260709 12:25:05.509413 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 623963us
W20260709 12:25:05.510079 23741 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.164s	user 0.020s	sys 0.016s
I20260709 12:25:05.510196 23800 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.510088 18765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.001s	sys 0.013s
I20260709 12:25:05.512894 23733 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:05.470983 23774 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:05.519771 18913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.009s	sys 0.008s
W20260709 12:25:05.520201 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.522545 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.472548 23778 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.527145 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 59841.3us
W20260709 12:25:05.384958 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.390682 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.509338 18843 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
W20260709 12:25:05.529067 18918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.004s	sys 0.003s
I20260709 12:25:04.939451 23635 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.506966 18847 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:05.552758 23678 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.554286 23792 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.552814 23822 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.580540 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.585839 23838 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:05.595484 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104720us
W20260709 12:25:05.597244 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.614008 18765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.001s	sys 0.013s
W20260709 12:25:05.610852 18812 connection.cc:256] RPC call timeout handler was delayed by -1.6785419869997895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:25:05.605634 23806 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.906s	user 0.010s	sys 0.023s
I20260709 12:25:05.635357 18845 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:05.474632 23796 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.645356 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:05.655160 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2467) took 3941 ms. Trace:
I20260709 12:25:05.657152 19483 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
W20260709 12:25:05.657828 18812 connection.cc:256] RPC call timeout handler was delayed by -1.6785419869997895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:25:05.658466 18812 connection.cc:256] RPC call timeout handler was delayed by -1.4166419869998208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:25:05.658854 18812 connection.cc:256] RPC call timeout handler was delayed by -1.1907419869999103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260709 12:25:05.659248 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:05.660287 18919 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
W20260709 12:25:05.660837 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.659250 18812 connection.cc:256] RPC call timeout handler was delayed by -1.1709419869998783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 12:25:05.655702 18917 rpcz_store.cc:276] 0709 12:25:01.678702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.373706 (+1695004us) service_pool.cc:224] Handling call
0709 12:25:03.374257 (+   551us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:25:03.498889 (+124632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.498922 (+    33us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:25:03.503713 (+  4791us) log.cc:844] Serialized 104 byte log entry
0709 12:25:04.357181 (+853468us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:04.357236 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.357343 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.617200 (+1259857us) raft_consensus.cc:1685] finished
0709 12:25:05.618045 (+   845us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.619936 (+  1891us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22465,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5231,"thread_start_us":973825,"threads_started":2,"wal-append.queue_time_us":1174124}
I20260709 12:25:05.661558 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:05.667972 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:05.667279 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:05.697621 18844 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:05.696408 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2479) took 1440 ms. Trace:
I20260709 12:25:05.701395 18843 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.654827 23754 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:05.702764 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 71677us
I20260709 12:25:05.710172 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.711684 18919 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:05.674047 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:05.739123 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:05.743173 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.744465 18848 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:05.745584 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:05.748296 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.749629 18844 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:25:05.749858 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 99425.3us
W20260709 12:25:05.751197 23834 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.164s	user 0.002s	sys 0.002s
I20260709 12:25:05.751879 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.754127 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.755577 23756 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.756053 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.757193 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.757512 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.758097 19483 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:05.755342 23802 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:25:05.758709 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 96982.6us
I20260709 12:25:05.758934 19485 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:25:05.759032 23802 consensus_queue.cc:1243] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:05.759784 23773 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.760739 23773 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:05.761730 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.762539 23788 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.762658 18844 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
W20260709 12:25:05.764094 23816 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:25:05.765893 23678 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.751037 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:05.759950 23802 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:05.756487 23756 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.766532 23782 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:05.790457 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 83722.7us
I20260709 12:25:05.770169 18848 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:05.778681 18839 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:25:05.754941 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.789095 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:05.800191 19491 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:05.803339 18844 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.590441 18920 rpcz_store.cc:276] 0709 12:25:01.582645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.334413 (+1751768us) service_pool.cc:224] Handling call
0709 12:25:03.334840 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.335108 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:04.210528 (+875420us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.831238 (+620710us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.831305 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:04.831357 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.831421 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.831537 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586724,"prepare.queue_time_us":1134005,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":28731,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":65721,"thread_start_us":1438981,"threads_started":2}
I20260709 12:25:05.806995 18842 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:05.807329 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 94098.7us
I20260709 12:25:05.803555 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.700054 18921 rpcz_store.cc:276] 0709 12:25:04.243946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.348676 (+104730us) service_pool.cc:224] Handling call
0709 12:25:04.349043 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.349288 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:05.528342 (+1179054us) log.cc:844] Serialized 14 byte log entry
0709 12:25:05.606629 (+ 78287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:05.615915 (+  9286us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:05.618772 (+  2857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.639961 (+ 21189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.684584 (+ 44623us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7058,"prepare.queue_time_us":120450,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":22030,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":281,"thread_start_us":1223664,"threads_started":2}
I20260709 12:25:05.816560 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.818003 19483 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:05.818709 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.815441 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:05.787460 23802 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:05.825701 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 85106us
I20260709 12:25:05.706152 23778 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.729965 23800 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:05.763386 23788 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:05.825764 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74905.4us
I20260709 12:25:05.842272 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:05.843878 23832 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.188s	user 0.000s	sys 0.002s
I20260709 12:25:05.735862 23774 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.844069 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.888362 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:05.845970 23754 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:05.831943 23782 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.852065 18848 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:05.852514 19490 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:05.818056 23810 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:05.799728 23792 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.842605 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:05.718962 23741 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:05.823069 23678 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.789896 23838 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.855159 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:05.858754 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:05.859943 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:05.860100 18846 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:05.844620 23798 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:05.833045 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.845993 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2715) took 1187 ms. Trace:
I20260709 12:25:05.865855 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:05.889161 18839 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:05.872840 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.869777 18914 pending_rounds.cc:85] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 6
I20260709 12:25:05.921631 18847 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:05.899183 19488 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:05.902108 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:05.908005 18843 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:05.908950 18840 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:05.909940 18919 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:05.862558 23818 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.911183 23754 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:05.911427 23812 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.910674 23640 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.925657 18844 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:05.867798 23756 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.928650 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:05.929451 23813 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.921931 18914 pending_rounds.cc:107] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 13.7
W20260709 12:25:05.930799 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 194618us
I20260709 12:25:05.931360 23823 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:05.932946 23741 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:05.951404 23824 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.933683 19487 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:25:05.935254 18920 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:05.954538 23749 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.846s	user 0.019s	sys 0.010s
I20260709 12:25:05.955087 23749 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:05.956125 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2463) took 3812 ms. Trace:
I20260709 12:25:05.956601 18915 rpcz_store.cc:276] 0709 12:25:02.143555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.470600 (+1327045us) service_pool.cc:224] Handling call
0709 12:25:03.471036 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:03.471484 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:25:03.471514 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:03.472130 (+   616us) log.cc:844] Serialized 52 byte log entry
0709 12:25:04.341234 (+869104us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:04.341286 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.341366 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.955646 (+1614280us) raft_consensus.cc:1685] finished
0709 12:25:05.955698 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.955910 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12020,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3847,"thread_start_us":868593,"threads_started":1,"wal-append.queue_time_us":1145911}
I20260709 12:25:05.951406 18770 raft_consensus.cc:2368] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:05.959650 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:05.962613 23678 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:05.966638 23615 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:05.967948 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 113026us
I20260709 12:25:05.968873 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2475) took 1726 ms. Trace:
I20260709 12:25:05.969427 18913 rpcz_store.cc:276] 0709 12:25:04.242515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.242691 (+   176us) service_pool.cc:224] Handling call
0709 12:25:04.243173 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.655190 (+1412017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:05.655251 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.656030 (+   779us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.725249 (+ 69219us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:05.725294 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.755267 (+ 29973us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.968540 (+213273us) raft_consensus.cc:1685] finished
0709 12:25:05.968573 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.968774 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11307,"raft.queue_time_us":288174,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"thread_start_us":1425072,"threads_started":2,"wal-append.queue_time_us":258063}
W20260709 12:25:05.972174 23799 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.280s	user 0.015s	sys 0.011s
I20260709 12:25:05.938122 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:05.973387 18773 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:05.978628 23812 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.979224 23822 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:05.980369 23543 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:05.980872 23543 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:05.981257 23543 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:05.981420 23812 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.986958 23774 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.988775 23838 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:05.906875 23773 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:05.938282 23733 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:05.923491 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:05.949493 23640 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.864180 23842 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 12:25:05.949569 23813 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:05.994536 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 180354us
I20260709 12:25:05.920502 18765 rpcz_store.cc:276] 0709 12:25:04.658658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.660450 (+  1792us) service_pool.cc:224] Handling call
0709 12:25:04.660859 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.661135 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:04.817768 (+156633us) log.cc:844] Serialized 14 byte log entry
0709 12:25:05.750356 (+932588us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:05.799995 (+ 49639us) log.cc:844] Serialized 14 byte log entry
0709 12:25:05.806846 (+  6851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:05.813931 (+  7085us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:05.822651 (+  8720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.845578 (+ 22927us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.845833 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":801249,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":99,"raft.queue_time_us":34773,"raft.run_cpu_time_us":520,"raft.run_wall_time_us":116045,"spinlock_wait_cycles":30452224,"thread_start_us":963086,"threads_started":2,"wal-append.queue_time_us":706157}
I20260709 12:25:05.949983 23818 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.919920 23798 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:05.950856 23792 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:05.968916 18841 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:05.995447 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:05.991127 19491 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:05.927610 19489 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:05.969785 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:05.957949 23749 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:05.947438 18914 raft_consensus.cc:2889] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:06.007681 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 64327.1us
I20260709 12:25:06.019807 18920 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:06.022593 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:06.022827 23621 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.777s	user 0.019s	sys 0.008s
I20260709 12:25:06.023416 18770 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.023479 23621 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:05.998178 23733 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:06.004385 23798 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:06.032465 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62790.6us
W20260709 12:25:06.031594 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 159187us
I20260709 12:25:06.030069 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.011837 23823 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:06.026258 23621 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.032418 23733 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.055752 23615 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:06.061558 23588 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.474s	user 0.016s	sys 0.009s
I20260709 12:25:06.058463 23792 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.085208 18773 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:05.966722 23802 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.090612 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.022959 23692 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:25:06.064575 23819 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:06.100087 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:06.105815 23819 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.111610 23678 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:06.122862 23811 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:25:06.123656 23777 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:25:06.124817 23800 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:06.127056 23823 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.131567 23802 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:06.134895 23782 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.134773 23837 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:06.135083 23640 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:06.119354 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 43500us
I20260709 12:25:06.275104 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.275959 18913 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:06.275998 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.277670 23800 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:06.278106 23800 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.278517 23800 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.139981 23788 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:06.143043 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:06.281081 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 138158us
I20260709 12:25:06.282238 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:06.274121 23837 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:06.283833 23837 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.283975 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.284430 23635 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:06.285223 23635 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.285655 23796 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:06.148958 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 535167us
I20260709 12:25:06.096779 23792 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.286706 23830 raft_consensus.cc:2764] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:06.286996 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:06.288388 23792 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:06.289084 23792 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:06.289481 23792 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.289862 23792 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:06.290169 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.290971 18771 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:06.292155 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.292989 18771 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:06.160200 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 922) took 1311 ms. Trace:
W20260709 12:25:06.164551 23576 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.715s	user 0.018s	sys 0.011s
I20260709 12:25:06.096292 23588 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.297730 19488 rpcz_store.cc:276] 0709 12:25:04.848476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.848648 (+   172us) service_pool.cc:224] Handling call
0709 12:25:04.848990 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.932257 (+1083267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.159783 (+227526us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54005c21d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:06.160093 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413887872}
I20260709 12:25:06.300127 23588 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.138430 23813 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.301388 23581 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.301988 23581 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:06.169517 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 69509us
I20260709 12:25:06.155476 23818 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.167956 23819 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:06.255805 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.201591 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.264523 18770 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:06.270742 23811 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:06.269722 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:06.138314 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.146469 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1013) took 1346 ms. Trace:
I20260709 12:25:06.286127 23796 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:06.153812 23850 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:25:06.285223 23747 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:06.293587 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.294935 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.295502 23782 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:06.295877 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.296202 23795 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:06.296406 23543 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.269330 23824 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:06.318037 23851 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.253s	user 0.004s	sys 0.003s
I20260709 12:25:06.318691 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.325986 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:06.328199 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49353.6us
I20260709 12:25:06.254904 23678 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:06.332808 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 212651us
I20260709 12:25:06.339987 23813 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:06.346876 23819 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.349942 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:06.329733 18918 rpcz_store.cc:276] 0709 12:25:04.800207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.800361 (+   154us) service_pool.cc:224] Handling call
0709 12:25:04.821218 (+ 20857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:04.821557 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.821585 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:04.822069 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.718865 (+896796us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:05.768318 (+ 49453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.786177 (+ 17859us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.146121 (+359944us) raft_consensus.cc:1685] finished
0709 12:25:06.146144 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.146361 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":607189,"raft.queue_time_us":166,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7493,"thread_start_us":790883,"threads_started":1,"wal-append.queue_time_us":1314202}
I20260709 12:25:06.356614 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2478) took 2019 ms. Trace:
I20260709 12:25:06.373960 18916 rpcz_store.cc:276] 0709 12:25:04.243653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.243766 (+   113us) service_pool.cc:224] Handling call
0709 12:25:06.158777 (+1915011us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:06.263313 (+104536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707323776}
I20260709 12:25:06.374620 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:06.332832 23796 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.377192 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:06.378242 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59721us
W20260709 12:25:06.378482 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 99022.4us
I20260709 12:25:06.379204 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:06.379545 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.379853 23588 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:06.380241 23112 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:06.380319 23588 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:06.381002 23588 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.341135 23747 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:06.382644 23747 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.382905 23708 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:06.383653 23708 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:06.384306 23819 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.371583 23813 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.385835 23813 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:06.386089 18769 raft_consensus.cc:2410] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:06.329270 23811 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:06.387744 23811 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.389191 23811 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.391937 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.392220 18764 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.398295 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:06.400331 23822 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:06.400822 23822 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:06.403914 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:06.404728 18770 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:06.394151 23112 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:06.358186 23778 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.406499 23112 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:06.407560 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.401876 23822 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.408583 18764 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:06.411020 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.411883 18767 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:06.413441 23733 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.414995 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:06.416237 23798 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.417418 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:06.415273 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:06.422227 23747 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:06.423192 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.423889 23837 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.424548 23747 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.425251 23112 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:06.425616 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:06.426330 18846 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:06.426821 23635 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.427942 18840 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:06.428877 23813 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.429697 23581 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:06.396922 23842 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:06.398382 23799 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:06.431092 23799 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.431150 23813 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.431558 23799 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.431844 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:06.432796 23588 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.435133 23588 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.437886 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:06.438511 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.438673 18922 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.438776 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.438939 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:06.439360 18921 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:06.439486 18919 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:25:06.440359 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.440827 18913 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:06.416419 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.438561 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.448263 18916 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:06.448544 23842 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:06.449074 23842 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:06.448973 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:06.450708 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:06.451578 19488 raft_consensus.cc:2368] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:25:06.454705 23824 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:06.455252 23824 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:06.455626 23824 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:06.456053 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:06.457248 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:06.458225 18841 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:25:06.458030 18840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:25:06.458353 23810 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.458942 18840 raft_consensus.cc:606] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:06.459429 18840 raft_consensus.cc:614] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:06.459024 23810 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.461687 23810 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.450172 23842 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.462805 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:06.464186 23842 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.465655 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:06.466780 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.467248 18913 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:06.467438 23112 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:06.467908 23112 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.468371 23112 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.469256 18914 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:06.467825 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.467491 18919 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:06.473455 19488 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:06.466429 23813 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:06.474597 23813 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:06.473889 19488 pending_rounds.cc:85] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 12
I20260709 12:25:06.476297 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.477380 23773 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.478729 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:06.474201 18922 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:06.488147 19488 pending_rounds.cc:107] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:06.488269 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.495349 19488 raft_consensus.cc:2889] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:06.488754 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.491349 23773 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.491709 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.492328 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:06.490589 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.506014 19489 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:06.511701 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:06.513372 23692 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:06.516263 23692 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:06.519964 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:06.521369 23692 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:06.522085 23692 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:06.522751 23692 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.529532 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:06.530817 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 77913.8us
W20260709 12:25:06.534744 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58839.7us
I20260709 12:25:06.504007 19492 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:06.486358 23813 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.480479 23837 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:06.535069 18887 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.500s (SENT)
I20260709 12:25:06.537432 18918 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:25:06.540102 18767 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:06.542868 23802 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:06.548673 23824 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.552101 23800 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.492105 23795 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:25:06.504678 23798 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.555140 23543 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.505342 23849 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:25:06.558650 23802 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:06.559782 23802 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.539098 23788 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:06.562798 23788 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.563203 23788 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.563287 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.565650 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:06.567756 18913 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:06.568523 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:06.560148 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:06.569103 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:06.569799 18914 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.569602 23792 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.570573 23749 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:06.571587 23733 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.572057 23792 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.572512 23818 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:06.543444 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:06.570046 23819 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:06.574043 19487 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:06.573032 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:06.577633 19490 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:06.576467 18769 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:25:06.570227 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:06.588320 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.591073 18918 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:06.593652 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:06.601330 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:06.602267 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.570586 23842 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:06.587960 23819 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:06.576149 23818 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:06.616721 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.571708 23749 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:25:06.622969 18737 leader_election.cc:400] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:25:06.623363 18737 leader_election.cc:403] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:06.617578 18738 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:06.614022 23678 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:06.607302 23543 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:06.610021 23708 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:06.633675 19490 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:06.612335 23800 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:06.619174 23819 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.616204 23842 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:06.651296 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44258.1us
W20260709 12:25:06.654891 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 148948us
I20260709 12:25:06.618486 23747 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:06.655988 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:06.659428 23802 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:06.662832 23818 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.663618 23822 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.658811 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:06.665854 23824 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.667968 23576 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:06.695912 23640 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:06.696435 23640 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.696868 23640 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:06.698278 18887 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.594s (SENT)
W20260709 12:25:06.699635 18887 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.601s (SENT)
I20260709 12:25:06.702451 23796 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.704859 23796 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.705476 23788 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.618806 23588 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:25:06.708858 23788 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:06.670995 23813 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.672791 23842 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.655826 23621 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.684404 23773 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:06.634317 23543 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:06.631855 23823 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:06.734479 23543 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:06.734782 23823 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.735433 23823 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.734781 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:06.692355 18914 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:06.692492 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:06.693372 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 56646.1us
I20260709 12:25:06.731233 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:06.740329 18919 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:06.732837 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 126849us
W20260709 12:25:06.741307 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 48896.3us
W20260709 12:25:06.745182 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 124983us
I20260709 12:25:06.747313 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.709937 23576 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:25:06.763896 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.776233 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:06.783236 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82628us
I20260709 12:25:06.746693 23844 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:06.776190 23818 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.777643 23678 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:06.817234 23844 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:06.841419 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 94194us
I20260709 12:25:06.843770 23678 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:06.844071 23886 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:25:06.830411 23112 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.849363 23112 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:06.856801 18914 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:06.857271 23689 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:06.779985 23747 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.825482 23777 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:06.865670 23635 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:25:06.866039 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 55832.9us
I20260709 12:25:06.868232 23837 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:06.878680 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:06.879463 18914 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.872905 18913 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:06.839949 23881 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:06.863840 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:06.859510 23576 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.884200 18840 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:06.885520 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:06.886849 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:06.888079 23875 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:25:06.886880 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:06.821784 23812 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:25:06.888906 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:06.887926 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:06.842770 23844 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:06.860818 23689 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:06.909514 18844 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:25:06.914623 18919 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:06.909675 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:06.899314 18846 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:06.910187 23112 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:06.910514 23813 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:06.910630 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:06.910805 23635 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:06.903786 23576 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.899588 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:06.886291 23876 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.179s	user 0.003s	sys 0.010s
W20260709 12:25:06.916208 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.918176 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:06.923691 23877 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:06.928295 23689 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.931176 18840 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:06.935323 18847 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.919740 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:06.858883 23811 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:25:06.876256 23882 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:06.941642 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 130834us
I20260709 12:25:06.839242 23799 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:06.888834 23881 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:06.897858 23749 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:06.948428 18914 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:06.942708 18842 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:06.963191 18918 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:06.964181 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:06.965098 18846 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:06.935025 23112 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:06.968369 23112 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:06.954001 23733 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:06.974542 18917 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:06.975247 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:06.976073 18915 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:06.977370 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:06.978372 18921 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.974707 19489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:25:06.986990 19489 raft_consensus.cc:606] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:06.987459 19489 raft_consensus.cc:614] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:06.974793 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.937765 23837 consensus_queue.cc:1243] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:07.000521 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:07.001468 18919 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:07.001659 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:06.951507 23749 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:06.958065 23849 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:06.953229 23881 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.021864 18847 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
W20260709 12:25:07.023706 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 105621us
I20260709 12:25:07.025380 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.029057 18913 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:06.990017 23882 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:07.035297 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 89365.6us
I20260709 12:25:07.030864 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:07.036325 19491 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.032065 18846 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:07.037781 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:07.039535 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:07.046838 18886 leader_election.cc:400] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:07.047317 18886 leader_election.cc:403] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:25:07.044185 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.005043 23788 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:07.011144 23777 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:07.071666 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:07.048810 18842 raft_consensus.cc:2376] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12. Re-sending same reply.
I20260709 12:25:07.065003 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.066960 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:07.074210 18844 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:25:07.072460 18918 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:07.065909 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.077463 18840 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:07.042485 23747 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:07.043622 23849 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:07.029981 23887 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:25:07.102888 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:07.165705 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:07.155761 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.157173 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:07.150127 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60102.6us
I20260709 12:25:07.158723 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:07.122893 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:07.108351 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:07.116835 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 79124.3us
I20260709 12:25:07.157778 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:07.174474 19491 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:07.142755 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:07.153903 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.176128 18844 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:07.178260 18915 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:07.179006 18922 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:07.182476 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:07.183723 18914 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:07.081014 23588 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:07.190012 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.190657 18919 raft_consensus.cc:2368] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:25:07.194146 18847 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:07.123865 23615 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:07.195964 18918 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:07.192939 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:07.195569 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.197562 18914 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:25:07.076612 23788 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:07.091226 23795 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:25:07.199518 23877 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:07.199947 23877 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:07.165400 23778 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:07.203637 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:07.210780 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:07.211525 18839 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:07.214715 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:07.210788 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:07.215934 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:07.216812 18844 raft_consensus.cc:2368] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:25:07.211086 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:07.215767 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 144158us
I20260709 12:25:07.218554 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:07.217687 18922 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:07.221138 18913 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:07.143824 23543 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:07.215391 18846 raft_consensus.cc:2376] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12. Re-sending same reply.
I20260709 12:25:07.193320 23823 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:07.242187 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.206351 23778 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:07.202454 23678 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:25:07.158617 23749 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:07.170188 23882 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:07.764410 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:07.313009 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.547701 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.263090 18841 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 8: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:07.278622 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.221762 23822 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:07.770972 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:07.773164 18918 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:07.764786 18839 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.541s	user 0.035s	sys 0.014s
I20260709 12:25:07.297107 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:07.779299 18917 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:25:07.771955 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.780099 18839 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:07.780892 18840 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.785321 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:07.786149 18845 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:07.486027 19457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.094s (SENT) [suppressed 43 similar messages]
I20260709 12:25:07.789283 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.789572 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:07.790561 18839 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:07.294422 23885 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
W20260709 12:25:07.763408 23895 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.498s	user 0.000s	sys 0.001s
W20260709 12:25:07.299810 23890 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:25:07.297664 23878 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:25:07.813005 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.813247 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:07.813733 18839 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:07.813935 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:07.815433 18768 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:07.816406 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:07.816612 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.817629 18839 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:07.800671 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.032s	sys 0.037s
W20260709 12:25:07.820544 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.032s	sys 0.038s
I20260709 12:25:07.801785 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:07.222748 23615 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:07.403280 23842 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:07.319058 23692 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.796s	user 0.014s	sys 0.001s
I20260709 12:25:07.254091 23773 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:07.263139 23823 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:07.778853 23822 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:07.811048 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:07.467473 23881 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:07.277446 23849 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:07.812317 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 919) took 1082 ms. Trace:
I20260709 12:25:07.815361 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:07.711400 23819 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.034s	user 0.012s	sys 0.001s
I20260709 12:25:07.801337 18767 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:07.816681 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:07.876025 18922 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:07.480468 23799 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:07.824901 18845 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:07.836350 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:07.839912 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:07.297184 23844 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:07.807533 23749 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:07.848318 23640 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.151s	user 0.014s	sys 0.001s
I20260709 12:25:07.848472 18769 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:25:07.836289 23615 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:07.863794 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:07.216308 23777 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:07.903153 18773 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:07.831928 23898 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.904304 18764 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:07.843153 23842 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:07.885239 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:07.866508 19487 rpcz_store.cc:276] 0709 12:25:06.730117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.730346 (+   229us) service_pool.cc:224] Handling call
0709 12:25:06.735381 (+  5035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.735885 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:06.736203 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.823053 (+ 86850us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:06.823557 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.823707 (+   150us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:06.823742 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.823828 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.812088 (+988260us) raft_consensus.cc:1685] finished
0709 12:25:07.812109 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.812249 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17729,"prepare.queue_time_us":1074,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2096,"raft.queue_time_us":26250,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":37722,"thread_start_us":68590,"threads_started":1,"wal-append.queue_time_us":290341}
I20260709 12:25:07.887240 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.891923 18847 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:07.863582 23773 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:07.832311 23839 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:25:07.847812 23788 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:07.934034 18917 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
W20260709 12:25:07.880865 23824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.033s
W20260709 12:25:07.942663 18921 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.005s
I20260709 12:25:07.955127 18921 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:07.893296 18771 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:07.948472 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:07.929582 23621 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.192s	user 0.014s	sys 0.000s
I20260709 12:25:07.843202 23692 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:07.951809 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:07.953025 18767 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.890908 23543 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:07.956278 18768 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:07.959112 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:07.969455 18764 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:07.974839 18765 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:07.954509 23824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.012s	sys 0.033s
I20260709 12:25:07.977303 18921 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:07.979370 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:07.979584 18767 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:07.980199 18922 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:07.883610 23819 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:07.984413 18771 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:07.987483 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:07.982717 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 177956us
I20260709 12:25:07.971725 23621 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:25:08.017757 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.013164 18767 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:07.949304 23640 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:07.995707 18773 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.024610 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.017236 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:07.981915 23733 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:08.028934 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 542915us
I20260709 12:25:07.980782 23899 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:07.897670 23778 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.031474 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.035780 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:08.036123 18845 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:07.946705 23898 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.037914 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:08.040864 19457 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.507s (SENT)
I20260709 12:25:08.044082 18770 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:08.046118 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.047111 18845 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 9.
I20260709 12:25:07.959821 23822 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.032315 23839 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:08.081502 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.088503 18845 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:08.041889 19457 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.633s (SENT)
I20260709 12:25:08.034634 23899 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:08.023087 23823 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:25:08.124773 18887 connection.cc:256] RPC call timeout handler was delayed by -1.4855905350000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 12:25:08.099972 23788 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:08.034195 23733 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:08.115666 23112 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.147s	user 0.016s	sys 0.002s
I20260709 12:25:08.151227 18773 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:25:08.156883 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.704s (SENT)
I20260709 12:25:08.157647 18845 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:08.043345 23842 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.163159 23112 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.169950 23839 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:08.172315 23839 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.173720 18772 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
W20260709 12:25:08.060675 23678 consensus_queue.cc:1175] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 14 status { last_received { term: 13 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:25:08.175526 23911 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:25:08.175997 23909 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:25:08.178256 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.179738 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:08.180064 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.180404 18846 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
W20260709 12:25:08.180696 23818 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.343s	user 0.010s	sys 0.004s
I20260709 12:25:08.181396 23919 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.181579 23898 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:08.186050 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 147188us
I20260709 12:25:08.191581 18765 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:08.193910 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.181397 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.200887 18845 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.202675 18840 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:08.195230 18768 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:25:08.186045 23576 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.233s	user 0.008s	sys 0.005s
W20260709 12:25:08.220615 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.002s	sys 0.005s
W20260709 12:25:08.221170 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.002s	sys 0.005s
W20260709 12:25:08.179771 23905 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 12:25:08.234445 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.187150 23822 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:08.321703 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.223295 18845 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
W20260709 12:25:08.291446 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 249540us
W20260709 12:25:08.314597 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 92401.5us
W20260709 12:25:08.325695 19457 leader_election.cc:336] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.683s (SENT)
W20260709 12:25:08.315390 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 97014.9us
I20260709 12:25:08.319190 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.326366 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:08.327001 18846 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:08.193475 23112 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.331830 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.332988 18846 raft_consensus.cc:2368] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
W20260709 12:25:08.334055 23912 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
W20260709 12:25:08.332273 23902 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:25:08.159138 23788 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.115164 23773 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.334363 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.339948 18846 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:08.340497 23800 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:08.340955 23800 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:08.341220 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.341919 23800 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.343397 23800 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.344168 23621 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.344949 23621 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.346980 23692 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.347707 23903 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.348312 23621 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.348255 23903 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.349877 23899 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.351243 23899 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.320506 23881 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:08.359298 18922 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:08.359325 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 202620us
I20260709 12:25:08.358101 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:08.360757 18916 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.360841 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.337406 23788 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.182111 23919 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.368417 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:08.369181 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.371598 18845 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:08.372318 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:08.342151 18846 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:08.377442 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:08.328819 23799 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:08.360193 23844 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:08.392903 18843 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.030s	sys 0.078s
I20260709 12:25:08.391297 18846 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 13. Ops: []
W20260709 12:25:08.393370 18843 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.030s	sys 0.078s
I20260709 12:25:08.373165 23576 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.366307 23692 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:08.401712 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.374207 23621 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.412853 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2415) took 1213 ms. Trace:
I20260709 12:25:08.418570 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:08.420002 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53742.9us
W20260709 12:25:08.429378 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.413432 18843 rpcz_store.cc:276] 0709 12:25:07.193738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.198955 (+  5217us) service_pool.cc:224] Handling call
0709 12:25:07.199322 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.199760 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.199787 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.200298 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.405639 (+205341us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:08.393782 (+988143us) log.cc:844] Serialized 14 byte log entry
0709 12:25:08.406946 (+ 13164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.407043 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.407093 (+    50us) raft_consensus.cc:1685] finished
0709 12:25:08.407106 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.407271 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26988,"prepare.queue_time_us":629698,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":21449,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2469,"thread_start_us":958860,"threads_started":2,"wal-append.queue_time_us":751543}
I20260709 12:25:08.409161 23112 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.436707 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:08.411696 23819 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:08.439040 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 113425us
I20260709 12:25:08.388077 23906 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:25:08.445569 19457 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.771s (SENT)
I20260709 12:25:08.446221 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:08.441483 19483 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:08.450613 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:08.467921 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.396324 23799 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.412171 23576 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:08.502982 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47900us
W20260709 12:25:08.505728 18887 connection.cc:256] RPC call timeout handler was delayed by -1.3581893499999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 12:25:08.506356 18887 connection.cc:256] RPC call timeout handler was delayed by -1.1196893500000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.229s for a response
W20260709 12:25:08.508333 18887 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.514s (SENT)
I20260709 12:25:08.510072 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.426556 23621 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.442763 23788 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:08.438124 23692 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.508751 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:08.497313 23931 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:25:08.524456 23913 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:08.531453 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 94831.1us
I20260709 12:25:08.510820 18846 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:08.586779 23692 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.575618 23913 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:08.599164 23929 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:25:08.602152 23894 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:08.584435 23925 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:25:08.605464 23919 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.533852 23921 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:08.598563 18913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2477) took 1472 ms (client timeout 1936 ms). Trace:
W20260709 12:25:08.667737 18913 rpcz_store.cc:269] 0709 12:25:07.126648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.142360 (+ 15712us) service_pool.cc:224] Handling call
0709 12:25:08.598287 (+1455927us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b5400034dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:08.598461 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100282240}
I20260709 12:25:08.592370 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:08.583981 23907 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:08.606489 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:08.578969 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 125290us
I20260709 12:25:08.588668 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:08.671963 18765 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.671998 18773 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:08.606757 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 161242us
I20260709 12:25:08.649082 23894 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:08.675776 19457 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.948s (SENT)
I20260709 12:25:08.638902 23813 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:08.670856 23921 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.676496 23813 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:08.677524 23813 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.638374 23906 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:25:08.664207 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.681891 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.666198 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 157894us
W20260709 12:25:08.682786 18887 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.637s (SENT)
I20260709 12:25:08.644338 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:08.675489 23894 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.662762 23935 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:08.687187 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:08.645474 23913 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.683339 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:08.691953 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.828s (SENT)
I20260709 12:25:08.692456 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:08.693954 18887 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.900s (SENT)
I20260709 12:25:08.686795 23894 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.694468 23906 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:08.695451 23907 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:08.696470 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52285us
I20260709 12:25:08.697329 18739 leader_election.cc:400] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:25:08.697618 18739 leader_election.cc:403] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:08.698680 23906 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:25:08.699057 18773 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:08.700034 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:08.703202 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:08.702615 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.686932 23813 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.708900 18769 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:08.704142 18765 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:08.711243 23935 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:08.711603 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.940s (SENT)
I20260709 12:25:08.712396 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2421) took 1407 ms. Trace:
W20260709 12:25:08.713080 18887 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.075s (SENT)
I20260709 12:25:08.713737 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:08.711417 23932 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:08.712823 18848 rpcz_store.cc:276] 0709 12:25:07.305230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.305609 (+   379us) service_pool.cc:224] Handling call
0709 12:25:07.771053 (+465444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.060490 (+289437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.060522 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.091584 (+ 31062us) log.cc:844] Serialized 26 byte log entry
0709 12:25:08.374212 (+282628us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:08.374254 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.374337 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.712117 (+337780us) raft_consensus.cc:1685] finished
0709 12:25:08.712142 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.712323 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10422,"raft.queue_time_us":52956,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"spinlock_wait_cycles":14208,"thread_start_us":464390,"threads_started":2,"wal-append.queue_time_us":303281}
W20260709 12:25:08.719786 18887 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.102s (SENT)
I20260709 12:25:08.720326 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:08.721194 23927 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:08.722996 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.202s (SENT)
I20260709 12:25:08.724563 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:08.726074 18841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 822) took 1842 ms (client timeout 1948 ms). Trace:
I20260709 12:25:08.726176 23830 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:08.726759 18841 rpcz_store.cc:269] 0709 12:25:06.883650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.886462 (+  2812us) service_pool.cc:224] Handling call
0709 12:25:08.725789 (+1839327us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b5400285354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:08.725966 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846333440}
I20260709 12:25:08.728346 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.729765 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2423) took 1283 ms. Trace:
W20260709 12:25:08.732667 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.732589 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:08.733392 18913 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.744506 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:08.745587 18922 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:08.746558 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70796.6us
I20260709 12:25:08.749285 18765 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:08.749202 18916 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:08.757197 18913 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:08.730185 18844 rpcz_store.cc:276] 0709 12:25:07.446675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.764618 (+317943us) service_pool.cc:224] Handling call
0709 12:25:07.796025 (+ 31407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.077094 (+281069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.077151 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.100438 (+ 23287us) log.cc:844] Serialized 26 byte log entry
0709 12:25:08.376331 (+275893us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:08.376386 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.376482 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.729529 (+353047us) raft_consensus.cc:1685] finished
0709 12:25:08.729550 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.729702 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8140,"raft.queue_time_us":27680,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":413791,"threads_started":2,"wal-append.queue_time_us":295548}
I20260709 12:25:08.761766 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.761881 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:08.763314 19457 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.053s (SENT)
I20260709 12:25:08.764995 18842 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:08.766355 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.767408 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:08.771443 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.772087 18841 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:08.768710 18846 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:08.717420 23689 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:08.775637 18848 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:08.776633 23824 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:08.785648 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:08.790417 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.797626 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.798941 18841 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:08.800448 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.801985 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:08.804276 19457 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.194s (SENT)
W20260709 12:25:08.807323 19457 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.235s (SENT)
I20260709 12:25:08.763720 23907 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:08.808658 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 103282us
I20260709 12:25:08.717288 23932 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.818946 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.774243 23937 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:08.816534 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:08.839395 18765 raft_consensus.cc:2376] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14. Re-sending same reply.
I20260709 12:25:08.837664 18766 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:08.815680 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.842456 23937 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:08.843585 23937 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.847975 18846 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:08.839001 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.849643 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:08.852607 23813 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.853224 23813 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.836052 23921 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:08.858462 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.832171 23824 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.864681 18844 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:08.865707 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.865854 23824 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:08.836063 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:08.809213 23799 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:08.869879 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:08.870638 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.874058 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.875445 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.876289 18848 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:08.877146 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:08.871606 23813 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.835808 23621 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.882910 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.884627 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.885490 18846 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:08.850680 23913 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:08.886368 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.895426 18846 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:08.897320 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.898093 18846 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:08.890961 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:08.899955 18918 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:08.904409 18844 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:08.898972 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:08.905903 19489 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:08.907331 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:08.907871 19489 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.908309 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:08.914709 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 65135.6us
I20260709 12:25:08.915484 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:08.910759 23749 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.005s	user 0.012s	sys 0.003s
W20260709 12:25:08.925949 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 89953.9us
I20260709 12:25:08.927131 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:08.891067 23913 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:08.889257 23576 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:08.938823 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:08.925993 23678 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.926709 23906 raft_consensus.cc:2764] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:25:08.928894 23689 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:08.934321 23799 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:08.937021 23842 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:08.933300 23893 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.633s	user 0.026s	sys 0.048s
W20260709 12:25:08.950297 23822 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.003s
W20260709 12:25:09.099351 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 182718us
I20260709 12:25:08.953886 23799 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.947587 23942 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:08.952858 23842 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.105136 18738 leader_election.cc:400] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12.
I20260709 12:25:09.114111 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:08.949529 23678 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:08.953282 23813 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 12:25:09.106791 23799 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.042124 23903 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:09.111301 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 164395us
I20260709 12:25:09.107556 23747 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.130620 19489 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:09.106662 23942 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:09.116255 23842 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.134166 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.136886 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.139998 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.140228 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.141067 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.141729 18918 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
W20260709 12:25:09.043198 23893 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.757s	user 0.026s	sys 0.048s
I20260709 12:25:09.134495 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.154268 18766 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
W20260709 12:25:09.137576 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 201373us
I20260709 12:25:09.139010 18846 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:25:09.140666 18771 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:25:09.144784 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.146798 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:09.148042 23928 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.596s	user 0.005s	sys 0.021s
I20260709 12:25:09.143143 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:09.150029 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.151379 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.138161 23689 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:09.155851 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:09.159783 18773 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:09.139793 18767 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:09.160751 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:09.158162 18843 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.165489 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:09.167294 23914 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.990s	user 0.012s	sys 0.000s
I20260709 12:25:09.169368 23811 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:09.170961 23811 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:09.171458 23811 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:09.172358 23811 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:09.174862 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.175587 18765 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:09.140507 23932 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:09.139410 23942 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:09.179833 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:09.184284 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.205732 18917 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:09.186542 19457 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.954s (SENT)
I20260709 12:25:09.206624 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:09.189074 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.207568 18914 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:09.190151 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:09.208979 18919 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:09.210405 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.210888 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:09.213122 18848 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:09.201414 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:09.214146 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.215981 18848 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13. Re-sending same reply.
I20260709 12:25:09.218873 18918 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:09.220117 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.220467 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.221292 18916 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:09.221836 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.228930 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.229351 18913 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:09.229672 18914 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:09.176294 23822 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:09.236063 18921 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:09.231498 18918 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:09.232071 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.139189 23747 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.230830 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:09.238106 18914 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:09.219131 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.248668 18913 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.252533 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.253710 18916 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:09.258059 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.259999 18848 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:09.263758 18843 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
W20260709 12:25:09.252533 23849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.003s	sys 0.026s
I20260709 12:25:09.200434 23689 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:09.232561 23928 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:25:09.268203 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81703.4us
I20260709 12:25:09.280696 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.281730 18843 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:09.286183 18916 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:25:09.287014 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.291684 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.235363 23822 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:09.297981 18913 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:09.254823 23932 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.265519 23813 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:09.305723 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.271759 23849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.003s	sys 0.027s
I20260709 12:25:09.315585 18913 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:25:09.307294 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.314563 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.331640 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2726) took 1512 ms. Trace:
W20260709 12:25:09.332247 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.332115 18764 rpcz_store.cc:276] 0709 12:25:07.818897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.978294 (+159397us) service_pool.cc:224] Handling call
0709 12:25:07.978740 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:07.983630 (+  4890us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:08.086037 (+102407us) log.cc:844] Serialized 14 byte log entry
0709 12:25:08.409666 (+323629us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:08.415223 (+  5557us) log.cc:844] Serialized 52 byte log entry
0709 12:25:08.415405 (+   182us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:08.415439 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.415510 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:09.147455 (+731945us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:09.331315 (+183860us) raft_consensus.cc:1685] finished
0709 12:25:09.331427 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.331571 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4228,"prepare.queue_time_us":178773,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":8920,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":28167,"spinlock_wait_cycles":6843136,"thread_start_us":282941,"threads_started":2,"wal-append.queue_time_us":358845}
I20260709 12:25:09.335371 18843 raft_consensus.cc:2368] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:09.325892 23778 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:09.338289 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.341850 18921 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:09.340648 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2417) took 2123 ms. Trace:
I20260709 12:25:09.345899 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.347141 18848 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:09.351212 23937 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.351804 23937 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:09.348258 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.356236 23747 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:09.304692 23824 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:09.354077 23937 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:09.312003 23822 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.342720 18842 rpcz_store.cc:276] 0709 12:25:07.213153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.213350 (+   197us) service_pool.cc:224] Handling call
0709 12:25:07.234789 (+ 21439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.766290 (+1531501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.336563 (+570273us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:09.336738 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3518646144}
I20260709 12:25:09.376215 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:09.381593 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:09.381856 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:09.387081 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 221673us
I20260709 12:25:09.388324 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:09.390641 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.390727 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:09.392166 18843 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:09.393352 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.394484 18843 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:09.400702 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.400942 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.401772 18842 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:09.395934 23921 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:09.405758 23921 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.406147 23921 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:09.400467 23576 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:09.409097 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.409955 18842 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.308974 23877 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:09.402830 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.416631 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:09.396463 23932 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:09.381259 23824 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.437119 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:09.440316 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58806.5us
I20260709 12:25:09.441416 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:09.442746 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:09.425946 23933 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:09.448318 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.454995 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:09.458173 18848 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:09.461560 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.462555 18843 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:09.464454 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.466102 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:09.438795 23844 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:09.468294 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.396685 23689 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.465451 18848 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:09.470093 19484 raft_consensus.cc:2410] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:09.470374 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.472138 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.473345 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.475099 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.476593 18843 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:09.430716 23842 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.477622 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.479487 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:09.475796 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:09.481305 19488 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:09.481768 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:09.482476 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.482354 19492 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.488015 19486 raft_consensus.cc:2368] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13.
I20260709 12:25:09.491609 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.494819 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:09.496145 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:09.500288 23640 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:09.501865 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:09.469437 23844 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:09.508841 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 67541.6us
I20260709 12:25:09.470769 23576 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:09.513546 18843 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:09.546484 18842 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:09.548852 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.549675 18913 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:09.516111 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:09.515566 19484 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:09.519760 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:09.524121 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.479058 23877 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.491075 23906 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:09.552628 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.552734 18844 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13. Re-sending same reply.
I20260709 12:25:09.554021 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.554661 18844 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:09.531752 23842 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:09.539608 23824 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:09.543103 23939 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.701s	user 0.004s	sys 0.000s
I20260709 12:25:09.548965 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.555826 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:09.567287 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47624.5us
I20260709 12:25:09.568158 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.571957 18844 raft_consensus.cc:2376] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12. Re-sending same reply.
I20260709 12:25:09.573522 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.512243 23844 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.575796 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.576282 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.559509 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:09.559629 18848 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:09.578327 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.562186 18913 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:09.562140 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:09.565022 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:09.524010 23678 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:09.568890 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:09.570923 18916 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:09.571139 18914 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:09.542138 23799 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:09.588809 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:09.576973 18842 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:09.592860 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:09.593376 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:09.584210 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.596006 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.597025 18843 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:09.561314 23907 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.596851 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.598802 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:09.609546 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:09.597465 23894 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:09.598490 23910 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:25:09.577919 23576 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:09.628472 23894 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.640750 18844 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:09.641420 19491 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:09.591590 23906 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:09.646904 18843 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:09.651346 18844 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:09.646476 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:09.651996 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2626) took 1482 ms. Trace:
I20260709 12:25:09.652205 18842 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:09.598140 23640 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:09.652633 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2630) took 1270 ms. Trace:
I20260709 12:25:09.651494 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2623) took 1483 ms. Trace:
I20260709 12:25:09.653609 18843 rpcz_store.cc:276] 0709 12:25:08.168168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.642964 (+1474796us) service_pool.cc:224] Handling call
0709 12:25:09.643283 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.651232 (+  7949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.651436 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:09.653127 18842 rpcz_store.cc:276] 0709 12:25:08.386199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.603597 (+1217398us) service_pool.cc:224] Handling call
0709 12:25:09.652574 (+ 48977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:09.652355 18844 rpcz_store.cc:276] 0709 12:25:08.169192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.650795 (+1481603us) service_pool.cc:224] Handling call
0709 12:25:09.651164 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.651767 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.651944 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:09.643703 18916 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:09.598616 23951 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:09.595196 23824 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:09.653098 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 43682us
I20260709 12:25:09.658140 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:09.590006 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.660823 18914 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:09.648789 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:09.655241 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 195690us
I20260709 12:25:09.664561 18844 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:09.666004 18843 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:09.676578 19492 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:09.646582 23621 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:09.688534 23621 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.689006 23621 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.691017 23942 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.646337 23894 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:09.693362 23942 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:09.679838 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.695436 18842 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:09.696200 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2634) took 1202 ms. Trace:
I20260709 12:25:09.696514 18842 rpcz_store.cc:276] 0709 12:25:08.497163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.663685 (+1166522us) service_pool.cc:224] Handling call
0709 12:25:09.695084 (+ 31399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.695898 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.696106 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:09.703387 23733 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:09.707719 23933 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.708350 23933 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:09.710846 23112 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:09.711294 23112 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:09.712280 18842 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:09.714507 18916 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:09.715370 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:09.716265 18841 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:09.716508 18915 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:09.716847 23749 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.717406 23749 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.642674 23957 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:25:09.646535 23953 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:09.678628 23813 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:09.681727 18844 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:09.677562 23910 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 12:25:09.685658 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.685925 23799 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:09.740482 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 215332us
I20260709 12:25:09.655753 23640 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.656306 23951 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:09.743446 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 146791us
I20260709 12:25:09.738289 18844 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:09.744496 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 148847us
I20260709 12:25:09.751868 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.751971 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.649785 23678 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:25:09.752909 18768 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:09.753146 19485 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:09.754083 18842 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:09.780335 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.748940 23640 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:09.781064 18842 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:25:09.747437 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64613.3us
I20260709 12:25:09.781623 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:09.781960 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.782565 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.752177 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:09.783175 18812 connection.cc:256] RPC call timeout handler was delayed by -3.0971696420001535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:25:09.783545 18812 connection.cc:256] RPC call timeout handler was delayed by -3.0359696420000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 12:25:09.783855 18812 connection.cc:256] RPC call timeout handler was delayed by -3.003569642000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 12:25:09.784145 18812 connection.cc:256] RPC call timeout handler was delayed by -2.9927696420004395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 12:25:09.757242 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:09.758055 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.758733 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.760489 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.698268 23921 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.770294 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2419) took 2524 ms. Trace:
W20260709 12:25:09.771584 18772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 865) took 1965 ms (client timeout 2094 ms). Trace:
I20260709 12:25:09.721879 23813 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:09.745548 23824 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:09.795711 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47256.3us
I20260709 12:25:09.757122 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:09.790992 18847 rpcz_store.cc:276] 0709 12:25:07.245895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.246071 (+   176us) service_pool.cc:224] Handling call
0709 12:25:07.276574 (+ 30503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.932263 (+655689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.770023 (+1837760us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400285854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:09.770211 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414552448}
W20260709 12:25:09.791818 18772 rpcz_store.cc:269] 0709 12:25:07.806532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.806763 (+   231us) service_pool.cc:224] Handling call
0709 12:25:09.771365 (+1964602us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54002116d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:09.771486 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506164480}
W20260709 12:25:09.786661 18812 connection.cc:256] RPC call timeout handler was delayed by -2.9090696420003042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 12:25:09.789117 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:09.799036 18812 connection.cc:256] RPC call timeout handler was delayed by -2.8154696420001528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:25:09.801036 18812 connection.cc:256] RPC call timeout handler was delayed by -2.792069642000115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 12:25:09.802099 18812 connection.cc:256] RPC call timeout handler was delayed by -2.6966696420004155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 12:25:09.803063 18812 connection.cc:256] RPC call timeout handler was delayed by -2.6516696420003427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 12:25:09.805272 18844 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:09.815106 18812 connection.cc:256] RPC call timeout handler was delayed by -2.5922696420002467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 12:25:09.815608 18812 connection.cc:256] RPC call timeout handler was delayed by -2.4815696420000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23170000000000002s for a response
W20260709 12:25:09.815900 18812 connection.cc:256] RPC call timeout handler was delayed by -1.9343696420000924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2925s for a response
W20260709 12:25:09.816167 18812 connection.cc:256] RPC call timeout handler was delayed by -1.8740696420004497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2992s for a response
W20260709 12:25:09.816450 18812 connection.cc:256] RPC call timeout handler was delayed by -1.68866964200015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31980000000000003s for a response
I20260709 12:25:09.753623 23951 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:09.820230 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:09.821707 18848 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:09.828967 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.829959 18764 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
W20260709 12:25:09.832185 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.842348 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:09.844802 18765 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:09.847455 23907 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:09.851752 23112 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.854367 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:09.858976 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.790098 23747 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:09.853118 23112 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.883538 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:09.884753 18773 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:09.878235 23953 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.887704 18915 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:09.784034 23778 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:25:09.784415 23901 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
W20260709 12:25:09.906061 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.877954 18765 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:09.910091 18768 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:09.910622 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:09.911381 18764 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:09.909626 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.869876 23894 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.920557 18772 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:09.774375 23844 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.941370 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:09.943568 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:09.881527 23849 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:25:09.951472 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:09.942195 18915 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
W20260709 12:25:09.930236 23822 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.000s
I20260709 12:25:09.957880 18764 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:09.959587 18767 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:09.872648 23813 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:09.987341 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:10.015961 18887 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.019s (SENT)
I20260709 12:25:10.016660 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:10.020686 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1043) took 2777 ms. Trace:
I20260709 12:25:10.023079 18771 raft_consensus.cc:2410] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:10.026211 18915 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:10.025034 18920 rpcz_store.cc:276] 0709 12:25:07.243120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.244027 (+   907us) service_pool.cc:224] Handling call
0709 12:25:07.244557 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.244855 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:07.286226 (+ 41371us) log.cc:844] Serialized 14 byte log entry
0709 12:25:09.847001 (+2560775us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18003db0a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:25:10.019139 (+172138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:10.019199 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:10.019257 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.020444 (+  1187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.020616 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39923,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":343485,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":24629504,"thread_start_us":171983,"threads_started":1}
I20260709 12:25:09.909570 23953 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:09.999526 23957 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:10.047461 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 165396us
I20260709 12:25:10.045783 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2665) took 1308 ms. Trace:
I20260709 12:25:10.050733 18843 rpcz_store.cc:276] 0709 12:25:08.737773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.672788 (+935015us) service_pool.cc:224] Handling call
0709 12:25:09.673227 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.683026 (+  9799us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:09.784910 (+101884us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.045298 (+260388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:10.045371 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:10.045433 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.045530 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.045700 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4707,"prepare.queue_time_us":101629,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"thread_start_us":201468,"threads_started":1}
I20260709 12:25:10.056308 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:09.961669 23822 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.063338 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:10.063671 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.019s (SENT)
W20260709 12:25:10.067144 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 3.287s (SENT)
I20260709 12:25:10.069231 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:10.030788 23830 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:10.047073 23957 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:10.075878 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59948.1us
W20260709 12:25:10.077409 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:10.072592 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 262324us
W20260709 12:25:10.096732 18887 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.102s (SENT)
W20260709 12:25:10.108779 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45511.9us
I20260709 12:25:10.111171 19484 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:10.071863 23576 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:10.087464 23957 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.117676 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.124809 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.126596 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.129128 23966 raft_consensus.cc:2764] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:10.112105 23792 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:25:10.130470 23970 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:10.131057 23966 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.112319 23849 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:25:10.132004 23971 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.132682 23976 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.133664 23976 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:10.135004 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:10.135663 19488 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:10.132725 23971 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.131983 23966 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:10.142135 23971 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:10.160108 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:10.132786 23849 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:10.177626 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:10.184636 18887 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.191s (SENT)
I20260709 12:25:10.151140 23822 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.146543 23921 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.146377 23953 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.196201 19488 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:10.197434 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.176309 23849 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:10.175201 23975 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.187534 23741 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:10.188539 23894 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.237228 23689 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.237864 23689 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:10.215258 23984 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:25:10.239034 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 986) took 1305 ms. Trace:
I20260709 12:25:10.219708 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 845) took 2274 ms. Trace:
I20260709 12:25:10.239584 19491 rpcz_store.cc:276] 0709 12:25:08.933832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.934014 (+   182us) service_pool.cc:224] Handling call
0709 12:25:10.238718 (+1304704us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54006739d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:10.238912 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613541632}
I20260709 12:25:10.240264 23689 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:10.224522 23749 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.230513 23812 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:10.241307 23812 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:10.242172 23741 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:10.242323 23812 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.243290 23741 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:10.233443 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.240s (SENT)
I20260709 12:25:10.184286 23830 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:25:10.245816 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:10.246237 23830 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:10.246678 23830 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:10.247575 23830 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.248891 23830 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.186137 23970 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:10.251852 23970 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:10.252262 23970 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:10.252386 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:10.253108 19491 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:10.253192 23970 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.198346 23824 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:10.201217 23844 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.206043 23640 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.174566 23910 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:25:10.197860 23621 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.239665 18845 rpcz_store.cc:276] 0709 12:25:07.945014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.372512 (+427498us) service_pool.cc:224] Handling call
0709 12:25:08.372816 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.677779 (+304963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.677811 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:08.677853 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:08.677885 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.219328 (+1541443us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400125054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:10.219401 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.219613 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700902656}
W20260709 12:25:10.220878 23877 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.659s	user 0.005s	sys 0.004s
W20260709 12:25:10.263684 18846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2650) took 1566 ms (client timeout 1900 ms). Trace:
I20260709 12:25:10.169235 23971 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:25:10.265285 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:10.264962 23951 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:10.270640 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 144138us
I20260709 12:25:10.259994 23640 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.278926 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:10.260718 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:10.280449 18846 rpcz_store.cc:269] 0709 12:25:08.696754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.898685 (+201931us) service_pool.cc:224] Handling call
0709 12:25:10.258082 (+1359397us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400380c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:10.263608 (+  5526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535427968}
W20260709 12:25:10.281553 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48163.2us
I20260709 12:25:10.281723 18839 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:25:10.290791 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.286023 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:10.286197 23892 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:10.286842 23824 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:10.287281 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:10.283918 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:10.289095 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:10.295269 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:10.291559 23792 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:10.299553 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:10.301354 23621 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.294898 23988 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.302556 23892 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.326766 23892 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.328074 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:10.329077 18766 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13. Re-sending same reply.
I20260709 12:25:10.303907 23933 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.294359 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.308075 18765 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:10.308763 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:10.283084 23970 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.332561 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:10.332895 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.314646 23849 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:10.318814 18887 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.809s (SENT)
I20260709 12:25:10.335080 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:10.323376 18841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2642) took 1649 ms (client timeout 1749 ms). Trace:
I20260709 12:25:10.335807 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:10.335932 18841 rpcz_store.cc:269] 0709 12:25:08.673921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.800061 (+126140us) service_pool.cc:224] Handling call
0709 12:25:10.323025 (+1522964us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b540041afd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:10.323272 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103361920}
I20260709 12:25:10.311048 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2434) took 1472 ms. Trace:
I20260709 12:25:10.337467 18848 rpcz_store.cc:276] 0709 12:25:08.838777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.577980 (+739203us) service_pool.cc:224] Handling call
0709 12:25:10.310744 (+732764us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54003269d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:10.310954 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553564928}
I20260709 12:25:10.333317 18764 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:10.337941 23910 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:10.340117 23910 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:10.340313 23904 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:10.340551 23576 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:10.340847 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:10.341109 23576 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:10.341670 18765 raft_consensus.cc:2368] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:25:10.341156 23910 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.340351 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.342324 23990 raft_consensus.cc:2764] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:10.342736 23824 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.341599 23576 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.343560 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.344997 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.340128 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.345870 23799 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:10.346586 23968 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:10.346825 23635 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:10.347127 23968 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:10.347427 23635 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:10.347635 23968 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:10.348492 23635 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.350152 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:10.333531 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:10.346274 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:10.359082 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63894us
W20260709 12:25:10.361030 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 165941us
I20260709 12:25:10.361382 18769 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:10.346271 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.368794 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:10.369731 18764 raft_consensus.cc:2376] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15. Re-sending same reply.
I20260709 12:25:10.330801 23822 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:10.368197 18766 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:10.341711 23849 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.346617 23799 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:10.377157 18765 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:10.366094 23640 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:10.366034 23933 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:10.373579 23971 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:10.374020 23822 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.326812 23988 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.380606 23799 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:10.392768 23913 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:25:10.398335 23813 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:25:10.391813 23957 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.410789 18773 raft_consensus.cc:2368] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:25:10.412873 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:10.415014 23990 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:10.415869 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:10.406594 23799 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:10.417486 23756 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:10.417897 23756 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:10.420408 23951 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.429174 23913 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.429667 23913 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:10.430482 23913 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.432314 23913 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.397243 23971 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.438457 23971 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:10.439450 23756 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.440639 23901 raft_consensus.cc:2764] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:25:09.841624 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:10.451892 23957 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.452723 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:10.454788 19457 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.094s (SENT)
I20260709 12:25:10.455258 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:10.456439 19457 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.521s (SENT)
I20260709 12:25:10.459148 23576 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.461607 23576 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:10.397882 23822 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:10.394806 23621 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:25:10.471894 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:10.473732 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:10.474808 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:10.475628 18917 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:10.478637 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:10.479507 18918 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.487600 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:10.488525 18920 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:10.493731 18913 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:10.497110 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.498811 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:10.499518 18848 raft_consensus.cc:2376] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13. Re-sending same reply.
I20260709 12:25:10.462244 23576 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.500914 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:10.506215 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:10.512200 18846 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:10.507822 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:10.501891 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:10.513708 18848 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:10.508649 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:10.515553 18845 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:10.508860 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:10.510319 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:10.517447 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 100628us
I20260709 12:25:10.514077 18916 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:10.512478 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:10.526554 18842 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:10.517517 18844 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:10.542949 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.515028 23901 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.563789 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:10.566821 18844 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:10.511962 23971 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.524118 23951 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.568426 18848 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:10.569342 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:10.525070 23692 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:10.538004 23904 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.577732 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.602492 23692 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:10.604100 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.605648 23692 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.583253 18913 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:10.584769 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:10.631793 18916 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:10.632009 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 238858us
I20260709 12:25:10.617461 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:10.531643 23892 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.571269 18917 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:10.649155 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 840) took 2806 ms. Trace:
W20260709 12:25:10.658725 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 81065.3us
I20260709 12:25:10.649868 18844 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:10.565544 23812 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:10.660558 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.658849 18839 rpcz_store.cc:276] 0709 12:25:07.843015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.843513 (+   498us) service_pool.cc:224] Handling call
0709 12:25:07.879473 (+ 35960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.290377 (+2410904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.648777 (+358400us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b5400326ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:10.649053 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5523917568}
I20260709 12:25:10.674379 18920 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:10.677420 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.678268 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.576313 23971 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.576027 23951 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.648516 23877 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:10.662659 23839 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:10.573225 23901 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.699899 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.708787 18916 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:10.701821 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:10.711503 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.597646 23904 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.684681 23823 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:10.731016 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.716328 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:10.737866 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:10.705855 23877 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:10.733845 23999 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:25:10.763880 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:10.712630 23985 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:10.724767 23678 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:10.775920 23811 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:10.776458 23811 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.776832 23811 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:10.780326 23689 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:10.780951 23689 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:10.782243 23901 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:10.785778 18887 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.816s (SENT)
I20260709 12:25:10.786315 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:10.787151 23908 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:10.787632 18887 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.714s (SENT)
I20260709 12:25:10.767270 23749 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:10.758977 23877 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:10.788431 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.775s (SENT)
W20260709 12:25:10.788959 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.798482 18918 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
W20260709 12:25:10.798842 23995 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:25:10.782042 23689 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:10.801301 23997 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:25:10.725556 23903 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:25:10.808015 23903 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:10.808218 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 947) took 1314 ms. Trace:
I20260709 12:25:10.808573 23903 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:10.808758 19485 rpcz_store.cc:276] 0709 12:25:09.494238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.497055 (+  2817us) service_pool.cc:224] Handling call
0709 12:25:09.744996 (+247941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.779748 (+ 34752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.807996 (+1028248us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540021cfd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:10.808143 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569475968}
I20260709 12:25:10.811596 23892 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:10.813277 23951 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:10.810164 19489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45480 (request call id 934) took 1394 ms (client timeout 1701 ms). Trace:
I20260709 12:25:10.818921 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:10.817207 19489 rpcz_store.cc:269] 0709 12:25:09.415572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.416366 (+   794us) service_pool.cc:224] Handling call
0709 12:25:10.809971 (+1393605us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400580054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:10.810101 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394076416}
W20260709 12:25:10.827505 23996 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:25:10.829461 18846 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:10.835282 18919 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:10.836555 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:10.839352 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 265614us
I20260709 12:25:10.773797 24001 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:10.780957 23971 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:10.809752 23903 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.808218 23904 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:10.849368 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:10.827555 23811 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:10.865038 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:10.871675 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:10.883404 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 189595us
I20260709 12:25:10.886019 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:10.894385 19491 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:25:10.905879 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.906356 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:10.906530 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:10.907301 18916 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:25:10.907400 18918 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:10.841516 23822 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:10.905507 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:10.924818 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:10.903333 23990 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:10.915076 23812 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:10.932611 23968 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.002s
I20260709 12:25:10.949409 23951 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:10.933122 23824 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:25:11.082597 23975 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:11.083094 23975 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:11.083832 23822 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:10.963680 23988 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:10.964035 23968 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.086827 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:11.087612 18764 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:11.088754 23968 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:11.009750 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.091115 19489 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:10.934109 23901 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:10.933907 23749 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.108033 23749 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:11.074966 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 133946us
W20260709 12:25:11.076508 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 286999us
W20260709 12:25:11.112350 18887 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.880s (SENT)
I20260709 12:25:11.112916 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:11.112963 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:11.116233 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.116400 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 400158us
I20260709 12:25:11.115067 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:11.080458 23799 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.018s
I20260709 12:25:11.122663 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:11.123369 18920 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
W20260709 12:25:11.079840 24003 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.234s	user 0.002s	sys 0.007s
I20260709 12:25:11.121411 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:11.131042 23112 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:11.079118 24012 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:11.104352 23812 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:11.144446 18887 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.951s (SENT)
I20260709 12:25:11.144824 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:11.147475 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.025s (SENT)
I20260709 12:25:11.147883 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:11.130575 23951 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:11.158824 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:11.139782 24013 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.139422 23844 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:11.161860 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62602.9us
I20260709 12:25:11.133315 23901 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:11.084055 23975 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.200351 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:11.203665 18921 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:25:11.207206 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:11.207206 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:11.208366 18764 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.210537 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:11.153386 23823 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:11.173326 23992 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:11.235216 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:11.235962 18771 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:11.160209 24012 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:11.152598 23822 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 12:25:11.241928 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 97127.4us
I20260709 12:25:11.132658 23799 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.235993 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:11.206871 23908 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.165015 23749 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.148944 24011 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:11.241572 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.237107 23975 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:11.263083 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.266384 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.269740 18764 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:11.245111 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:11.142328 24022 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:25:11.209251 23844 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:11.251694 18921 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:11.219403 23823 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:11.241634 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 95536.4us
I20260709 12:25:11.270146 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:11.271490 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.273571 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.289599 18846 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.289740 18844 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.279826 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.267567 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:11.281348 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:11.295260 18922 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:11.206578 24027 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:25:11.195967 24013 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.302632 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.284634 18842 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:11.254870 23947 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.219197 24016 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:25:11.303815 18848 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:11.308133 18846 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:11.323568 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.328461 18844 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:11.328724 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:11.329490 18764 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:11.329663 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.330681 18844 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:11.331869 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.334002 18844 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:11.335101 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.335785 18845 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:11.337801 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.338908 18846 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:11.341585 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.342471 18842 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:11.344182 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.344970 18844 raft_consensus.cc:2376] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13. Re-sending same reply.
I20260709 12:25:11.346113 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.345038 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.346128 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:11.347047 18844 raft_consensus.cc:2376] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12. Re-sending same reply.
I20260709 12:25:11.348119 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.348951 18842 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:11.349794 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.296264 23974 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.296487 23823 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.341413 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2751) took 1053 ms. Trace:
I20260709 12:25:11.350449 18846 raft_consensus.cc:2376] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13. Re-sending same reply.
I20260709 12:25:11.351410 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.352821 18846 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:11.360785 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.361701 18846 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.353791 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.355495 23799 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.356792 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:11.359211 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.351809 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.258695 23908 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.320169 23947 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:11.366187 18770 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:11.350782 18765 rpcz_store.cc:276] 0709 12:25:10.288248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.386457 (+ 98209us) service_pool.cc:224] Handling call
0709 12:25:10.399864 (+ 13407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:10.426743 (+ 26879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.426778 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:10.427436 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 12:25:10.583849 (+156413us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:10.778254 (+194405us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b180043a4a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:10.875646 (+ 97392us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.876209 (+   563us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.904695 (+ 28486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.904819 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.341101 (+436282us) raft_consensus.cc:1685] finished
0709 12:25:11.341138 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.341335 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253933,"prepare.queue_time_us":152678,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4913,"raft.queue_time_us":77625,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":11140,"spinlock_wait_cycles":40729472,"thread_start_us":344511,"threads_started":2,"wal-append.queue_time_us":319721}
I20260709 12:25:11.380496 18771 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:11.371459 18842 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:25:11.350940 23877 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.562s	user 0.018s	sys 0.000s
I20260709 12:25:11.376047 18846 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:11.390177 18842 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:11.403419 18766 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:11.403887 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:11.404573 18764 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:11.414582 18922 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:11.416923 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:11.418808 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:11.424268 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 154296us
I20260709 12:25:11.426337 19491 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:11.337888 23678 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:25:11.392755 23947 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:11.399256 24004 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.294s	user 0.001s	sys 0.001s
I20260709 12:25:11.444227 23921 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.444969 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:11.393252 23953 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:11.448999 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:11.305291 23951 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.430364 23844 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.450700 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:11.452764 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:11.416357 23822 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:11.455287 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:11.302246 23901 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.289165 23812 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.302000 24012 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.471268 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.472051 18765 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
W20260709 12:25:11.453215 24003 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:11.425518 23839 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:11.440913 24011 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.489532 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.494524 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:11.495858 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:11.497778 23908 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:11.498870 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.504508 24010 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.340s	user 0.001s	sys 0.001s
W20260709 12:25:11.511197 24024 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260709 12:25:11.512327 24030 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:25:11.407213 23877 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.377729 23974 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.517362 18765 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:11.518119 18766 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:11.517606 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:11.519901 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2540) took 1439 ms. Trace:
I20260709 12:25:11.521756 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2443) took 1013 ms. Trace:
I20260709 12:25:11.534030 18843 rpcz_store.cc:276] 0709 12:25:10.508015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.508163 (+   148us) service_pool.cc:224] Handling call
0709 12:25:10.508517 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:10.524271 (+ 15754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.524320 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:10.536874 (+ 12554us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.852385 (+315511us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:10.852434 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.852531 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.521474 (+668943us) raft_consensus.cc:1685] finished
0709 12:25:11.521511 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.521670 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6743,"raft.queue_time_us":6871,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":19021,"thread_start_us":253234,"threads_started":1,"wal-append.queue_time_us":538001}
I20260709 12:25:11.465821 23822 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.549528 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:11.532771 18915 rpcz_store.cc:276] 0709 12:25:10.080221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.080444 (+   223us) service_pool.cc:224] Handling call
0709 12:25:10.091901 (+ 11457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:10.128585 (+ 36684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.128619 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:10.129269 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.987137 (+857868us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b18003f72a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:25:11.142701 (+155564us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:11.142741 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.142830 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.519466 (+376636us) raft_consensus.cc:1685] finished
0709 12:25:11.519504 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.519828 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25489,"raft.queue_time_us":26666,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":52892416,"thread_start_us":155358,"threads_started":1,"wal-append.queue_time_us":1317532}
I20260709 12:25:11.553602 18812 leader_election.cc:400] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13.
I20260709 12:25:11.554243 18812 leader_election.cc:403] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.481762 23953 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:11.553663 18765 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:25:11.520587 24029 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:25:11.533643 24031 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 12:25:11.524646 23877 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.464656 23921 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.515452 24034 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.555213 23822 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:11.574045 24013 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:11.554765 23749 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:11.534817 23839 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.585330 23877 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13.
I20260709 12:25:11.584198 24027 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:11.606912 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.612275 23921 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:11.615912 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62540.9us
W20260709 12:25:11.617100 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 349731us
I20260709 12:25:11.617580 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:11.619068 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.620252 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.622233 23824 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:11.622364 23907 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:11.622730 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:11.622998 23907 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.622895 23824 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.624220 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:11.624641 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:11.622776 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:11.625468 23907 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:11.625514 23824 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:11.626199 23907 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.593355 23974 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:11.629494 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.639480 23749 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.639945 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.640882 23749 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.642454 23749 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:11.644039 24044 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:11.645248 23749 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:11.645869 23749 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:11.646296 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.646610 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.646831 23749 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.648716 18839 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:11.648762 23749 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.650417 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.651170 18839 raft_consensus.cc:2368] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:25:11.653179 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.654070 18847 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:11.619916 23921 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.626289 23824 raft_consensus.cc:2764] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:25:11.628415 24034 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.619542 24033 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.663540 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.665596 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:11.667732 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.652711 23877 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.660248 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:11.668857 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44722.2us
I20260709 12:25:11.685899 19484 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:11.630725 23953 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.702956 18766 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:11.705145 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.706898 24056 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.691720 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:11.732622 24034 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:11.734755 23907 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:11.735271 23907 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.735324 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:11.735812 23907 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:11.737673 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 77512.3us
I20260709 12:25:11.701648 23947 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.745038 23947 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.740622 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:11.748600 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:11.751523 18765 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:11.758042 18886 leader_election.cc:400] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:25:11.764138 18886 leader_election.cc:403] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.761559 23974 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:11.771961 23907 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.752529 24056 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:11.770092 24045 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:25:11.779455 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:11.782734 23974 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:25:11.786988 23756 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:11.788465 23975 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.003s
I20260709 12:25:11.789745 18914 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:25:11.790155 18914 pending_rounds.cc:85] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 10
I20260709 12:25:11.790427 18914 pending_rounds.cc:107] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:11.790795 18914 raft_consensus.cc:2889] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:11.754545 24046 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:11.775559 23799 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:11.802767 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:11.773782 23823 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:11.809517 24042 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:25:11.809810 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:11.810003 23975 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.810545 18840 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:11.802711 24054 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:11.811856 18845 raft_consensus.cc:2368] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13.
W20260709 12:25:11.807494 19457 connection.cc:256] RPC call timeout handler was delayed by -1.1681791860000885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 12:25:11.812637 19457 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.804s (SENT)
I20260709 12:25:11.813166 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:11.809442 18886 leader_election.cc:400] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:25:11.814678 18886 leader_election.cc:403] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.815498 24054 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:25:11.795342 24046 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:11.798803 23824 raft_consensus.cc:2764] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:25:11.817997 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:11.831683 24054 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:11.832680 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.795524 23822 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.831419 18840 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:11.838694 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:11.840627 19457 connection.cc:256] RPC call timeout handler was delayed by -1.0610791859999154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 12:25:11.841166 19457 connection.cc:256] RPC call timeout handler was delayed by -1.0474936929999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 12:25:11.841583 19457 connection.cc:256] RPC call timeout handler was delayed by -1.0241791860003104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 12:25:11.842060 19457 connection.cc:256] RPC call timeout handler was delayed by -1.0093826679999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 12:25:11.829686 24046 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:11.857908 23822 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.859233 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:11.839679 23824 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.860981 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:11.837786 23839 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:11.841336 23907 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:11.864216 23824 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.864199 24061 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.886852 23813 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.886049 24055 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.889693 24060 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:11.895788 23799 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:11.906949 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:11.897863 23813 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.907912 24033 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:11.908340 24033 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.908692 24033 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:11.909654 23813 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.907004 24060 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.912256 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:11.912957 18918 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:11.900312 24038 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:25:11.914716 24060 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.917912 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:11.918828 24060 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:11.919543 24060 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.921438 18918 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:11.921816 24033 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.923463 24060 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.924175 24033 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:11.924837 24033 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.926455 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:11.927383 24038 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.928208 24038 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:11.930202 19486 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:11.930821 24038 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:11.932034 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:11.932379 24033 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.932927 24038 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:11.937954 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:11.938959 19484 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.940241 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:11.944243 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:11.944536 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:11.941749 24038 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:11.948758 23824 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:11.949044 23823 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:11.949302 24038 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.903023 24055 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.950733 18767 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:11.952044 24055 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.956367 23830 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:11.957077 23830 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.958501 23813 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:11.959147 23813 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.961580 23813 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:11.961746 23830 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:11.963620 19484 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:11.964247 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:11.967711 23968 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:11.968500 23968 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:11.970016 23903 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.984026 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 887) took 1165 ms. Trace:
I20260709 12:25:11.984516 18767 rpcz_store.cc:276] 0709 12:25:10.818527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.818646 (+   119us) service_pool.cc:224] Handling call
0709 12:25:11.983824 (+1165178us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001b12d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:11.983950 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601256320}
I20260709 12:25:11.969762 23968 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:11.980763 24046 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:11.993649 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:11.997228 18920 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 10.
I20260709 12:25:11.999018 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:12.000967 23988 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:12.001586 18772 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:11.999328 23811 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:11.992560 23830 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:12.004007 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.004103 23830 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.004994 18848 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:12.007193 23894 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:12.001449 23988 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:12.008069 23894 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.008626 23988 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.009869 23988 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.005919 24046 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:12.010895 23830 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:12.011155 23894 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:12.021052 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:12.021072 18844 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:12.027848 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:12.029006 23903 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:12.029407 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.030324 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:12.031715 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:12.032615 18840 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.033895 23903 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:12.035108 23903 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.046844 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.047647 18847 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
W20260709 12:25:12.049853 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50984.1us
W20260709 12:25:12.052191 19457 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.888s (SENT)
I20260709 12:25:12.052599 18840 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:12.052702 18773 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:12.055263 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:12.052023 24049 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:12.060235 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2184) took 2146 ms. Trace:
I20260709 12:25:12.060477 24049 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.060963 24049 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.060693 18768 rpcz_store.cc:276] 0709 12:25:09.912767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.913468 (+   701us) service_pool.cc:224] Handling call
0709 12:25:10.614531 (+701063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.076858 (+462327us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:11.076915 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.076993 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:11.077055 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.078830 (+  1775us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.058587 (+979757us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54001d6350. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:12.058700 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3981,"raft.queue_time_us":55395,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":10888,"spinlock_wait_cycles":1611379968,"thread_start_us":356032,"threads_started":1}
I20260709 12:25:12.063107 19483 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:12.065887 19492 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:12.067445 19486 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:12.068931 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:12.069451 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.075038 23692 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:12.076069 19487 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:12.059787 23799 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.076874 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:12.087879 18840 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:12.088550 18847 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:12.088979 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:12.075465 23903 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:25:12.090109 23953 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:25:12.105391 24067 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:12.106338 24067 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:12.107626 24067 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.127094 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:12.128481 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:12.129511 24078 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:25:12.129642 23830 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:12.130064 24011 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:12.130707 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.131959 24011 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:12.137182 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.128281 24049 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.156848 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:12.164023 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:12.168274 18848 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:12.130115 23830 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.119189 23903 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:25:12.179760 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.147226 24011 consensus_queue.cc:1243] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:12.154237 24069 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:12.172329 23747 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:12.179092 23812 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:12.183588 23830 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.207121 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.217422 23777 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:12.218008 23777 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.218425 23777 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:12.232427 18887 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.176s (SENT)
I20260709 12:25:12.234417 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.234776 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.235186 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:12.235507 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.247042 18848 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:12.234184 23689 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:12.237026 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:12.251919 18887 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.247s (SENT)
I20260709 12:25:12.252244 18843 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:12.252525 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:12.253576 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.189765 24016 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.237974 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:12.177284 23824 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:25:12.251852 23689 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.263295 23824 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:12.263595 23689 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:12.263703 23824 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:12.264817 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2551) took 1009 ms. Trace:
I20260709 12:25:12.264667 23824 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.265305 18914 rpcz_store.cc:276] 0709 12:25:11.255480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.255677 (+   197us) service_pool.cc:224] Handling call
0709 12:25:11.256032 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.791318 (+535286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.264498 (+473180us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b540027ddd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:12.264739 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225925376}
W20260709 12:25:12.266888 24084 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.065s	user 0.000s	sys 0.002s
I20260709 12:25:12.236649 18842 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:12.276372 23970 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:12.276962 23970 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:12.247207 18846 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:12.205351 23692 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:25:12.279500 23907 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.280745 23913 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:12.281268 23913 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:12.280855 23830 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.282196 23913 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.284662 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 934) took 1395 ms. Trace:
I20260709 12:25:12.284580 23913 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.200342 24069 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.285151 19489 rpcz_store.cc:276] 0709 12:25:10.888990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.889943 (+   953us) service_pool.cc:224] Handling call
0709 12:25:10.890355 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.092767 (+202412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.284387 (+1191620us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400136854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:12.284588 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461100800}
I20260709 12:25:12.288873 24069 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:12.207273 23747 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.236617 23812 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.289914 23747 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.291661 23812 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:12.292414 23908 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:12.293537 23908 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:12.293871 23908 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:12.294621 24049 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:12.256174 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49205.6us
W20260709 12:25:12.296643 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.246210 24083 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:25:12.258507 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.290s (SENT)
I20260709 12:25:12.284706 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 897) took 1018 ms. Trace:
I20260709 12:25:12.299189 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:12.300168 19489 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:12.299886 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.301188 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.301416 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.311687 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:12.312517 18920 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.312759 24027 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:12.313247 24027 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.313633 24027 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:12.313737 24039 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.821s	user 0.000s	sys 0.004s
I20260709 12:25:12.294843 23908 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:12.315326 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56854.2us
W20260709 12:25:12.319434 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.325888 18920 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:12.299036 18770 rpcz_store.cc:276] 0709 12:25:11.266421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.269883 (+  3462us) service_pool.cc:224] Handling call
0709 12:25:11.281282 (+ 11399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.377451 (+ 96169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.284444 (+906993us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b540002e254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:12.284627 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155773696}
I20260709 12:25:12.329135 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:12.318002 23991 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:12.330211 18917 raft_consensus.cc:2410] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:12.331261 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:12.331982 18919 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.335186 18922 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:12.335929 23830 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:12.338362 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:12.344125 23635 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:12.338442 24046 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:12.346377 24046 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.338783 23907 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:12.348196 23907 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.327597 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:12.350544 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.373548 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:12.377065 18917 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:12.383956 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.386555 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.322574 23824 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:12.401691 18919 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:12.403806 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:12.405011 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.382934 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.405601 18921 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:12.417012 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.396435 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:12.406347 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:12.349165 24046 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:12.361531 24065 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:12.421578 18915 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:12.412444 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.415509 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:12.422672 18772 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:12.415679 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:12.424099 18770 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:12.277935 23970 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.391919 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:12.413823 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:12.425869 18768 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.433468 18916 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:12.392794 23903 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.374082 23991 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.340106 23811 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:25:12.458173 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:12.463943 18914 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:12.480634 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 164247us
I20260709 12:25:12.481554 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.407160 23756 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:12.489807 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:12.490756 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.494906 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.496109 18772 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:12.497541 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 83795us
I20260709 12:25:12.373759 23635 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:25:12.449743 23992 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:12.508659 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.448859 23908 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:12.515081 19483 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:12.515735 18914 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:12.453640 24032 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:12.525446 18768 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:12.525980 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:12.457069 23692 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:12.530793 18772 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.459076 24065 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:12.532178 18770 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:12.536485 18916 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:12.545855 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:12.551432 24088 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:25:12.553710 18772 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:12.539054 24011 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:25:12.521538 23947 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:12.558543 23692 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:12.560042 23692 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.468834 23903 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.524946 23991 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.512276 23756 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.604281 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.539290 23830 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:25:12.542793 24022 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:25:12.573124 24067 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:25:12.646183 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:12.646883 18773 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.626374 23823 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.611747 23991 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:25:12.660225 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 210146us
W20260709 12:25:12.662125 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127652us
W20260709 12:25:12.664917 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120797us
I20260709 12:25:12.670946 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.653360 24067 consensus_queue.cc:1243] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:12.678359 18769 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:12.678586 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:12.683018 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.684541 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.700794 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:12.657501 23992 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:25:12.655763 23823 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.715378 18773 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:12.722963 18766 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:12.731278 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:12.644999 24065 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:12.733974 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 191380us
I20260709 12:25:12.735174 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:12.736780 18841 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.735971 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:12.740665 18846 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:12.740808 18842 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:12.743779 23823 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:12.745627 23823 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.755192 24091 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:12.699189 23830 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 12:25:12.765218 23689 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.002s
I20260709 12:25:12.771189 23903 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:12.731459 24016 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:12.711186 24011 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:25:12.794708 18841 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
W20260709 12:25:12.790319 23777 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.007s
I20260709 12:25:12.790858 23907 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:12.746265 23823 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.795888 24016 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:12.793444 23689 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:12.888007 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 187322us
I20260709 12:25:12.878958 24099 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:12.809942 23777 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:12.910421 18918 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:12.877735 24027 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:12.896548 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 153559us
I20260709 12:25:12.896780 18768 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:25:12.912338 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 239172us
I20260709 12:25:12.896183 18887 leader_election.cc:400] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11.
I20260709 12:25:12.879033 23990 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:25:12.894104 24098 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:12.918133 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:12.899551 24099 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:12.908747 23913 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.622s	user 0.014s	sys 0.001s
I20260709 12:25:12.931826 18767 raft_consensus.cc:2410] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:25:12.933148 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:12.926867 23988 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:12.948319 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.948722 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:12.917053 24067 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:12.953809 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:12.919902 23824 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:25:12.931640 24096 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:12.961300 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:12.941594 23747 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.003s
I20260709 12:25:12.921653 24101 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:25:12.967651 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.973093 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:12.946372 24102 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.985535 18772 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:12.950165 23988 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:12.998831 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 81983.9us
I20260709 12:25:13.002476 24100 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:12.964901 24106 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.005383 23913 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.008287 23689 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:13.008713 24097 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:25:13.005923 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:12.972086 23747 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:12.976171 24099 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.013722 24109 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.016088 23988 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.018702 23913 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.036628 24117 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:13.037973 24121 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:13.038123 24104 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.039073 24100 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.039563 24027 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.041416 18920 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:13.043459 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:13.006755 24111 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:12.976300 24096 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.012466 24011 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:13.065222 18913 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:12.988668 24102 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.058270 23823 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:13.069096 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120526us
W20260709 12:25:13.085786 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 142099us
I20260709 12:25:13.086604 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:13.067128 24099 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:13.112021 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 68625.7us
I20260709 12:25:13.069547 23988 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.070544 24107 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:13.164341 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 60090.6us
I20260709 12:25:13.168975 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:13.172147 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:13.083509 23635 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.183543 18844 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:25:13.182027 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:13.077670 24011 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:13.083824 23777 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.181293 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:13.186909 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:13.012557 24106 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.198693 23971 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.198758 24106 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:13.199312 23971 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.204499 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:13.204887 18847 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:13.202100 23971 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:13.207257 23971 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.209535 23849 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:13.210081 23971 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.216506 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:13.171801 24109 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:13.162786 24027 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.222951 18772 pending_rounds.cc:85] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 6
I20260709 12:25:13.254885 18772 pending_rounds.cc:107] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:13.255295 18772 raft_consensus.cc:2889] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:13.070582 24100 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:13.064307 24122 consensus_queue.cc:1175] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e2529a8cff04207bb1b07c108e16983" responder_term: 14 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.7-13.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:13.230773 24109 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.271848 18769 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:13.280435 24109 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.281450 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:13.282539 18769 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:13.283622 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:13.285040 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:13.185416 24129 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:13.258832 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:13.284339 23913 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:13.287386 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:13.288029 18846 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:25:13.188932 24111 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:13.194972 24011 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.185083 23824 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:13.307797 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.170814 23908 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:25:13.102761 24123 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 12:25:13.311061 18769 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.325284 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:13.188357 23823 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:25:13.214356 24104 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:25:13.356612 24121 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:13.357074 24121 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:13.358069 24121 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.358780 23747 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:13.359534 24121 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:13.360677 24027 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:13.356663 23813 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 12:25:13.329741 24112 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 12:25:13.330268 24105 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.350s	user 0.003s	sys 0.000s
I20260709 12:25:13.331707 23812 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:13.366741 23812 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:13.367803 23812 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.309568 24129 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.333916 23947 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:13.335691 24046 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:13.336503 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:13.336792 24127 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.339696 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:13.213869 23635 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.186075 24107 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.391598 18771 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:13.324745 24108 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.324944 23913 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.350554 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2553) took 1030 ms. Trace:
I20260709 12:25:13.398486 18913 rpcz_store.cc:276] 0709 12:25:12.320495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.324220 (+  3725us) service_pool.cc:224] Handling call
0709 12:25:12.342719 (+ 18499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.073129 (+730410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.350226 (+277097us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400334354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:13.350470 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660968192}
I20260709 12:25:13.353020 23907 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:13.322665 24111 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.279680 24100 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.278846 24096 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.372068 23971 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:13.431027 18764 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:13.403780 18771 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:13.383174 24022 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:13.379302 24046 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:13.386029 23894 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:13.401041 24104 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:25:13.426172 23824 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.320940 24115 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 12:25:13.400863 23907 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:13.448403 24022 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:13.458643 24118 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:13.460078 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 349456us
I20260709 12:25:13.410744 24111 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:13.462616 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:13.480060 18913 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:13.471621 18914 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:25:13.473312 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.475184 18916 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:13.480064 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:13.477847 24102 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.483717 18768 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:25:13.401311 24108 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.486625 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:13.478269 23907 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.487896 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:13.457260 23971 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.493736 18915 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 8.
I20260709 12:25:13.487531 24049 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:25:13.485574 24118 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.496178 24049 consensus_queue.cc:1243] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:13.392338 24127 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.495596 24119 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.497473 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:13.505244 18914 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:13.471295 23824 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.517381 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:13.516114 18913 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:13.518277 18913 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:13.521819 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:13.522698 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:13.523510 18844 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:13.525065 18847 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:13.525188 18846 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:13.526444 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:13.506220 24132 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.509455 23907 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.534533 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:13.523592 18913 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.540252 18913 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:13.548938 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 360032us
I20260709 12:25:13.498862 23971 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.531075 24115 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:13.533345 23903 raft_consensus.cc:2764] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:25:13.560557 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:13.540969 24049 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:13.581442 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:13.553969 24129 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.586328 18771 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:13.591010 23635 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.579537 24130 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:25:13.592633 24128 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.593151 24128 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.593508 24128 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.594558 24108 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:13.564587 24115 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:13.595777 24115 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:13.598706 24011 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.600579 24127 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:13.546573 23947 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:25:13.601709 23947 consensus_queue.cc:1243] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:13.602581 18913 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:13.603071 24011 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:13.547258 24132 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.603717 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:13.605621 24132 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:13.507395 24119 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.605257 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:13.606947 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:13.607085 18913 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:13.607777 18847 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:13.608009 24119 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:13.608201 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:13.539958 23813 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:25:13.608924 18913 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
W20260709 12:25:13.608927 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.533775 23953 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:25:13.609920 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:13.516781 24046 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.611420 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:13.660470 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 99993.2us
W20260709 12:25:13.662612 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.667850 24131 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:13.611337 24046 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:13.659590 24065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.030s	sys 0.033s
I20260709 12:25:13.677172 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:13.687188 18848 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:13.678144 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:13.688496 19483 raft_consensus.cc:2410] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:13.680696 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:13.685423 19487 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:13.702558 24127 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.703186 24127 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:13.686240 24065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.031s	sys 0.033s
I20260709 12:25:13.682462 24102 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:13.712857 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.667249 24130 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.683295 24011 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.534732 24022 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.691103 24119 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.614604 24049 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.694749 24134 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.698901 24132 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.743577 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:13.744613 18913 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:25:13.699582 24120 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.722821 24118 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:13.726925 24107 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:13.774485 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 112143us
I20260709 12:25:13.739774 24103 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.775482 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:13.762089 24104 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.735425 24130 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.724784 24102 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.786777 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:13.737471 24011 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.762960 23971 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:13.793457 24027 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.740554 24119 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.806057 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:13.778955 24107 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.754086 24132 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.781814 24140 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:13.787079 23849 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.787115 23824 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:13.979131 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 173142us
W20260709 12:25:13.995929 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.813071 24065 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:13.978318 24135 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.755836 24120 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.782372 24103 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.991686 23799 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:13.787703 24104 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:13.754070 24134 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:13.994402 23844 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:13.816982 24027 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.039093 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2199) took 1360 ms. Trace:
I20260709 12:25:14.045403 18766 rpcz_store.cc:276] 0709 12:25:12.678365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.698952 (+ 20587us) service_pool.cc:224] Handling call
0709 12:25:12.722723 (+ 23771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.723398 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.038857 (+1315459us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b54002a0b50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:14.039027 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53579008}
I20260709 12:25:14.023664 24142 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.997282 24140 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.105357 24136 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.106269 24136 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.107645 24140 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:14.108955 24145 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.353s	user 0.000s	sys 0.000s
I20260709 12:25:14.109193 24136 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:14.110682 24141 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:25:14.110857 24150 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:25:14.111016 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.111733 18839 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 9.
I20260709 12:25:14.112239 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 887) took 1036 ms. Trace:
I20260709 12:25:14.112838 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:14.113086 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:14.114516 24138 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.115244 24138 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.119594 24157 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:14.124506 24120 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.128605 24130 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:14.037654 24065 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:25:14.133575 24119 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.113672 18839 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:14.145092 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:14.146888 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:14.148016 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:14.149412 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:14.115975 24146 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:25:14.166210 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:14.227254 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.994567 24107 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.140591 24027 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.112613 18845 rpcz_store.cc:276] 0709 12:25:13.075844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.076024 (+   180us) service_pool.cc:224] Handling call
0709 12:25:13.076412 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.459540 (+383128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.459569 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.467468 (+  7899us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.705878 (+238410us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:13.705916 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.705984 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:14.112023 (+406039us) raft_consensus.cc:1685] finished
0709 12:25:14.112043 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.112178 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36000,"raft.queue_time_us":86534,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8375,"thread_start_us":552922,"threads_started":2,"wal-append.queue_time_us":300231}
I20260709 12:25:14.275225 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.280553 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:14.281085 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 115007us
I20260709 12:25:14.025565 23849 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:25:14.282258 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.282028 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:14.312561 18845 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:14.269696 23894 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:14.269023 24100 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:14.280367 24131 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.015790 24135 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.267227 24119 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:14.243539 24138 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.239576 24136 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:14.057179 23844 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:14.349164 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 329199us
I20260709 12:25:14.313316 24033 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:25:14.359215 24148 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 12:25:14.300014 24103 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.340016 24049 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.345937 23894 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.145361 24142 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.349242 24100 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.364398 24033 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:14.366109 24138 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.374876 23894 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:14.375736 23907 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.828s	user 0.013s	sys 0.000s
I20260709 12:25:14.404088 23844 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.354905 24131 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.374045 24102 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.394708 24138 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.389644 24100 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.395282 24011 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:14.374454 23799 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:14.426767 24132 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:14.429639 24135 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.397617 24134 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.440073 24131 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:14.448594 24107 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:14.439978 24115 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.000s
W20260709 12:25:14.460366 24109 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.179s	user 0.010s	sys 0.004s
W20260709 12:25:14.471627 24160 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 12:25:14.489426 24115 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:14.474639 24147 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.469s	user 0.000s	sys 0.004s
I20260709 12:25:14.461565 24142 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.496251 24104 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:14.462280 24128 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.868s	user 0.012s	sys 0.000s
I20260709 12:25:14.463745 24138 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.466675 23970 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.404697 24016 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:14.454299 24111 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.961s	user 0.010s	sys 0.000s
I20260709 12:25:14.492069 24109 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:14.492352 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68780.1us
I20260709 12:25:14.491858 24136 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:14.507484 23799 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.511059 24016 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.496673 24134 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.512459 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:14.512833 24046 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.004s
I20260709 12:25:14.458541 24033 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.524957 24136 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.514516 18846 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:14.506319 24128 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.539902 18847 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:14.522071 18848 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:14.499361 24027 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:14.535651 24109 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:14.537685 23894 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.511556 24111 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.548302 18847 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:25:14.547269 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 265317us
I20260709 12:25:14.540606 24106 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:14.557310 24106 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:14.557752 24106 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.533373 24134 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.563719 18848 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:14.549329 24033 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.566212 18922 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:14.567303 24096 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.567862 24096 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:14.568511 24166 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:25:14.563099 24032 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.575453 18767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 905) took 2186 ms (client timeout 1660 ms). Trace:
I20260709 12:25:14.575647 24032 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:14.576093 18767 rpcz_store.cc:269] 0709 12:25:12.388864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.403524 (+ 14660us) service_pool.cc:224] Handling call
0709 12:25:14.575146 (+2171622us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540002d354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:14.575332 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181283072}
I20260709 12:25:14.577880 18768 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:25:14.564496 24172 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.541004 24136 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.578019 24032 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.570135 24096 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.582304 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:14.578378 18768 pending_rounds.cc:85] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 11
I20260709 12:25:14.627647 18768 pending_rounds.cc:107] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:14.627889 18768 raft_consensus.cc:2889] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:14.592258 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:14.629330 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47117us
I20260709 12:25:14.592559 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.588454 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.630337 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:14.632200 19491 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:14.593334 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.594550 18846 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:14.596499 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2570) took 1124 ms. Trace:
I20260709 12:25:14.635710 18917 rpcz_store.cc:276] 0709 12:25:13.472544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.474423 (+  1879us) service_pool.cc:224] Handling call
0709 12:25:13.474739 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.474956 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:13.726930 (+251974us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.596001 (+869071us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b18003bd640. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:25:14.596157 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:14.596209 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:14.596259 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.596323 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.596433 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128935,"prepare.queue_time_us":339991,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":728014,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":9150336,"thread_start_us":376099,"threads_started":2,"wal-append.queue_time_us":639497}
W20260709 12:25:14.597203 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.642122 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.644232 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:14.601725 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 154535us
W20260709 12:25:14.615039 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.618249 18847 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:14.648258 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.621556 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.649472 18765 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
W20260709 12:25:14.601572 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.646831 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.650450 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.606878 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.618201 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.597277 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:14.650563 19491 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:14.653142 19483 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:14.653602 18844 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:14.693208 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:14.619235 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:14.654834 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.644790 18916 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:14.695863 18847 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:14.599246 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2569) took 1130 ms. Trace:
I20260709 12:25:14.629428 19487 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:14.649245 19485 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:14.701345 18917 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:14.702693 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.696694 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.619640 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.620290 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.692976 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.703850 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.702499 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.704854 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:14.620924 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.706235 18914 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:14.707530 18918 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:25:14.707950 18918 pending_rounds.cc:85] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 5
I20260709 12:25:14.708195 18918 pending_rounds.cc:107] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:25:14.708170 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.708809 18918 raft_consensus.cc:2889] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:14.708168 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.708756 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.584391 23894 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.710049 18764 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:14.711077 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.713479 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:14.713656 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 116455us
I20260709 12:25:14.703680 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.709085 18914 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:14.716251 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.716583 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.717372 18914 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:14.718590 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.720141 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.721074 18914 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:14.698336 18919 rpcz_store.cc:276] 0709 12:25:13.469277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.470809 (+  1532us) service_pool.cc:224] Handling call
0709 12:25:13.471114 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.574051 (+102937us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:13.766697 (+192646us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.597766 (+831069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:14.597820 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:14.597872 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.598990 (+  1118us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540027ced4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:14.599037 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.599170 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577695,"prepare.queue_time_us":430133,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":579368,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":236167424,"thread_start_us":416174,"threads_started":2,"wal-append.queue_time_us":347137}
I20260709 12:25:14.723763 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.723872 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.692193 23908 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:14.717185 18765 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:14.596557 24111 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:14.596940 24168 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.725461 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:14.722383 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.585671 24128 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.596776 24115 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.692109 24108 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:25:14.582959 24172 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.594815 24134 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.715487 18844 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:14.728864 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:14.601878 24046 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.762729 24046 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.764230 18916 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:14.582759 23990 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.766734 23990 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.728372 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.692122 23907 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.770112 23990 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.597609 23824 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.602747 23756 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.732312 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.692881 23971 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.703096 24009 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:14.735574 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:14.740968 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:14.766062 24046 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.702468 24109 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:14.702687 24011 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:14.742856 18914 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:14.728223 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.745815 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:14.729071 23968 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:14.753723 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 123488us
I20260709 12:25:14.753522 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:14.761142 24032 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:14.742651 24175 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:14.761801 24107 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:14.655298 24096 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.771041 23756 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.770344 23907 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.783792 23756 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.785625 23907 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.785914 23756 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.786819 18917 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:14.772006 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:14.772285 23971 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.790860 23971 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:14.791394 18921 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:14.772802 18919 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:14.795689 24144 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.033s	user 0.011s	sys 0.022s
I20260709 12:25:14.795475 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.796293 18921 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:14.797237 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.797844 18921 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:14.774840 24134 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:14.799144 24134 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.799512 24134 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.801260 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2204) took 1579 ms. Trace:
I20260709 12:25:14.712251 23844 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:14.802230 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.803141 19489 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:14.777735 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:14.804983 18914 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:14.708647 23918 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:14.777930 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:14.811070 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:14.779320 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:14.808444 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:14.814127 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:14.801764 18772 rpcz_store.cc:276] 0709 12:25:13.221557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.222224 (+   667us) service_pool.cc:224] Handling call
0709 12:25:13.222671 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.256026 (+ 33355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.256077 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.256669 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.536355 (+279686us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.978355 (+442000us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.011242 (+ 32887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.011335 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:14.795115 (+783780us) spinlock_profiling.cc:243] Waited 891 us on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:14.800888 (+  5773us) raft_consensus.cc:1685] finished
0709 12:25:14.800998 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.801179 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32570,"prepare.queue_time_us":866070,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":32963,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5456,"spinlock_wait_cycles":2049408,"thread_start_us":640539,"threads_started":2,"wal-append.queue_time_us":485242}
I20260709 12:25:14.832041 18919 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:14.748327 23908 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:14.778142 24140 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:14.843215 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64002.6us
I20260709 12:25:14.759629 24115 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:14.844080 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:14.777835 23968 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.809222 24111 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:14.853777 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 198250us
I20260709 12:25:14.827114 24104 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:14.863965 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 159201us
I20260709 12:25:14.874739 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:14.876256 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:14.828722 24142 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:14.828203 23990 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:14.828564 24119 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:14.866323 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.845270 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:14.872641 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.835748 23621 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.747596 24168 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.889333 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:14.841650 24121 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.775650 24109 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.779680 24175 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.779646 24032 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.770735 23824 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.772536 24009 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.866542 23971 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:14.780206 24096 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.843302 24140 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.775977 24011 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.904531 19483 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:14.871002 23968 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.869534 24108 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:14.896023 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:14.947379 19489 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:14.891798 24181 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:14.885360 24104 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.885093 24142 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:14.900142 23990 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.899775 23907 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:14.902971 24119 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.919735 24135 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:14.919435 24115 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:14.899542 24100 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.919289 23971 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:14.946406 24140 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:14.964121 18767 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:14.912961 23621 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.950960 23908 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:14.953665 24108 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.979327 24009 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:14.961750 23990 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:14.981333 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 94224us
I20260709 12:25:14.949386 24185 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:14.916508 24121 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:14.955340 24104 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:14.958050 24142 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.020856 24108 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.023684 24108 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:15.023962 24027 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:15.024313 24108 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.024693 24027 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.026964 24108 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:14.980895 24167 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:15.002007 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 158003us
I20260709 12:25:14.969525 24119 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:14.962829 24181 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:14.975986 24135 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:15.015642 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.017694 18840 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:15.019460 24191 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:15.030988 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:15.040530 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:15.041756 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:15.042158 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.046546 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:15.046885 18920 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 15 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:25:15.047230 18772 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:15.047806 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.049571 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:15.053401 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 208217us
W20260709 12:25:15.054836 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 177769us
I20260709 12:25:15.057482 19487 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:15.027832 24185 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.066838 24109 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:15.060678 24184 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:25:15.068588 24127 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.075459 24099 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:15.076251 24099 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.076675 24099 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.050165 24135 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:15.093346 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2472) took 1407 ms. Trace:
I20260709 12:25:15.104671 18842 rpcz_store.cc:276] 0709 12:25:13.685702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.114271 (+428569us) service_pool.cc:224] Handling call
0709 12:25:14.166827 (+ 52556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.320019 (+153192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.320070 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:14.320136 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:14.320208 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.092953 (+772745us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54001081d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:15.093029 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.093254 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351631104}
I20260709 12:25:15.096184 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2565) took 1634 ms. Trace:
I20260709 12:25:15.106880 18918 rpcz_store.cc:276] 0709 12:25:13.461685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.461826 (+   141us) service_pool.cc:224] Handling call
0709 12:25:13.477563 (+ 15737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.709657 (+1232094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.095818 (+386161us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:15.096093 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2827740416}
I20260709 12:25:15.097697 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 912) took 1562 ms. Trace:
I20260709 12:25:15.108390 18768 rpcz_store.cc:276] 0709 12:25:13.535153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.535335 (+   182us) service_pool.cc:224] Handling call
0709 12:25:14.577438 (+1042103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.628334 (+ 50896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.097405 (+469071us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540002d350. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:15.097610 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2380214016}
W20260709 12:25:15.094878 19456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.660s (SENT) [suppressed 54 similar messages]
I20260709 12:25:15.057590 24108 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:15.101974 19458 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:15.126214 24102 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:15.058574 24180 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:15.078755 24111 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.063807 23970 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.136443 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:15.134033 19458 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:15.081283 24185 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:15.145861 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.089854 24127 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.150933 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.063561 24186 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.088150 24172 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.079804 24183 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:25:15.154090 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:15.300830 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 146854us
W20260709 12:25:15.230278 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 189840us
I20260709 12:25:15.134405 24126 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:15.296164 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 237554us
I20260709 12:25:15.044488 24167 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:15.150360 24151 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:15.298409 18918 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:15.144268 23799 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:15.303725 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:15.291077 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.313326 18919 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:15.063050 23971 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.317669 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.338352 18921 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:15.229969 24027 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:15.230374 24166 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:25:15.330633 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.301890 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:15.294628 24033 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.318615 24127 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.319675 23849 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:15.335106 24182 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.316s	user 0.000s	sys 0.000s
I20260709 12:25:15.144114 24102 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.234174 24122 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:15.361994 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58393.1us
I20260709 12:25:15.311867 24168 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:15.326138 24096 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.331664 23824 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:15.400348 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.327888 24186 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.372978 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:15.404740 18921 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.407476 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:15.342135 24178 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.395s	user 0.002s	sys 0.000s
I20260709 12:25:15.324198 24032 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.160555 23970 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.155422 24111 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:15.383878 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 289028us
W20260709 12:25:15.384521 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 329973us
I20260709 12:25:15.328992 23799 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:15.149914 24180 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.346101 24108 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:15.368989 24011 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.433125 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.434149 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.377313 23849 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.475234 23849 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:15.399078 24101 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:15.447137 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.517392 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.413115 23824 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.373533 24192 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:15.450105 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.533887 18917 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:15.451166 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.361073 24109 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 12:25:15.456880 24189 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:25:15.448944 23799 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:15.415283 24100 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:15.497542 23907 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.498224 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2485) took 1497 ms. Trace:
I20260709 12:25:15.554607 18846 rpcz_store.cc:276] 0709 12:25:14.001281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.540623 (+539342us) service_pool.cc:224] Handling call
0709 12:25:14.541006 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.634954 (+ 93948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.483309 (+848355us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b54003269d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:15.498153 (+ 14844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122157312}
I20260709 12:25:15.498778 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.556715 18920 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 8.
I20260709 12:25:15.499069 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:15.499854 24127 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.499666 23812 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:15.330274 24181 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.500712 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 886) took 2425 ms. Trace:
I20260709 12:25:15.566836 18841 rpcz_store.cc:276] 0709 12:25:13.075043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.075215 (+   172us) service_pool.cc:224] Handling call
0709 12:25:13.075576 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.426725 (+351149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.426775 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.450461 (+ 23686us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.722007 (+271546us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:13.722054 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.483654 (+1761600us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400238f54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:15.500295 (+ 16641us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.500348 (+    53us) raft_consensus.cc:1685] finished
0709 12:25:15.500367 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.500641 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2718,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":2400,"spinlock_wait_cycles":806425344,"thread_start_us":224473,"threads_started":1,"wal-append.queue_time_us":518151,"wal-append.run_cpu_time_us":7921,"wal-append.run_wall_time_us":1434261}
I20260709 12:25:15.474514 24197 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.501349 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2487) took 1378 ms. Trace:
I20260709 12:25:15.577306 18848 rpcz_store.cc:276] 0709 12:25:14.122710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.543282 (+420572us) service_pool.cc:224] Handling call
0709 12:25:14.543677 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.566164 (+ 22487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.472194 (+906030us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54003287d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:15.501274 (+ 29080us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40767744}
I20260709 12:25:15.501703 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:15.502369 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2577) took 1992 ms. Trace:
I20260709 12:25:15.474633 24011 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:25:15.505775 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2568) took 1845 ms. Trace:
I20260709 12:25:15.414237 24186 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.583906 18922 rpcz_store.cc:276] 0709 12:25:13.509635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.518605 (+  8970us) service_pool.cc:224] Handling call
0709 12:25:13.532148 (+ 13543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.566724 (+1034576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.488942 (+922218us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400100754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:15.502301 (+ 13359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377577728}
I20260709 12:25:15.325815 24126 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.511763 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.512388 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.399313 24122 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:15.448064 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.527889 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.528056 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2203) took 2308 ms. Trace:
I20260709 12:25:15.532281 18921 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:15.454317 23621 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.542868 18917 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:15.515395 24107 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:15.562198 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63221.7us
I20260709 12:25:15.626530 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:15.515741 24101 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.566510 24200 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:15.564021 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 262232us
I20260709 12:25:15.565081 18920 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:15.514575 24033 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:25:15.576045 24142 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.002s
I20260709 12:25:15.590138 18913 rpcz_store.cc:276] 0709 12:25:13.660529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.139667 (+479138us) service_pool.cc:224] Handling call
0709 12:25:14.140065 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.599889 (+459824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.599923 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:14.600536 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:25:14.814264 (+213728us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:14.814315 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.814467 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.505424 (+690957us) raft_consensus.cc:1685] finished
0709 12:25:15.505457 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.505675 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459343,"raft.queue_time_us":459770,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":88,"thread_start_us":213258,"threads_started":1,"wal-append.queue_time_us":298162}
I20260709 12:25:15.443859 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:15.578723 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2575) took 2079 ms. Trace:
I20260709 12:25:15.617424 18921 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:15.615335 18773 rpcz_store.cc:276] 0709 12:25:13.219790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.220514 (+   724us) service_pool.cc:224] Handling call
0709 12:25:13.220986 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.381492 (+160506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.381535 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.394530 (+ 12995us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.755854 (+361324us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.755902 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.449833 (+693931us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:15.527581 (+1077748us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540002d854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:15.527668 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.527737 (+    69us) raft_consensus.cc:1685] finished
0709 12:25:15.527759 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.527974 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380136576,"thread_start_us":306036,"threads_started":1,"wal-append.queue_time_us":378260,"wal-append.run_cpu_time_us":6534,"wal-append.run_wall_time_us":1746489}
W20260709 12:25:15.580416 24131 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.000s	sys 0.043s
I20260709 12:25:15.515966 24205 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.529001 24108 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.632939 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:15.633955 18922 pending_rounds.cc:85] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 6
I20260709 12:25:15.679593 18922 pending_rounds.cc:107] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:15.679965 18922 raft_consensus.cc:2889] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:15.680402 24131 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.000s	sys 0.043s
I20260709 12:25:15.634796 19487 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:15.650786 24198 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:15.688336 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 346500us
I20260709 12:25:15.652763 24186 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:15.654623 24195 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:25:15.587638 23907 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.659327 24102 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.632076 24107 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:15.659698 24180 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:15.661633 23990 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 12:25:15.540230 23824 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:15.663679 24134 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.864s	user 0.011s	sys 0.001s
I20260709 12:25:15.647010 23621 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:15.667284 23970 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:15.670800 24126 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:15.671904 23968 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 12:25:15.674130 23849 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:15.674916 24135 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.005s
I20260709 12:25:15.634994 24101 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.676824 24197 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:25:15.645040 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.681736 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 237952us
W20260709 12:25:15.615177 24106 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.057s	user 0.012s	sys 0.002s
I20260709 12:25:15.589486 24046 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:15.749984 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:15.677685 18915 rpcz_store.cc:276] 0709 12:25:13.499646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.516753 (+ 17107us) service_pool.cc:224] Handling call
0709 12:25:13.517194 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:13.517674 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:13.758456 (+240782us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.752842 (+994386us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.061750 (+308908us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:15.064546 (+  2796us) log.cc:844] Serialized 52 byte log entry
0709 12:25:15.064752 (+   206us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:15.079880 (+ 15128us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.578237 (+498357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.578360 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.578432 (+    72us) raft_consensus.cc:1685] finished
0709 12:25:15.578449 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.578663 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374869,"prepare.queue_time_us":822977,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":141,"raft.queue_time_us":451977,"raft.run_cpu_time_us":534,"raft.run_wall_time_us":22875,"thread_start_us":1544605,"threads_started":5,"wal-append.queue_time_us":634824}
I20260709 12:25:15.700045 18913 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:15.678412 24204 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:15.621395 24203 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.714912 18919 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:15.691169 23812 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:15.692776 24121 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:15.699060 24154 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.321s	user 0.010s	sys 0.010s
I20260709 12:25:15.689424 24033 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.688467 24142 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.690696 24205 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.722479 23990 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.693495 24198 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.724391 24134 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.744845 23968 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.813261 19492 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:15.795392 24203 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.814509 23968 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:15.815181 23968 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:15.790264 24100 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:15.790203 23812 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:15.795207 24191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.017s	sys 0.037s
I20260709 12:25:15.748978 24135 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:15.817417 24136 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.196s	user 0.008s	sys 0.007s
I20260709 12:25:15.789790 24106 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:15.783164 24197 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.819053 24100 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.850728 24100 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.850944 24108 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.790124 24046 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:15.674942 18666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 289) took 26792 ms (client timeout 15000 ms). Trace:
I20260709 12:25:15.658082 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 913) took 1002 ms. Trace:
W20260709 12:25:15.923792 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 200657us
W20260709 12:25:15.679768 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46919.6us
I20260709 12:25:15.651754 18760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c18380178684f0e93b10d0c7a912d02 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:33726
I20260709 12:25:15.926064 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 918) took 1268 ms. Trace:
I20260709 12:25:15.855746 24136 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:15.791183 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:15.926848 18770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.013s	sys 0.029s
I20260709 12:25:15.931663 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2712) took 2744 ms. Trace:
W20260709 12:25:15.938832 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.942770 18885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.010s	sys 0.011s
W20260709 12:25:15.943174 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 155530us
W20260709 12:25:15.951077 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 312790us
I20260709 12:25:15.954442 18913 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:15.841004 24140 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.823s	user 0.013s	sys 0.000s
W20260709 12:25:15.878010 24185 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
W20260709 12:25:15.832435 24191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.017s	sys 0.037s
I20260709 12:25:15.848474 24198 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.879542 24205 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:15.855530 24122 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.061810 24172 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.063227 24102 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.065850 24027 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.360349 18845 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:16.360940 24140 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.172236 23621 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:16.327247 24204 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:16.185231 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2586) took 1130 ms. Trace:
W20260709 12:25:16.366567 18770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.017s	sys 0.033s
I20260709 12:25:16.352254 24135 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.378328 24204 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.371201 24191 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:16.375247 23621 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.176204 23907 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:16.367059 18885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.016s	sys 0.014s
I20260709 12:25:16.068514 24121 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.326781 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:15.821259 23812 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:16.344198 19456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.000s	sys 0.010s
I20260709 12:25:16.364897 24172 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:16.376905 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2212) took 2991 ms. Trace:
I20260709 12:25:16.375837 18914 rpcz_store.cc:276] 0709 12:25:15.054583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.054757 (+   174us) service_pool.cc:224] Handling call
0709 12:25:15.078767 (+ 24010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.316744 (+237977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:15.316795 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:15.316858 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:15.316908 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.184558 (+867650us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54003543d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:16.184640 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.184944 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546610560}
I20260709 12:25:16.359823 18842 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
W20260709 12:25:16.400552 19456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.001s	sys 0.018s
I20260709 12:25:16.403319 24200 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:16.405542 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1025) took 1606 ms. Trace:
I20260709 12:25:16.406808 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:16.415041 19487 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:25:16.415185 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:16.403385 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.417089 19491 rpcz_store.cc:276] 0709 12:25:14.799241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.800948 (+  1707us) service_pool.cc:224] Handling call
0709 12:25:16.403742 (+1602794us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b5800106598. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66f8c 00007f3357e66ef6 000000000036eb39 00007f335feda1e0 00007f335ffa30c4 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:25:16.404086 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.404657 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.404696 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.404776 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:16.404850 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.404972 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.405192 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13603712}
W20260709 12:25:16.409873 24101 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.007s
I20260709 12:25:16.419977 24101 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:16.413671 18658 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.003s	sys 0.009s
W20260709 12:25:16.421346 18658 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.004s	sys 0.009s
I20260709 12:25:16.421931 24200 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:16.422372 19485 raft_consensus.cc:2368] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:16.426592 24106 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.429478 24172 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.074509 24032 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.084576 23990 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.431685 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2583) took 1375 ms. Trace:
I20260709 12:25:16.432967 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:16.433879 23971 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:16.454116 24167 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:16.410564 24131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.010s
I20260709 12:25:16.436828 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:16.437978 24099 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.438624 24108 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.440923 24101 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.441553 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:16.441958 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:16.445310 24111 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:16.447036 23824 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.457458 24175 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.458501 24135 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.397293 18770 rpcz_store.cc:276] 0709 12:25:13.385751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.385928 (+   177us) service_pool.cc:224] Handling call
0709 12:25:13.386418 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.386817 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.386850 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.387347 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.368168 (+1980821us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180016dda0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:25:16.375851 (+1007683us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:16.375988 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.376175 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.376247 (+    72us) raft_consensus.cc:1685] finished
0709 12:25:16.376258 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.376725 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19868,"raft.queue_time_us":5040,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7527,"spinlock_wait_cycles":4072832,"thread_start_us":1006869,"threads_started":1,"wal-append.queue_time_us":2464842}
I20260709 12:25:16.480365 19490 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:16.187896 23849 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.362185 24027 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:16.464159 24181 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:16.464320 19488 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 7.
I20260709 12:25:16.487752 24135 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:16.489128 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120733us
I20260709 12:25:16.465668 18916 rpcz_store.cc:276] 0709 12:25:15.056360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.579905 (+523545us) service_pool.cc:224] Handling call
0709 12:25:15.580123 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:15.610493 (+ 30370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:15.610544 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:15.611203 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.943735 (+332532us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:15.944707 (+   972us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.945184 (+   477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.945343 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.431181 (+485838us) raft_consensus.cc:1685] finished
0709 12:25:16.431204 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.431447 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54086,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":21528,"raft.queue_time_us":101115,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5554,"spinlock_wait_cycles":5706496,"thread_start_us":331707,"threads_started":1,"wal-append.queue_time_us":728836}
I20260709 12:25:16.500722 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:16.368556 18843 rpcz_store.cc:276] 0709 12:25:13.186857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.187049 (+   192us) service_pool.cc:224] Handling call
0709 12:25:13.187410 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:13.531972 (+344562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.532002 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:13.532620 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 12:25:13.979327 (+446707us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:14.227510 (+248183us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.251361 (+ 23851us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.463251 (+211890us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b180048e680. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:25:14.496942 (+ 33691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.497066 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.532491 (+1035425us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:15.930860 (+398369us) raft_consensus.cc:1685] finished
0709 12:25:15.930920 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.931361 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206435,"prepare.queue_time_us":159242,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":282763,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":2534,"spinlock_wait_cycles":48385664,"thread_start_us":851749,"threads_started":4,"wal-append.queue_time_us":788772}
I20260709 12:25:16.372629 24102 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.368364 18766 rpcz_store.cc:276] 0709 12:25:14.657855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.725246 (+ 67391us) service_pool.cc:224] Handling call
0709 12:25:14.725594 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.899086 (+173492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.899115 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:14.899635 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.016463 (+116828us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:15.016523 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.016614 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.925218 (+908604us) raft_consensus.cc:1685] finished
0709 12:25:15.925303 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.925731 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1013,"raft.queue_time_us":33587,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":119,"thread_start_us":266099,"threads_started":2,"wal-append.queue_time_us":229341}
I20260709 12:25:16.370869 24185 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.496222 24181 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:16.521823 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:16.522531 24181 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:16.525054 24181 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.527127 24038 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:16.527755 24038 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.528230 24038 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:16.530329 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:16.531409 18914 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:16.533015 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:16.533751 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:16.535969 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2592) took 1390 ms. Trace:
I20260709 12:25:16.536474 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:16.538170 24032 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:16.544930 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.549650 23907 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.550163 23824 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:16.551527 24204 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:15.821733 23968 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.553022 24022 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.571270 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1031) took 1740 ms. Trace:
I20260709 12:25:16.555311 18919 rpcz_store.cc:276] 0709 12:25:15.145023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.330311 (+185288us) service_pool.cc:224] Handling call
0709 12:25:16.535459 (+1205148us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54003e6554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:16.535707 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828378880}
W20260709 12:25:16.573684 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.544950 18845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2496) took 1927 ms (client timeout 2221 ms). Trace:
I20260709 12:25:16.577742 23907 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:16.578912 24046 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:16.579349 23824 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.370606 18769 rpcz_store.cc:276] 0709 12:25:14.656162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.658550 (+  2388us) service_pool.cc:224] Handling call
0709 12:25:14.658993 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.958734 (+299741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.958794 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:14.959462 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.335868 (+376406us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:15.410141 (+ 74273us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.410482 (+   341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.496504 (+ 86022us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540002e254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:15.496578 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.657728 (+161150us) raft_consensus.cc:1685] finished
0709 12:25:15.657839 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.658006 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27163,"prepare.queue_time_us":298388,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":5772,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":12289,"spinlock_wait_cycles":675359104,"thread_start_us":397889,"threads_started":2,"wal-append.queue_time_us":612361}
W20260709 12:25:16.581559 18845 rpcz_store.cc:269] 0709 12:25:14.617893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.618959 (+  1066us) service_pool.cc:224] Handling call
0709 12:25:16.544648 (+1925689us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400284454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:16.544843 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3827681024}
I20260709 12:25:16.580986 19489 rpcz_store.cc:276] 0709 12:25:14.830569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.830841 (+   272us) service_pool.cc:224] Handling call
0709 12:25:14.831247 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.947946 (+116699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.553857 (+1605911us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b5400521054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:16.571013 (+ 17156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221313408}
W20260709 12:25:16.590735 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 57152.3us
W20260709 12:25:16.370857 18666 rpcz_store.cc:269] 0709 12:24:48.751258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.751503 (+   245us) service_pool.cc:224] Handling call
0709 12:25:15.538540 (+26787037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:00.541942 (+     0us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9c016c
0709 12:25:00.946464 (+404522us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:00.947176 (+   712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:00.947222 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:25:00.947241 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:00.949500 (+  2259us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:00.949582 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:00.949610 (+    28us) tablet.cc:685] Acquiring locks for 31 operations
0709 12:25:01.157427 (+207817us) tablet.cc:701] Row locks acquired
0709 12:25:01.157499 (+    72us) write_op.cc:260] PREPARE: finished
0709 12:25:01.157747 (+   248us) write_op.cc:270] Start()
0709 12:25:01.158090 (+   343us) write_op.cc:276] Timestamp: P: 1783599901157649 usec, L: 0
0709 12:25:01.158121 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:25:01.159289 (+  1168us) log.cc:844] Serialized 11990 byte log entry
0709 12:25:02.961471 (+1802182us) op_driver.cc:464] REPLICATION: finished
0709 12:25:03.435929 (+474458us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335e9c1ef0
0709 12:25:04.677351 (+1241422us) write_op.cc:301] APPLY: starting
0709 12:25:04.682524 (+  5173us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:05.868159 (+1185635us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:05.868221 (+    62us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:06.389986 (+521765us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:06.390654 (+   668us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 12:25:06.390704 (+    50us) write_op.cc:312] APPLY: finished
0709 12:25:06.391439 (+   735us) log.cc:844] Serialized 268 byte log entry
0709 12:25:06.600100 (+208661us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:06.780303 (+180203us) write_op.cc:454] Released schema lock
0709 12:25:06.827089 (+ 46786us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:06.881903 (+ 54814us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:06.881948 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1008222,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1638253,"apply.run_cpu_time_us":87009,"apply.run_wall_time_us":2214232,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133893,"num_ops":31,"prepare.queue_time_us":1329364,"prepare.run_cpu_time_us":30057,"prepare.run_wall_time_us":452442,"raft.queue_time_us":761894,"raft.run_cpu_time_us":22095,"raft.run_wall_time_us":1371896,"replication_time_us":1803087,"spinlock_wait_cycles":364330240,"thread_start_us":3844821,"threads_started":5,"wal-append.queue_time_us":533232,"wal-append.run_cpu_time_us":40233,"wal-append.run_wall_time_us":3684986}]]}
I20260709 12:25:16.473836 24108 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.598202 18916 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:16.615530 24108 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.617650 18914 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:16.624264 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:16.512127 24121 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.566761 24200 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:16.611765 24191 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:16.646530 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 193280us
I20260709 12:25:16.618708 24111 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:16.633424 24102 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.670771 24221 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.671700 24221 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:16.674549 24187 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.367s	user 0.006s	sys 0.000s
I20260709 12:25:16.675295 24069 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.676213 24069 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.676978 23844 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:16.677680 24109 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:16.678323 24109 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:16.678958 24109 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:16.680858 24210 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:25:16.683226 24107 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.963s	user 0.006s	sys 0.019s
I20260709 12:25:16.683394 24135 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:16.683845 24107 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.684422 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:16.685824 18919 raft_consensus.cc:2410] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:16.686551 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:16.687224 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:16.688192 18919 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
W20260709 12:25:16.689055 24104 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.669s	user 0.017s	sys 0.006s
W20260709 12:25:16.689721 24100 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.019s
W20260709 12:25:16.674641 18920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.007s	sys 0.005s
W20260709 12:25:16.691227 18920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.008s	sys 0.005s
I20260709 12:25:16.683394 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:16.691332 18913 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.674113 24221 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.660248 24032 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.761617 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1110) took 1662 ms. Trace:
I20260709 12:25:16.762552 24020 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:16.763468 24237 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:25:16.763370 24020 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.690361 24100 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:16.765851 24100 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.768289 24109 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.769145 24142 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.689705 24104 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:16.770991 24109 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.771064 24197 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:16.674614 24095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.925s	user 0.011s	sys 0.014s
W20260709 12:25:16.722771 23799 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.006s	user 0.011s	sys 0.012s
I20260709 12:25:16.696354 24027 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.678031 24096 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 12:25:16.781611 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 93581.7us
I20260709 12:25:17.081386 24104 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.072764 23968 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:16.974617 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 297369us
I20260709 12:25:16.762107 18917 rpcz_store.cc:276] 0709 12:25:15.099419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.670673 (+571254us) service_pool.cc:224] Handling call
0709 12:25:16.542618 (+871945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.543090 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.543126 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.543190 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:16.543267 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.543355 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.761299 (+217944us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54003e6550. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:16.761427 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004218112}
I20260709 12:25:16.694831 24131 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:16.873283 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:16.862928 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.008167 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2600) took 1550 ms. Trace:
W20260709 12:25:17.095525 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 426323us
W20260709 12:25:16.796366 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 250800us
I20260709 12:25:17.102753 18914 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
W20260709 12:25:16.822222 24231 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:25:17.116652 24119 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.970s	user 0.009s	sys 0.013s
I20260709 12:25:17.117395 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.110625 23844 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:17.119055 23844 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:17.119900 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.117211 24119 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.121443 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:17.123126 24227 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:25:17.123610 24119 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.118248 18921 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:17.121461 23844 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.772917 23824 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:17.108807 24095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.360s	user 0.022s	sys 0.021s
I20260709 12:25:16.899407 24107 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.826939 24016 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.765852 24020 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:17.135670 24242 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:25:17.136425 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:17.073347 24185 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:16.872449 24121 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.103642 24131 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:17.071672 24200 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:16.694873 24111 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.099180 18915 rpcz_store.cc:276] 0709 12:25:15.458161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.789805 (+331644us) service_pool.cc:224] Handling call
0709 12:25:16.549155 (+759350us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b58001e5198. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:25:16.549479 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.578472 (+ 28993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.578504 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.579226 (+   722us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.639333 (+ 60107us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:16.639377 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.639447 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.994295 (+354848us) raft_consensus.cc:1685] finished
0709 12:25:16.994322 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.007958 (+ 13636us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4212,"raft.queue_time_us":22129,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":19628,"spinlock_wait_cycles":17234688,"thread_start_us":59647,"threads_started":1,"wal-append.queue_time_us":245231}
I20260709 12:25:16.820633 24213 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.528s
I20260709 12:25:17.175101 18913 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:17.163825 24100 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.175635 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 62661.1us
I20260709 12:25:17.114193 23799 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.167666 24131 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:17.198030 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 908) took 1183 ms. Trace:
I20260709 12:25:17.203773 18917 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:17.210506 24136 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.218772 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.219684 18919 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:17.223085 19485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 960) took 1749 ms (client timeout 1601 ms). Trace:
W20260709 12:25:17.223619 19485 rpcz_store.cc:269] 0709 12:25:15.473659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.527555 (+ 53896us) service_pool.cc:224] Handling call
0709 12:25:17.222787 (+1695232us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54004812d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:17.222967 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855269120}
I20260709 12:25:17.225911 24140 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.228173 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.228981 18919 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:17.230360 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1032) took 2391 ms. Trace:
I20260709 12:25:17.230949 19492 rpcz_store.cc:276] 0709 12:25:14.838791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.841084 (+  2293us) service_pool.cc:224] Handling call
0709 12:25:14.869420 (+ 28336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.813753 (+944333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.229710 (+1415957us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540080b954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:17.230095 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170048384}
I20260709 12:25:17.178123 24119 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:17.237015 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 51783.9us
W20260709 12:25:17.234738 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 536971us
W20260709 12:25:17.241636 18916 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
I20260709 12:25:17.242029 18916 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:17.243804 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.245684 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.247020 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.247715 18919 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:17.159814 24016 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.200508 24200 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:17.256785 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2586) took 2037 ms. Trace:
I20260709 12:25:17.255818 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.238229 24119 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.259060 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.256440 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.261011 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.257117 18922 rpcz_store.cc:276] 0709 12:25:15.060968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.614785 (+553817us) service_pool.cc:224] Handling call
0709 12:25:15.633677 (+ 18892us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:15.680864 (+ 47187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:15.680899 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:15.681654 (+   755us) log.cc:844] Serialized 78 byte log entry
0709 12:25:16.072939 (+391285us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:16.073050 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.073231 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.904040 (+830809us) raft_consensus.cc:1685] finished
0709 12:25:16.904065 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.096114 (+192049us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1290,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5723,"thread_start_us":351811,"threads_started":1,"wal-append.queue_time_us":969560}
I20260709 12:25:17.255579 24200 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.254511 23907 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:17.267422 19492 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 7.
I20260709 12:25:17.271502 18839 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:17.271713 24069 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.276629 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.280726 24203 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:17.281805 18915 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:17.281924 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.283128 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.284957 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.285473 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:17.285861 24232 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.759s	user 0.004s	sys 0.000s
I20260709 12:25:17.286602 24203 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.287563 24228 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.740s	user 0.002s	sys 0.000s
I20260709 12:25:17.288057 24135 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:17.288714 24135 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.290378 24142 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.290918 24142 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:17.291028 24117 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:17.291468 24142 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.291595 24117 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.293079 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.248486 24100 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.286226 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.265120 24119 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:17.287225 24203 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.292001 24117 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.202037 18848 rpcz_store.cc:276] 0709 12:25:15.779986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.791859 (+ 11873us) service_pool.cc:224] Handling call
0709 12:25:15.792294 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.792600 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:25:16.394274 (+601674us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.859318 (+465044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.949175 (+ 89857us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:16.963256 (+ 14081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.963398 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.963546 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231637,"prepare.queue_time_us":802310,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":88315,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"thread_start_us":401275,"threads_started":2,"wal-append.queue_time_us":224853}
I20260709 12:25:17.299532 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.272610 24200 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.306794 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.298197 24249 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:17.313069 24247 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.322814 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.313889 24033 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.298352 24018 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:17.323525 24247 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.324422 24018 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:17.315558 24136 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.316365 24055 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:25:17.321264 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1108) took 2222 ms. Trace:
I20260709 12:25:17.323587 18769 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
W20260709 12:25:17.324169 23812 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.000s
I20260709 12:25:17.314922 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.292151 24135 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:17.310654 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50302.7us
I20260709 12:25:17.326218 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.312214 18917 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:17.310503 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.313920 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:17.337569 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:17.324205 18886 connection.cc:256] RPC call timeout handler was delayed by -1.1279798779996781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:25:17.340723 18886 connection.cc:256] RPC call timeout handler was delayed by -1.0721798780000427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 12:25:17.329671 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.340164 19458 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.325461 24018 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.345100 18916 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 10: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:17.335148 18920 rpcz_store.cc:276] 0709 12:25:15.098765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.636938 (+538173us) service_pool.cc:224] Handling call
0709 12:25:15.650144 (+ 13206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:15.945492 (+295348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:15.945549 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:15.955611 (+ 10062us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.691646 (+736035us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:16.691701 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.320783 (+629082us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400180e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:17.320844 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.320897 (+    53us) raft_consensus.cc:1685] finished
0709 12:25:17.320911 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.321180 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677377280,"thread_start_us":735448,"threads_started":1,"wal-append.queue_time_us":704710}
I20260709 12:25:17.346254 18922 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:17.327502 24140 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:17.328409 24136 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.352483 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.335230 24249 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:17.353192 24222 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:17.355536 19491 raft_consensus.cc:1813] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:17.357153 19489 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:17.357882 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.358906 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.359198 24140 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:17.360390 24140 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.362044 24134 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.363086 18917 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.340380 23812 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.368758 19491 raft_consensus.cc:2368] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 13.
I20260709 12:25:17.336006 24096 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:25:17.371060 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.356122 24136 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.369257 23812 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:17.374344 23971 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.901s	user 0.010s	sys 0.003s
I20260709 12:25:17.374683 18922 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
W20260709 12:25:17.374969 24240 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:25:17.367292 24247 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.377161 24016 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.376786 24249 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.377978 18914 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:17.377918 24168 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:17.379689 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.389444 24018 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.392356 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.399569 18922 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
W20260709 12:25:17.393357 24038 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.865s	user 0.013s	sys 0.001s
I20260709 12:25:17.395644 24111 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.370142 24222 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:17.406369 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.401316 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.411105 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.411841 18914 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:17.413683 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:17.418462 24222 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.400730 24203 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:17.425287 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.418344 24243 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33726 (request call id 93) took 1785 ms. Trace:
I20260709 12:25:17.387421 24185 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:25:17.430954 18916 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.440280 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.383208 24213 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:25:17.416857 23799 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.427577 24243 rpcz_store.cc:276] 0709 12:25:15.637148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.651462 (+ 14314us) service_pool.cc:224] Handling call
0709 12:25:17.307418 (+1655956us) ts_tablet_manager.cc:1151] Deleting tablet 6c18380178684f0e93b10d0c7a912d02
0709 12:25:17.339007 (+ 31589us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:25:17.400008 (+ 61001us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":894256,"thread_start_us":172126,"threads_started":1}
I20260709 12:25:17.444669 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:17.448302 18887 connection.cc:256] RPC call timeout handler was delayed by -1.1026785600001858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:25:17.425642 24168 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:17.408007 24038 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.455958 18922 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 8.
I20260709 12:25:17.466786 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.467020 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.468393 18922 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:17.469749 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.475086 24168 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.475850 18770 raft_consensus.cc:2410] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:25:17.482463 18915 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:17.483771 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.484689 18915 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:17.485587 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.451643 24100 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.492873 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.493862 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.486384 18915 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:17.518536 18916 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:17.497344 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:17.496116 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 43624.3us
I20260709 12:25:17.499410 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:17.522631 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 165712us
I20260709 12:25:17.523865 18769 raft_consensus.cc:2368] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:17.494660 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:17.497843 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.493261 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.510625 18922 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:17.525255 18917 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:17.524756 18840 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.493460 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:17.516222 24181 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.991s	user 0.017s	sys 0.000s
I20260709 12:25:17.488638 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.510537 19458 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.496289 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.496711 24142 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.563266 18767 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:17.564007 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.564164 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.564947 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.498620 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.566534 18842 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:17.563818 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:17.493489 24016 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:25:17.566918 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57963.7us
I20260709 12:25:17.568903 18914 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:17.565580 18921 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:17.495754 24038 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.494946 24100 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:17.491124 24104 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:17.576362 24104 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.579027 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.492301 24119 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.580574 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.581811 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.570686 18918 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:17.583182 24104 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.578907 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:17.583678 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.584139 18844 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.583846 24016 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.584524 18771 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:17.585644 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.493662 24107 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:17.583074 24214 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.010s	sys 0.007s
I20260709 12:25:17.581920 24119 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.587137 18768 raft_consensus.cc:2368] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10.
I20260709 12:25:17.586825 24107 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.587723 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:17.588403 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.589244 24107 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.589674 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.590659 18845 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
W20260709 12:25:17.586843 24214 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.010s	sys 0.007s
I20260709 12:25:17.591598 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.592418 18843 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:17.491459 24191 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:17.593523 24191 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.509459 24117 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.594689 24247 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:17.595796 24247 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:17.583034 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.596710 24117 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.564630 18917 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:17.596932 24193 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:17.597617 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.597815 18844 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:17.598362 18772 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:17.598716 24203 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.598976 24096 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:17.599400 24096 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:17.599290 24203 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.599403 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.572710 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:17.601440 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.601966 24142 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.603060 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet 1485e54f9795416785f4baf244599201 with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45412
I20260709 12:25:17.490782 24121 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.498750 18656 catalog_manager.cc:5028] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): tablet 6c18380178684f0e93b10d0c7a912d02 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
W20260709 12:25:17.604434 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.569089 18848 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:17.605824 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:17.606806 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.611114 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.490895 24199 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:17.614198 18914 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:17.613415 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.586246 24016 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.622473 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:17.626171 18656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 127588us
I20260709 12:25:17.596345 24247 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:17.570577 24249 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:17.629127 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.598589 23971 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.633342 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.634258 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:17.635125 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.630470 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:17.632494 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.598595 24185 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:25:17.592444 24136 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:17.695508 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 115269us
I20260709 12:25:17.633169 24249 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:17.665071 18765 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:17.714146 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:17.715808 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 58218us
I20260709 12:25:17.628535 24096 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.720486 18916 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:17.645576 23971 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.724584 23844 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:25:17.643055 24131 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.716351 24249 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.749929 18848 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:17.751291 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.643338 24121 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.652654 24100 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:17.773170 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62405.3us
I20260709 12:25:17.777169 24020 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:17.675201 24199 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.789208 18840 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:17.796361 19485 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:17.726384 24210 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:25:17.801621 18916 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:17.804107 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.805576 24113 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:17.806456 24113 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:17.807839 24113 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.812358 24136 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:17.813402 24260 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:25:17.818657 24020 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:17.820930 24247 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.823587 24214 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:17.839149 24100 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.842573 18844 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:17.821964 24020 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.837980 24131 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:17.847777 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 52661.9us
I20260709 12:25:17.847954 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.871969 18845 raft_consensus.cc:2410] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:25:17.852784 24203 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:17.855280 24191 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.857571 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:17.859522 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2492) took 3735 ms (client timeout 1511 ms). Trace:
I20260709 12:25:17.842629 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.862987 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.864423 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.867465 18886 leader_election.cc:400] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:17.887377 18886 leader_election.cc:403] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:17.761590 24200 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:17.847913 18843 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: [11.7-12.8]
I20260709 12:25:17.879040 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.921947 18840 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:17.888962 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.891098 18844 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:25:17.885772 18839 rpcz_store.cc:269] 0709 12:25:14.124282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.266980 (+142698us) service_pool.cc:224] Handling call
0709 12:25:17.859152 (+3592172us) spinlock_profiling.cc:243] Waited 2.99 s on lock 0x7b5400238554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:17.859393 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6865997184}
I20260709 12:25:17.893800 24121 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:17.922879 18845 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:17.897128 24199 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:17.897967 18921 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:17.899770 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.899960 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.906886 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.907397 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.963186 18846 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:17.908268 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.913887 19492 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:17.915104 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.964412 18914 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:17.916324 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:17.917845 24096 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.918627 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:17.919425 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.919601 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:17.920264 18848 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:17.968719 18919 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.886178 18842 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:17.966570 18916 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:17.974733 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 107495us
I20260709 12:25:17.976339 18766 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:25:17.980012 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:17.983984 19489 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.975463 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.971769 19458 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.987543 18848 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:25:17.990067 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:17.990530 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.991045 18918 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:17.991679 18921 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:17.995946 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:17.986651 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:17.997845 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:17.998764 18914 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.000121 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:18.003007 18844 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:17.978508 23971 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:18.015616 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.017107 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.019173 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:18.019737 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:18.023542 18848 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:18.028825 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:18.031486 19485 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:17.972226 24193 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:25:18.039196 23812 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:18.039660 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.020848 24020 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:25:18.040345 18846 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:18.040635 24020 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:18.041041 24020 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:18.041471 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.042300 18846 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 9: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:18.043174 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.043730 18846 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:18.044534 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.045142 18846 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:18.045962 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:18.021883 24121 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:18.047019 24121 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.047534 24121 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:18.047761 24213 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:18.048336 24213 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:18.049490 24213 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.051252 24193 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:18.039690 23812 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:18.025204 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49818us
I20260709 12:25:17.987623 23824 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:18.058988 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.062844 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:18.063447 24261 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:25:18.062831 23756 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:18.127420 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.042070 24020 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.127388 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.076586 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:18.131688 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 410314us
I20260709 12:25:18.026295 23968 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:18.132102 18848 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:18.080941 18921 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:18.096282 24200 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:18.066028 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.046500 18846 raft_consensus.cc:2376] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13. Re-sending same reply.
I20260709 12:25:18.114750 24184 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:18.119717 18840 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:18.117236 18919 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:18.117769 18914 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:25:18.128569 18845 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:18.076186 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.137856 18843 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:18.139412 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.131484 18839 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:18.115572 24193 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:18.147315 18842 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:18.149333 18921 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:18.150478 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.151135 18915 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:18.154074 18844 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:18.154343 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.130672 24142 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.127763 24214 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:18.162295 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.163022 18843 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:18.145314 18848 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 12.
I20260709 12:25:18.129523 23756 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:18.141973 18916 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:18.167635 18839 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
I20260709 12:25:18.177847 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:18.178794 18840 raft_consensus.cc:1813] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:18.179364 18840 raft_consensus.cc:2368] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:25:18.179875 18844 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:18.184082 18843 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:25:18.184584 18843 pending_rounds.cc:85] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 6
I20260709 12:25:18.184856 18843 pending_rounds.cc:107] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:25:18.185151 18843 raft_consensus.cc:2889] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.188478 24193 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.162133 24142 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:18.170369 24020 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:18.160888 24184 consensus_queue.cc:1243] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:25:18.146314 24203 raft_consensus.cc:2764] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:18.192492 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:18.190557 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.205651 18845 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:18.206990 19489 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:18.199254 18846 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
W20260709 12:25:18.216324 18738 connection.cc:256] RPC call timeout handler was delayed by -2.8323346120000679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 12:25:18.173691 24213 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.190380 24193 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.219177 18842 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:18.191048 24268 tablet_replica.cc:333] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:25:18.223716 18886 leader_election.cc:400] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 13.
I20260709 12:25:18.231632 18886 leader_election.cc:403] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:18.228834 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 209784us
I20260709 12:25:18.228835 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.234026 19489 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:18.192224 24142 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.234973 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.236697 18773 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:18.233018 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:18.242976 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:18.252305 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:18.257342 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.259200 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.255745 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.264221 24191 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.264600 24181 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.267055 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.268409 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.270916 23812 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.271919 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:18.273037 23812 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.175120 24214 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.227345 24249 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.276315 24214 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:18.277001 24249 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:18.264057 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.267112 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.264674 24191 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.190318 24121 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.269539 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.284931 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:18.288676 18770 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:18.305761 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.250376 24199 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:18.306803 18766 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:18.311733 24016 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:18.312072 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.313187 18767 raft_consensus.cc:2368] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14.
I20260709 12:25:18.318477 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:18.293548 24191 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.327205 24100 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:18.327729 24100 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:18.327180 24185 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:18.328191 24100 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.331446 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.332775 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.333402 18765 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:18.341601 24200 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:18.312283 24016 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:18.342695 24016 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.314934 24199 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:18.346784 24199 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:18.347224 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.352260 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.342234 24200 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:18.350181 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.354185 24200 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.355614 24200 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:18.355796 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.357165 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.358434 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.361186 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.334255 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:18.367560 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.370844 18767 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:18.372112 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:18.373453 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.368085 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:18.369967 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:18.376804 18764 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:18.378147 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.379302 18764 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:18.375775 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:18.383410 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:18.385838 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:18.395646 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:18.392642 24200 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:18.381237 23824 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.406742 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:18.411616 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 43622.8us
I20260709 12:25:18.414809 24121 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:18.417297 24263 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.436206 24200 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:18.442341 24200 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:18.442080 24263 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.440081 23824 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:18.420861 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:18.444363 18773 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:18.444633 23824 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.444825 24263 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:18.421682 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:18.445585 19489 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:18.445923 18773 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:18.421375 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:18.446601 19491 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:18.446798 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:18.418215 18770 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:18.421375 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:18.425731 18766 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:18.448539 18766 pending_rounds.cc:85] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 12
I20260709 12:25:18.448812 18766 pending_rounds.cc:107] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:18.449065 18766 raft_consensus.cc:2889] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.427745 23756 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.429040 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.430425 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.450845 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.451376 19490 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:18.451731 19484 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.431217 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.452571 19483 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.433017 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:18.436152 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:18.459105 18764 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:18.460245 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:18.460541 24016 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.461797 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:18.462546 18919 raft_consensus.cc:2368] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9.
I20260709 12:25:18.463099 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.506633 18918 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:18.506877 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:18.508456 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:18.510257 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76351.6us
I20260709 12:25:18.470876 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:18.515159 18920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.047s	sys 0.065s
W20260709 12:25:18.516433 18920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.048s	sys 0.065s
I20260709 12:25:18.466572 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:18.521518 19485 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:18.523383 19489 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:18.529793 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 96879.8us
I20260709 12:25:18.528167 24038 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:18.531038 24038 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:18.531687 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:18.532303 24038 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.533313 18921 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:18.534830 23756 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.535459 24181 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 13.
I20260709 12:25:18.536971 18913 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:18.537003 19484 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
W20260709 12:25:18.545694 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 81379.6us
W20260709 12:25:18.570168 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 435954us
I20260709 12:25:18.573693 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:18.548703 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:18.577028 19458 leader_election.cc:400] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9.
I20260709 12:25:18.577486 19458 leader_election.cc:403] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:18.506943 23968 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:18.600417 23968 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.592427 24181 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:18.606817 24181 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:18.607028 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2605) took 1098 ms. Trace:
I20260709 12:25:18.607409 24181 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:18.607674 18917 rpcz_store.cc:276] 0709 12:25:17.508885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.065042 (+556157us) service_pool.cc:224] Handling call
0709 12:25:18.065523 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.066175 (+   652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.066222 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.090698 (+ 24476us) log.cc:844] Serialized 26 byte log entry
0709 12:25:18.454997 (+364299us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:18.455058 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.455155 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.606661 (+151506us) raft_consensus.cc:1685] finished
0709 12:25:18.606693 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.606938 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":534,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":185,"thread_start_us":363066,"threads_started":1,"wal-append.queue_time_us":492712}
I20260709 12:25:18.593122 18668 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.610585 24168 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 8. Current term is 9.
I20260709 12:25:18.611598 24168 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:18.611533 18668 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.613651 24168 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:18.595597 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:18.599031 24016 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:18.527062 23971 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:18.604931 18772 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:18.594251 24121 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:18.619235 19456 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.660s (SENT)
I20260709 12:25:18.614624 24274 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:18.617753 18767 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:18.547957 24268 raft_consensus.cc:2243] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.617228 23824 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.636147 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:18.650969 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 77364us
I20260709 12:25:18.578464 24020 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:18.652709 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:18.623162 18668 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 7 to 9, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 9 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:18.647527 24263 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:18.656875 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 335871us
I20260709 12:25:18.647871 24121 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:25:18.667173 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 348036us
I20260709 12:25:18.664000 19483 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:18.668996 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:18.695544 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.658222 24264 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:18.672686 24121 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.654999 24213 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:25:18.702558 24016 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:18.713021 18668 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 10 to 12, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 12 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.700865 24020 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:18.709789 24018 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:18.711280 24264 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:18.733191 24181 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:18.734856 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 153357us
W20260709 12:25:18.717963 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65337.7us
W20260709 12:25:18.742218 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.735554 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:18.751186 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.753283 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.759683 23971 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:18.760322 23971 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:18.764972 24016 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.765638 24016 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:18.766181 24016 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.746295 24264 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:18.772337 24142 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:25:18.773030 24142 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.775473 23824 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:18.775826 24181 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:18.771920 24200 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.783900 18765 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:18.789335 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.793116 18668 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:18.799250 18668 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 9 to 10, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 10 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.801708 24285 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:18.803229 23812 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.009s
I20260709 12:25:18.804032 24285 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:18.817111 19490 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
W20260709 12:25:18.821058 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 119768us
I20260709 12:25:18.807243 18668 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 5 to 6, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 6 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:18.798009 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 196357us
W20260709 12:25:18.806596 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 274974us
I20260709 12:25:18.829493 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:18.806041 24270 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:25:18.805771 23844 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:18.862108 23844 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:18.867154 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:18.875250 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.876232 24200 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:18.870119 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1130) took 1369 ms. Trace:
I20260709 12:25:18.882974 18922 rpcz_store.cc:276] 0709 12:25:17.500338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.031351 (+531013us) service_pool.cc:224] Handling call
0709 12:25:18.121450 (+ 90099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.121873 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:25:18.153208 (+ 31335us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.344843 (+191635us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b1800459b20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:25:18.869483 (+524640us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b1800459b20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287
0709 12:25:18.869716 (+   233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.869783 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:18.869839 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.869920 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.870051 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26746,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":85273,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5271,"spinlock_wait_cycles":72885760,"thread_start_us":430543,"threads_started":2,"wal-append.queue_time_us":597906}
I20260709 12:25:18.810942 24100 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.858341 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2728) took 1131 ms. Trace:
I20260709 12:25:18.814085 24268 raft_consensus.cc:2272] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.804581 24285 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:18.806527 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:25:18.912912 19484 raft_consensus.cc:606] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:18.845304 24184 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:25:18.880131 24193 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:18.855500 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120013us
I20260709 12:25:18.808528 24264 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.806742 24020 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.907126 24278 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:18.896849 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:18.856304 24191 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.907743 18841 rpcz_store.cc:276] 0709 12:25:17.726965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.755689 (+ 28724us) service_pool.cc:224] Handling call
0709 12:25:17.798600 (+ 42911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.853018 (+ 54418us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:17.963849 (+110831us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.749227 (+785378us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.857772 (+108545us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.857876 (+   104us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:18.857945 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.858042 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.858256 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":335536,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":193697,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"thread_start_us":999099,"threads_started":5,"wal-append.queue_time_us":762019}
I20260709 12:25:18.920461 18668 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:18.940973 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1128) took 1546 ms. Trace:
I20260709 12:25:18.941422 18920 rpcz_store.cc:276] 0709 12:25:17.394924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.858353 (+463429us) service_pool.cc:224] Handling call
0709 12:25:17.902800 (+ 44447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.903241 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.903273 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.903839 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:25:18.517844 (+614005us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:18.517917 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.518035 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.940739 (+422704us) raft_consensus.cc:1685] finished
0709 12:25:18.940761 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.940908 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15883,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":125,"thread_start_us":613439,"threads_started":1,"wal-append.queue_time_us":806176}
I20260709 12:25:18.959105 24285 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.963788 24286 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:18.965615 19486 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:18.969398 24142 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:18.938426 24193 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.980984 24193 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:18.940233 24199 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.004s
I20260709 12:25:18.981112 23844 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:18.981911 24199 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:18.982517 18668 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:19.002781 24264 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:19.005177 23844 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:19.006206 18668 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 5 to 9, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 9 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:19.035202 19456 leader_election.cc:336] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.537s (SENT)
I20260709 12:25:19.013341 24268 ts_tablet_manager.cc:1916] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:18.950018 24018 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
W20260709 12:25:19.064661 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 197578us
I20260709 12:25:19.065028 18920 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:19.058918 24193 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
W20260709 12:25:19.076625 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.541s (SENT)
I20260709 12:25:19.101007 24016 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:19.107856 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:19.063634 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 176345us
W20260709 12:25:19.106727 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 182110us
I20260709 12:25:19.112051 24309 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:19.107843 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:19.112761 24193 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:19.114603 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:19.114559 24309 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:19.117856 24297 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:19.117924 24309 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:19.118556 24297 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:19.119901 19456 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.591s (SENT)
W20260709 12:25:19.120635 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51611.8us
I20260709 12:25:19.121465 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:19.121733 24273 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:19.080818 24191 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:19.122721 24273 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:19.123013 24310 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:19.123674 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:19.119599 24297 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:19.129163 24200 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:19.129475 24309 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:19.129992 24185 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.130736 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:19.131552 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.131966 24203 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:19.132485 24203 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:19.132898 24203 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.124137 24016 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:19.114236 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:19.138252 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:19.137326 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:19.143373 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:19.146165 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:19.146986 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:19.149087 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.149678 18921 raft_consensus.cc:2376] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12. Re-sending same reply.
I20260709 12:25:19.137925 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:19.151902 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.157644 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.161760 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.162570 18915 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.165113 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:19.171808 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.171705 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.172559 18918 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:19.117350 24193 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:19.186050 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:19.179489 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.134279 24199 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:19.152572 18921 raft_consensus.cc:2376] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13. Re-sending same reply.
I20260709 12:25:19.216364 24121 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:19.161829 23824 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:19.158661 24290 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:19.231361 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:19.179033 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.210259 18914 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:19.159158 24296 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:19.234776 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.173134 24229 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:19.236958 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 51007.2us
W20260709 12:25:19.236321 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 98459us
I20260709 12:25:19.238242 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.229763 23824 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:19.185724 24285 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:19.246042 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:19.247448 18772 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:19.247975 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.271225 18921 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:19.187049 24142 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.276087 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.246227 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:19.277372 18772 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:19.271632 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.171783 24181 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:25:19.230852 24309 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:19.289496 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.237607 24264 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.305620 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 59704.1us
W20260709 12:25:19.307072 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.313242 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.306445 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.247041 24278 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:19.328917 18914 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:19.291569 24277 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:25:19.323086 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.340387 18842 raft_consensus.cc:2410] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:25:19.324265 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.237151 24296 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:19.269688 23824 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.327612 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.277581 24293 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.322892 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.331032 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.336642 18768 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:19.337354 18841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:25:19.344460 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.348380 18764 raft_consensus.cc:2376] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13. Re-sending same reply.
I20260709 12:25:19.349402 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.354534 18841 raft_consensus.cc:606] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:19.355170 18841 raft_consensus.cc:614] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:19.355355 18769 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:19.358040 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:19.354589 18766 raft_consensus.cc:2376] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16. Re-sending same reply.
I20260709 12:25:19.361013 18771 raft_consensus.cc:2368] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
W20260709 12:25:19.361382 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 115237us
I20260709 12:25:19.361686 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.362321 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:19.363220 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.364012 18772 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:19.365023 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.359014 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:19.366238 18844 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:19.369830 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.370673 18765 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:25:19.345341 24264 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:19.374825 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.359905 24168 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:19.376125 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.376576 24264 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:19.377326 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.328440 24285 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:19.392230 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:19.392462 24285 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:19.378306 18772 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:19.395238 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.378662 18921 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:19.384315 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.385754 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.356698 24296 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:19.386494 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.387187 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.387878 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:19.388347 24311 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:25:19.388942 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.390451 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:19.391492 24301 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:19.427543 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:19.398082 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.400671 18766 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:19.396577 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.400738 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.402410 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:19.321200 23756 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:19.406139 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.436729 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.437155 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.437626 18840 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:19.437778 18772 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:19.438776 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.400811 18915 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:19.408813 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:19.441045 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:19.442579 18915 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:19.416347 18769 raft_consensus.cc:2410] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:25:19.434969 18914 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:19.442708 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.444993 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.443691 18842 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:19.358292 24278 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:19.455849 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.456799 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:19.460311 18914 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:19.458010 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:19.462631 18915 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:19.464258 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.464466 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:19.465180 18839 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:19.466114 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.467367 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.467914 18915 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:19.408946 23971 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.648s	user 0.014s	sys 0.000s
I20260709 12:25:19.469578 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.478873 18766 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:19.483122 18915 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:19.483779 18921 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:19.483021 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80751.5us
I20260709 12:25:19.414997 24121 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:19.491377 18844 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:19.491504 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.491731 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.496043 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:19.496608 18840 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:19.346268 24193 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:19.393671 24285 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:19.496124 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.487798 18915 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:19.499213 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.465590 24273 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:19.369307 24293 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:19.597705 18887 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.537s (SENT)
I20260709 12:25:19.759385 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.809803 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:19.802567 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.599931 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 113606us
I20260709 12:25:19.627086 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.501564 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.689765 18772 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:19.813702 18766 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:19.626660 18842 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:19.695760 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:19.819533 18844 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 12:25:19.620610 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 211881us
I20260709 12:25:19.820530 18840 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:25:19.822436 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.818466 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:19.830090 18768 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:19.830091 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:19.631585 24313 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
W20260709 12:25:19.831171 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.702917 24308 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.327s	user 0.000s	sys 0.004s
I20260709 12:25:19.839943 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:19.775417 24301 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:25:19.829668 24316 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:25:19.837024 18921 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:19.760788 24310 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.837976 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:19.839039 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 241387us
I20260709 12:25:19.873370 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:19.873966 18887 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.551s (SENT)
I20260709 12:25:19.496636 24307 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:19.877012 24307 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:19.872766 24278 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:19.877547 24307 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:19.877800 24322 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:19.842665 24318 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.885448 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:19.810124 24273 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:19.887871 24273 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.889163 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.889906 18839 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:19.891428 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:19.843315 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:19.893640 18840 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:19.600939 23756 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:19.774932 24193 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.896946 23756 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:19.897394 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.894622 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:19.899024 24319 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:25:19.892957 18839 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:19.866513 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 474387us
I20260709 12:25:19.621286 24321 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:19.841140 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.483665 23971 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:19.900108 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:19.900727 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.901187 18886 leader_election.cc:400] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:25:19.876523 18766 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:19.901552 18886 leader_election.cc:403] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:19.841195 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:19.902323 23971 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:19.902879 18844 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:19.903112 23971 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:19.903539 23971 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.903899 23971 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:19.904052 18844 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:19.874679 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.653s (SENT)
W20260709 12:25:19.905620 18887 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.670s (SENT)
I20260709 12:25:19.906044 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:19.902364 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.898953 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.900933 18917 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:19.875926 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1148) took 1034 ms. Trace:
I20260709 12:25:19.901559 18765 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:19.907521 18840 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:19.908592 18913 rpcz_store.cc:276] 0709 12:25:18.841327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.841488 (+   161us) service_pool.cc:224] Handling call
0709 12:25:18.857488 (+ 16000us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.865573 (+  8085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.865603 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.897516 (+ 31913us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.151211 (+253695us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:19.151283 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.151398 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.394220 (+242822us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:19.840875 (+446655us) raft_consensus.cc:1685] finished
0709 12:25:19.840899 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.875856 (+ 34957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11513,"raft.queue_time_us":22989,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":19874,"spinlock_wait_cycles":28249472,"thread_start_us":200938,"threads_started":1,"wal-append.queue_time_us":373931}
I20260709 12:25:19.840883 24264 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.930683 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:19.831506 24168 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
W20260709 12:25:19.907876 24314 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.519s	user 0.001s	sys 0.001s
W20260709 12:25:19.907275 24312 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 12:25:19.831632 24229 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 12:25:19.954624 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:19.959053 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:19.962733 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:19.964164 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.670s (SENT)
W20260709 12:25:19.977407 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.740s (SENT)
I20260709 12:25:19.977847 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:19.915489 24324 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.976660 18768 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
W20260709 12:25:19.981105 18918 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.000s
I20260709 12:25:19.981475 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:19.986253 18918 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:19.987340 18914 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:25:19.990989 18918 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:19.995076 24328 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
W20260709 12:25:19.996284 24326 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:25:19.996763 24295 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:20.005895 24296 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.000s
I20260709 12:25:19.967430 24264 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:19.906816 24310 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:20.060240 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 159174us
I20260709 12:25:20.008469 24191 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:20.010897 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1147) took 1172 ms. Trace:
I20260709 12:25:20.075762 18919 rpcz_store.cc:276] 0709 12:25:18.838864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.839044 (+   180us) service_pool.cc:224] Handling call
0709 12:25:18.839537 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.843824 (+  4287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.843869 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.861920 (+ 18051us) log.cc:844] Serialized 26 byte log entry
0709 12:25:18.949098 (+ 87178us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b18001a9440. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:25:19.138769 (+189671us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:19.138810 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.138885 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.010530 (+871645us) raft_consensus.cc:1685] finished
0709 12:25:20.010554 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.010818 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3732,"raft.queue_time_us":4429,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6796,"spinlock_wait_cycles":15758208,"thread_start_us":189457,"threads_started":1,"wal-append.queue_time_us":515899}
I20260709 12:25:20.018262 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:20.020493 18842 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:20.021492 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:20.021927 18839 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:20.118194 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:20.119486 18844 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:20.031620 24263 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:20.109349 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.031157 24295 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:20.116010 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:20.091780 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 262083us
W20260709 12:25:20.117781 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 71044.9us
W20260709 12:25:20.121085 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 102925us
I20260709 12:25:20.128065 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:20.128490 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 257454us
W20260709 12:25:20.121858 18738 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.771s (SENT) [suppressed 68 similar messages]
I20260709 12:25:20.075577 24191 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:20.136499 18772 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:20.143589 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:20.144498 18839 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:20.145478 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 168097us
W20260709 12:25:20.146203 18887 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.779s (SENT)
I20260709 12:25:20.146602 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:20.149307 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:20.150022 18768 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:20.117300 24328 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:20.155961 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:20.157025 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.159183 18842 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:20.062085 24296 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.133272 24295 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:20.123107 24324 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:20.160871 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44937.4us
I20260709 12:25:20.160830 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.168187 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:20.168769 18839 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:20.168195 18886 leader_election.cc:400] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:20.143955 24191 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:20.172086 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:20.161761 24185 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.031s	user 0.008s	sys 0.006s
I20260709 12:25:20.157557 24334 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.211052 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:20.211896 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43840.7us
I20260709 12:25:20.218631 18768 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:20.219116 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:20.213680 18847 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:20.216045 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 84354us
W20260709 12:25:20.227396 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93786us
I20260709 12:25:20.229842 19486 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:20.191140 24185 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.240106 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:20.210235 24100 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:20.242910 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:20.243826 18768 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:20.180914 24333 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:25:20.252948 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.231350 24324 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:20.256168 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:20.257608 18768 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
W20260709 12:25:20.259806 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82115.8us
I20260709 12:25:20.259085 24229 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:20.280376 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1153) took 1146 ms. Trace:
I20260709 12:25:20.260890 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:20.271309 23844 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.265s	user 0.014s	sys 0.000s
I20260709 12:25:20.283180 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:20.245075 24342 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:20.281306 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 150739us
I20260709 12:25:20.281577 18920 rpcz_store.cc:276] 0709 12:25:19.133701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.133944 (+   243us) service_pool.cc:224] Handling call
0709 12:25:19.164138 (+ 30194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.893553 (+729415us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18001a9500. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af83bfb 00007f335af8e64b
0709 12:25:19.893733 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:19.893765 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:19.894371 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 12:25:20.122055 (+227684us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:20.122109 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.122197 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.276679 (+154482us) raft_consensus.cc:1685] finished
0709 12:25:20.276698 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.280265 (+  3567us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58114,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5545,"spinlock_wait_cycles":31155072,"thread_start_us":284583,"threads_started":2,"wal-append.queue_time_us":279852}
W20260709 12:25:20.293448 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74462.7us
I20260709 12:25:20.294473 24333 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:20.294893 24264 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.295959 24345 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:20.302985 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:20.271102 24310 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:20.272356 24332 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.289584 24334 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.292613 24229 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:20.281363 24113 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:25:20.297259 24348 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:20.326458 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 204618us
I20260709 12:25:20.305970 24345 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:20.259904 24336 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:25:20.305574 24333 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:20.334798 18920 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:20.337345 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.335932 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.261066 24324 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.321885 24342 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:20.338001 18847 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:20.342918 18842 raft_consensus.cc:2368] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13.
W20260709 12:25:20.340721 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.335527 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 201807us
I20260709 12:25:20.341773 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:20.304600 23844 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:25:20.332547 24345 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:20.340355 24333 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:20.372535 18842 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:25:20.393558 18887 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.866s (SENT)
W20260709 12:25:20.394284 18887 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.791s (SENT)
I20260709 12:25:20.394344 24229 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:20.395190 18842 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:20.401001 18887 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.878s (SENT)
I20260709 12:25:20.401463 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:20.367442 24264 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:20.379520 23756 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.376832 24309 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:20.406776 18842 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:20.396167 24342 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:20.438162 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 96504.1us
I20260709 12:25:20.326731 24334 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.397205 24353 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.399688 24352 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:20.397855 24296 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.337013 24348 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.423411 24310 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.447484 24353 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.448462 24340 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.449414 24361 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:20.452198 24341 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:25:20.453116 24338 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:25:20.453965 24335 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:25:20.515580 24293 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.454669 24367 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:20.516819 24367 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.520340 24353 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:20.521159 24367 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:20.458665 24351 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:25:20.459349 18773 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:20.461987 18844 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:20.462451 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.523617 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.523949 18844 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:20.525326 18844 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:20.463126 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 62188.2us
I20260709 12:25:20.526849 24355 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:20.528151 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1154) took 1391 ms. Trace:
I20260709 12:25:20.437503 24229 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.528671 18922 rpcz_store.cc:276] 0709 12:25:19.136367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.136589 (+   222us) service_pool.cc:224] Handling call
0709 12:25:19.166273 (+ 29684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.166568 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:25:19.322641 (+156073us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.527556 (+1204915us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b180014b480. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287
0709 12:25:20.527699 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.527763 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:20.527826 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.527918 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.528072 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":247798,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":161540,"spinlock_wait_cycles":20194432,"thread_start_us":266112,"threads_started":2}
I20260709 12:25:20.472198 24328 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.532589 24328 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.535211 24328 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.472484 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:20.440860 23756 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.536800 24348 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.538977 23756 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.539611 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2504) took 1244 ms. Trace:
W20260709 12:25:20.475732 24193 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.003s
I20260709 12:25:20.540055 18846 rpcz_store.cc:276] 0709 12:25:19.294777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.295169 (+   392us) service_pool.cc:224] Handling call
0709 12:25:19.335651 (+ 40482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.368929 (+ 33278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:19.368959 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:19.385161 (+ 16202us) log.cc:844] Serialized 26 byte log entry
0709 12:25:20.297068 (+911907us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800147580. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:25:20.373268 (+ 76200us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:20.373316 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.373400 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.539315 (+165915us) raft_consensus.cc:1685] finished
0709 12:25:20.539336 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.539547 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8071,"raft.queue_time_us":28597,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":46799,"spinlock_wait_cycles":31352064,"thread_start_us":75957,"threads_started":1,"wal-append.queue_time_us":1127359}
I20260709 12:25:20.550277 18767 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:20.550864 18767 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:20.551669 18767 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.550300 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:20.553253 18918 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:20.477149 24345 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:20.555728 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46032.4us
I20260709 12:25:20.553534 18841 raft_consensus.cc:2376] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11. Re-sending same reply.
W20260709 12:25:20.485381 24273 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.002s
I20260709 12:25:20.487140 23844 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.490216 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2612) took 1324 ms. Trace:
W20260709 12:25:20.490784 24307 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.001s
I20260709 12:25:20.491361 18842 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:25:20.492043 23971 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.007s
W20260709 12:25:20.493707 23824 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.097s	user 0.010s	sys 0.003s
I20260709 12:25:20.494516 18771 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:20.441210 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:20.449893 24264 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.503569 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2621) took 1128 ms. Trace:
W20260709 12:25:20.570314 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 97958.7us
I20260709 12:25:20.563122 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.475836 24333 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.554633 18844 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:25:20.469856 24295 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.555948 18767 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:20.480867 24203 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.347s	user 0.014s	sys 0.000s
I20260709 12:25:20.528158 24355 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:20.481851 24354 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:20.584053 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.558815 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.559660 18769 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:20.556141 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:20.560737 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2624) took 1184 ms. Trace:
I20260709 12:25:20.560547 18914 rpcz_store.cc:276] 0709 12:25:19.166136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.461263 (+295127us) service_pool.cc:224] Handling call
0709 12:25:19.987000 (+525737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.987827 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.489938 (+502111us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400334d50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:20.490131 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207984512}
I20260709 12:25:20.562076 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2622) took 1186 ms. Trace:
I20260709 12:25:20.563445 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:20.564354 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.896s (SENT)
I20260709 12:25:20.551812 24363 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:20.570279 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:20.571473 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:20.574064 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 132924us
I20260709 12:25:20.618021 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:20.575418 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.511013 24310 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.623819 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 955) took 1335 ms. Trace:
I20260709 12:25:20.624258 18770 rpcz_store.cc:276] 0709 12:25:19.288492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.305089 (+ 16597us) service_pool.cc:224] Handling call
0709 12:25:19.344965 (+ 39876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.358513 (+ 13548us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:19.368541 (+ 10028us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.521037 (+1152496us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b18000897a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:25:20.623482 (+102445us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.623540 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:20.623588 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.623654 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.623760 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10015,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":7217,"spinlock_wait_cycles":6535424,"thread_start_us":102192,"threads_started":1}
W20260709 12:25:20.626725 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55337.9us
I20260709 12:25:20.627192 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 952) took 1339 ms. Trace:
I20260709 12:25:20.627447 18842 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:20.628675 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:20.577327 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:20.570209 18915 rpcz_store.cc:276] 0709 12:25:19.375598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.822286 (+446688us) service_pool.cc:224] Handling call
0709 12:25:19.822655 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.822918 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:19.833701 (+ 10783us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.344482 (+510781us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.501571 (+157089us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.503177 (+  1606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.503243 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:20.503294 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.503365 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.503501 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35343,"prepare.queue_time_us":11131,"prepare.run_cpu_time_us":172,"prepare.run_wall_time_us":10584,"raft.queue_time_us":193518,"raft.run_cpu_time_us":604,"raft.run_wall_time_us":47525,"thread_start_us":643633,"threads_started":3,"wal-append.queue_time_us":439870}
W20260709 12:25:20.558611 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 247353us
I20260709 12:25:20.616940 18916 rpcz_store.cc:276] 0709 12:25:19.375889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.879464 (+503575us) service_pool.cc:224] Handling call
0709 12:25:19.879770 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.879984 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:20.032086 (+152102us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.337325 (+305239us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.339236 (+  1911us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.559093 (+219857us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.561626 (+  2533us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.561707 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:20.561777 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.561863 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.562005 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82983,"prepare.queue_time_us":83678,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":14911,"raft.queue_time_us":244461,"raft.run_cpu_time_us":675,"raft.run_wall_time_us":39098,"spinlock_wait_cycles":5035392,"thread_start_us":583006,"threads_started":4,"wal-append.queue_time_us":157428}
I20260709 12:25:20.628742 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:20.632043 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54831.7us
I20260709 12:25:20.583380 24181 raft_consensus.cc:2764] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:20.619220 18913 rpcz_store.cc:276] 0709 12:25:19.376453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.975548 (+599095us) service_pool.cc:224] Handling call
0709 12:25:19.984465 (+  8917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.984755 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:20.060790 (+ 76035us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.560376 (+499586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.560431 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:20.560490 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.560558 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.560681 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8679,"prepare.queue_time_us":136576,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":102575,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":442797,"threads_started":2,"wal-append.queue_time_us":337076}
I20260709 12:25:20.636250 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.586067 24285 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:20.639223 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.640442 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.505662 24352 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.616472 24355 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:20.564775 24367 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 12:25:20.643078 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.638064 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:20.644062 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.647851 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:20.633791 24096 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:25:20.563854 24273 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.620994 24348 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:20.570102 24307 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.630653 24345 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:20.654484 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:20.656479 18846 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:20.585367 24353 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:25:20.573416 23971 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.571014 23844 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.655220 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:20.690460 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:20.668239 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.658177 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.634812 24309 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:20.700018 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:20.700317 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71706.3us
I20260709 12:25:20.701376 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.573731 23824 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.633460 24333 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.633641 24193 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:20.681752 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:20.683727 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45615.3us
I20260709 12:25:20.684352 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.685539 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.687376 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:20.644996 24321 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.615607 24203 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.643533 24285 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:20.645068 24337 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:20.691308 19490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:25:20.641285 23756 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:25:20.701886 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:20.705312 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.709836 18764 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:20.704300 18920 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:20.712149 18842 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:20.711735 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56571us
I20260709 12:25:20.714699 18848 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:20.715606 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:20.704059 23824 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.716048 23971 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:20.718956 24296 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:20.720011 24307 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:20.692088 24373 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:20.690944 24100 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:20.644799 24016 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:20.722680 24193 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.723417 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:20.725145 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:20.702181 24343 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:20.681874 24229 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:20.724341 18843 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:20.769970 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.777343 18919 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:20.777660 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:20.777856 18916 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:20.777789 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.778358 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:20.773769 19490 raft_consensus.cc:606] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:20.773972 24285 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.789700 24371 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:25:20.791051 24191 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.005s
I20260709 12:25:20.773538 24309 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:20.793609 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 91789.8us
W20260709 12:25:20.794587 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 71273.4us
I20260709 12:25:20.767443 24268 ts_tablet_manager.cc:1929] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.4
I20260709 12:25:20.779359 24337 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:20.800949 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:20.801306 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:20.806962 24278 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:20.808573 24203 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.809157 24286 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.809587 24100 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:20.832491 24100 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.833274 24264 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.804193 23756 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:20.834736 23756 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.835242 23756 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:20.811630 24273 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:20.781216 24131 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:25:20.818374 24352 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.815694 24371 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:25:20.820621 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 95552.6us
I20260709 12:25:20.844413 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:20.845245 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:20.774246 24321 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.846813 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2618) took 1489 ms. Trace:
I20260709 12:25:20.798573 24348 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.847249 18921 rpcz_store.cc:276] 0709 12:25:19.357824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.484604 (+126780us) service_pool.cc:224] Handling call
0709 12:25:19.484885 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.870232 (+385347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.845844 (+975612us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400032fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:20.846740 (+   896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809356544}
W20260709 12:25:20.828423 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.830498 24268 log.cc:1199] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/1485e54f9795416785f4baf244599201
I20260709 12:25:20.831009 24369 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:20.837059 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.822702 24327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.004s	sys 0.008s
W20260709 12:25:20.855897 24327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.004s	sys 0.008s
I20260709 12:25:20.787636 24296 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:20.856763 24321 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:20.826989 24247 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:20.857784 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:20.857582 24309 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.863632 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2245) took 1476 ms. Trace:
I20260709 12:25:20.863407 24371 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.864038 18769 rpcz_store.cc:276] 0709 12:25:19.387550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.500300 (+112750us) service_pool.cc:224] Handling call
0709 12:25:20.863408 (+1363108us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400179dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:20.863534 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673652480}
I20260709 12:25:20.864887 24371 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:20.865412 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.866467 24334 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.868146 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2258) took 1036 ms. Trace:
I20260709 12:25:20.867753 24337 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.868701 18764 rpcz_store.cc:276] 0709 12:25:19.831510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.838708 (+  7198us) service_pool.cc:224] Handling call
0709 12:25:20.867895 (+1029187us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b540017a2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:20.868080 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921488128}
I20260709 12:25:20.870918 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.871609 18769 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.872759 19484 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:20.873929 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.875156 24168 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:20.875650 24168 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:20.876554 24268 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45412 (request call id 0) took 3275 ms. Trace:
I20260709 12:25:20.876721 24168 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.877120 24268 rpcz_store.cc:276] 0709 12:25:17.601353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.602683 (+  1330us) service_pool.cc:224] Handling call
0709 12:25:18.177060 (+574377us) ts_tablet_manager.cc:1151] Deleting tablet 1485e54f9795416785f4baf244599201
0709 12:25:18.190546 (+ 13486us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:25:18.813477 (+622931us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000343d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af93362 00007f335e97e34c 00007f335ffa160a 00007f335ffd22d0 00007f335ffb883d 00007f335ffb87e9 00007f335ffb8779 00007f335ffb8741 00007f335ffb796d 0000000000388634
0709 12:25:20.252029 (+1438552us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:20.696815 (+444786us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:20.876456 (+179641us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600369024,"tablet-delete.queue_time_us":551724,"thread_start_us":413045,"threads_started":1}
I20260709 12:25:20.878603 19483 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:20.839481 24278 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:20.840672 24038 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.884861 18768 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:20.879725 19489 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:20.874951 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:20.850068 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.870026 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.881542 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:20.875015 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1152) took 1767 ms. Trace:
I20260709 12:25:20.889200 18917 rpcz_store.cc:276] 0709 12:25:19.107843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.108035 (+   192us) service_pool.cc:224] Handling call
0709 12:25:19.108389 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.907894 (+799505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.874761 (+966867us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:20.874945 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822115072}
I20260709 12:25:20.891891 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:20.892066 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70051.1us
I20260709 12:25:20.896422 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:20.827556 24191 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.899315 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:20.900136 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:20.906826 19491 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:25:20.907150 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:20.784641 24355 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.909022 24324 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:20.910993 24263 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:20.911449 24263 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:20.912328 24263 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.913462 24263 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.915782 23844 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.916191 24191 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:20.917047 24191 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.627552 18767 rpcz_store.cc:276] 0709 12:25:19.287483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.287667 (+   184us) service_pool.cc:224] Handling call
0709 12:25:19.287964 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.550170 (+1262206us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b540038c5a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8d1c0 00007f335af8e231 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c
0709 12:25:20.626744 (+ 76574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.626781 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.626829 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:20.626866 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.626997 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.627131 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"spinlock_wait_cycles":38008192}
I20260709 12:25:20.857585 24296 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.920922 24184 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:20.921440 24184 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:20.900913 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:20.919610 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.902050 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:20.905206 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:20.901780 24348 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:20.923688 19483 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:20.924415 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:20.925603 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.933068 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:20.891673 24016 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.940603 18769 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:20.942896 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:20.940883 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.943598 19488 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:20.941802 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:20.944361 18765 raft_consensus.cc:2376] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16. Re-sending same reply.
I20260709 12:25:20.943624 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:20.949816 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44658.6us
I20260709 12:25:20.950804 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:20.951586 18767 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:20.955699 24386 raft_consensus.cc:2764] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:20.956555 24386 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:20.957134 24386 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.922410 24184 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.959127 24184 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.967214 23844 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:20.967820 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:20.968730 24333 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:20.968834 24020 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.969201 24333 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:20.969339 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:20.942158 24324 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:20.970120 24333 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:20.970633 24020 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:20.970872 24324 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.971143 24020 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.971437 24324 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.971556 24333 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:20.971586 24020 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:20.975024 18771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2251) took 1585 ms (client timeout 1750 ms). Trace:
I20260709 12:25:20.952684 24348 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:20.975513 18771 rpcz_store.cc:269] 0709 12:25:19.389461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.396319 (+  6858us) service_pool.cc:224] Handling call
0709 12:25:20.974803 (+1578484us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54002a0b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:20.974951 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889487232}
I20260709 12:25:20.976328 24348 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.976917 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:20.977952 18766 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:20.978680 18773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 956) took 1689 ms (client timeout 2030 ms). Trace:
W20260709 12:25:20.978820 18845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 921) took 1646 ms (client timeout 1640 ms). Trace:
W20260709 12:25:20.979101 18773 rpcz_store.cc:269] 0709 12:25:19.288804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.289220 (+   416us) service_pool.cc:224] Handling call
0709 12:25:20.978487 (+1689267us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001793d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:20.978615 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676330880}
W20260709 12:25:20.979162 18845 rpcz_store.cc:269] 0709 12:25:19.332456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.399318 (+ 66862us) service_pool.cc:224] Handling call
0709 12:25:20.978615 (+1579297us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400381154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:20.978742 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696055040}
I20260709 12:25:20.980383 18840 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:20.981793 24016 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:20.980427 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2811) took 1648 ms. Trace:
I20260709 12:25:20.982664 18766 rpcz_store.cc:276] 0709 12:25:19.332450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.929824 (+597374us) service_pool.cc:224] Handling call
0709 12:25:20.977746 (+1047922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.978420 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.980192 (+  1772us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002a0b50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:20.980355 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338267904}
I20260709 12:25:20.983573 24278 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:20.985320 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1156) took 1156 ms. Trace:
I20260709 12:25:20.985785 18919 rpcz_store.cc:276] 0709 12:25:19.828892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.115996 (+287104us) service_pool.cc:224] Handling call
0709 12:25:20.141271 (+ 25275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.798101 (+656830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.985054 (+186953us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54003b4054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:20.985250 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462317952}
I20260709 12:25:20.992138 18914 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:20.989135 18738 leader_election.cc:400] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13.
I20260709 12:25:20.993247 18738 leader_election.cc:403] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:20.996101 18915 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:20.997874 18914 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:21.008183 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:21.009176 18765 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:21.003304 23968 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:25:20.980487 24285 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.007207 23844 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13.
I20260709 12:25:21.013908 23968 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:20.994099 24191 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:21.014470 23968 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:21.005734 24016 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.008193 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:21.033263 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.038256 18769 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.043668 18847 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:25:21.042711 19456 leader_election.cc:336] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.030s (SENT)
I20260709 12:25:21.031538 24309 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:21.067431 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78431.8us
I20260709 12:25:21.071287 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:21.072096 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 121381us
I20260709 12:25:21.074038 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:21.074116 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.082329 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.035030 24020 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.086666 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.088740 18848 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:21.089406 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:21.090847 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:21.046448 24016 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.094691 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:21.095058 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:21.096414 18847 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:21.097611 18915 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:21.101225 18764 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:21.101940 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:21.102970 18842 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:21.087972 24038 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:21.109167 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.074097 24345 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:25:21.112171 18765 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:21.114898 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:21.116418 18769 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:21.116719 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:21.117789 18765 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.119189 18844 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:21.079885 24184 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:25:21.074514 24309 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.099710 24337 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:21.124802 24285 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.126108 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:21.131018 19487 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:21.132491 24309 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.132586 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:21.133224 24309 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:21.133620 24309 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.133966 24309 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.133867 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:21.102775 23968 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.135891 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:21.136610 23968 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:21.092144 23844 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:25:21.104966 24353 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:21.138808 23844 consensus_queue.cc:1243] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:21.139391 24353 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:21.139894 24353 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:21.140121 24285 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.139181 24100 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:21.142601 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.093809 24096 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:25:21.161828 18765 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:25:21.167323 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46878.7us
I20260709 12:25:21.167861 18765 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:21.124735 24305 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:21.125047 24386 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.130594 24191 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:25:21.121917 24334 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:25:21.148837 24100 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:21.121475 24264 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:25:21.195685 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1158) took 1228 ms. Trace:
I20260709 12:25:21.140806 24353 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.124517 23756 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:21.203303 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.241429 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.174650 24305 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:21.233158 24388 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.002s
W20260709 12:25:21.248461 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.238922 24100 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:21.147903 24385 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:21.233400 18765 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:21.233867 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 98132.6us
I20260709 12:25:21.254978 18765 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:25:21.255584 18765 pending_rounds.cc:85] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 6
I20260709 12:25:21.255951 18765 pending_rounds.cc:107] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:25:21.256021 24345 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:21.256649 18765 raft_consensus.cc:2889] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:21.256735 24345 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:21.257794 18771 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:21.258759 18765 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:21.258739 24345 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.259574 24142 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:21.260069 24142 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:21.260274 24345 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:21.172439 24296 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:25:21.260802 18765 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:21.262691 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:21.263484 24016 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.263571 24278 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:21.264631 18765 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:25:21.265861 24310 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.169031 24337 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:25:21.169209 24390 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:21.266845 24390 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:21.266916 18772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2812) took 1934 ms (client timeout 2260 ms). Trace:
I20260709 12:25:21.267205 18769 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:25:21.267365 24390 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.267597 18769 pending_rounds.cc:85] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 5
I20260709 12:25:21.268083 18769 pending_rounds.cc:107] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 11.6
W20260709 12:25:21.267436 18772 rpcz_store.cc:269] 0709 12:25:19.332788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.829799 (+497011us) service_pool.cc:224] Handling call
0709 12:25:21.266684 (+1436885us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540002e754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:21.266849 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699613952}
I20260709 12:25:21.268473 18769 raft_consensus.cc:2889] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:21.216238 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104907us
W20260709 12:25:21.241968 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.272044 24142 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.273690 24142 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.274487 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2257) took 1489 ms. Trace:
I20260709 12:25:21.258932 23756 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.274923 18769 rpcz_store.cc:276] 0709 12:25:19.780855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.117543 (+1336688us) service_pool.cc:224] Handling call
0709 12:25:21.266838 (+149295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.269007 (+  2169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.269585 (+   578us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540002e750. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:21.269723 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342472576}
W20260709 12:25:21.276062 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 749968us
W20260709 12:25:21.276711 18887 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.000s (SENT)
I20260709 12:25:21.268091 24295 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.238925 18920 rpcz_store.cc:276] 0709 12:25:19.966960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.350853 (+383893us) service_pool.cc:224] Handling call
0709 12:25:20.361358 (+ 10505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.776038 (+414680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.195293 (+419255us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400181854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:21.195584 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788127488}
I20260709 12:25:21.243420 24020 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.244182 24305 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:21.281265 24285 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:21.235140 24324 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.283063 23844 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:21.283136 18919 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:21.283708 23844 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:21.284379 24324 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.284855 23844 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.285718 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:21.250713 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.286417 19486 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.287142 24185 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:21.287567 24185 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:21.288424 24185 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.289275 24309 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.289778 24185 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.291761 24309 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.292908 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.293179 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.294567 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.295786 24263 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:21.295853 24214 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.296384 24263 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:21.297307 24263 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.297897 24400 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:21.298784 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.299456 19483 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:21.296244 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:21.296684 24214 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.302551 24214 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:21.257105 24353 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.305559 18887 leader_election.cc:400] T 1485e54f9795416785f4baf244599201 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:25:21.288810 24398 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:21.309841 19486 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 10.
W20260709 12:25:21.311321 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.311803 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:21.302618 24310 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:21.310169 24020 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.286226 23844 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.317674 24020 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.320145 24020 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.310541 24263 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:21.301604 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:21.312778 18769 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:21.326211 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.326368 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:21.330902 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 174501us
I20260709 12:25:21.333314 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:21.333699 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:21.334072 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:21.336604 18769 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:25:21.337553 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:21.339568 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:21.338238 18914 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:21.324084 24348 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:21.345131 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:21.330724 24020 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.332131 24372 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:21.350235 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.313616 24398 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.346515 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:21.366694 24296 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.354910 24400 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.367465 24296 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.367681 24400 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.323640 24247 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:25:21.332640 24324 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:25:21.376065 19457 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.568s (SENT)
I20260709 12:25:21.355957 24020 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.395669 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:21.343978 24352 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:25:21.397465 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.403095 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.411605 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:21.412781 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:21.352406 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:21.371102 24396 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:25:21.414491 18843 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:21.418043 18846 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:21.430583 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.355778 24351 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:25:21.433451 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2822) took 2056 ms. Trace:
I20260709 12:25:21.431408 18843 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:21.373047 24400 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.440828 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:21.466416 18767 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:21.443027 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:21.445971 18773 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:21.370358 24296 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.432049 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:21.449955 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:21.456913 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.458197 18768 rpcz_store.cc:276] 0709 12:25:19.377230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.275881 (+898651us) service_pool.cc:224] Handling call
0709 12:25:20.880781 (+604900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.885444 (+  4663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.433249 (+547805us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b540017a2d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:21.433390 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367229696}
I20260709 12:25:21.439302 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2513) took 1432 ms. Trace:
I20260709 12:25:21.386987 24372 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:21.377746 24385 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:21.411389 24020 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:21.462020 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 109743us
I20260709 12:25:21.476711 18840 rpcz_store.cc:276] 0709 12:25:20.007200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.011348 (+  4148us) service_pool.cc:224] Handling call
0709 12:25:20.980191 (+968843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.980894 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.438958 (+458064us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b5400381150. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:21.439199 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151575296}
W20260709 12:25:21.476478 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 131475us
W20260709 12:25:21.485532 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53598.1us
I20260709 12:25:21.432827 24337 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:21.488909 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:21.476554 24397 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:21.496407 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:21.500576 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:21.501709 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 168492us
I20260709 12:25:21.430801 24325 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:25:21.471524 24131 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:21.486807 24324 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:21.488202 24385 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.495208 23756 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.504294 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:21.488408 24310 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:21.529750 24355 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.528762 24390 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.519011 24193 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:21.509876 24348 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:21.504257 24337 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.542832 24352 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:21.543299 24295 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.545178 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.582965 18843 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:21.507097 24191 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:21.509893 24334 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:21.584551 24334 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.585124 24334 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:21.565863 24333 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:21.587118 24333 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.569494 24193 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.588754 24193 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:21.510215 24131 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:21.590766 24409 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:21.591353 24409 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:21.591436 24131 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.592864 24131 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.592533 24409 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.594774 24142 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:21.581889 24295 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.597075 24398 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.599593 24348 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.606581 24372 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.608325 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:21.612533 24020 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.617242 24020 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.617784 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:21.618575 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.618757 18843 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.545943 24385 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:21.544641 23756 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.623204 23756 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.624490 24193 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:21.627784 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 123545us
I20260709 12:25:21.540928 18920 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:21.562250 24310 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.561398 24305 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:21.662356 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.667069 24407 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:21.667922 24352 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:21.649483 24324 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.647606 24310 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:21.692195 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.693408 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:21.651960 24413 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:21.718629 18841 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:21.644716 24384 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:25:21.644306 24278 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:25:21.731336 19488 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:21.688086 24390 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.685182 24386 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:25:21.765384 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.766865 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:21.716292 24351 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:25:21.772258 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:21.775655 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 965) took 1269 ms. Trace:
I20260709 12:25:21.781549 19488 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:21.715885 24324 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:21.781461 18765 rpcz_store.cc:276] 0709 12:25:20.506514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.265642 (+759128us) service_pool.cc:224] Handling call
0709 12:25:21.266043 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:21.329222 (+ 63179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.329256 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:21.331415 (+  2159us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.465322 (+133907us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:21.768173 (+302851us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.775194 (+  7021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.775304 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.775361 (+    57us) raft_consensus.cc:1685] finished
0709 12:25:21.775380 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.775573 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87933,"prepare.queue_time_us":128459,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":74805,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4927,"thread_start_us":391291,"threads_started":2,"wal-append.queue_time_us":247102}
W20260709 12:25:21.785140 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 282486us
I20260709 12:25:21.806078 19483 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:21.813685 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:21.763162 24402 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.819983 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.820602 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.821543 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.763255 24193 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.774812 23844 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:21.787081 24351 consensus_queue.cc:1243] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:25:21.825587 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.826555 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:21.824963 18843 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:21.740984 24413 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:21.832649 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.762969 24390 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:25:21.840654 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:21.809880 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:21.828562 24100 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.006s
W20260709 12:25:21.844837 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 289573us
I20260709 12:25:21.851866 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:21.851837 18772 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:21.853662 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:21.854592 18771 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:21.828215 23844 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:21.861876 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:21.862821 18773 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:21.864382 18920 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:21.865695 18768 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:25:21.866173 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56399us
I20260709 12:25:21.867043 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:21.869868 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:21.922996 24185 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.007s
W20260709 12:25:21.871230 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.858595 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 967) took 1349 ms. Trace:
I20260709 12:25:21.761327 24352 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.873759 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:21.956595 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82932.5us
I20260709 12:25:21.828900 24402 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.878159 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:21.860623 24353 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.549s	user 0.019s	sys 0.001s
I20260709 12:25:21.960320 18917 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:21.960446 18920 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:21.880649 18914 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:21.881497 19491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:25:21.962348 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:21.845413 24321 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:25:21.883956 24390 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:21.893854 24367 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:21.896687 19492 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
W20260709 12:25:21.909124 24263 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.005s
I20260709 12:25:21.911484 24409 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.915813 24413 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:21.916303 24411 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:21.917212 24337 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.987071 24337 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:21.986634 23756 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.987486 24337 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:21.988474 24337 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.989754 24337 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.917562 24324 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:21.990968 19456 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.655s (SENT)
I20260709 12:25:21.918130 24305 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:21.881538 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:21.873381 24412 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:21.993563 24412 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:21.994630 24412 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.998623 24410 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:21.999310 24410 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:21.999410 18770 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:21.868304 23844 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:21.875841 24345 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.003s
I20260709 12:25:21.949859 18769 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:21.870730 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:22.001974 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 131333us
I20260709 12:25:22.003132 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.004850 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:21.956199 18764 rpcz_store.cc:276] 0709 12:25:20.509208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.269337 (+760129us) service_pool.cc:224] Handling call
0709 12:25:21.269625 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.269842 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:21.393374 (+123532us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.858194 (+464820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:21.858254 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:21.858298 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.858373 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.858527 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56602,"prepare.queue_time_us":185405,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":17200,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":12643,"thread_start_us":567498,"threads_started":2}
W20260709 12:25:21.963219 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.968533 18914 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:25:21.969591 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 102633us
I20260709 12:25:21.857766 24100 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:21.974893 18766 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:21.962237 19491 raft_consensus.cc:606] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:21.970961 24142 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:21.971902 24296 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:22.000380 24410 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.036149 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.037647 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.039750 18845 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:22.041162 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:22.043980 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:22.057168 18765 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:21.935726 19488 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:22.018217 18768 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:25:22.095186 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 54102.7us
I20260709 12:25:22.095535 18839 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:22.096231 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:22.098143 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:22.102747 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66669us
I20260709 12:25:22.103199 24413 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:22.103780 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.104012 24413 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:22.104178 24386 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:22.102954 24305 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:22.105084 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.105634 24305 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:22.105871 24406 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:22.106030 24142 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.106659 24406 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.107203 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:22.018553 23756 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.107990 24305 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:22.106554 24296 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:22.102844 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65299.7us
I20260709 12:25:22.108698 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:22.109514 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:22.116694 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:22.005106 24324 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.117498 18845 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:22.118525 18839 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:22.120890 18840 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:21.998024 24334 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:22.123024 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.976141 24367 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:22.127501 18914 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:22.094799 24411 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:22.138366 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.134893 18845 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:22.111466 24413 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:22.116083 24398 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.147948 18843 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:22.150709 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.160274 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:22.163756 18920 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:22.165441 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:22.148452 24355 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.116374 24285 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:25:22.189858 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:22.215775 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.117435 24430 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:25:22.193902 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.192356 24422 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:22.285245 18914 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
W20260709 12:25:22.274513 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 84731.6us
I20260709 12:25:22.313736 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:22.133028 24425 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.170s
W20260709 12:25:22.291258 24377 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:25:22.193567 24411 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:22.324970 18842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.020s	sys 0.040s
W20260709 12:25:22.332062 18842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.020s	sys 0.040s
W20260709 12:25:22.340070 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.320351 24372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.017s	sys 0.041s
I20260709 12:25:22.273281 24355 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.332715 23756 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.181741 18917 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:22.170091 24413 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:22.352666 24372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.017s	sys 0.042s
I20260709 12:25:22.179746 24428 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.381352 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.176137 24305 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.196s
I20260709 12:25:22.299978 24296 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.181011 24351 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.205s
I20260709 12:25:22.189302 24214 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.196s
I20260709 12:25:22.183925 24346 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.202s
W20260709 12:25:22.399492 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 261209us
I20260709 12:25:22.391031 24100 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.370554 23756 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:22.395485 24397 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.901s	user 0.015s	sys 0.007s
I20260709 12:25:22.403165 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:22.407160 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 213683us
I20260709 12:25:22.181341 24398 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.425197 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:22.426507 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.391916 24428 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.414646 24397 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:22.453368 18917 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:25:22.433313 24433 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 12:25:22.434180 24426 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:25:22.415928 24345 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.461715 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2654) took 1127 ms. Trace:
I20260709 12:25:22.462829 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2546) took 1081 ms. Trace:
I20260709 12:25:22.462257 18915 rpcz_store.cc:276] 0709 12:25:21.334003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.334494 (+   491us) service_pool.cc:224] Handling call
0709 12:25:21.334814 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:21.516609 (+181795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.516653 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:21.523976 (+  7323us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.874895 (+350919us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:21.874934 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.875002 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.461407 (+586405us) raft_consensus.cc:1685] finished
0709 12:25:22.461442 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.461639 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139555,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":14776,"thread_start_us":403794,"threads_started":2,"wal-append.queue_time_us":617467}
I20260709 12:25:22.446455 24263 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.451911 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.412132 24430 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.455318 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:22.432744 23968 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:22.427968 24334 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.457262 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.421367 24400 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.459041 18848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c18545306c9477ba3e214f788705644"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:25:22.477592 18848 raft_consensus.cc:606] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:22.464496 24385 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.845s	user 0.013s	sys 0.009s
I20260709 12:25:22.468413 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.463491 18844 rpcz_store.cc:276] 0709 12:25:21.381449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.381623 (+   174us) service_pool.cc:224] Handling call
0709 12:25:21.417509 (+ 35886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:21.475706 (+ 58197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.475750 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:21.540718 (+ 64968us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b2c0005b308. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:25:21.541222 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.949398 (+408176us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:21.949446 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.949526 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.462513 (+512987us) raft_consensus.cc:1685] finished
0709 12:25:22.462537 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.462763 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64726,"raft.queue_time_us":58087,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10492,"spinlock_wait_cycles":19965312,"thread_start_us":407708,"threads_started":1,"wal-append.queue_time_us":733946}
I20260709 12:25:22.468680 24263 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.473873 23968 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.474726 24351 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.426090 24409 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:22.461927 24345 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.476279 24353 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:22.466892 24346 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:25:22.504993 24409 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.511482 24409 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:22.522605 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.485855 24385 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.540099 23968 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:22.483254 24430 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:22.544525 24442 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:25:22.544390 24430 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:22.546931 24440 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:25:22.544183 24185 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.549127 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2659) took 1211 ms. Trace:
I20260709 12:25:22.549472 24185 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.549660 18918 rpcz_store.cc:276] 0709 12:25:21.338066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.338179 (+   113us) service_pool.cc:224] Handling call
0709 12:25:21.338562 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:21.772797 (+434235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.772831 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:21.773376 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:25:22.189774 (+416398us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:22.189830 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.189934 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.548905 (+358971us) raft_consensus.cc:1685] finished
0709 12:25:22.548931 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.549067 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1194,"raft.queue_time_us":172919,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":10621,"thread_start_us":798722,"threads_started":2,"wal-append.queue_time_us":594436}
I20260709 12:25:22.552445 24185 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.549064 24263 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:22.563383 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.565024 23844 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 12:25:22.597291 23844 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.569970 24409 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.508910 24352 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:22.575783 24345 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.584338 24398 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.585536 24355 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.492694 24351 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.586503 24406 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:22.549063 24428 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:22.587718 24337 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.597s	user 0.014s	sys 0.000s
I20260709 12:25:22.484191 24400 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.588477 24445 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:22.589468 18841 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 10. Current term is 12. Ops: []
I20260709 12:25:22.660372 24413 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.593233 24452 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:22.594534 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:22.595482 24295 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.596192 24353 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:22.569011 24310 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.845s	user 0.010s	sys 0.001s
I20260709 12:25:22.597735 24385 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.607764 24168 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:22.611256 24441 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.161s	user 0.002s	sys 0.002s
I20260709 12:25:22.688570 24346 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.689319 24346 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.688647 23844 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.612435 24324 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:22.627300 18770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 959) took 2122 ms (client timeout 1655 ms). Trace:
W20260709 12:25:22.843053 18770 rpcz_store.cc:269] 0709 12:25:20.505158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.715321 (+210163us) service_pool.cc:224] Handling call
0709 12:25:22.627070 (+1911749us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540029bdd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:22.627217 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2810477440}
I20260709 12:25:22.846477 24372 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:22.847136 24372 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:22.848322 24372 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.849700 24372 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:22.636658 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 168322us
I20260709 12:25:22.659519 24430 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.851222 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.592810 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:22.677258 18846 raft_consensus.cc:2410] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:22.853418 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.678526 18921 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:22.683283 18917 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:22.691843 24346 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.693817 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.856405 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.680373 24452 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.856914 24445 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:22.856587 24324 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:22.859472 24452 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:22.705896 24351 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.707831 24413 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:22.869547 23756 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:22.708259 24418 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.855s	user 0.007s	sys 0.006s
I20260709 12:25:22.708606 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.709837 24278 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:22.870765 24278 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:22.871739 24278 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.872907 24278 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:22.874850 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2658) took 1537 ms. Trace:
I20260709 12:25:22.875303 18913 rpcz_store.cc:276] 0709 12:25:21.337788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.337899 (+   111us) service_pool.cc:224] Handling call
0709 12:25:21.351062 (+ 13163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:21.401801 (+ 50739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.401850 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:21.402646 (+   796us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.626778 (+224132us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:21.626850 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.626962 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.707549 (+1080587us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:22.874482 (+166933us) raft_consensus.cc:1685] finished
0709 12:25:22.874509 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.874769 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71468,"raft.queue_time_us":196825,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":6538,"spinlock_wait_cycles":14485760,"thread_start_us":221513,"threads_started":2,"wal-append.queue_time_us":357466}
I20260709 12:25:22.686007 24310 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.880376 24310 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.709839 24353 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.719429 24402 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.720249 24437 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:22.886498 24348 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:22.725366 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2547) took 1343 ms. Trace:
I20260709 12:25:22.890482 18919 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:22.891440 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.890590 18842 rpcz_store.cc:276] 0709 12:25:21.382023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.382173 (+   150us) service_pool.cc:224] Handling call
0709 12:25:21.387417 (+  5244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.387640 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:21.813833 (+426193us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.724839 (+911006us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:22.724918 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:22.725000 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.725100 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.725275 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467894,"prepare.queue_time_us":139274,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":393276,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":844919,"threads_started":2,"wal-append.queue_time_us":582841}
I20260709 12:25:22.892717 24324 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:22.892925 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.893198 24324 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:22.894129 24324 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.894670 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:22.726888 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 276490us
I20260709 12:25:22.896375 18922 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:22.898532 24392 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:22.900197 24392 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:22.901288 24406 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.901914 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2276) took 1051 ms. Trace:
I20260709 12:25:22.727427 24397 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:22.901857 24406 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.902062 24392 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:25:22.730865 24400 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.731387 24390 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:22.724102 24436 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:22.890933 24445 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:22.738693 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.744906 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 431270us
I20260709 12:25:22.747164 19489 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:22.756853 24352 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:22.765897 24412 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:22.785863 24333 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.798096 24411 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:22.825183 24168 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.833189 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.895535 24324 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:22.851043 24430 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.670900 18918 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:22.898245 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:22.903249 24385 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:25:22.902376 18766 rpcz_store.cc:276] 0709 12:25:21.850116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.850310 (+   194us) service_pool.cc:224] Handling call
0709 12:25:21.864729 (+ 14419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:22.011664 (+146935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.901659 (+889995us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540029ccd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:22.901853 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249102592}
I20260709 12:25:22.940917 24385 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:22.941466 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:22.911872 24412 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:22.942824 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:22.943552 24412 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.944932 24412 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:22.945941 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.946646 24385 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:22.912173 24411 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:22.947561 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:22.948170 18767 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.947966 24411 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.949270 24411 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:22.949960 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:22.912451 24168 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.951066 24436 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:22.952159 24436 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:22.952611 24168 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.917248 24400 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:22.953718 24400 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.955899 24400 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.956568 19483 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:22.957155 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:22.957468 18769 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:22.957823 18771 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:22.958760 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:22.959107 18771 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:22.959383 18769 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:22.960443 18771 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:25:22.960896 18772 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:22.918592 24334 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:22.962864 18767 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:22.962826 24334 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.966513 24385 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:22.967612 24436 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.968128 24436 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.968631 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:22.886540 24367 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.976711 24367 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.920189 18770 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:22.920547 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:22.979935 18768 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:22.921213 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:22.981554 18764 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:22.921749 24450 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:22.983139 24450 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:22.983588 24450 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:22.916625 24430 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:22.923271 24346 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:25:22.923349 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.922327 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:22.926994 18922 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:22.986809 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 64556.6us
I20260709 12:25:22.987495 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:22.987777 24334 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.988101 18922 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.928539 18916 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:22.936291 24191 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:22.928929 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.991014 24191 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.931434 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:22.991684 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:22.992214 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 60869.4us
I20260709 12:25:22.919574 24310 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.992756 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:22.993280 24191 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.993120 24310 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.993956 24214 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:22.942142 23756 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.995108 23756 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:22.995488 24310 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:22.996141 24310 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:22.988010 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.922513 24351 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:25:22.970623 24385 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:22.927318 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.003275 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.004076 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.004740 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.005632 18918 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:22.972205 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.912012 24363 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.006889 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.007581 18915 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:22.986231 24346 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:23.008360 24346 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:23.008536 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.009246 18915 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:23.009596 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:23.009403 24346 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:22.994159 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:23.010192 19483 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:22.942376 24390 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:22.997362 23756 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:22.991349 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:23.016965 18764 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:23.017583 18772 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:23.011806 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.006668 24363 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.018606 18773 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:23.019624 18770 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:25:22.986760 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:22.937844 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.020697 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.021515 18918 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:23.022583 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.022786 24351 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.023443 24351 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.026629 24446 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.027220 24446 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.029273 18915 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:23.029526 24446 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:23.031309 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.033042 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:23.033740 19487 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:23.034024 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:22.904188 24406 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:23.005462 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.035089 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:22.942143 18766 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:25:23.037006 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.970366 24436 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:23.038954 24346 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.974754 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:23.017028 24390 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:23.008824 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.442106 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.458890 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.092895 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.460505 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.461061 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.104770 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:23.463277 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:23.464347 18843 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:23.465682 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:23.468222 24455 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.469133 24455 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:23.471305 24345 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.472082 24345 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:23.108081 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.474656 18773 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:23.109560 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.477119 18770 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:23.112438 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.113464 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.478281 18772 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:23.478633 18916 raft_consensus.cc:2410] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:25:23.092234 19489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1067) took 1794 ms (client timeout 2119 ms). Trace:
W20260709 12:25:23.481267 19489 rpcz_store.cc:269] 0709 12:25:21.292447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.292589 (+   142us) service_pool.cc:224] Handling call
0709 12:25:23.086207 (+1793618us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54006c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:23.086357 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3342767872}
W20260709 12:25:23.117779 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.120985 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.122728 18766 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:23.490536 24372 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:23.491150 24372 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.493551 24372 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:23.118140 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 953) took 1077 ms. Trace:
I20260709 12:25:23.123476 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.495172 18764 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:23.494719 18841 rpcz_store.cc:276] 0709 12:25:22.040410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.117058 (+ 76648us) service_pool.cc:224] Handling call
0709 12:25:22.138682 (+ 21624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:22.676421 (+537739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.117866 (+441445us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400125054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:23.118066 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036022656}
I20260709 12:25:23.126062 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.496378 18769 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:23.128544 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.496790 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:23.497435 18767 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:23.130012 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.133034 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.499361 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.500774 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.501991 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.069252 24310 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:23.592635 24310 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:23.134074 23756 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.103602 24334 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.140904 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:23.597532 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 456710us
I20260709 12:25:23.600345 24446 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:23.600775 24446 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.026333 24351 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:23.118716 24363 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:23.073297 24398 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:23.623905 24398 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.624389 24398 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:23.149628 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.627528 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.155637 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:23.634614 24310 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.635340 24310 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:23.637838 24310 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:23.156911 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:23.046627 24450 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:23.189956 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.640290 18920 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:23.641402 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.036268 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.642747 24450 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:23.643411 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.644737 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.645512 18914 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:23.222136 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:23.225616 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.649137 24450 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.649722 24450 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:23.228271 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 286071us
I20260709 12:25:23.268661 24437 raft_consensus.cc:993] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:25:23.654520 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:23.654930 24437 raft_consensus.cc:1081] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:25:23.655395 18769 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:23.656663 18769 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:23.657435 18766 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:25:23.659226 18772 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:23.660480 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:23.661825 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:23.663164 18768 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:25:23.663573 18768 pending_rounds.cc:85] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 8
I20260709 12:25:23.663815 18768 pending_rounds.cc:107] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:25:23.664093 18768 raft_consensus.cc:2889] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:23.285825 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:23.300415 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.663825 24450 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:23.302840 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.667682 18919 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:23.668614 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.669277 18919 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:23.303750 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:22.974061 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:23.671247 18847 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.973398 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:23.672084 18846 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.317221 18913 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:23.318976 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.673326 18915 raft_consensus.cc:2376] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16. Re-sending same reply.
I20260709 12:25:23.339923 24409 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:23.348203 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:23.681288 18845 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:23.370815 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.372678 24412 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:23.373163 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.374861 24191 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:23.375384 24384 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:23.379196 24444 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.944s	user 0.005s	sys 0.000s
W20260709 12:25:23.392907 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.984084 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet 1485e54f9795416785f4baf244599201 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:25:23.409982 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.412115 24168 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:23.716168 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:22.971254 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:23.083001 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:23.479736 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.093484 24185 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.505465 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:23.508046 18922 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.519s	user 0.019s	sys 0.002s
I20260709 12:25:23.856508 18922 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:23.857648 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.859038 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.515110 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:23.519245 18917 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:23.523494 18918 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:23.526925 19489 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:23.860131 18922 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:23.530488 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:23.533020 19487 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:23.540503 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:23.541420 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:23.539084 24411 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.862476 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.531248 24346 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:25:23.554353 24345 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:23.572486 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53212.4us
I20260709 12:25:23.577350 24455 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:23.596474 23756 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:23.868453 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 564802us
I20260709 12:25:23.043979 24390 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:23.601126 24446 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:23.892962 24367 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:23.893522 24367 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:23.894585 24367 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.896159 24367 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.601469 24214 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.901109 24437 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:23.901552 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.604471 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 144934us
I20260709 12:25:23.901863 24437 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.904466 24351 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:23.905854 24437 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:23.642118 18920 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:23.906889 24478 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:23.907361 24478 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:23.907645 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.908422 18920 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:23.909500 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.670193 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.911022 18919 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:23.912096 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.674294 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.682317 18842 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:23.912845 18919 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:23.898244 24214 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.913879 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:23.684700 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.922806 18921 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:23.923138 24390 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.924013 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.681593 18848 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:23.717630 18844 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:23.718502 18916 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:23.716945 18913 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
W20260709 12:25:23.717811 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 746582us
I20260709 12:25:23.722868 24385 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:23.927891 24385 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:23.928920 24385 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.720043 24480 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.930704 24480 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.716390 24168 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:23.932960 24168 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.934049 24168 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:23.720201 18658 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 736094us
I20260709 12:25:23.721174 24412 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.935128 18915 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.716627 24384 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.715987 24191 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:23.791396 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52561us
I20260709 12:25:23.943573 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:23.796756 18668 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 279) took 37759 ms (client timeout 15000 ms). Trace:
I20260709 12:25:23.945293 24491 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:23.792462 24409 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:23.946611 24409 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.947363 24409 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:23.944736 18668 rpcz_store.cc:269] 0709 12:24:46.042560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.055204 (+ 12644us) service_pool.cc:224] Handling call
0709 12:25:23.790791 (+37735587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:19.949114 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:19.949827 (+   713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:19.949889 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:25:19.949909 (+    20us) tablet.cc:662] Decoding operations
0709 12:25:19.950995 (+  1086us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:19.951120 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:19.951147 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:25:19.952104 (+   957us) tablet.cc:701] Row locks acquired
0709 12:25:19.952166 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:25:19.952357 (+   191us) write_op.cc:270] Start()
0709 12:25:19.952532 (+   175us) write_op.cc:276] Timestamp: P: 1783599919952281 usec, L: 0
0709 12:25:19.952555 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:20.112946 (+160391us) log.cc:844] Serialized 3934 byte log entry
0709 12:25:20.724181 (+611235us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b
0709 12:25:21.032523 (+308342us) op_driver.cc:464] REPLICATION: finished
0709 12:25:21.243441 (+210918us) write_op.cc:301] APPLY: starting
0709 12:25:21.243558 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:21.296271 (+ 52713us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:21.296339 (+    68us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:21.577386 (+281047us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:21.577834 (+   448us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:25:21.577899 (+    65us) write_op.cc:312] APPLY: finished
0709 12:25:21.609751 (+ 31852us) log.cc:844] Serialized 97 byte log entry
0709 12:25:21.610929 (+  1178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:21.611102 (+   173us) write_op.cc:454] Released schema lock
0709 12:25:21.611183 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:21.615057 (+  3874us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:21.615099 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":674168,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":202692,"apply.run_cpu_time_us":20082,"apply.run_wall_time_us":371548,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":836311,"prepare.run_cpu_time_us":18762,"prepare.run_wall_time_us":907544,"raft.queue_time_us":124862,"raft.run_cpu_time_us":25680,"raft.run_wall_time_us":207284,"replication_time_us":1051281,"spinlock_wait_cycles":7748352,"thread_start_us":1257801,"threads_started":4,"wal-append.queue_time_us":654487,"wal-append.run_cpu_time_us":24508,"wal-append.run_wall_time_us":1792929}]]}
I20260709 12:25:23.788894 24485 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:23.812335 18847 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:23.813123 24492 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.826596 24452 raft_consensus.cc:993] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: : Instructing follower 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:25:23.950835 24485 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.834381 18846 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:23.951608 24492 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:23.510066 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.525866 24402 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:25:23.953174 24402 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:23.953647 24402 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:23.951787 24452 raft_consensus.cc:1081] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Signalling peer 1e2529a8cff04207bb1b07c108e16983 to start an election
I20260709 12:25:23.863215 18917 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:23.957130 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.597309 24334 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:23.857688 24398 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:23.960500 18771 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:23.874126 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.964408 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2645) took 1040 ms. Trace:
I20260709 12:25:23.958247 18917 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:23.964926 18918 rpcz_store.cc:276] 0709 12:25:22.924092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.963173 (+1039081us) service_pool.cc:224] Handling call
0709 12:25:23.963615 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:23.963892 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.963936 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:23.964000 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:23.964051 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.964133 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.964325 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.875306 24495 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:23.872092 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:23.871681 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:23.864506 24185 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:23.968286 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 96259.6us
I20260709 12:25:23.867578 24411 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:23.885887 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.638834 18839 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:23.646319 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:23.914561 19486 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.915176 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:23.969960 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:23.916718 18919 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:23.973544 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2649) took 1048 ms. Trace:
I20260709 12:25:23.974056 18919 rpcz_store.cc:276] 0709 12:25:22.925070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.913610 (+988540us) service_pool.cc:224] Handling call
0709 12:25:23.973453 (+ 59843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.910223 18920 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:23.915145 24494 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:23.970188 24490 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:23.969552 24351 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:23.988794 24490 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.988919 24351 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.992570 24351 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:23.994417 24411 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:23.920111 23756 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:23.921159 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:23.764537 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.997180 24479 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.936553 24412 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:23.971897 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2650) took 1046 ms. Trace:
I20260709 12:25:24.002697 18914 rpcz_store.cc:276] 0709 12:25:22.925312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.646048 (+720736us) service_pool.cc:224] Handling call
0709 12:25:23.971798 (+325750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.970521 24495 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:25:23.989403 24490 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:23.987509 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 72430.7us
I20260709 12:25:23.988083 24494 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.009716 24494 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:23.988134 24452 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.009743 24437 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.010613 24452 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:24.011116 24452 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.011059 24437 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.012884 24446 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.013814 24437 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:24.014213 19483 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:24.015146 24334 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:23.915657 24214 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.017288 24384 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:23.916296 24478 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.018523 24478 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.018668 24485 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:24.020567 24191 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:24.030812 24398 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:24.034680 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 91207.3us
I20260709 12:25:24.054347 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:24.035673 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 114615us
I20260709 12:25:24.007541 24402 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.010282 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.069589 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:24.043684 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.070413 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60213.3us
I20260709 12:25:24.071457 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.073051 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:23.927487 18664 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 12, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 12 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:24.044389 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:24.046111 24185 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.047633 24384 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:24.075991 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.076030 18915 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:24.075389 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.077657 18843 pending_rounds.cc:85] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 8
I20260709 12:25:24.077975 18843 pending_rounds.cc:107] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:25:24.077863 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:24.032379 24494 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:24.032016 24492 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:24.032519 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62642.6us
I20260709 12:25:24.031351 24480 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.089900 19491 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:24.058215 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.059319 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.065297 19486 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:24.041786 24446 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.078366 18843 raft_consensus.cc:2889] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:24.030110 24490 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.078329 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.108258 18914 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:24.108835 18842 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:24.109546 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2681) took 1159 ms. Trace:
I20260709 12:25:24.109963 18914 rpcz_store.cc:276] 0709 12:25:22.949922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.003896 (+1053974us) service_pool.cc:224] Handling call
0709 12:25:24.008489 (+  4593us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b58001e5198. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:25:24.008708 (+   219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.108804 (+100096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.109322 (+   518us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b54000348d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:24.109486 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233687680}
I20260709 12:25:24.111339 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:24.111987 18914 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:24.113075 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:24.113670 18914 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:24.079245 18839 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:24.071229 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:24.116202 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45079.5us
I20260709 12:25:24.118350 24384 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.119017 24384 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.119485 24384 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.123520 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.079988 18913 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:24.080340 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:24.125550 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45322.5us
I20260709 12:25:24.127694 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.129451 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:24.081314 24390 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:24.082362 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2676) took 1150 ms. Trace:
I20260709 12:25:24.082620 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.144328 18844 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:24.144047 18915 rpcz_store.cc:276] 0709 12:25:22.931772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.674026 (+742254us) service_pool.cc:224] Handling call
0709 12:25:24.082098 (+408072us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b5400336154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:24.082294 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50880896}
W20260709 12:25:24.085014 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.088171 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.145995 18848 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 10: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:24.093403 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.143952 24390 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:24.084561 24345 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.084810 23756 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:24.096925 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.097780 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.151147 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:24.151460 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53788us
I20260709 12:25:24.151872 18846 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:24.097795 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.147233 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.098330 24494 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:24.098932 24492 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:24.085583 24437 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:25:24.101260 24488 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:24.210928 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.211072 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:24.211784 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.101436 24310 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:24.102955 24402 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.078999 24485 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:24.213721 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.104198 18664 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:24.215015 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.147998 24446 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.034539 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 162947us
I20260709 12:25:24.224009 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:24.224058 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 90456.5us
I20260709 12:25:24.224576 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:24.225157 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:24.225502 19485 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:24.225890 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.138125 18922 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:24.227264 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:24.227952 18922 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:24.228727 18737 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:24.139848 18916 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:24.229875 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2646) took 1305 ms. Trace:
I20260709 12:25:24.208794 24450 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:24.089510 18845 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:24.146763 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53503.8us
I20260709 12:25:24.236076 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.095786 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.145133 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.148918 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.150556 24345 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.214016 24488 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.174966 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.152758 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.200521 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.147289 24390 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.131768 23844 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:24.140736 24295 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.211794 18913 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:24.147295 24398 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.213094 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:24.103797 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.214375 19483 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:24.255038 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.256647 24367 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:25:24.256949 24498 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:25:24.257094 24367 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.257606 24367 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:24.258239 24398 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.258469 24496 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:24.258765 24398 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.238590 23756 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:24.215632 19492 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
W20260709 12:25:24.209463 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08001e49c0 after lost signal to thread 17571
I20260709 12:25:24.236135 24363 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.267932 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080031c6c0 after lost signal to thread 18705
W20260709 12:25:24.269884 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08000ceb00 after lost signal to thread 18797
I20260709 12:25:24.230180 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:24.230307 18916 rpcz_store.cc:276] 0709 12:25:22.924358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.479415 (+555057us) service_pool.cc:224] Handling call
0709 12:25:24.229808 (+750393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:24.208514 24495 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:24.145728 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:24.231887 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:24.137009 24334 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:25:24.199103 24436 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:24.233062 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:24.232548 24480 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:25:24.238821 18847 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:24.239270 19486 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:24.158057 18914 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:24.237918 24455 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:25:24.150331 24191 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
W20260709 12:25:24.242164 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 89505.5us
W20260709 12:25:24.251086 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50664.6us
I20260709 12:25:24.232720 24479 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:24.261482 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2678) took 1317 ms. Trace:
I20260709 12:25:24.235832 24185 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:24.240777 24491 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:24.270346 18794 debug-util.cc:398] Leaking SignalData structure 0x7b0800320840 after lost signal to thread 18798
W20260709 12:25:24.315007 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5b00 after lost signal to thread 18872
W20260709 12:25:24.315344 18794 debug-util.cc:398] Leaking SignalData structure 0x7b0800270c60 after lost signal to thread 18873
W20260709 12:25:24.316447 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8f80 after lost signal to thread 18946
W20260709 12:25:24.316725 18794 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5d80 after lost signal to thread 18947
I20260709 12:25:24.275544 24495 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:24.276286 18915 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:24.213832 24409 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.279204 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2680) took 1330 ms. Trace:
I20260709 12:25:24.247552 24488 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:24.283967 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51016.6us
I20260709 12:25:24.324678 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.325563 19490 raft_consensus.cc:2368] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
W20260709 12:25:24.325706 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.326483 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.105195 24452 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.233466 18917 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:24.236514 24346 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:25:24.229802 24485 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.331135 24452 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.253232 24295 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.331873 24295 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.332592 24485 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:24.286211 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.253183 24450 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:24.293170 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1196) took 1181 ms. Trace:
I20260709 12:25:24.235357 24446 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.335179 18914 rpcz_store.cc:276] 0709 12:25:23.111418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.292006 (+1180588us) service_pool.cc:224] Handling call
0709 12:25:24.292463 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.292725 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.292767 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:24.292827 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:24.292878 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.292953 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.293096 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:24.300282 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.336061 24450 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.294811 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:24.338816 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44131.3us
I20260709 12:25:24.304288 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:24.340579 24452 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:24.311367 24506 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:24.341463 24452 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:24.342973 24452 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.371284 24446 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.323366 18919 rpcz_store.cc:276] 0709 12:25:22.948832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.992578 (+1043746us) service_pool.cc:224] Handling call
0709 12:25:24.009115 (+ 16537us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b58001e5198. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:25:24.014616 (+  5501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:24.015112 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.015150 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:24.015816 (+   666us) log.cc:844] Serialized 52 byte log entry
0709 12:25:24.081668 (+ 65852us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:24.081716 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.081796 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.262610 (+180814us) raft_consensus.cc:1685] finished
0709 12:25:24.262661 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.279074 (+ 16413us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4244,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":31462272,"thread_start_us":65385,"threads_started":1,"wal-append.queue_time_us":65449}
W20260709 12:25:24.311376 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81292.1us
I20260709 12:25:24.293880 24214 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:24.280993 23756 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:24.253669 24385 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.323330 18794 debug-util.cc:398] Leaking SignalData structure 0x7b080032c320 after lost signal to thread 19516
I20260709 12:25:24.305886 18918 rpcz_store.cc:276] 0709 12:25:22.944381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.966270 (+1021889us) service_pool.cc:224] Handling call
0709 12:25:24.027911 (+ 61641us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b58001e5198. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:25:24.028327 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.028810 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:24.028842 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:24.029392 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:25:24.159012 (+129620us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:24.159086 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.159205 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:24.261117 (+101912us) raft_consensus.cc:1685] finished
0709 12:25:24.261151 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.261403 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3501,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"spinlock_wait_cycles":124724608,"thread_start_us":129106,"threads_started":1,"wal-append.queue_time_us":129565}
I20260709 12:25:24.312225 24479 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:24.379072 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:24.404857 18919 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:24.293797 24310 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:24.310082 24411 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:24.296167 24492 raft_consensus.cc:2764] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:25:24.385840 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 43652.1us
I20260709 12:25:24.245206 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.392022 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1197) took 1280 ms. Trace:
I20260709 12:25:24.419023 18915 rpcz_store.cc:276] 0709 12:25:23.111673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.323088 (+1211415us) service_pool.cc:224] Handling call
0709 12:25:24.391256 (+ 68168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.391527 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.391580 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:24.391648 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:24.391700 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.391780 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.391932 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:24.281629 24363 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:24.434224 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 189146us
I20260709 12:25:24.383213 24214 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:24.281225 24494 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.320817 23844 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:24.448408 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 148183us
I20260709 12:25:24.413833 18918 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:25:24.415584 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:24.449571 18918 pending_rounds.cc:85] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 6
I20260709 12:25:24.449848 18918 pending_rounds.cc:107] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:24.296283 24436 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.428654 24411 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.408885 24479 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:24.435384 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.409590 18921 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:24.327740 24495 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:24.404871 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2683) took 1450 ms. Trace:
I20260709 12:25:24.450106 18918 raft_consensus.cc:2889] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:24.473030 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.472574 18913 rpcz_store.cc:276] 0709 12:25:22.954336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.265529 (+1311193us) service_pool.cc:224] Handling call
0709 12:25:24.266000 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.266325 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:24.330672 (+ 64347us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.404501 (+ 73829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:24.404579 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:24.404631 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.404695 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.404811 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63563,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":4548,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":20011,"thread_start_us":112261,"threads_started":2,"wal-append.queue_time_us":108364}
I20260709 12:25:24.411892 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c18545306c9477ba3e214f788705644"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54084
I20260709 12:25:24.450106 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:24.479079 18919 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.479794 18919 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.451247 19491 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:24.452842 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.455749 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.481789 18847 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:24.456853 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.457846 18839 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 12:25:24.466526 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.433732 24310 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:24.481997 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.440459 24214 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.410548 24385 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.519025 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2677) took 1575 ms. Trace:
I20260709 12:25:24.484622 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:24.516383 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.519798 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.516098 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:24.486709 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:24.547528 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:24.485297 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.439309 24491 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:24.516908 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:24.522207 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 290374us
I20260709 12:25:24.547947 18917 rpcz_store.cc:276] 0709 12:25:22.943452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.965846 (+1022394us) service_pool.cc:224] Handling call
0709 12:25:24.231884 (+266038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.329685 (+ 97801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.518816 (+189131us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000f6750. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:24.518965 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516806912}
I20260709 12:25:24.549508 18846 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:24.519222 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.553141 18844 raft_consensus.cc:2410] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:25:24.522811 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47031.5us
I20260709 12:25:24.455669 24185 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.552879 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:24.554366 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 227985us
I20260709 12:25:24.557659 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.449339 24351 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.515061 24450 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.473718 24501 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:25:24.298127 18664 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 11, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 11 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:24.542475 24295 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.551515 24278 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:24.517535 23756 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.542176 24455 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:24.560509 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:24.564801 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49038.4us
I20260709 12:25:24.568219 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:24.585767 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:24.606838 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.555316 24334 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.558207 24185 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.576663 24278 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:24.576242 24295 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:24.640607 24384 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.007s
I20260709 12:25:24.564468 24517 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:24.576977 24385 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.613816 19492 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
W20260709 12:25:24.636029 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50335.7us
I20260709 12:25:24.573163 24506 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:24.687027 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:24.637369 24479 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.639499 24363 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.577240 24519 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.640511 18840 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:24.565416 24508 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.577299 24504 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:24.642616 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.628724 24310 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.566746 24412 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:24.567935 18919 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.559834 24507 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.655745 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:24.578472 24505 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:24.721119 24505 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:24.723218 24479 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:24.722654 24505 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.584450 24450 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:24.567183 24168 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.006s
W20260709 12:25:24.662434 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 189505us
I20260709 12:25:24.662565 24526 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:24.725445 24526 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.607106 24455 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.664865 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:24.726460 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:24.664628 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.666677 19486 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.668303 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.727748 24526 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:24.728360 24526 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:24.728178 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60032us
I20260709 12:25:24.728808 24526 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.729177 24526 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.575647 24436 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.665149 24529 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:24.611415 23844 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.731200 24529 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.731673 24529 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.734009 24529 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:24.580150 24345 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:24.657927 24512 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 12:25:24.688891 18773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:33308
W20260709 12:25:24.679014 24478 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.003s
I20260709 12:25:24.640336 24390 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.657318 24185 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.645859 24521 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:24.694942 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:24.696848 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.699005 18768 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:24.743474 24505 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.705010 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:24.569902 24367 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.714216 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2661) took 1760 ms. Trace:
I20260709 12:25:24.809791 18921 rpcz_store.cc:276] 0709 12:25:22.953449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.923691 (+970242us) service_pool.cc:224] Handling call
0709 12:25:24.713893 (+790202us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54000f5d54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:24.714119 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100999552}
I20260709 12:25:24.811304 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:24.812112 18921 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:24.813251 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:24.715091 18920 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:24.721230 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:24.726577 24455 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:24.726787 18771 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:24.816215 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:24.667299 19487 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:24.609723 24402 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:24.573951 18664 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 12, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 12 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.744287 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.699018 24409 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:24.765244 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:24.766872 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 105763us
I20260709 12:25:24.767503 18919 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:24.787678 24538 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.791405 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104445us
I20260709 12:25:24.867498 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:24.814042 18921 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:24.795006 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.705787 24504 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.686964 24384 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.694942 18766 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:24.709174 24412 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:24.803107 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:24.803517 18840 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:24.804414 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.806762 19486 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:24.806975 18773 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.749893 24506 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:24.886562 18773 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:24.824182 18772 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:24.847605 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.887913 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:24.888672 18841 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:25:24.889127 18841 pending_rounds.cc:85] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 8
I20260709 12:25:24.889364 18841 pending_rounds.cc:107] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:25:24.889600 18841 raft_consensus.cc:2889] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:24.849090 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:24.794435 24385 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.852023 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107794us
I20260709 12:25:24.734277 24278 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.892426 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.740799 24507 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.841461 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:24.854480 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54084 (request call id 2693) took 1077 ms. Trace:
I20260709 12:25:24.894137 18769 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:24.894228 18919 rpcz_store.cc:276] 0709 12:25:23.763509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.411749 (+648240us) service_pool.cc:224] Handling call
0709 12:25:24.828842 (+417093us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:24.858136 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:24.792177 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 92021us
I20260709 12:25:24.817931 24520 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:24.885331 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:24.902005 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.791436 24535 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:24.802220 24516 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 12:25:24.804006 24503 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 12:25:24.710826 24508 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.900840 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:24.874742 24409 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:25:24.901930 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 97603.7us
I20260709 12:25:24.903339 18766 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:24.907271 18847 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:24.899051 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:24.907809 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 66494.7us
I20260709 12:25:24.909272 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:24.874441 23844 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:24.913375 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:24.819578 24402 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.808907 24214 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:24.887656 24506 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.888741 24351 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:24.874004 24504 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.923166 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:24.934710 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.926976 18772 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:24.934619 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.919866 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:24.807813 24521 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.949981 18769 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:24.908442 24345 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:24.904711 24478 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.908702 23756 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.916843 24531 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:24.948774 24191 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.974284 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54754.4us
I20260709 12:25:24.917058 24411 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:24.971096 24450 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:24.949024 24402 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.979710 19490 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:24.972963 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:24.939782 24334 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:24.951491 24506 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:24.973774 18770 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [17.14-18.15]
I20260709 12:25:24.905964 24385 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:24.887180 24538 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:24.978312 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 55263.6us
I20260709 12:25:24.973924 24446 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.985963 18915 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:24.982544 24531 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.018224 24384 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:25.014822 24488 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.002s
I20260709 12:25:24.983587 24527 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.015904 18664 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 12, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 12 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:25.023782 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2684) took 1540 ms. Trace:
W20260709 12:25:25.024248 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 281166us
W20260709 12:25:25.024097 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51215.8us
I20260709 12:25:25.065754 18914 rpcz_store.cc:276] 0709 12:25:23.483867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.336329 (+852462us) service_pool.cc:224] Handling call
0709 12:25:24.336706 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.337157 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:24.337535 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.447488 (+109953us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.448373 (+   885us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.555956 (+107583us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.787395 (+231439us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:24.787963 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:25:24.788122 (+   159us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:24.788174 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.788251 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.023548 (+235297us) raft_consensus.cc:1685] finished
0709 12:25:25.023570 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.023721 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":436,"prepare.queue_time_us":61315,"prepare.run_cpu_time_us":217,"prepare.run_wall_time_us":17174,"raft.queue_time_us":333569,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":557,"spinlock_wait_cycles":9189120,"thread_start_us":433861,"threads_started":3,"wal-append.queue_time_us":204916}
I20260709 12:25:24.930529 24520 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:25.019411 24398 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.001s
I20260709 12:25:25.039881 18886 leader_election.cc:400] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:25:25.086921 18886 leader_election.cc:403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:25.011703 24508 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:25.087925 24538 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:25.088303 24508 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12.
I20260709 12:25:25.089277 24520 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:24.953280 24412 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:25.089583 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49843.4us
I20260709 12:25:25.009546 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2682) took 2058 ms. Trace:
I20260709 12:25:25.069715 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.092870 24518 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:25.093333 24518 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.093688 24518 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:25.093840 24214 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:25.061240 24411 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:25:25.038033 23756 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:25.066699 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:25.099632 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:25.103610 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.071074 24488 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.075870 18773 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.077574 24185 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.086696 24398 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.090569 24490 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:25.071574 24507 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:25.090215 24412 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.111210 18842 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:25.153919 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.111783 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:25.111703 24214 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:25.155275 18772 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:25.092991 24367 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.156876 18847 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:25.108255 18922 rpcz_store.cc:276] 0709 12:25:22.950852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.228607 (+1277755us) service_pool.cc:224] Handling call
0709 12:25:24.228924 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.229147 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:24.667162 (+438015us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.007794 (+340632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:25.007840 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:25.007929 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.009332 (+  1403us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.009482 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57664,"prepare.queue_time_us":100519,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":57839,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":720058,"threads_started":2,"wal-append.queue_time_us":393748}
I20260709 12:25:25.161523 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:25.162134 18922 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.065364 24390 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.118551 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:25.118722 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52122.3us
I20260709 12:25:25.163630 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:25.120908 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:25.163971 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:25.164559 18914 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:25.111276 18664 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 13, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 13 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.136497 24385 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.136689 18771 raft_consensus.cc:2368] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18.
I20260709 12:25:25.137320 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:25.169149 19487 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 9.
I20260709 12:25:25.169720 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.169998 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:25.137985 18840 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:25.139997 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:25.171772 18921 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:25.173295 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:25.141039 24495 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 12:25:25.143491 23756 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.063222 24446 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.059880 24516 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:25.145777 24185 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.064074 24529 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:25:25.025254 24536 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.007027 24191 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:25.148520 24540 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
I20260709 12:25:25.132791 24345 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:25.116981 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:25.165805 18841 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:25.177915 18921 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:25.064803 24531 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.230433 18845 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:25.231271 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:25.145354 24526 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.238711 24398 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.243396 24402 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.245848 24402 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:25.238742 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45480 (request call id 1010) took 1068 ms. Trace:
I20260709 12:25:25.247668 19491 rpcz_store.cc:276] 0709 12:25:24.170879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.174535 (+  3656us) service_pool.cc:224] Handling call
0709 12:25:25.238543 (+1064008us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003075d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:25.238663 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481939328}
I20260709 12:25:25.248286 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.251127 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:25.253787 18921 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:25.023303 24334 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.195461 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.180998 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:25.167992 24523 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:25:25.204373 18766 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:25.202291 24446 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.197669 24495 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.195004 24520 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:25.201926 23756 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.194458 24527 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:25.219364 24345 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:25.220252 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 103359us
I20260709 12:25:25.288763 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.221961 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1195) took 2110 ms. Trace:
I20260709 12:25:25.222771 24372 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:25.224138 24191 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:25.225306 24529 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:25.290654 24214 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:25.302994 24214 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.303423 24214 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.304621 24496 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.305130 24496 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.206096 24516 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.226488 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:25.308525 18917 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.311188 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.312757 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.313421 18766 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:25.227126 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.314100 18768 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.228711 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.316834 18767 raft_consensus.cc:2368] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:25.317987 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.319561 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.320992 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.259665 18922 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:25.262846 18772 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:25.263021 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82112us
I20260709 12:25:25.202157 24519 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:25:25.249897 18914 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:25.247030 23844 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:25.331640 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:25.283425 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.287654 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:25.342609 18767 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:25.332834 18913 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:25.331252 18917 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:25.345521 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.289610 18916 rpcz_store.cc:276] 0709 12:25:23.111118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.271254 (+1160136us) service_pool.cc:224] Handling call
0709 12:25:24.288303 (+ 17049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.336649 (+ 48346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.336681 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:24.336724 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:24.336755 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.221727 (+884972us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b54003255d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:25.221772 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.221900 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110625536}
I20260709 12:25:25.264400 24334 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.291348 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.346735 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:25.347216 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55987us
I20260709 12:25:25.348220 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.292763 18918 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:25.267544 24517 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:25.349825 24517 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.350235 24517 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.227497 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2679) took 2282 ms. Trace:
I20260709 12:25:25.315568 18769 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.291159 24345 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:25.211422 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:25.360030 18840 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.361279 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.362061 18766 raft_consensus.cc:2368] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17.
I20260709 12:25:25.351011 24295 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:25:25.363199 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.364464 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.365307 18766 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:25.350769 18920 rpcz_store.cc:276] 0709 12:25:22.945013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.975366 (+1030353us) service_pool.cc:224] Handling call
0709 12:25:24.714751 (+739385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.814685 (+ 99934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.227310 (+412625us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54000f5d50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:25.227439 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571779840}
I20260709 12:25:25.313112 24214 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:25.355774 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107554us
I20260709 12:25:25.358978 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:25.379519 18847 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.369999 18840 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:25.384086 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.386549 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:25.349184 18767 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.292235 24372 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:25.360114 24351 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:25.362099 18769 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:25.314849 24535 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:25.280682 24518 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.342235 23844 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:25.372967 24544 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:25:25.391816 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:25.392606 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 141540us
I20260709 12:25:25.393332 18772 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:25.410239 18766 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:25.380448 24490 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:25.413714 18847 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:25.408454 23844 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.419916 24518 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.421453 24372 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.422996 24372 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.352200 24455 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.431676 18767 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:25.433054 18767 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:25.414435 18772 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:25.393317 24519 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:25.426779 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:25.393493 24521 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:25.399892 24529 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:25.441005 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58901.4us
I20260709 12:25:25.400086 24535 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.445842 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:25.444854 24535 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.399775 24412 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:25:25.442970 24295 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:25.446848 24529 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.462942 18772 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:25.409018 24506 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.474834 24295 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:25.482215 24295 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.486946 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.478910 24529 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.482841 24446 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.491714 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 957) took 1443 ms. Trace:
I20260709 12:25:25.492153 24502 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.492496 24446 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:25.486987 24547 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:25:25.479569 24526 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:25.497097 24504 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
I20260709 12:25:25.497432 24496 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.498265 24412 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:25.498773 24412 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:25.499711 24412 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.500531 24496 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.501070 24412 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:25.445912 24519 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:25.378662 18664 catalog_manager.cc:5697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 11, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 11 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.448959 24516 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.507454 24490 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:25.507638 23756 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.492156 18843 rpcz_store.cc:276] 0709 12:25:24.047853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.077032 (+ 29179us) service_pool.cc:224] Handling call
0709 12:25:24.077413 (+   381us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:24.107309 (+ 29896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.107338 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:24.107975 (+   637us) log.cc:844] Serialized 78 byte log entry
0709 12:25:24.208045 (+100070us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:24.227391 (+ 19346us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.350696 (+1123305us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b180031d380. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:25.490739 (+140043us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b180031d380. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287
0709 12:25:25.491092 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.491338 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.491441 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.491487 (+    46us) raft_consensus.cc:1685] finished
0709 12:25:25.491501 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.491652 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20929,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":25491,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":9379,"spinlock_wait_cycles":32555008,"thread_start_us":135150,"threads_started":2,"wal-append.queue_time_us":148090}
I20260709 12:25:25.535049 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:25.535751 18917 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:25.517283 24455 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.518836 24479 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:25.551312 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:25.553320 18920 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:25.555511 18917 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:25.521677 24535 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.523078 24214 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:25.523707 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.562976 24535 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:25.523979 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.565892 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.518144 24334 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.567440 24450 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:25.568094 18767 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:25:25.568194 24450 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:25.569224 24334 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:25.569446 24516 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:25.477062 18768 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:25.524672 24495 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:25.574787 18773 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:25.524843 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46536.9us
I20260709 12:25:25.576267 24489 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:25.576697 24489 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:25.525568 24558 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:25.528409 24536 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.577840 24558 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:25.577538 24489 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.529898 24553 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.530769 24519 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.531972 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:25.531350 18664 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 11, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 11 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:25.532598 24490 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.532757 24554 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:25.537396 24531 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:25.539734 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.497581 24504 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.524092 24526 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:25.573558 24191 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:25.574307 24518 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:25.577250 18773 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:25.570070 24516 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:25.579169 18767 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:25.580415 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:25.581116 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:25.583187 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.619436 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.620272 18767 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:25.584429 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.584920 18921 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.589294 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2795) took 1130 ms. Trace:
I20260709 12:25:25.621181 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.621568 18845 rpcz_store.cc:276] 0709 12:25:24.458435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.848813 (+390378us) service_pool.cc:224] Handling call
0709 12:25:25.589112 (+740299us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400206054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:25.589235 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780903168}
I20260709 12:25:25.590467 18766 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:25.589784 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.594233 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.621984 18767 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:25.595484 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:25.541517 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 665926us
I20260709 12:25:25.624395 18768 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.624532 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.625200 18767 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.581694 24185 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:25.602466 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:25.590994 24529 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.578970 24558 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.592166 24489 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:25.604786 24384 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:25.643905 23844 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.604306 24505 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:25:25.615717 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.529325 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:25.591653 24480 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:25.627501 24185 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:25.625080 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:25.569252 24450 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.627849 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.620471 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:25.652051 18771 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:25.646313 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:25.652776 19485 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 9.
I20260709 12:25:25.588544 24502 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:25.638131 18764 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:25:25.684664 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.684844 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 259942us
W20260709 12:25:25.686208 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 83881.1us
I20260709 12:25:25.641563 24529 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:25.642541 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2697) took 1055 ms. Trace:
I20260709 12:25:25.600415 24507 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.600220 24390 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.600122 24385 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.637804 18920 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:25.682526 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.711974 18773 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:25.646323 23844 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:25.694368 18915 rpcz_store.cc:276] 0709 12:25:24.587242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.587420 (+   178us) service_pool.cc:224] Handling call
0709 12:25:25.642301 (+1054881us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:25.642471 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610140544}
I20260709 12:25:25.696978 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:25.713361 19491 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:25.717135 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:25.717429 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 92436us
I20260709 12:25:25.720645 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:25.722977 18843 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:25.722882 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:25.723310 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:25.723860 18847 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:25.736851 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.734723 18768 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:25.739276 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.741464 18768 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.647255 24437 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:25.749428 18842 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:25.647061 24518 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:25.681484 24527 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.649873 24504 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:25.681288 24495 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.789923 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:25.756232 19491 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:25.757947 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2852) took 1047 ms. Trace:
I20260709 12:25:25.799119 18770 rpcz_store.cc:276] 0709 12:25:24.710340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.911459 (+201119us) service_pool.cc:224] Handling call
0709 12:25:24.973499 (+ 62040us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:25.027425 (+ 53926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.757752 (+730327us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b540029dbd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:25.757885 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141830912}
W20260709 12:25:25.799662 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 209941us
I20260709 12:25:25.800588 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:25.800698 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:25.647369 24480 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:25.752858 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:25.588738 24553 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.780354 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:25.780844 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:25.774338 18773 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:25.803321 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:25.780244 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:25.777693 18767 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:25.639143 24517 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.767676 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:25.766799 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:25.764315 18886 leader_election.cc:400] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:25.817234 18886 leader_election.cc:403] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:25.812427 19492 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:25.818586 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:25.819281 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:25.765609 24535 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.819928 19492 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.754276 24437 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:25.784376 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:25.693344 24191 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.781394 24485 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:25.760602 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.807363 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:25.648284 24185 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.809496 18844 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:25.778692 18921 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:25.793401 24434 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:25.782150 24412 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.823330 19483 raft_consensus.cc:2368] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13.
I20260709 12:25:25.735260 24507 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.835784 19488 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:25.790467 18768 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:25.652190 24516 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.835448 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:25.838976 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:25.710925 24502 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:25.783015 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59832.8us
I20260709 12:25:25.905473 24529 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.794335 24536 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:25.910810 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:25.911823 19486 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:25.810346 24557 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:25:25.747896 24385 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.735132 24390 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.762351 24518 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:25.904345 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 97054.2us
I20260709 12:25:25.809971 24278 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:25.907387 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68545.2us
I20260709 12:25:25.822785 24478 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.837432 24495 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:25.946805 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 194060us
I20260709 12:25:26.000264 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:25.991725 19456 leader_election.cc:400] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18.
I20260709 12:25:26.002131 19456 leader_election.cc:403] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:25:25.996884 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:26.002377 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1200) took 2188 ms. Trace:
I20260709 12:25:25.650831 18664 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.987362 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:26.035890 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48594.7us
I20260709 12:25:26.002852 18921 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15. Re-sending same reply.
I20260709 12:25:25.952752 24554 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:26.040477 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 239880us
W20260709 12:25:26.042970 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 133240us
W20260709 12:25:26.023300 24547 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:25:25.945241 24536 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.995275 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:25.989704 19491 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:26.005191 18917 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:26.002831 18918 rpcz_store.cc:276] 0709 12:25:23.813793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.475054 (+661261us) service_pool.cc:224] Handling call
0709 12:25:24.475410 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.349714 (+874304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.002124 (+652410us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003b4554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:26.002309 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879275776}
I20260709 12:25:25.827610 24505 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:25.849429 24488 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.057574 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:25.912176 24412 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:25.823570 24345 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.797099 24527 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.024206 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:26.082010 18916 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:25.999122 24478 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:25.857735 24485 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.003150 24191 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:25:26.082685 18845 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:26.054082 24536 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:25.996488 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:26.089938 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.090569 18920 raft_consensus.cc:2368] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17.
I20260709 12:25:25.910353 24552 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:26.029569 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:26.028999 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:26.032441 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:26.033411 18922 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:26.057066 24554 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:25.999243 24495 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:25.988559 24564 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.859759 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2850) took 1150 ms. Trace:
I20260709 12:25:26.038136 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:26.053440 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58278.1us
I20260709 12:25:25.989017 24278 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:26.006709 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1013) took 1459 ms. Trace:
I20260709 12:25:26.039589 24446 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:26.070833 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.084414 24505 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:26.117645 19490 rpcz_store.cc:276] 0709 12:25:24.547234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.556621 (+  9387us) service_pool.cc:224] Handling call
0709 12:25:24.557011 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.018963 (+461952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.006455 (+987492us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540079ed54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:26.006648 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965865728}
I20260709 12:25:26.071473 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.058871 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:26.077199 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:26.079195 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:26.123910 18918 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:25.998605 24492 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 12:25:26.025367 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.125906 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.125527 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48422.5us
I20260709 12:25:25.984916 24480 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.084142 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:26.129876 18921 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.006791 24402 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:25:26.085084 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:26.085285 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.070309 24295 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:26.034633 18919 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:26.095407 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65955.2us
I20260709 12:25:26.097976 18848 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:26.100093 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.084178 24526 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:26.101709 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:26.100983 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 336898us
I20260709 12:25:26.072893 24518 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.161578 18769 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:26.118036 18764 rpcz_store.cc:276] 0709 12:25:24.709543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.904367 (+194824us) service_pool.cc:224] Handling call
0709 12:25:24.904713 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.683875 (+779162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.859477 (+175602us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540017b1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:25.859687 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686144256}
I20260709 12:25:26.120944 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:26.127159 18846 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:26.128201 18812 leader_election.cc:400] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17.
I20260709 12:25:26.128146 24559 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.097185 24560 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:26.124280 18843 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:26.126888 24564 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.210227 18812 leader_election.cc:403] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:25:26.192062 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:26.220708 18845 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:26.191474 18840 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:26.213953 19492 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
W20260709 12:25:26.221072 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93008.1us
I20260709 12:25:26.185256 18921 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
W20260709 12:25:26.130561 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 92529.9us
I20260709 12:25:26.217518 18841 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:26.211701 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:26.101805 24495 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:26.228794 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.171066 24566 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:25:26.124596 24278 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.232920 18848 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:26.148622 24503 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:26.231787 18846 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:26.175089 24502 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.179469 24412 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.165417 24507 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.160013 24485 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.175952 24385 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.167201 24345 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.229349 24367 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.228467 24553 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.236701 24552 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:26.233281 24575 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.234987 24526 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:25:26.164839 24505 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.250880 24580 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:26.263219 24565 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:25:26.264158 24552 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:26.269279 24552 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.270114 24529 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:26.271344 24564 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.263059 24575 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.155185 24554 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:26.266997 24568 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:25:26.272795 24580 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:26.274305 24580 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.229810 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:26.147863 18664 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 12, leader changed from <none> to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 12 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:26.318348 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 197294us
W20260709 12:25:26.321470 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 91875.4us
W20260709 12:25:26.327800 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 3.107s (SENT) [suppressed 21 similar messages]
I20260709 12:25:26.335675 24345 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:26.336248 24390 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.337404 24385 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:26.338538 24390 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.339035 24295 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:26.337042 24345 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.339538 24390 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.352203 24295 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:26.354183 24295 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:26.331756 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 101909us
W20260709 12:25:26.330240 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 118477us
W20260709 12:25:26.322134 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 98477.7us
I20260709 12:25:26.358264 18841 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:26.320852 18913 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:26.369280 24345 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.368116 18664 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 12, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 12 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.272513 24536 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.384773 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:26.389207 24489 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:26.391803 24526 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:26.392168 24527 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.392391 24526 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:26.398905 24516 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:26.383963 24576 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17.
I20260709 12:25:26.390143 24489 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.384888 24492 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:26.370298 24345 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:26.415611 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 88073.9us
I20260709 12:25:26.428582 18768 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
W20260709 12:25:26.429848 24490 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.021s
I20260709 12:25:26.430667 24490 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.434015 24490 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.435427 18664 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 13, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 13 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.441970 24345 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.424669 24516 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:26.445464 24516 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.446817 24492 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:26.462548 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:26.466641 24580 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:26.472110 24580 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:26.394155 24526 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.480062 24526 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:26.448530 24492 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.487241 24390 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.488263 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:26.489266 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:26.490208 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:26.490741 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:26.450894 24489 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.492964 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:26.494614 24506 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.494850 24529 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:26.494518 24485 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:26.495661 24529 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:26.497277 24529 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.448743 24516 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.498981 24384 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:26.499660 24384 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:26.499161 24531 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.501396 24384 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.473618 24580 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.519572 24478 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.530376 24536 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.531569 24446 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18.
I20260709 12:25:26.531956 24384 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.532413 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:26.533874 24506 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:26.534698 24506 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.535131 24506 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:26.537722 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2587) took 1430 ms. Trace:
I20260709 12:25:26.538272 18842 rpcz_store.cc:276] 0709 12:25:25.107051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.155966 (+ 48915us) service_pool.cc:224] Handling call
0709 12:25:25.156243 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.749229 (+592986us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b540012f820. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8d1c0 00007f335af8e231 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c
0709 12:25:25.754471 (+  5242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.537084 (+782613us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54003bd154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:26.537432 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471281408}
I20260709 12:25:26.524323 24517 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.525313 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:26.558856 24334 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:26.525108 24278 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:26.539911 24569 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.485s	user 0.001s	sys 0.002s
W20260709 12:25:26.524435 24562 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.428s	user 0.000s	sys 0.004s
I20260709 12:25:26.541474 24575 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.546093 18770 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:26.562279 18839 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:26.562451 18770 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:26.564337 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2306) took 1288 ms. Trace:
I20260709 12:25:26.564070 18770 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:26.548785 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45789.2us
I20260709 12:25:26.569410 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2296) took 1299 ms. Trace:
I20260709 12:25:26.570015 18766 rpcz_store.cc:276] 0709 12:25:25.269751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.411108 (+141357us) service_pool.cc:224] Handling call
0709 12:25:25.590241 (+179133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.622961 (+ 32720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.568935 (+945974us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540036bfd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:26.569172 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411220224}
I20260709 12:25:26.549974 24345 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.571612 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:26.571813 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:26.573046 18770 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:26.573530 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:26.548237 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.564775 18772 rpcz_store.cc:276] 0709 12:25:25.275557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.487965 (+212408us) service_pool.cc:224] Handling call
0709 12:25:25.488353 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.498604 (+ 10251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.498636 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.499128 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.774693 (+275565us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:25.774759 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.774849 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.502263 (+727414us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:26.563761 (+ 61498us) raft_consensus.cc:1685] finished
0709 12:25:26.563797 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.564148 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9818,"raft.queue_time_us":10944,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":75131648,"thread_start_us":262754,"threads_started":1,"wal-append.queue_time_us":554765}
I20260709 12:25:26.578052 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:26.572074 24536 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:25:26.579849 24536 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:26.580462 24536 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:26.580605 24517 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:26.581331 18917 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:26.582733 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.583915 18848 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:26.585426 24185 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:26.591547 18840 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:26.591805 24492 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.559440 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:26.574169 18766 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:26.572942 18771 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:26.592360 24191 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.602051 19492 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:26.603387 24492 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.607296 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:26.608942 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49691us
I20260709 12:25:26.614668 24479 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:26.600606 18768 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:26.611770 24437 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.582237 24536 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.634847 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.608963 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:26.645236 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:26.647861 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:26.649154 19488 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:26.640015 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:26.440456 18664 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 12, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 12 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.637619 24345 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:26.581732 24517 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.657791 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:26.655620 24351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.003s	sys 0.019s
I20260709 12:25:26.666425 18842 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:26.669348 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:26.664604 24351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.228s	user 0.003s	sys 0.020s
I20260709 12:25:26.661203 24490 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:26.674352 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:26.684799 24593 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260709 12:25:26.676051 18737 leader_election.cc:400] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13.
I20260709 12:25:26.686754 18737 leader_election.cc:403] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:25:26.633834 24191 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.671588 24437 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.694813 18840 raft_consensus.cc:2368] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
W20260709 12:25:26.694972 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.695469 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.695922 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.698721 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:26.669085 24579 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:26.699497 24492 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.700016 24579 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.701963 24517 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.661470 24295 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:25:26.702534 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:26.694722 24552 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:25:26.687668 24351 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:26.706758 24552 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:25:26.692478 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 85477.1us
W20260709 12:25:26.710098 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.714572 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.716158 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 74698.9us
I20260709 12:25:26.716814 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:26.720801 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.719765 18841 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
W20260709 12:25:26.725092 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.727532 18664 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.729559 24480 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:26.732074 24518 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.734668 18915 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:26.736119 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2313) took 1141 ms. Trace:
I20260709 12:25:26.736594 18769 rpcz_store.cc:276] 0709 12:25:25.594105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.595233 (+  1128us) service_pool.cc:224] Handling call
0709 12:25:26.735679 (+1140446us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54001d4f54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:26.735901 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234988928}
W20260709 12:25:26.737242 24583 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.483s	user 0.003s	sys 0.000s
I20260709 12:25:26.739311 18767 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:26.742184 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:26.743304 18921 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:26.743178 18840 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:26.744779 24517 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.745514 24517 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.748720 24517 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.751578 24575 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.754707 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:26.755221 24575 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.757580 24575 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.729907 18664 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.765882 19490 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:25:26.766361 19490 pending_rounds.cc:85] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 9
I20260709 12:25:26.766654 19490 pending_rounds.cc:107] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:25:26.766949 19490 raft_consensus.cc:2889] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:26.768908 24561 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.750s	user 0.004s	sys 0.000s
I20260709 12:25:26.746160 24191 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:26.771385 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.772246 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:26.773219 18919 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:26.776692 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50642.2us
I20260709 12:25:26.776798 18664 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 16, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 16 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.777596 24552 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:26.778208 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:26.778442 18921 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:26.724684 24295 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13.
I20260709 12:25:26.780186 24384 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:26.781014 24384 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:26.782416 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.783214 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.784191 18839 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:26.785033 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.785826 18843 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:26.786043 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:26.786260 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.786468 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:26.787119 18845 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:26.788763 24495 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.013s
I20260709 12:25:26.791497 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:26.792661 24185 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:26.793200 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:26.793464 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:26.795161 24185 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:26.795550 24278 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.797277 18921 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:26.805212 24555 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:26.781810 24384 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.712845 24351 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.775671 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:26.810540 18841 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:26.822082 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2849) took 2102 ms. Trace:
W20260709 12:25:26.826887 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 66113.7us
I20260709 12:25:26.840196 18737 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:26.847013 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 71513.2us
I20260709 12:25:26.809046 24536 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:26.841522 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48478.9us
I20260709 12:25:26.853085 18843 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:26.813393 24185 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:26.805832 24555 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:26.860487 18844 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:26.862864 24559 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.863523 24559 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.863996 24185 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.864738 24491 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:26.866561 24372 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:26.866276 24555 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.867882 24555 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:26.868233 24412 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:26.868884 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:26.868955 24412 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.870596 23844 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:26.871376 24295 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.872267 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1020) took 1123 ms. Trace:
I20260709 12:25:26.872035 24295 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.872661 19484 rpcz_store.cc:276] 0709 12:25:25.749094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.750599 (+  1505us) service_pool.cc:224] Handling call
0709 12:25:25.751058 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.751361 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:26.575540 (+824179us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b18000f2aa0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf
0709 12:25:26.575780 (+   240us) log.cc:844] Serialized 14 byte log entry
0709 12:25:26.751572 (+175792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:26.759927 (+  8355us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:26.820575 (+ 60648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.842845 (+ 22270us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.872068 (+ 29223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10999,"prepare.queue_time_us":234545,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2646,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4825,"spinlock_wait_cycles":46736128,"thread_start_us":366620,"threads_started":2,"wal-append.queue_time_us":262876}
I20260709 12:25:26.876060 24345 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:26.876813 23844 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:26.876271 24529 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:26.875957 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:26.890569 24519 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:26.890957 18918 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:26.890807 24529 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:26.892900 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:26.866060 24559 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.880635 24402 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:26.881352 24504 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:26.881119 23844 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.805328 24495 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.825282 18765 rpcz_store.cc:276] 0709 12:25:24.701179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.701401 (+   222us) service_pool.cc:224] Handling call
0709 12:25:24.701819 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.737348 (+ 35529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.737396 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.724829 (+987433us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b18003b80c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a
0709 12:25:26.399435 (+674606us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b2c00057528. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:25:26.400461 (+  1026us) log.cc:844] Serialized 26 byte log entry
0709 12:25:26.658281 (+257820us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:26.662236 (+  3955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.663334 (+  1098us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.764536 (+101202us) raft_consensus.cc:1685] finished
0709 12:25:26.764580 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.803352 (+ 38772us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35078,"raft.queue_time_us":38562,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":17626,"spinlock_wait_cycles":23440512,"thread_start_us":252633,"threads_started":1,"wal-append.queue_time_us":352791}
I20260709 12:25:26.888295 24579 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:26.889559 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:26.856400 24492 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.893483 24529 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:26.897106 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:26.861866 24490 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:26.896858 24552 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:26.902977 18842 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:26.879660 24295 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:26.905547 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:26.911001 24490 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:26.912322 24490 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:26.918330 18913 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:26.861720 24506 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:26.920881 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52134.7us
I20260709 12:25:26.902936 24385 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:26.908636 24552 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.922276 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:26.906872 24491 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:25:26.957614 18739 leader_election.cc:400] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17.
I20260709 12:25:26.963850 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:26.972978 18918 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:26.973533 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:26.980229 18922 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:26.984241 18844 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:25:26.929358 24558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.014s	sys 0.007s
I20260709 12:25:26.930919 24552 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.003108 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:27.008148 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.009572 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:27.013653 18842 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:27.014184 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.018684 18921 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:26.994896 24504 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:26.950006 24517 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:27.021112 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:26.957729 24295 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:27.002381 24558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.014s	sys 0.015s
I20260709 12:25:26.879177 18664 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 13, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 13 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.954217 24575 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:27.028434 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 93719.7us
I20260709 12:25:26.999413 24478 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:25:27.026018 24479 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:25:27.037161 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:27.038059 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:26.936589 24385 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:27.048383 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:27.045840 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 146735us
I20260709 12:25:27.047765 19487 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:27.016945 24412 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.026173 24517 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.048911 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:27.027127 24504 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:26.936439 24492 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.061977 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.063047 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.063797 18922 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:27.049206 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:27.067495 18914 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:27.062870 18768 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:27.070197 18919 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:27.070197 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:27.072722 19484 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:27.074184 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:27.076160 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.077884 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:27.078902 24489 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:27.079309 24489 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:27.079696 24489 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.082020 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.082955 18919 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:25:27.083937 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.085116 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.085867 18919 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:27.089102 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.089428 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.060456 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.087350 18919 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:27.062299 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:27.092411 18917 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:25:27.095114 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:27.097782 24606 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:25:27.099565 18772 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:27.101063 18772 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:27.102145 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:27.103096 18846 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:27.104208 18770 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:27.059549 24295 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.092810 18917 pending_rounds.cc:85] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 6
I20260709 12:25:27.107250 18917 pending_rounds.cc:107] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:27.107540 18917 raft_consensus.cc:2889] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:27.108651 24295 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.115710 18769 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.115283 24385 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.115899 24504 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.118861 24506 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.120363 19485 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 12:25:27.102442 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.098253 18767 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.097666 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.122848 18773 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:27.127193 18921 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:27.060436 24517 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:27.135632 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.143460 19487 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:27.149664 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:27.160740 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.163177 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.178174 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:27.179261 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.182353 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:27.091229 24575 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.188627 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:27.160039 24526 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.198585 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:27.193634 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 244243us
I20260709 12:25:27.205331 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.167795 24558 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:27.181999 24595 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:27.210965 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.212512 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:27.184695 24185 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.225198 18914 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:27.231639 18773 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:27.173475 24295 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:25:27.236730 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:27.238619 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:27.261076 18769 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
W20260709 12:25:27.263060 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 43517.5us
W20260709 12:25:27.261915 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 217595us
I20260709 12:25:27.220479 24531 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.214828 24402 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:25:27.208371 24526 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:27.267848 18739 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:27.264205 24609 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:25:27.264514 24580 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:27.281824 24518 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.003s
I20260709 12:25:27.245471 24595 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.283118 18918 raft_consensus.cc:2410] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:27.268718 24485 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:27.266117 24191 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:27.287537 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 89074.5us
I20260709 12:25:27.252271 24185 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:27.297971 24185 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:27.298547 24559 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:27.299012 24559 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:27.300026 24559 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.301339 24559 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.256831 24558 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.283352 24402 consensus_queue.cc:1243] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:27.294811 24536 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:27.290468 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:27.309123 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:27.288599 24479 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:27.290233 24334 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:27.289618 24485 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.286764 24278 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:27.322585 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:27.322497 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44019.9us
I20260709 12:25:27.280130 24489 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.318264 18921 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:25:27.310878 24384 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.006s
I20260709 12:25:27.325706 24402 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:27.326610 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48690.7us
I20260709 12:25:27.282598 24531 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:27.347467 18767 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:27.316251 24492 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:27.351681 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 104454us
I20260709 12:25:27.320837 24479 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.383939 24479 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:27.385715 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:27.324268 24485 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:27.386693 19486 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.389561 24489 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.391794 24575 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.393731 18848 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:27.356240 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1090) took 1660 ms. Trace:
W20260709 12:25:27.356398 24608 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:25:27.335997 24595 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:27.330453 24385 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:25:27.359226 24278 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.364272 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1095) took 1603 ms. Trace:
I20260709 12:25:27.372176 24480 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:25:27.397629 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 72110.1us
W20260709 12:25:27.377709 24618 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:25:27.382687 18772 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:27.383296 24526 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:27.394085 24531 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:27.269145 18664 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 14, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 14 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:27.448596 18664 catalog_manager.cc:5697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.334879 24402 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:27.397536 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75209.3us
I20260709 12:25:27.450771 24402 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.451922 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:27.452934 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:27.396009 19485 rpcz_store.cc:276] 0709 12:25:25.695506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.695725 (+   219us) service_pool.cc:224] Handling call
0709 12:25:25.696126 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.120840 (+1424714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.355906 (+235066us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400562a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:27.356173 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3274281856}
W20260709 12:25:27.376236 24612 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:27.455875 24575 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:27.456108 24531 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:27.321151 24412 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:25:27.418182 24351 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:27.429790 23756 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:25:27.432180 24278 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.348466 24384 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:27.437019 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.467404 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.468243 19486 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:27.442080 24517 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.410372 24492 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:27.424000 24480 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:25:27.464888 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 127688us
I20260709 12:25:27.456516 24575 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:27.419314 19487 rpcz_store.cc:276] 0709 12:25:25.761183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.768395 (+  7212us) service_pool.cc:224] Handling call
0709 12:25:27.363982 (+1595587us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400580054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:27.364161 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2839827712}
I20260709 12:25:27.457314 24622 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.459560 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:27.434058 24558 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:27.465310 24351 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.487404 24558 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:27.488732 18764 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:27.490065 18769 pending_rounds.cc:85] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 10
I20260709 12:25:27.490444 18769 pending_rounds.cc:107] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:25:27.490763 18769 raft_consensus.cc:2889] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:27.490489 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.491866 18767 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:27.467337 24531 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:27.472059 24552 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.498046 24622 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:27.511076 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:27.511186 23756 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.515874 23756 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:27.516566 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 95189.3us
I20260709 12:25:27.519842 24517 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.521346 24295 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:27.522342 24622 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:27.523742 24529 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:27.524341 24529 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:27.526418 24495 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.527021 24529 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:27.531711 24402 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.534915 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:27.536358 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:27.536713 24485 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:27.537238 19490 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:27.539373 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:27.540635 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 160434us
I20260709 12:25:27.541810 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:27.542896 24575 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:27.485445 24351 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.549437 19484 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:27.550840 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:27.546114 24620 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.205s	user 0.000s	sys 0.002s
I20260709 12:25:27.501765 24489 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.573836 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:27.585386 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.585747 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.586061 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:27.594720 18768 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.595934 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:27.595986 18767 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:25:27.598068 18914 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:27.600543 19486 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:27.600622 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.601117 18764 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:27.524336 24437 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:27.593230 18766 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:27.604290 19490 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:27.610270 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:27.610608 18887 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.503s (SENT)
I20260709 12:25:27.611088 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:27.612691 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.613313 18918 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:27.614086 18773 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:27.577077 24526 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:27.614879 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 64118.2us
I20260709 12:25:27.561491 24552 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:27.621858 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:27.624085 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:27.562137 24295 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:27.628351 24621 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 12:25:27.629215 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60367us
I20260709 12:25:27.630698 18842 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:27.631145 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.631227 18843 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:27.619177 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:27.569900 24517 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:27.576025 23756 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:27.501302 24480 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.635735 18841 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:27.567883 24622 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:25:27.641045 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:27.615226 24334 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.606943 24437 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:27.645931 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:27.615015 24402 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:27.629969 24518 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:27.600203 24559 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:25:27.637791 24412 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:27.659108 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.632710 24526 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:27.663693 18842 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:27.647939 24504 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:27.481316 18664 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 16, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 16 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.660344 24518 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.683029 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:27.682163 18843 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
W20260709 12:25:27.684729 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 98788.9us
W20260709 12:25:27.691262 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.697207 18921 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:27.699635 18846 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:27.669332 24526 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:27.702644 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 78672.5us
I20260709 12:25:27.703965 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:27.674503 24480 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:27.706270 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:27.741328 18916 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.743543 19487 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:27.744748 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:27.685716 24518 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.660599 24334 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.671169 24402 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:25:27.761523 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:27.747190 24618 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:27.762496 18918 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:27.738965 24384 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:27.764839 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:27.739271 24485 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:27.776400 18913 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:25:27.778088 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74204.3us
I20260709 12:25:27.784654 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:27.771395 24586 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.791855 18840 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:27.792353 18846 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:27.670410 24531 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:27.705381 24437 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:27.821316 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49806.2us
I20260709 12:25:27.807477 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:27.825704 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:27.783272 24455 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:27.764640 24295 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:27.836649 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:27.855113 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:27.855353 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.871640 18839 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
W20260709 12:25:27.889420 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 65428.9us
I20260709 12:25:27.844657 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:25:27.850315 18848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2806) took 1212 ms (client timeout 1529 ms). Trace:
I20260709 12:25:27.890820 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:27.911391 19486 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 11: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:27.911386 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66823.7us
I20260709 12:25:27.911978 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:27.910753 18848 rpcz_store.cc:269] 0709 12:25:26.638357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.638649 (+   292us) service_pool.cc:224] Handling call
0709 12:25:27.850081 (+1211432us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b5400380754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:27.850207 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445320960}
I20260709 12:25:27.787737 24504 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:25:27.914144 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:27.835922 24634 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 12:25:27.928421 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:27.869670 24519 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:27.919539 18847 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:27.941639 18918 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:25:27.942054 18918 pending_rounds.cc:85] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 14
I20260709 12:25:27.942255 18918 pending_rounds.cc:107] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:25:27.942812 18918 raft_consensus.cc:2889] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:27.853271 24616 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.513s	user 0.001s	sys 0.002s
I20260709 12:25:27.925977 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:27.861182 24580 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.927538 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:27.824307 23756 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:27.919338 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:27.933058 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44005.5us
I20260709 12:25:27.914438 24455 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:27.938570 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:27.975823 19490 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:27.948372 24579 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:28.004501 18916 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:27.959918 24412 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:28.005511 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:27.960953 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:27.962661 24536 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:27.963208 24639 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:25:27.964236 24631 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:27.967988 18844 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:27.971999 18768 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:27.929296 19485 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:28.014416 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:28.015146 18770 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:27.966885 24479 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.582s	user 0.002s	sys 0.010s
I20260709 12:25:27.927125 24446 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:27.950237 24505 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:28.013711 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:27.923049 24485 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.969909 23844 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:27.966182 24437 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.938599 24478 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.810441 24586 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.004973 24579 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:28.047600 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:28.047878 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107934us
W20260709 12:25:28.034931 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 74051.8us
I20260709 12:25:28.009281 24506 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:28.013680 24631 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:28.062518 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:28.068836 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:28.036307 24446 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:28.076920 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:28.048678 24536 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:28.079919 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 69244.8us
I20260709 12:25:28.040805 24505 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:28.014782 24552 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:25:28.024052 24185 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:28.009474 24580 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:28.036665 24479 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:28.093765 24640 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:25:28.083468 24622 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:28.131830 24622 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.132279 24622 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:28.077857 24455 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.085390 24446 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.103422 24478 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.141433 19488 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:28.105154 18770 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:28.122783 24559 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:25:28.127784 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1106) took 1057 ms. Trace:
I20260709 12:25:28.130154 24479 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:28.103065 24638 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:25:28.116628 24575 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:28.164422 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:28.144011 19492 rpcz_store.cc:276] 0709 12:25:27.070842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.071116 (+   274us) service_pool.cc:224] Handling call
0709 12:25:27.071445 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.097510 (+ 26065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.097540 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.098040 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.207511 (+109471us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:27.207570 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.207683 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:27.852536 (+644853us) spinlock_profiling.cc:243] Waited 84.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:28.123201 (+270665us) raft_consensus.cc:1685] finished
0709 12:25:28.123225 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.127703 (+  4478us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25604,"raft.queue_time_us":27252,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":193668480,"thread_start_us":108952,"threads_started":1,"wal-append.queue_time_us":191093}
I20260709 12:25:28.118439 24555 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:28.112098 23756 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:28.068176 24485 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:28.137586 24334 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:28.155048 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 181195us
I20260709 12:25:27.879468 18664 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 14, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:28.121646 24506 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:28.154363 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 209219us
W20260709 12:25:28.279706 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 67692.2us
I20260709 12:25:28.202443 24555 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:28.147986 24455 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.176859 24412 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
W20260709 12:25:28.289799 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 171468us
I20260709 12:25:28.287191 24647 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:28.294531 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 110401us
I20260709 12:25:28.165835 24579 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:28.207103 24334 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:25:28.302513 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:28.294920 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 83944.5us
I20260709 12:25:28.297528 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:28.201462 24631 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.294891 24651 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:28.312227 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 304777us
I20260709 12:25:28.209887 24505 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:28.319226 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 232430us
W20260709 12:25:28.330965 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:28.331753 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.315981 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:28.307708 24385 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:28.300940 24517 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:25:28.311858 24579 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.305980 24384 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:25:28.353363 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:28.350373 24641 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.297900 24647 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:28.359864 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.346956 24505 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.344537 24631 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.362524 24506 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:28.409256 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:28.384510 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 270219us
I20260709 12:25:28.423506 18765 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:25:28.384040 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 177867us
I20260709 12:25:28.373461 24191 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:28.372668 24656 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:28.320755 24651 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.388504 24485 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:28.446436 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:28.454770 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 83616.2us
I20260709 12:25:28.355276 24385 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.415612 24661 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:28.467968 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 156280us
I20260709 12:25:28.347115 24555 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.435707 24536 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:28.477005 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 174618us
I20260709 12:25:28.469782 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:28.479235 18913 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:28.480779 18919 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:28.482559 18844 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.350196 18664 catalog_manager.cc:5697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 15, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 15 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:28.440985 24580 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:28.442348 24345 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:28.503620 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:28.470328 24478 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:28.512679 18922 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:28.485857 24661 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.364795 24641 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.492967 24485 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:28.491819 24650 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:28.502380 24384 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:28.507270 24646 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.257s
I20260709 12:25:28.569957 24384 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:28.570252 24642 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
W20260709 12:25:28.571215 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84428.8us
I20260709 12:25:28.510715 24586 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:28.556761 24661 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:28.546093 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:28.571084 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 217846us
I20260709 12:25:28.581453 18770 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:25:28.583328 18764 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 12:25:28.581259 24580 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:28.585579 24526 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.844s	user 0.012s	sys 0.000s
I20260709 12:25:28.585988 24385 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:28.595042 23844 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 12:25:28.595577 23844 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:28.599771 24647 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:28.487875 24191 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.603308 18664 catalog_manager.cc:5697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:28.604486 24191 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:28.605824 24480 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.865s	user 0.006s	sys 0.004s
I20260709 12:25:28.605232 18664 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 6 to 9, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 9 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:28.606818 24651 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:28.607985 24641 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:28.613143 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:28.569173 24650 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.619532 18768 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:28.625317 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:28.625553 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:28.627173 19485 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:28.627512 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:28.571163 24384 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:28.645303 18768 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
W20260709 12:25:28.645211 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 221421us
I20260709 12:25:28.660501 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:28.662438 18765 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:28.660022 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:28.622223 24650 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:28.686430 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 130570us
I20260709 12:25:28.684437 18768 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:28.689122 24627 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.689940 24627 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.693192 24627 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:28.694021 24657 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:25:28.696180 24654 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:28.696769 24654 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.697188 24654 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:28.698482 24653 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:25:28.586180 24526 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:28.707173 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:28.625103 24580 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:25:28.710450 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:28.712764 18768 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:28.711581 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:28.680327 24485 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:28.718672 19488 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:25:28.719844 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 220268us
W20260709 12:25:28.721325 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 100002us
I20260709 12:25:28.722503 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:28.721675 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:28.724308 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:28.732443 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:28.733561 18765 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:28.679145 24517 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 12:25:28.739920 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.645818 24536 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.744942 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:28.740381 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:28.745813 18768 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:28.742491 24437 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.683s	user 0.013s	sys 0.000s
I20260709 12:25:28.729789 23756 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:25:28.752071 24479 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:28.760164 24518 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.989s	user 0.014s	sys 0.000s
I20260709 12:25:28.773742 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:28.814604 18768 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
W20260709 12:25:28.819018 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 87591.8us
W20260709 12:25:28.774756 24622 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.009s
W20260709 12:25:28.780274 24351 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.180s	user 0.012s	sys 0.004s
W20260709 12:25:28.845166 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 97587.8us
I20260709 12:25:28.784761 24676 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.784087 24666 raft_consensus.cc:2764] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:25:28.840235 24479 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.784897 24659 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.860337 23756 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:28.780367 24518 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:28.862877 24678 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:25:28.862732 24455 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:28.892882 24664 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.893573 24664 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:28.869115 24628 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:28.896661 24628 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.881948 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:28.900964 18765 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:28.884363 18839 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:28.884567 18766 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:25:28.869998 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127453us
I20260709 12:25:28.849092 24622 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:28.904475 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:25:28.861546 24671 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:25:28.881578 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:28.907012 18768 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:28.888820 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:28.909178 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:28.911988 18845 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:28.914949 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:28.915622 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:28.916656 18918 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:28.915652 18768 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:28.914027 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:28.927243 18914 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:28.785050 24673 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.142s
W20260709 12:25:28.880100 24621 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.005s
I20260709 12:25:28.959427 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:28.928318 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:28.929934 18848 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.956275 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:28.963798 18922 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:28.959754 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:28.967131 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47181.8us
I20260709 12:25:28.875211 23756 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:28.927266 24579 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.001s
I20260709 12:25:28.975620 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:28.929514 24627 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:28.881855 24526 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:28.979826 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 126469us
W20260709 12:25:28.973645 24505 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
I20260709 12:25:28.900061 24518 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:28.900071 24628 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:28.874671 24479 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.983880 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:28.778892 18664 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 14, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 14 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:28.866021 24676 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:28.980517 24627 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:29.008075 18917 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:29.010803 24660 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:28.989800 24622 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:28.880656 24351 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:28.999614 24685 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:25:29.019279 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:28.977187 24648 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 12:25:29.039095 24692 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:25:29.040560 24696 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:29.041105 24696 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:29.041507 24696 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:29.047466 24674 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:25:29.047648 18664 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 11, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 11 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:29.050837 18767 raft_consensus.cc:1217] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[11.6-13.7]   Dedup: 11.6->[13.7-13.7]
I20260709 12:25:29.051409 18767 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 12:25:29.002223 24664 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.050558 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2888) took 1075 ms. Trace:
I20260709 12:25:28.907745 24659 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.020147 24627 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:29.077286 19484 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:29.071116 18773 rpcz_store.cc:276] 0709 12:25:27.975286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.005742 (+ 30456us) service_pool.cc:224] Handling call
0709 12:25:28.031700 (+ 25958us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:28.333355 (+301655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.333390 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:28.339977 (+  6587us) log.cc:844] Serialized 52 byte log entry
0709 12:25:28.659849 (+319872us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:28.699729 (+ 39880us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.704564 (+  4835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.704653 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.050151 (+345498us) raft_consensus.cc:1685] finished
0709 12:25:29.050171 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.050350 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11667,"prepare.queue_time_us":44954,"prepare.run_wall_time_us":43,"raft.queue_time_us":25308,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":20770,"spinlock_wait_cycles":7720704,"thread_start_us":518857,"threads_started":2,"wal-append.queue_time_us":386656}
W20260709 12:25:29.094403 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 78822.5us
I20260709 12:25:29.100507 18764 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:29.075944 24295 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:29.083642 24536 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:29.087311 24485 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:29.075865 24622 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:25:29.109632 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.070248 24660 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.123340 24485 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.106570 24536 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.049654 18664 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 15, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 15 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:25:29.129745 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 201475us
I20260709 12:25:29.139057 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.141269 18920 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
W20260709 12:25:29.132934 24699 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 12:25:29.132342 24684 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 12:25:29.132417 24701 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:25:29.143281 24695 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:29.156515 24695 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.157439 24641 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:29.157907 24641 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:29.159143 24695 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.143594 24672 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:29.136945 24536 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.146941 24479 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.149041 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45480 (request call id 1033) took 1145 ms. Trace:
W20260709 12:25:29.149390 24661 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.000s
I20260709 12:25:29.161139 19484 rpcz_store.cc:276] 0709 12:25:28.003574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.016028 (+ 12454us) service_pool.cc:224] Handling call
0709 12:25:29.148833 (+1132805us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400590e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:29.148975 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330883968}
I20260709 12:25:29.141309 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.168408 24641 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.169883 24641 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:29.170914 24696 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:29.171875 24446 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.000s	user 0.010s	sys 0.003s
I20260709 12:25:29.172472 24676 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.172350 24446 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.173014 24622 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:29.173475 24622 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.173523 24696 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.173967 24622 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:29.177716 24631 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.000s
I20260709 12:25:29.178783 18915 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:29.179265 18773 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:29.141916 24295 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.182948 24295 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.185412 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.186132 18920 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:29.199954 24659 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.206748 24351 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.208827 24446 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.208376 18664 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 14, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:29.211443 24654 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.007s
I20260709 12:25:29.211895 24654 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.162727 24672 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.216459 24672 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:29.217270 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54298.9us
I20260709 12:25:29.219460 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:29.223456 24650 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 12:25:29.223935 24650 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.225994 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.226806 18773 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:29.228457 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.167852 24661 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.230816 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.231372 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.232057 18773 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:29.232300 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:29.232617 24661 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.232931 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:29.233132 18770 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:29.233670 18773 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:29.230913 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.234879 18768 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
W20260709 12:25:29.236017 24669 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.567s	user 0.003s	sys 0.000s
I20260709 12:25:29.237025 24648 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.237926 18916 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:29.237589 24648 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.239172 24558 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.239311 18921 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:29.239722 24558 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.240182 24479 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.237051 18766 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:29.240679 24479 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.241143 24677 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:29.241683 24677 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.242911 18848 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:29.243557 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:29.216449 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1030) took 1325 ms. Trace:
I20260709 12:25:29.245433 19491 rpcz_store.cc:276] 0709 12:25:27.891523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.893661 (+  2138us) service_pool.cc:224] Handling call
0709 12:25:27.920429 (+ 26768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.175992 (+255563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.176029 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.275226 (+ 99197us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.726925 (+451699us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:28.728248 (+  1323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.216007 (+487759us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400510254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:29.216059 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.216129 (+    70us) raft_consensus.cc:1685] finished
0709 12:25:29.216144 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.216381 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12104,"raft.queue_time_us":5055,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":70598,"spinlock_wait_cycles":575876480,"thread_start_us":422866,"threads_started":1,"wal-append.queue_time_us":636042}
I20260709 12:25:29.254001 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2618) took 1468 ms. Trace:
I20260709 12:25:29.255038 18664 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 14, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:29.256462 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:29.257064 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.257903 24479 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.259263 24660 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.254662 18845 rpcz_store.cc:276] 0709 12:25:27.785359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.785496 (+   137us) service_pool.cc:224] Handling call
0709 12:25:27.821340 (+ 35844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.919811 (+1098471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.253606 (+333795us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003be054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:29.253905 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498646272}
W20260709 12:25:29.265110 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43823.7us
I20260709 12:25:29.266598 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:29.271670 18914 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 20 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:25:29.274089 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:29.323381 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49420.9us
I20260709 12:25:29.344532 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:29.214202 24654 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:29.366833 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67624.1us
I20260709 12:25:29.380666 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.226255 24650 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.364413 24687 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:29.391856 24367 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.392674 24367 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.396509 24648 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.276211 24351 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:29.271373 24518 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.382859 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.409968 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:29.403291 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.410712 18767 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:29.276247 24676 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:29.403328 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:29.277164 24519 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:29.408164 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.411198 19491 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:29.422813 18844 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:29.425436 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.426424 19485 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:29.429163 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.428364 18847 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:29.382230 24672 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:29.429098 24688 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:25:29.343258 24491 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:25:29.438446 18769 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:29.432739 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.430238 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:29.448695 24555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.031s	sys 0.040s
W20260709 12:25:29.450337 24555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.031s	sys 0.040s
I20260709 12:25:29.371001 24622 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.425261 24660 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:29.471084 18766 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:29.368522 24652 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:25:29.434409 24665 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.439198 24412 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:29.441591 24351 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:29.438572 24650 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:25:29.429564 24676 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:29.437212 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61329.3us
I20260709 12:25:29.492074 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.521607 18767 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:29.517943 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 259251us
I20260709 12:25:29.495908 24657 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:29.522591 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.525267 24559 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.531147 18769 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:25:29.547287 18771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.016s
W20260709 12:25:29.548494 18771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.000s	sys 0.017s
I20260709 12:25:29.508065 24677 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.503255 24665 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.500432 24660 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:29.559741 24712 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:25:29.559937 24714 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:25:29.554867 24631 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:29.552366 24519 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:29.514652 24412 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:29.569515 24691 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.669s	user 0.003s	sys 0.000s
I20260709 12:25:29.553169 24506 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:25:29.579352 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.566538 24351 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.551002 24580 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:29.596912 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:29.599578 18919 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:29.598074 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 153456us
I20260709 12:25:29.572805 24558 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.544363 24627 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.569566 24622 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.589093 24519 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:29.553406 24559 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.555114 24657 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.590755 24659 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:29.580049 24536 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.597849 24504 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:25:29.623281 24627 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.612782 24519 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.621388 19458 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.594617 24631 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.620882 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.651245 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:29.655845 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:29.656278 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.657760 18766 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:29.619642 24622 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:29.658699 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:29.664652 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:29.619130 24664 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:29.658368 18738 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.666153 19484 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:29.636253 24660 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.615917 24518 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:25:29.611055 24580 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.666231 24683 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:29.651473 24661 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:29.666263 24649 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:29.687227 18844 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:29.668332 24622 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.669570 24385 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:29.744279 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.681145 23844 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:29.748844 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:29.666594 24695 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:29.669731 24504 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:29.752538 24665 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.690105 24334 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:25:29.686142 24683 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:29.690644 24505 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:29.763342 24559 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.752992 24725 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:25:29.739154 24650 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:25:29.766654 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2616) took 2026 ms. Trace:
I20260709 12:25:29.767084 18842 rpcz_store.cc:276] 0709 12:25:27.741354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.757919 (+ 16565us) service_pool.cc:224] Handling call
0709 12:25:27.758233 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.764566 (+  6333us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:28.018489 (+253923us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.225138 (+1206649us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b18002ef1e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:29.765262 (+540124us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18002ef1e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287
0709 12:25:29.765713 (+   451us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.766099 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.766267 (+   168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:29.766314 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:29.766365 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.766456 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.766589 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23243,"prepare.queue_time_us":124160,"prepare.run_cpu_time_us":163,"prepare.run_wall_time_us":9471,"raft.queue_time_us":70956,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":31642,"spinlock_wait_cycles":58866304,"thread_start_us":620614,"threads_started":3,"wal-append.queue_time_us":404399}
I20260709 12:25:29.768967 24384 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.774962 24676 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.775417 24412 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.776441 24536 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.691743 24622 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:29.751448 23844 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.715370 24385 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.758106 24402 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.779019 24385 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:29.779274 24641 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.609s	user 0.013s	sys 0.000s
I20260709 12:25:29.780805 24580 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.781435 23844 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:29.687948 24649 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:29.790588 24730 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 12:25:29.792199 24631 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:29.792515 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 113786us
I20260709 12:25:29.793421 24656 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:29.761194 24718 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:25:29.794328 24295 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:29.794750 24295 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:29.686103 24661 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:29.795954 24661 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:29.795866 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.796336 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:29.797081 18913 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:29.797257 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.797844 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:29.760425 24716 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:29.798483 18913 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.799948 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.801160 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.795717 24295 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.797845 18919 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:29.803550 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:29.803709 24656 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:29.804371 24656 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.804780 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.806074 24687 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:29.803544 24295 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.793569 24652 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:29.809195 24652 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:29.809584 24652 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:29.806074 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.810530 24652 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.811817 24652 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:29.812769 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.815001 24673 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:29.816394 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.675331 24664 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.787235 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.817174 18919 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:29.817363 18916 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:29.818740 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.820389 18913 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:29.797876 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:29.756233 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:29.821645 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.820529 18917 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
W20260709 12:25:29.823045 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66985.4us
I20260709 12:25:29.824038 24677 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:29.822178 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:29.824178 24559 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:29.828047 18916 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:25:29.824844 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:29.825111 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:29.790709 24649 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:29.826547 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:29.821641 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.843742 18916 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:29.845285 18919 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:25:29.845626 18917 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:29.826047 24677 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.826261 24641 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:29.795481 24385 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.827023 24687 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:29.849337 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.862936 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.865432 18847 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:25:29.828071 24559 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.867851 24559 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:29.864194 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.866298 24402 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:29.871099 24402 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.871570 24402 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.871876 24622 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.867265 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.874871 24367 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.878412 24657 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.880641 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.883577 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.885612 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.886272 18922 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:29.885926 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:29.887239 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:29.887539 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.887809 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.888108 18847 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.888671 18846 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:29.847239 24504 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:29.891177 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.847180 24627 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:29.903141 19484 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:29.862164 24677 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.893009 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.861586 24666 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:29.904366 18841 raft_consensus.cc:2368] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15.
I20260709 12:25:29.896602 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.930030 18765 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:29.925730 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:29.930967 18772 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:29.931042 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:29.926043 18771 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:29.931666 18765 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:29.851708 24656 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.932860 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.926422 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.937760 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:29.938962 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:29.939791 18773 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.936666 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:29.948987 18846 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:29.950873 18846 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:25:29.951265 18846 pending_rounds.cc:85] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 6
I20260709 12:25:29.951524 18846 pending_rounds.cc:107] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:29.951776 18846 raft_consensus.cc:2889] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:29.889678 24641 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:29.954267 24664 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:29.954612 24622 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.955458 24641 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.956656 24385 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:29.958010 24661 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:29.960570 24661 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:29.961807 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:29.947922 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44470us
I20260709 12:25:29.963251 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.965137 18839 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:29.828770 24683 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:29.966374 18847 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:29.897332 24725 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:29.927423 24733 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:25:29.983098 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:29.985072 18847 raft_consensus.cc:2376] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12. Re-sending same reply.
I20260709 12:25:29.994277 18843 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:25:29.994199 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.994855 18843 pending_rounds.cc:85] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 6
I20260709 12:25:29.995165 18843 pending_rounds.cc:107] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:25:29.995445 18843 raft_consensus.cc:2889] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:29.998725 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:29.999044 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 3.107s (SENT)
I20260709 12:25:30.001536 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:29.943646 24504 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:30.051537 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.122512 24214 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.248s
I20260709 12:25:30.214902 18765 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:29.980845 24518 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
W20260709 12:25:30.126849 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127861us
W20260709 12:25:30.089040 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 108365us
I20260709 12:25:30.087987 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:29.979396 24506 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 12:25:30.007987 24683 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.125484 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.085559 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:30.217286 18772 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
W20260709 12:25:30.216660 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 253611us
I20260709 12:25:30.228984 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:30.231992 18769 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:30.218151 24519 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.551s	user 0.017s	sys 0.001s
I20260709 12:25:29.982151 24666 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:30.227082 24742 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.220s	user 0.016s	sys 0.002s
I20260709 12:25:30.224596 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:30.214341 24701 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.127s	user 0.007s	sys 0.000s
I20260709 12:25:30.225512 24657 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:30.223627 24736 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.114s	user 0.000s	sys 0.008s
I20260709 12:25:30.242954 24506 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:30.234334 18771 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:30.243378 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:30.265697 18842 raft_consensus.cc:2376] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16. Re-sending same reply.
I20260709 12:25:30.245067 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:30.250975 18916 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:30.250826 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:30.209022 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.255806 18843 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:30.247710 24345 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.267606 24666 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.268352 24384 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:30.373950 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:30.269948 18915 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:25:30.223832 24641 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.272760 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2720) took 1171 ms. Trace:
I20260709 12:25:30.273327 24665 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:30.274682 24580 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:30.275358 24686 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:30.277212 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:30.277451 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:30.279556 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.290743 24278 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:30.217830 24479 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:30.297904 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2637) took 1036 ms. Trace:
I20260709 12:25:30.400920 19484 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:30.401191 24479 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.401119 18845 rpcz_store.cc:276] 0709 12:25:29.261973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.262105 (+   132us) service_pool.cc:224] Handling call
0709 12:25:29.262506 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:29.378965 (+116459us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:29.548498 (+169533us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.789884 (+241386us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:30.284467 (+494583us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b18002ccbc0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a
0709 12:25:30.285050 (+   583us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.285181 (+   131us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:30.285854 (+   673us) log.cc:844] Serialized 52 byte log entry
0709 12:25:30.286040 (+   186us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:30.286293 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.297408 (+ 11115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.297606 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.297664 (+    58us) raft_consensus.cc:1685] finished
0709 12:25:30.297678 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.297839 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115145,"prepare.queue_time_us":201829,"prepare.run_cpu_time_us":203,"prepare.run_wall_time_us":189,"raft.queue_time_us":127117,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":7579,"spinlock_wait_cycles":39329280,"thread_start_us":149662,"threads_started":2,"wal-append.queue_time_us":120945}
I20260709 12:25:30.404028 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.404815 18845 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:30.405675 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:30.336896 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.279536 24724 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.644s	user 0.001s	sys 0.003s
I20260709 12:25:30.368391 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.268641 24518 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:30.383028 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.407859 18842 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:30.408434 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2638) took 1145 ms. Trace:
I20260709 12:25:30.408836 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.409085 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.409718 18842 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:30.377929 18914 rpcz_store.cc:276] 0709 12:25:29.101654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.102602 (+   948us) service_pool.cc:224] Handling call
0709 12:25:30.272485 (+1169883us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:30.272660 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326954880}
I20260709 12:25:30.408802 18848 rpcz_store.cc:276] 0709 12:25:29.263156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.263288 (+   132us) service_pool.cc:224] Handling call
0709 12:25:29.263624 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.263841 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.263865 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.264400 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:25:29.576139 (+311739us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:29.576207 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.576287 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.278766 (+702479us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:30.408124 (+129358us) raft_consensus.cc:1685] finished
0709 12:25:30.408147 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.408379 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5084544,"thread_start_us":294539,"threads_started":1,"wal-append.queue_time_us":362083}
I20260709 12:25:30.411185 18842 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:30.411679 18848 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:30.407768 24455 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:30.412261 19487 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.412530 24455 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.413350 24278 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:30.414995 24278 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.416345 24455 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:30.417264 24278 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:30.387408 24627 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:30.342201 24650 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:30.422770 24650 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:30.421211 24627 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.424611 24650 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.344602 24506 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:30.429260 18845 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:25:30.434983 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.437013 19484 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:30.437384 19487 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:30.258781 24519 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.388137 24665 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.351495 24725 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:30.443969 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.452539 18848 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:30.387312 24526 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:30.449932 24506 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:30.451437 24738 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:25:30.380733 24657 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.428150 24505 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.459182 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.378531 24345 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.460530 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.387997 24641 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.453384 24665 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.441700 24455 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:30.468858 18845 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:30.444581 24650 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.469933 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.471318 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.472324 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:30.458611 24402 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.004s
W20260709 12:25:30.453998 23844 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.003s
I20260709 12:25:30.463783 24688 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:30.502328 24688 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:30.509182 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.509729 24345 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:30.509940 18845 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:30.502852 23844 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.516149 24657 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:30.518687 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 302338us
I20260709 12:25:30.519919 23844 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:30.481206 24446 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:30.460649 24526 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.511559 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:30.503146 24752 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.474357 24505 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.537024 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:30.530889 18773 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.002s
W20260709 12:25:30.502024 24559 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.004s
I20260709 12:25:30.542368 18773 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:30.543602 18845 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:30.458694 24504 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.517976 24747 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:30.538105 24446 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.535797 24725 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.557374 24526 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:30.485589 24455 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.573962 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:30.587134 24743 raft_consensus.cc:2764] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:25:30.588495 24455 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:30.590082 23756 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.591207 18914 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:30.591346 23756 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.592087 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1034) took 1363 ms. Trace:
I20260709 12:25:30.592492 18764 rpcz_store.cc:276] 0709 12:25:29.228352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.234851 (+  6499us) service_pool.cc:224] Handling call
0709 12:25:29.799622 (+564771us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:25:29.799822 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.800054 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:25:29.800376 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.591541 (+791165us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.591737 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.591787 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:30.591835 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.591911 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.592025 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":389373,"prepare.queue_time_us":686,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":99,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4398,"spinlock_wait_cycles":26238208,"thread_start_us":220046,"threads_started":1,"wal-append.queue_time_us":459327}
I20260709 12:25:30.572603 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:30.575209 24446 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:30.500351 24402 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.559180 24688 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:30.586376 24677 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.001s
I20260709 12:25:30.575453 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 2901) took 1168 ms. Trace:
I20260709 12:25:30.596385 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:30.554942 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.616704 18766 rpcz_store.cc:276] 0709 12:25:29.407275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.407405 (+   130us) service_pool.cc:224] Handling call
0709 12:25:30.575234 (+1167829us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b540017a2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:30.575378 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54226304}
I20260709 12:25:30.603175 18840 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:30.621572 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.595068 24519 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:30.627328 18845 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:30.527393 19490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:25:30.634181 19490 raft_consensus.cc:606] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:30.634372 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.634802 19490 raft_consensus.cc:614] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:30.635185 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.642567 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:30.643366 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 131891us
I20260709 12:25:30.603248 24334 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:30.650244 18846 raft_consensus.cc:2368] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14.
I20260709 12:25:30.609069 24686 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:30.652350 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:30.553938 24559 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.626932 24575 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:30.631183 24693 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:30.657353 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.666755 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.668258 18845 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:25:30.669641 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.682714 24559 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:30.684156 19486 raft_consensus.cc:2368] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:25:30.666849 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:30.687749 18845 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:30.689671 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.690783 18845 raft_consensus.cc:2376] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14. Re-sending same reply.
I20260709 12:25:30.692341 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.695446 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:30.697206 24729 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.061s	user 0.005s	sys 0.000s
I20260709 12:25:30.700953 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.701882 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2758) took 1271 ms. Trace:
I20260709 12:25:30.702522 18918 rpcz_store.cc:276] 0709 12:25:29.430060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.430428 (+   368us) service_pool.cc:224] Handling call
0709 12:25:29.430744 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.490795 (+ 60051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.490830 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.498190 (+  7360us) log.cc:844] Serialized 26 byte log entry
0709 12:25:29.584334 (+ 86144us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:29.584375 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.584442 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.695817 (+1111375us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:30.701303 (+  5486us) raft_consensus.cc:1685] finished
0709 12:25:30.701339 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.701738 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57825,"raft.queue_time_us":57200,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":2770,"spinlock_wait_cycles":3658496,"thread_start_us":63709,"threads_started":1,"wal-append.queue_time_us":127048}
W20260709 12:25:30.704852 24739 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:25:30.709308 18845 raft_consensus.cc:2410] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:30.711055 18845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:25:30.712706 24479 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:30.714094 24745 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.467s	user 0.000s	sys 0.001s
I20260709 12:25:30.714584 18845 raft_consensus.cc:606] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:30.716284 18845 raft_consensus.cc:614] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:30.552913 24752 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.723999 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.595562 24747 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.724752 18842 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:30.637032 24749 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:25:30.657527 24519 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.632251 24677 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.747938 24345 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:30.748613 24345 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.752869 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:30.754175 18770 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:30.758598 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:30.759693 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:30.764762 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.763280 18770 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:30.768719 24345 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:30.718407 24688 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.664633 24686 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:30.781208 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.781176 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:30.721374 24693 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:30.785028 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:30.662385 24558 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 12:25:30.725917 24455 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:30.808254 24455 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.811297 24531 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:30.780826 24519 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.811957 24531 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.813547 24519 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:30.813892 24531 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:30.814415 24455 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:30.815585 18739 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:30.819615 24749 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:30.820127 24455 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:30.828368 24758 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 12:25:30.830488 24760 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:25:30.833678 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.795002 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.835781 18842 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:30.795264 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:25:30.837755 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.838543 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:30.803102 24334 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:30.726059 24575 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:30.804131 24677 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:30.806882 24652 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.995s	user 0.014s	sys 0.000s
I20260709 12:25:30.807576 18886 leader_election.cc:400] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:25:30.848523 18886 leader_election.cc:403] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:30.804165 24649 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.944s	user 0.012s	sys 0.002s
I20260709 12:25:30.792042 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:30.842212 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.529s (SENT)
I20260709 12:25:30.843312 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:30.844513 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:30.850545 18845 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:25:30.851087 18845 pending_rounds.cc:85] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 9
I20260709 12:25:30.851414 18845 pending_rounds.cc:107] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:25:30.851738 18845 raft_consensus.cc:2889] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:30.855005 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:30.855840 18846 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:25:30.856817 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:30.857398 18846 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:30.857023 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.607s (SENT)
I20260709 12:25:30.847822 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:30.878551 24649 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.884578 24526 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:30.916172 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 108725us
I20260709 12:25:30.850132 24683 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:31.027755 18844 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.883428 24686 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.859030 24446 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:30.890163 24693 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:30.843966 24334 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.031088 19491 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:31.031484 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.046258 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:31.049688 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 257729us
I20260709 12:25:31.067410 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:31.054287 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.071157 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.072304 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:31.073311 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 216312us
I20260709 12:25:31.074769 18767 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:25:31.076719 19457 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.603s (SENT)
I20260709 12:25:31.077363 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:31.081918 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:31.057121 18770 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:31.060868 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:31.050944 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 208795us
W20260709 12:25:31.087559 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.578s (SENT)
I20260709 12:25:31.089275 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.089983 18844 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:31.055831 24531 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:25:31.081513 24665 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.017s
I20260709 12:25:31.062587 24657 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.058873 24402 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:31.119072 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:31.097699 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:31.071376 24753 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.119874 18922 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.081961 24580 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:31.086630 24519 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:31.081036 24278 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.007s
I20260709 12:25:31.096302 24706 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.084761 24763 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.138372 18773 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:31.138243 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:31.138907 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:31.145447 18845 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:31.160022 24693 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:31.162727 24693 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.162006 18918 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:31.184940 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.165424 24747 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:31.132488 24518 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:31.185714 18842 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
W20260709 12:25:31.206712 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.214857 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127341us
W20260709 12:25:31.215858 18887 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.591s (SENT)
I20260709 12:25:31.216379 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:31.217516 18765 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:31.136636 24505 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.120990 24665 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:31.225854 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 147062us
I20260709 12:25:31.224781 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:31.233641 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 161419us
I20260709 12:25:31.235338 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:31.228741 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 133075us
I20260709 12:25:31.135160 24753 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:31.239411 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.236358 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:31.220897 24742 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 12:25:31.240025 18915 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:31.136160 24657 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.247658 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:31.243738 23844 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:31.244859 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:31.149634 24519 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.272897 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:31.255779 24772 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:25:31.255996 24753 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.285079 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:31.285848 18914 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:31.256765 24769 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:25:31.225488 24652 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:31.267532 24706 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:25:31.268401 24767 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:25:31.219944 24752 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:31.269615 24649 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:31.270982 24766 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:25:31.272852 24657 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:31.230173 24672 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:31.302821 24672 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.303547 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2827) took 1414 ms. Trace:
I20260709 12:25:31.303939 18840 rpcz_store.cc:276] 0709 12:25:29.891931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.899502 (+  7571us) service_pool.cc:224] Handling call
0709 12:25:30.602844 (+703342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.618146 (+ 15302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.303318 (+685172us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400206050. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:31.303482 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585859456}
I20260709 12:25:31.305164 24672 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:31.274768 23756 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.683s	user 0.016s	sys 0.000s
I20260709 12:25:31.239099 24345 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:31.306002 24345 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:31.306447 24345 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.310765 24757 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.311403 24757 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.316479 24641 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.317883 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1269) took 1700 ms. Trace:
I20260709 12:25:31.318341 18913 rpcz_store.cc:276] 0709 12:25:29.617793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.822916 (+205123us) service_pool.cc:224] Handling call
0709 12:25:30.295257 (+472341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:30.295722 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:25:30.610161 (+314439us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.846471 (+236310us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:30.847147 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 12:25:30.847316 (+   169us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:30.847365 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.847459 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.255204 (+407745us) raft_consensus.cc:1685] finished
0709 12:25:31.255228 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.317695 (+ 62467us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540027e2d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:31.317817 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":264695,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1938,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":18308,"spinlock_wait_cycles":1085724544,"thread_start_us":504194,"threads_started":2,"wal-append.queue_time_us":485801}
I20260709 12:25:31.287784 24580 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:31.323043 24580 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:31.323468 24580 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:31.277858 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.223559 24575 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:31.330732 24666 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:31.287045 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:31.331876 24666 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:25:31.332407 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45479.3us
I20260709 12:25:31.332662 24666 consensus_queue.cc:1243] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 15.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:25:31.300315 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.333127 24665 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:31.301260 24652 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.333899 24665 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:31.335952 24519 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.336124 24652 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:31.302062 24706 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:31.337904 24706 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:31.340868 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2835) took 1383 ms (client timeout 1562 ms). Trace:
W20260709 12:25:31.341557 24650 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.000s
W20260709 12:25:31.342264 18847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2838) took 1384 ms (client timeout 1578 ms). Trace:
W20260709 12:25:31.342747 18847 rpcz_store.cc:269] 0709 12:25:29.957903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.993889 (+ 35986us) service_pool.cc:224] Handling call
0709 12:25:31.342016 (+1348127us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54003bdb54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:31.342195 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792788736}
I20260709 12:25:31.344528 24646 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:31.345016 24646 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:31.345184 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.346822 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.346825 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.348394 18841 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:25:31.335978 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2730) took 1751 ms. Trace:
I20260709 12:25:31.349745 18921 rpcz_store.cc:276] 0709 12:25:29.584886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.585101 (+   215us) service_pool.cc:224] Handling call
0709 12:25:29.585397 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.593745 (+  8348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.593786 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:30.698789 (+1105003us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b180035a6a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:30.823664 (+124875us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b2c001538c8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:25:30.824175 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.109455 (+285280us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:31.109501 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.109582 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.335715 (+226133us) raft_consensus.cc:1685] finished
0709 12:25:31.335741 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.335908 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":464,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":176,"spinlock_wait_cycles":19255808,"thread_start_us":284906,"threads_started":1,"wal-append.queue_time_us":393534}
I20260709 12:25:31.352061 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:31.352434 24688 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.004s
I20260709 12:25:31.352797 18920 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:31.353211 18843 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
W20260709 12:25:31.354179 19488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 1020) took 1464 ms (client timeout 1778 ms). Trace:
W20260709 12:25:31.354777 19488 rpcz_store.cc:269] 0709 12:25:29.890242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.890846 (+   604us) service_pool.cc:224] Handling call
0709 12:25:31.353903 (+1463057us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400660654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:31.354090 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1663745920}
W20260709 12:25:31.354188 24777 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:31.326116 18918 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:31.363416 19491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1118) took 1490 ms (client timeout 1563 ms). Trace:
W20260709 12:25:31.364045 19491 rpcz_store.cc:269] 0709 12:25:29.872799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.887542 (+ 14743us) service_pool.cc:224] Handling call
0709 12:25:31.363133 (+1475591us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540062b6d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:31.363328 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285358336}
I20260709 12:25:31.365295 24555 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:31.252040 23844 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:31.366571 24559 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:31.366890 23844 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.366951 24559 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:31.367982 24559 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.369148 24559 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.373046 24693 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:31.373423 24575 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:31.373968 24575 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.376535 24575 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:31.378804 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:31.382073 24757 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.386838 24725 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:31.387373 24725 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.387738 24725 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.333160 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:31.391059 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57994.1us
I20260709 12:25:31.392066 24665 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:31.395537 24665 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.396621 24506 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.391988 24575 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:25:31.341368 18839 rpcz_store.cc:269] 0709 12:25:29.956978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.984573 (+ 27595us) service_pool.cc:224] Handling call
0709 12:25:31.340627 (+1356054us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400284454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:31.340798 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949612928}
I20260709 12:25:31.406205 18921 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.415547 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:31.305114 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.418816 18840 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:31.345988 24646 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.413174 24575 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:31.452698 18846 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
I20260709 12:25:31.453279 18846 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
W20260709 12:25:31.427711 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 183883us
I20260709 12:25:31.434629 18922 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:31.467154 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:31.389931 24345 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:31.472272 19457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.408s (SENT) [suppressed 24 similar messages]
I20260709 12:25:31.471788 23844 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.487874 24580 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.489424 18913 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:31.498225 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 430914us
I20260709 12:25:31.468289 23756 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.501470 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:31.497156 24518 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:25:31.503756 23844 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.477386 24743 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:31.525005 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:25:31.530284 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.531234 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.531544 24752 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:31.532219 24752 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.532783 24580 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:31.497005 24672 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.495286 24646 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:31.540266 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:31.541292 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.541188 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 83229.3us
I20260709 12:25:31.514983 24519 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.547091 24654 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.522748 24491 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:31.529094 24688 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.538312 24743 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:31.523429 23756 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.548254 24666 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:31.569320 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:31.553293 24749 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:31.575157 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:31.584885 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:31.570652 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:31.598313 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.599515 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:31.600035 24652 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:31.600570 24652 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:31.600988 24652 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.601971 24479 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:31.602449 24753 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:31.603011 24753 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:31.603521 24753 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:31.611572 18772 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:25:31.558406 24757 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.616305 24757 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.618568 24652 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.620179 23756 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.621166 24652 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.572813 24666 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:31.626261 18765 raft_consensus.cc:2410] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:25:31.653254 24666 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:31.629184 24345 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:31.629910 24743 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.655912 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:31.656924 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.631036 24757 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:31.633248 24531 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.002s
I20260709 12:25:31.662500 24531 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:25:31.663249 24666 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.665714 24666 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:31.636096 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:31.703126 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67172.5us
I20260709 12:25:31.551920 24575 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.541877 24672 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.647993 24278 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:31.648936 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.553802 24654 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:31.708039 24334 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 12:25:31.652154 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:31.655205 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:31.720829 18767 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:31.613492 18772 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:25:31.551815 24752 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:31.698046 18768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.015s	sys 0.023s
I20260709 12:25:31.550963 24519 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:31.698554 18919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.012s	sys 0.027s
I20260709 12:25:31.553167 24214 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260709 12:25:31.555353 24491 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.651201 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.729199 18917 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:31.714468 24650 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.715528 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:31.735811 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.752015 18768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.015s	sys 0.024s
W20260709 12:25:31.735764 18844 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.033s
W20260709 12:25:31.778769 18844 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.034s
W20260709 12:25:31.758020 18919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.013s	sys 0.028s
W20260709 12:25:31.752588 18887 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.028s
W20260709 12:25:31.779842 18887 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.009s	sys 0.028s
W20260709 12:25:31.780221 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 542264us
W20260709 12:25:31.781003 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.631s (SENT)
W20260709 12:25:31.774232 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.781497 18913 raft_consensus.cc:1217] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Deduplicated request from leader. Original: 12.13->[14.14-14.14]   Dedup: 14.14->[]
I20260709 12:25:31.782495 18913 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:25:31.783558 18769 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:25:31.718268 24782 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:31.786382 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.788836 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.795011 18846 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:31.795179 18847 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:31.795931 19487 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:31.797621 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.798604 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.797415 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:31.720672 24278 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:31.829922 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:31.799302 18845 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:31.830237 18839 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:25:31.855357 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:31.834272 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:31.856034 18766 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.856323 18847 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:31.834475 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:31.857421 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 76459.1us
I20260709 12:25:31.857946 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:31.858889 18847 raft_consensus.cc:2376] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13. Re-sending same reply.
I20260709 12:25:31.859494 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:31.859884 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.842983 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.843112 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:31.862679 18848 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.839339 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.865711 18846 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:31.866731 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:31.860771 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:31.869807 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:31.870877 18846 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.872547 18916 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:31.873972 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.753466 24334 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:31.836956 24781 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.885401 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.889884 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:31.878090 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 335236us
I20260709 12:25:31.882989 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:31.723642 24695 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.011s	sys 0.032s
I20260709 12:25:31.924114 18845 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:31.929571 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:31.939496 18918 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:31.930001 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.883591 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:31.847124 24782 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:31.792910 24650 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:31.831391 24518 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.14, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:25:31.946980 18766 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:31.971912 18770 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:31.979768 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.980289 24652 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:31.980732 18840 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:31.980768 24652 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.981302 24652 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:31.982888 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 99419us
I20260709 12:25:31.882337 24746 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:31.984927 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:31.981967 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.947852 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:31.949371 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:31.941098 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:31.989995 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:31.997085 18845 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:31.997691 18842 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.016s	sys 0.024s
I20260709 12:25:31.998104 18846 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
W20260709 12:25:31.998889 18842 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.016s	sys 0.024s
W20260709 12:25:31.938380 24695 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.011s	sys 0.039s
I20260709 12:25:32.001055 18839 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:32.006422 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:31.996714 24768 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:25:32.009613 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.013226 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:32.013767 24790 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:32.015720 18839 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:31.988422 24746 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:32.016259 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.006422 24518 consensus_queue.cc:1243] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 15.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:25:32.003425 24749 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:32.045192 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.036432 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:31.937973 24781 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.037622 18848 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:32.038188 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:32.049294 18921 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.044178 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:32.030542 24706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.009s	sys 0.038s
I20260709 12:25:32.050798 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:32.030855 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.013s	sys 0.034s
W20260709 12:25:32.053963 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.037469 24757 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:32.067713 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.014s	sys 0.034s
W20260709 12:25:32.072188 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 657050us
I20260709 12:25:31.962344 18764 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:32.071375 18839 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:31.988040 24278 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.075852 18843 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:32.078094 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:32.073262 24706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.009s	sys 0.042s
W20260709 12:25:32.080413 24786 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
W20260709 12:25:32.079367 24725 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.008s
I20260709 12:25:32.095963 18921 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:32.099251 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:32.142766 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43646us
I20260709 12:25:32.143265 18922 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 12:25:32.052446 24749 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.143879 18922 pending_rounds.cc:85] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 7
I20260709 12:25:32.156319 18922 pending_rounds.cc:107] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:25:32.156728 18922 raft_consensus.cc:2889] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:32.150102 18773 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:25:32.157778 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.158010 18766 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:25:32.158766 18921 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:25:32.160634 18771 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:32.091730 24491 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:32.139796 24783 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 12:25:32.127846 24278 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:32.181222 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1055) took 1322 ms. Trace:
I20260709 12:25:32.181391 24797 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:32.078256 24782 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:32.151273 24725 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.150576 24672 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:32.171900 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.172814 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1278) took 1137 ms. Trace:
W20260709 12:25:32.167729 24753 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.003s
I20260709 12:25:32.175120 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:32.175774 24781 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.176683 24650 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.092363 24746 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:32.080742 24757 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:32.127538 24519 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:32.167695 24793 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:25:32.181701 18768 rpcz_store.cc:276] 0709 12:25:30.858843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.859942 (+  1099us) service_pool.cc:224] Handling call
0709 12:25:30.860341 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:31.043803 (+183462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.043838 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:31.092102 (+ 48264us) log.cc:844] Serialized 52 byte log entry
0709 12:25:31.778575 (+686473us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:31.843998 (+ 65423us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.844265 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.844344 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:32.180946 (+336602us) raft_consensus.cc:1685] finished
0709 12:25:32.180969 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.181144 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167752,"prepare.queue_time_us":68332,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":185652,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":27381,"thread_start_us":641871,"threads_started":1,"wal-append.queue_time_us":955455}
I20260709 12:25:32.193336 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.198875 18921 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 10.
I20260709 12:25:32.199143 18841 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:32.190973 18919 rpcz_store.cc:276] 0709 12:25:31.035346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.035523 (+   177us) service_pool.cc:224] Handling call
0709 12:25:31.035966 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.055505 (+ 19539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.055538 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.071029 (+ 15491us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.779806 (+708777us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:31.779857 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.779945 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:32.172520 (+392575us) raft_consensus.cc:1685] finished
0709 12:25:32.172547 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.172741 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24778,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":19333,"thread_start_us":647352,"threads_started":1,"wal-append.queue_time_us":949768}
I20260709 12:25:32.200518 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:32.205875 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.206936 18921 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:32.210783 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:32.198021 24334 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:32.196220 24753 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.208581 24746 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:32.233714 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.236917 24757 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:32.238946 24753 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:32.244181 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:32.244766 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:32.245092 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.250706 24650 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.251515 24650 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.274338 18919 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:32.275159 18922 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:32.282022 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.284133 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.284785 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.285384 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.285410 18844 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.290951 18922 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:32.294008 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.294767 18919 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:32.295642 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.296576 18839 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.295836 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2660) took 1187 ms. Trace:
I20260709 12:25:32.300380 18842 rpcz_store.cc:276] 0709 12:25:31.109003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.221813 (+112810us) service_pool.cc:224] Handling call
0709 12:25:31.222249 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.222810 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:32.000307 (+777497us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.295277 (+294970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:32.295337 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:32.295388 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.295578 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.295755 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4017,"prepare.queue_time_us":105178,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":1063843,"threads_started":2}
I20260709 12:25:32.304903 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.312105 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:32.313009 19487 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:32.314445 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 170918us
I20260709 12:25:32.261102 24753 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:32.292550 24781 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.348001 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:32.349400 19492 raft_consensus.cc:2410] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 12:25:32.350307 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.346562 24781 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.333220 24505 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.354844 24505 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.357478 24505 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.359930 24781 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.362176 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.363309 18847 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:32.364564 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.365195 24725 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.365367 18847 raft_consensus.cc:2376] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15. Re-sending same reply.
I20260709 12:25:32.367390 18765 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:32.339504 24753 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.370255 24753 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.313486 24518 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.374753 24518 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.377293 24518 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.379370 24652 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:32.384276 18766 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 12:25:32.384428 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 458879us
I20260709 12:25:32.387100 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.388018 18845 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:32.389014 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.389142 18839 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:32.390331 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.387926 24652 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:32.391280 18839 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 11.
I20260709 12:25:32.393396 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.322551 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.395447 18842 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:32.371833 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.396979 24518 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.397184 18841 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:32.397541 24518 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.398713 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:32.399251 18766 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:25:32.399371 18772 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:32.399638 18766 pending_rounds.cc:85] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 8
I20260709 12:25:32.399897 18766 pending_rounds.cc:107] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:25:32.400113 18766 raft_consensus.cc:2889] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:32.400398 24518 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.400621 18841 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:32.407068 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:32.406947 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.408689 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.408793 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.409729 18922 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:32.410281 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:32.410718 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:32.410900 19489 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:32.411291 18919 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.412880 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:32.415179 24803 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:25:32.314038 24650 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.416374 24707 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.416987 24707 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:32.416599 24646 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.005s
I20260709 12:25:32.420231 24707 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:32.422096 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:32.347353 24749 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.425374 24707 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:32.425926 24707 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.426260 24707 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:32.429078 19488 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:32.410002 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.440919 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.441588 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.391286 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.444511 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:32.448037 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.452795 18916 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:32.454850 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.455394 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.461669 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.462321 18770 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:32.462463 18841 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:32.463375 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.390277 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.468238 18845 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
W20260709 12:25:32.469718 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53793us
W20260709 12:25:32.471408 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.585s (SENT)
I20260709 12:25:32.473188 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:32.481173 18887 connection.cc:256] RPC call timeout handler was delayed by -1.3123398390002876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 12:25:32.481756 18887 connection.cc:256] RPC call timeout handler was delayed by -1.2533656710002106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 12:25:32.467361 18844 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
W20260709 12:25:32.482241 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.796s (SENT)
W20260709 12:25:32.491199 18917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 1284) took 1447 ms (client timeout 1742 ms). Trace:
I20260709 12:25:32.493796 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.494958 18848 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:32.495694 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:32.491839 18917 rpcz_store.cc:269] 0709 12:25:31.043488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.081617 (+ 38129us) service_pool.cc:224] Handling call
0709 12:25:32.490914 (+1409297us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400335c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:32.491089 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336547200}
I20260709 12:25:32.496591 19490 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:32.508275 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.510732 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:32.517452 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.519884 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.525890 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.527025 18843 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
W20260709 12:25:32.528124 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57745us
I20260709 12:25:32.528337 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:32.529042 19492 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:32.533557 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:32.534698 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.542358 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:32.536340 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54138.8us
W20260709 12:25:32.544353 18887 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.801s (SENT)
I20260709 12:25:32.537744 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:32.545117 18847 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:32.545816 18844 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:32.548768 18845 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:32.527648 24752 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.540503 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:32.555364 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:32.560493 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:32.561952 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:32.567797 18839 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:32.530916 24652 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:32.553987 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:32.614171 18844 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
W20260709 12:25:32.586264 24785 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.027s	user 0.005s	sys 0.000s
I20260709 12:25:32.584350 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:32.657352 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:32.655097 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:32.655160 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:32.594919 24811 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:25:32.690619 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.575208 18841 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:32.655987 18919 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:32.687625 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:32.584687 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:32.603300 19484 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:25:32.706133 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 121884us
I20260709 12:25:32.576027 24491 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:32.709928 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54832us
W20260709 12:25:32.713167 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58134us
I20260709 12:25:32.572043 24519 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 12:25:32.714135 24800 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:32.569809 24334 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:32.715430 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2346) took 1137 ms. Trace:
I20260709 12:25:32.595778 24812 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:32.721580 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.721609 18764 rpcz_store.cc:276] 0709 12:25:31.578334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.578509 (+   175us) service_pool.cc:224] Handling call
0709 12:25:32.715180 (+1136671us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54001d6354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:32.715340 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192695168}
I20260709 12:25:32.572903 24672 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:32.720005 24725 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:32.727758 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:32.572361 24752 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.746263 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:32.764659 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:32.572731 24652 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.569203 24757 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:32.770434 24652 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:32.778738 24650 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:32.773320 24817 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:25:32.779413 24650 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.779923 24650 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:32.772341 24757 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.781065 24757 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:32.785460 24749 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.786293 24749 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:32.789076 24818 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:25:32.789119 24749 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.792022 24654 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.796779 24505 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:32.744782 24491 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:32.800168 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:32.653539 24295 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:32.710055 24518 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:32.777675 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:32.675797 24707 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:32.721037 24666 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:32.720819 24334 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:32.712855 24753 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:32.710237 24746 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:25:32.753755 24725 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:32.821491 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43946.2us
I20260709 12:25:32.771983 24781 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:32.829473 24491 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:32.833107 24746 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:32.819406 24518 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.819669 24505 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:32.821755 24278 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:32.848910 24505 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:32.821406 24749 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:32.847220 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:32.834769 24725 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:32.849380 24518 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:32.845621 18919 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:32.824955 24334 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.845924 24746 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:32.877930 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 348794us
I20260709 12:25:32.824256 24295 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:32.859334 24278 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:32.892485 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 383518us
I20260709 12:25:32.893739 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:32.905709 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:32.895473 24657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.034s
I20260709 12:25:32.894680 24752 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:32.927608 24707 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:32.928515 19492 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:32.931187 24295 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:32.935252 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 355363us
W20260709 12:25:32.936008 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.877s (SENT)
W20260709 12:25:32.937093 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 375188us
I20260709 12:25:32.894464 24749 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:32.938848 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:32.958108 19491 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 12:25:32.920439 24657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.001s	sys 0.035s
I20260709 12:25:32.947002 19492 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:32.999624 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:32.933570 24652 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:33.003732 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 290796us
W20260709 12:25:33.005820 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 296463us
I20260709 12:25:33.007445 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.004642 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.038681 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:32.975127 24811 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:25:33.006646 24749 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:32.974718 24686 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 12:25:33.038177 24817 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:32.978598 24650 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.058374 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.041846 24707 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:32.978053 24812 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 12:25:33.062330 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.041846 24505 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.053990 24752 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:33.084846 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:33.112170 24782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.008s	sys 0.026s
W20260709 12:25:33.105108 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 169141us
W20260709 12:25:33.105742 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43537.7us
I20260709 12:25:33.130925 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.132506 24706 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:33.134680 24778 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:33.131831 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.080531 24654 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:33.132182 24696 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:33.136945 24654 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:33.137380 24654 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:33.137324 24696 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.134126 24531 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:25:33.134732 24784 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:33.137878 24654 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:33.134449 24665 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:25:33.006413 24278 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.141506 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:33.099030 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 204321us
I20260709 12:25:33.143216 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:33.122119 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 183389us
I20260709 12:25:33.080302 24753 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
W20260709 12:25:33.140271 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 237763us
I20260709 12:25:33.124791 24749 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.114662 24752 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:33.159480 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74720.9us
I20260709 12:25:33.157887 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.106786 24800 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:33.198155 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.162904 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.151916 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.129382 24455 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:33.205341 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47902.3us
I20260709 12:25:33.145280 24367 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:33.206501 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:33.216020 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56338.4us
I20260709 12:25:33.218750 24706 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:33.170071 24836 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:33.149693 24828 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:25:33.224411 24828 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.226858 24828 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:33.226564 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63738.8us
I20260709 12:25:33.226018 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.231386 24706 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:33.231418 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.235400 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:33.237569 24531 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.238037 24531 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:33.238471 24531 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.239954 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.241470 24778 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.242690 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.152865 24214 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:25:33.154508 24782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.009s	sys 0.026s
I20260709 12:25:33.168074 24575 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:33.194103 24519 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:33.258738 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 353149us
W20260709 12:25:33.248688 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 96761.1us
I20260709 12:25:33.275415 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:33.170010 24672 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:33.249856 24785 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:25:33.169142 24812 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:33.207592 24752 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:33.280908 24672 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.291615 24672 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.250005 24491 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:33.253463 24384 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:25:33.295074 24491 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.296126 24812 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:33.297206 24812 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.251055 24817 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.283983 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:33.318483 18919 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:33.280674 24650 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:33.291031 24825 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 12:25:33.279593 24827 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.326s	user 0.001s	sys 0.001s
I20260709 12:25:33.278065 24367 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.398507 24367 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.401049 24367 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:33.257277 24686 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.253105 24214 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:33.403138 24214 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.404533 24214 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:33.302662 24800 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.270565 24811 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:33.291086 24652 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.306663 24455 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:33.307271 24506 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.307583 24812 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.314638 24666 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:33.345940 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 70613.6us
W20260709 12:25:33.415081 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 172604us
I20260709 12:25:33.415334 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:33.355540 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 102144us
I20260709 12:25:33.415999 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:33.384207 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 153234us
I20260709 12:25:33.393919 24856 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:33.396628 24725 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.002s
I20260709 12:25:33.397497 24853 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:33.317180 24707 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.373607 18919 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:33.416946 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:33.406158 24334 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.002s
I20260709 12:25:33.420451 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.430030 24725 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.434096 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.435846 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.418583 24856 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:33.442982 24856 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.445637 24665 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:33.446437 24665 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.448125 24531 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.448936 24665 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.425655 24650 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.451597 24334 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.419158 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.454137 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:33.455127 24652 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:33.455957 24652 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:33.456445 24652 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:33.457376 24652 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.460129 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.461925 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:33.462227 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.421972 24817 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:33.422784 24455 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.432408 24707 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.466032 24278 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:33.463694 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:33.466761 24278 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:33.467160 18770 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:33.467561 24518 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.587s	user 0.015s	sys 0.002s
I20260709 12:25:33.467756 24278 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.468214 24518 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.464016 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.471406 18766 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:33.464404 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.473292 18767 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:33.463696 18768 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:33.474012 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57213.1us
W20260709 12:25:33.474529 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.462599 18764 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:33.476022 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:33.476121 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:33.476979 18848 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:33.478844 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:33.479298 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:33.422267 24757 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.001s
I20260709 12:25:33.413511 24519 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:33.488556 18768 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:33.491441 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:33.494676 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:33.495159 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.495406 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.503129 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1022) took 1150 ms. Trace:
I20260709 12:25:33.503038 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.504199 18767 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:33.495764 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.426942 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:33.504799 18766 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:33.462317 24828 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:33.506652 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81067.4us
I20260709 12:25:33.506652 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.503579 18842 rpcz_store.cc:276] 0709 12:25:32.352692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.396229 (+ 43537us) service_pool.cc:224] Handling call
0709 12:25:32.396537 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.396929 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.396957 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.397524 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:25:32.852848 (+455324us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:33.201605 (+348757us) log.cc:844] Serialized 14 byte log entry
0709 12:25:33.502470 (+300865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.502894 (+   424us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.502934 (+    40us) raft_consensus.cc:1685] finished
0709 12:25:33.502945 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.503071 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5130,"prepare.queue_time_us":444774,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":78782,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":20511,"thread_start_us":1059552,"threads_started":3,"wal-append.queue_time_us":611170}
I20260709 12:25:33.511255 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:33.511893 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:33.465867 24707 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.465479 24695 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.515250 18767 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:33.515479 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.534224 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.490439 24811 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.521055 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.465407 24455 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:33.421480 24506 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.508673 18770 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:33.510632 24384 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.535981 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:33.538411 19492 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:33.516149 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.513880 24817 raft_consensus.cc:2764] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:33.543437 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.501957 24531 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.526885 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:33.541137 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.553082 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:33.537045 24848 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:33.561677 18842 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:25:33.562327 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:33.505965 24757 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.563227 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:33.563059 24866 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:33.483527 24853 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.563439 24519 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.564002 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:33.546252 24654 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.505666 24840 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:33.505970 24505 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.563090 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:33.426069 24666 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.602746 24666 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.587002 24811 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:33.605370 24696 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.608007 24757 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.596935 24518 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:33.610672 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:33.531929 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.612303 18766 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:33.613462 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.615195 18766 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:33.571079 24650 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:25:33.506039 24855 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:33.465322 24847 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.511503 24749 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:33.617177 24855 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.617709 24749 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.618898 18848 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:33.619868 24491 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.511153 24334 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:33.572971 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63717.1us
I20260709 12:25:33.620149 24855 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.621809 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:33.573469 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57424.9us
I20260709 12:25:33.577179 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.581542 24857 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.623194 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:33.624212 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:33.624915 18917 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:33.625339 24847 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:33.625921 24847 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:33.626891 24847 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.630800 24725 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:33.633190 24575 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.633723 24575 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:33.635634 24817 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:33.636413 24817 consensus_queue.cc:1243] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:33.636883 24817 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:33.637184 24817 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:33.590513 24686 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:25:33.634181 24575 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.583956 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.638862 24857 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 12:25:33.651801 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 67894.5us
I20260709 12:25:33.652671 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.653527 24811 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:33.587952 18772 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:33.587355 18846 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.639043 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:33.640082 24746 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.639290 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:33.656461 24746 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.644768 24853 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.641161 24334 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:33.587981 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:33.658784 24334 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:25:33.659117 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71229.2us
I20260709 12:25:33.570456 24828 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.588737 18768 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:33.550374 24657 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:33.553568 18764 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:33.648042 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:33.651099 18913 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:33.598723 18843 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.639120 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.593155 18847 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:33.599882 24752 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.621749 24855 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:33.573122 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.654224 24811 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.687876 18765 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:33.654281 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.586205 24820 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:33.692279 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:33.651808 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:33.689246 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:33.694828 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55806.7us
I20260709 12:25:33.695752 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.695894 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:33.667163 18846 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:33.667654 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:33.668196 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:33.590927 24848 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:33.668105 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.698364 18915 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:25:33.708123 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53921.5us
I20260709 12:25:33.709079 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:33.588282 24531 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:25:33.659161 24334 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:33.696576 18914 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:33.667081 18767 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:33.703616 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:33.705525 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:33.699900 24725 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:33.706553 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:33.670849 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 170457us
I20260709 12:25:33.660813 24828 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:33.711472 24696 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:33.707818 24853 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:33.737530 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:33.650671 24749 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:33.689927 24706 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:33.688858 24672 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.689191 24856 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.665216 24835 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:33.717113 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:33.722275 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:33.722517 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:33.735869 24531 consensus_queue.cc:1243] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:33.694818 18917 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.737972 24725 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:33.739924 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.739609 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:33.743824 18847 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:33.661039 24840 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.689697 24627 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:33.638041 24817 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.639174 24505 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:33.690055 24657 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.756039 18773 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:33.715643 24866 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:33.721002 24367 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.707361 24857 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.757872 18769 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:33.714574 24854 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.761674 18848 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 12:25:33.712471 24665 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.742255 24855 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:33.813669 24855 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:33.814649 24505 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:33.814760 24855 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:33.816152 24654 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:33.742506 24828 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.817577 24725 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:33.821516 24778 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.580s	user 0.015s	sys 0.000s
I20260709 12:25:33.822057 24778 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:33.765416 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.739696 18764 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:33.773232 18843 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:33.742014 24506 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:33.715523 24652 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.997602 24652 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:33.998310 24652 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.778367 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.783814 18842 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:25:33.747771 24820 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.756146 24757 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:33.759541 24835 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:34.005367 24835 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.007436 24835 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:33.788738 24749 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.811991 24817 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.812978 24665 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.013072 24784 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:33.986792 18917 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:34.013765 24784 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:33.789494 24627 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:33.981223 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.014374 24627 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.755944 24853 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.014698 24784 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.016222 24784 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.789156 24531 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:25:34.025117 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:34.030196 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 316785us
I20260709 12:25:34.027913 18770 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:34.028868 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:33.986492 24836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.011s	sys 0.026s
I20260709 12:25:34.034101 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:34.035830 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 257539us
I20260709 12:25:34.036510 18767 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:34.036939 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:33.822956 24854 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:33.876068 24706 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:34.049157 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:34.057996 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 316706us
W20260709 12:25:34.034651 24836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.012s	sys 0.026s
I20260709 12:25:34.059329 24836 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:34.059461 24837 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.488s	user 0.004s	sys 0.001s
I20260709 12:25:34.058879 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:34.064476 18767 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:34.063007 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:34.059798 24867 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:25:34.073477 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:34.075037 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:33.810345 24866 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.070591 24868 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:34.077987 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:34.085151 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:34.082854 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:34.072945 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:34.035003 24757 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:34.029894 24696 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:34.060000 24852 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.691s	user 0.000s	sys 0.005s
I20260709 12:25:34.083324 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:34.078706 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:34.117786 18920 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:33.811448 24334 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.057042 24778 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:34.079282 24666 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:34.118499 18767 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:34.078224 24781 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:34.122823 18840 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:34.083913 24665 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:34.116202 24707 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.568s	user 0.016s	sys 0.004s
I20260709 12:25:33.805672 24848 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.189213 24828 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:34.079358 24851 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.714s	user 0.003s	sys 0.011s
W20260709 12:25:34.153231 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.154100 24872 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:25:34.147871 24706 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.166718 24627 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.139659 24505 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:34.128363 24455 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:25:34.132112 24838 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.817s	user 0.000s	sys 0.013s
I20260709 12:25:34.171098 24657 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:34.149727 24856 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:34.171701 24652 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.143481 24666 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:34.173427 24830 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.878s	user 0.002s	sys 0.001s
W20260709 12:25:34.174886 24871 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:25:34.176753 24757 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.180748 24686 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:34.182091 24707 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.182966 24665 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.046644 24854 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.145726 18767 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:34.132174 24868 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:34.128888 24853 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:34.137495 24781 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.230230 18840 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
W20260709 12:25:34.171613 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.359898 18915 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.005s
I20260709 12:25:34.372113 24455 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:34.132755 24778 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:34.380559 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 319974us
W20260709 12:25:34.399621 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 316356us
I20260709 12:25:34.456233 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:34.351264 24505 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:34.413301 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.441303 18915 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:34.180830 24877 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:34.442963 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 360181us
W20260709 12:25:34.447844 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 374963us
I20260709 12:25:34.470042 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:34.476142 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:34.439854 24575 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.800s	user 0.009s	sys 0.003s
I20260709 12:25:34.464843 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:34.397787 24686 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:34.448140 24781 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:34.462175 24857 raft_consensus.cc:2764] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:25:34.474474 24505 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:34.479446 24868 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:34.502167 19457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.012s	sys 0.031s
W20260709 12:25:34.516238 19457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.013s	sys 0.031s
I20260709 12:25:34.352623 24836 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:34.512704 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 116667us
I20260709 12:25:34.514642 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1134) took 2110 ms. Trace:
I20260709 12:25:34.518751 19487 rpcz_store.cc:276] 0709 12:25:32.404426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.470628 (+ 66202us) service_pool.cc:224] Handling call
0709 12:25:32.471006 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.471277 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.471304 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.497556 (+ 26252us) log.cc:844] Serialized 26 byte log entry
0709 12:25:32.898616 (+401060us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:32.898654 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.898729 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.130129 (+1231400us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:34.503390 (+373261us) raft_consensus.cc:1685] finished
0709 12:25:34.503415 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.514522 (+ 11107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140157824,"thread_start_us":358444,"threads_started":1,"wal-append.queue_time_us":786815}
I20260709 12:25:34.530004 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:34.543838 24707 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:34.411294 24696 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.552631 19484 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:34.554323 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:34.562589 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:34.507815 24848 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:34.516698 24881 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:34.578718 24881 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.579643 24752 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:34.524540 24856 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:34.586066 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:34.588203 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 123462us
I20260709 12:25:34.489475 24575 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:34.558204 24384 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.984s	user 0.008s	sys 0.004s
I20260709 12:25:34.582073 24881 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:34.546525 24888 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:34.587951 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:34.599398 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:34.590476 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114437us
I20260709 12:25:34.560305 24868 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:34.662546 18916 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:34.527798 24855 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.582302 24820 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:25:34.599432 24887 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:34.610268 24384 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:34.683902 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:34.689077 19484 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:34.702963 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.658004 24828 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:34.662449 24866 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:34.598277 24856 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.552685 24455 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.573572 24686 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.715045 18915 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:34.716182 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:34.716928 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:34.717197 19485 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:25:34.669000 24652 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:34.722694 19485 pending_rounds.cc:85] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 13
I20260709 12:25:34.730034 19485 pending_rounds.cc:107] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:25:34.730330 19485 raft_consensus.cc:2889] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.665076 24817 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:25:34.688373 24887 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:34.623804 24848 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:34.708395 24881 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:34.744050 19484 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:34.745420 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:34.758922 24811 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.061s	user 0.009s	sys 0.005s
I20260709 12:25:34.759589 24811 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:34.759992 24817 consensus_queue.cc:1243] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:34.761683 24894 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:34.762110 24894 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:34.764125 24848 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:34.755153 18920 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:34.745971 24887 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:34.770220 24892 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:34.733325 24627 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:34.771175 19487 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:34.772881 24278 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.745342 24686 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:34.785696 24868 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.788494 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2370) took 1291 ms. Trace:
I20260709 12:25:34.679405 24855 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.717801 24897 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:34.809453 18737 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:34.831470 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:34.785115 24856 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:34.841395 18768 rpcz_store.cc:276] 0709 12:25:33.497153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.515176 (+ 18023us) service_pool.cc:224] Handling call
0709 12:25:34.788279 (+1273103us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b540029e0d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:34.788418 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126506368}
W20260709 12:25:34.843173 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.849066 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:34.857439 19487 raft_consensus.cc:2410] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:25:34.851915 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2382) took 1103 ms. Trace:
I20260709 12:25:34.860827 18768 rpcz_store.cc:276] 0709 12:25:33.790657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.850999 (+1060342us) service_pool.cc:224] Handling call
0709 12:25:34.851367 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.851548 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.851571 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.851613 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:34.851645 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.851698 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.851827 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:34.859177 24295 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:34.867041 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 247984us
I20260709 12:25:34.818529 24752 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:25:34.873487 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:34.838888 24278 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.866217 24627 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.859643 24897 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:34.960232 24905 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.917812 24894 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.961227 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:34.960276 24575 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:34.980949 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:34.847965 24505 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.981662 18848 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.963110 24855 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:34.966270 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:34.967087 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:34.875367 24873 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:34.986454 18921 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:34.987295 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:34.988122 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:34.967402 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:34.988557 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:34.989205 18922 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:34.989763 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:34.968873 24746 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.312s	user 0.015s	sys 0.006s
I20260709 12:25:34.972800 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:34.991811 18842 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:34.992630 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:34.973506 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:34.978961 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:34.978073 19483 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:34.979756 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:34.875681 24896 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.990032 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:34.968623 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.001328 18768 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:35.003803 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:34.994761 19484 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:34.995496 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.004480 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:34.847955 24902 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.138s
I20260709 12:25:35.002974 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.010900 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.012306 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:35.026079 24781 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.004s
I20260709 12:25:35.013598 24455 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:35.031596 24835 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.024s	user 0.013s	sys 0.002s
I20260709 12:25:34.993673 24749 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.036275 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:35.042375 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.015069 24894 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.042549 24781 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.046026 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:35.045418 24752 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:35.061992 24904 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:25:35.064813 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2381) took 1317 ms. Trace:
W20260709 12:25:35.065325 24891 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:34.983392 24905 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.015867 24873 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:35.069136 24897 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.072278 24887 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:34.981290 24627 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:35.092491 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 111267us
I20260709 12:25:35.105895 18766 rpcz_store.cc:276] 0709 12:25:33.747866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.474940 (+727074us) service_pool.cc:224] Handling call
0709 12:25:34.475424 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.482035 (+  6611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.482091 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.484958 (+  2867us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.587917 (+102959us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:34.587960 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.588033 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.064491 (+476458us) raft_consensus.cc:1685] finished
0709 12:25:35.064520 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.064713 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6117,"raft.queue_time_us":19458,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":16286,"thread_start_us":81838,"threads_started":1,"wal-append.queue_time_us":545583}
I20260709 12:25:35.114140 18848 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:35.073715 24334 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:35.048867 24749 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.015519 24896 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.132555 18766 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:35.158219 18771 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:35.124181 24858 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.167904 24873 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:35.197549 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:35.216377 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.218091 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:35.180243 24912 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:25:35.187273 24784 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.170s	user 0.016s	sys 0.000s
I20260709 12:25:35.228154 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.192441 24665 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.181535 24914 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:35.202189 24906 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.203888 24877 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.240504 24877 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.243139 24877 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.178041 24907 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:35.195214 24845 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:35.209120 24666 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.197703 24901 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.195896 24921 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:35.238412 24914 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.238901 24917 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.239521 24910 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.239395 24906 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.217314 24278 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.209599 24695 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:35.228777 24908 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:35.229323 24706 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:35.313869 24917 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.317570 24910 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.328274 24906 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.329054 24627 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:35.315546 24905 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.300860 24845 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.309871 24901 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.386844 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2380) took 1639 ms. Trace:
I20260709 12:25:35.387442 18767 rpcz_store.cc:276] 0709 12:25:33.747563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.453011 (+705448us) service_pool.cc:224] Handling call
0709 12:25:34.453491 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.461472 (+  7981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.461511 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.462097 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.849400 (+387303us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:34.883666 (+ 34266us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.966660 (+ 82994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.966746 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.386490 (+419744us) raft_consensus.cc:1685] finished
0709 12:25:35.386521 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.386752 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7461,"prepare.queue_time_us":19335,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":23016,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":3703,"thread_start_us":344703,"threads_started":1,"wal-append.queue_time_us":494705}
I20260709 12:25:35.376089 24896 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.299749 24907 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.311125 24921 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:35.401563 24854 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.953s	user 0.011s	sys 0.004s
I20260709 12:25:35.365778 24706 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.365993 24908 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.410548 24917 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.402755 24921 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.402099 24854 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.426282 24896 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.440361 19489 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:35.440011 24914 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.440451 24887 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.456111 24901 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:35.434628 24896 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.459914 24896 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.460427 24887 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.461109 24887 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.456172 24706 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:35.463276 24854 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.463308 24887 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:35.472394 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 340294us
W20260709 12:25:35.483876 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.429821 18918 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:35.508927 24887 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:35.510764 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.512511 24887 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.516186 24887 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.516799 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.518004 18921 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:35.518287 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.518896 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.519438 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.519658 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.520925 24858 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.521638 24858 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.525534 24858 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.527289 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.527269 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.528352 18922 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:35.528764 24908 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:35.528985 18921 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:35.537238 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.358196 18842 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
W20260709 12:25:35.590471 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.591619 18842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
new_leader_uuid: "1e2529a8cff04207bb1b07c108e16983"
 from {username='slave'} at 127.0.0.1:51636
I20260709 12:25:35.592377 18842 raft_consensus.cc:606] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Received request to transfer leadership to TS 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:35.592861 18842 raft_consensus.cc:614] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:35.594656 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:35.591081 24894 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.005s
I20260709 12:25:35.591295 24908 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.635138 24921 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.638760 18914 raft_consensus.cc:2410] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:35.638999 24921 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.641832 24921 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:35.643967 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.638317 24899 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:35.648605 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:35.654647 24924 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:35.655194 24924 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.655575 24924 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.658489 24778 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.659850 24672 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.662866 24907 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.663060 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.663401 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.664058 18921 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:35.665086 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.667222 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.644515 24908 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:35.669199 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.671795 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2695) took 2110 ms. Trace:
I20260709 12:25:35.673070 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.674600 18921 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:35.677573 24876 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.236s	user 0.008s	sys 0.016s
I20260709 12:25:35.672312 18844 rpcz_store.cc:276] 0709 12:25:33.559882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.562501 (+  2619us) service_pool.cc:224] Handling call
0709 12:25:33.562800 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.650874 (+ 88074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.650906 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:33.650948 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:33.650983 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.670150 (+2019167us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b54003269d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:35.670223 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.670456 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201997056}
I20260709 12:25:35.681097 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1308) took 2084 ms. Trace:
I20260709 12:25:35.649822 24899 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.682771 24899 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.681545 18919 rpcz_store.cc:276] 0709 12:25:33.596556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.596796 (+   240us) service_pool.cc:224] Handling call
0709 12:25:33.597144 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:33.687693 (+ 90549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.687747 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:33.697181 (+  9434us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.048815 (+351634us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:34.048862 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.175053 (+126191us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b540011fdd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:34.175103 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.676937 (+1501834us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:35.680845 (+  3908us) raft_consensus.cc:1685] finished
0709 12:25:35.680871 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.681028 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10106,"raft.queue_time_us":26988,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":14057,"spinlock_wait_cycles":241110144,"thread_start_us":306340,"threads_started":1,"wal-append.queue_time_us":638928}
I20260709 12:25:35.685357 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.686453 18919 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:35.690819 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.699479 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.701550 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.703260 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:35.714440 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58581.3us
I20260709 12:25:35.716562 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.720607 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.721249 18922 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:35.721974 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.723037 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.723811 18919 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.690055 24778 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.722586 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:35.722508 18922 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:35.744699 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.745692 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.747742 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.718286 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:35.750478 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:35.753834 19490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:25:35.754710 19490 raft_consensus.cc:606] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:35.755050 19490 raft_consensus.cc:614] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:35.756475 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.757391 18922 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:35.758378 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.760439 18921 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:35.762318 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.762693 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:35.760335 24883 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:35.766921 24781 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.777890 24908 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.747803 24847 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:35.763322 24672 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.786556 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.788142 18922 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:35.790541 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:35.791210 24334 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:35.770902 24924 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.747516 24778 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.825800 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:35.795240 18919 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:35.795827 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:35.829411 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.826478 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.830708 24278 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.835117 24278 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.836156 24883 raft_consensus.cc:2764] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:25:35.842141 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.843144 18922 raft_consensus.cc:2376] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15. Re-sending same reply.
I20260709 12:25:35.844425 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.845237 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.814435 24916 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:35.793751 24847 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:35.848822 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:35.862993 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:35.865919 18921 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.828091 24334 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.838326 24278 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.866163 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:35.867965 19488 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:35.870155 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1142) took 1340 ms. Trace:
I20260709 12:25:35.850881 24916 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:35.871752 19487 rpcz_store.cc:276] 0709 12:25:34.529552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.529709 (+   157us) service_pool.cc:224] Handling call
0709 12:25:35.867588 (+1337879us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400136854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:35.870079 (+  2491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551871232}
I20260709 12:25:35.864024 24847 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.855923 24924 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.878057 18919 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:35.871645 24334 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:35.874241 24672 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:25:35.875837 24757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.300s	user 0.025s	sys 0.032s
I20260709 12:25:35.882829 24916 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.886142 18921 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:35.867738 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:35.891778 24840 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:35.897188 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:35.896377 24672 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:35.900231 24884 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:35.900799 24884 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:35.900699 24672 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:35.894760 24757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.026s	sys 0.032s
I20260709 12:25:35.923403 18921 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:35.923898 18921 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:35.924772 18921 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.894318 24800 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.926497 18921 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.895356 24873 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:35.938222 18773 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:35.899501 24506 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:35.901832 24884 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.936008 24916 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:35.959067 24934 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:35.956446 24506 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:35.983361 18921 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:35.939580 24800 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.966943 24491 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:35.941088 24873 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:35.993273 24491 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:35.993750 24845 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:35.996093 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.034s	sys 0.080s
I20260709 12:25:35.996197 24491 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:35.980365 24880 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.475s	user 0.010s	sys 0.014s
W20260709 12:25:35.996634 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.034s	sys 0.080s
I20260709 12:25:35.992437 24505 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:36.004941 18844 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:36.007359 24845 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.007784 18841 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:36.008065 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:36.007524 18846 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:36.008780 18843 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:36.008041 24845 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.009895 24873 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.011705 24845 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:36.012147 18847 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:25:36.013873 24384 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.014544 24384 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.016886 24384 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.021337 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.024281 24506 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.027905 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2377) took 2528 ms. Trace:
I20260709 12:25:36.028373 18771 rpcz_store.cc:276] 0709 12:25:33.499209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.623885 (+124676us) service_pool.cc:224] Handling call
0709 12:25:33.624255 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.160441 (+1536186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.027629 (+867188us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400211bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:36.027836 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3471801600}
W20260709 12:25:36.030623 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.032223 24817 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:36.032693 24817 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:36.033028 24800 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:35.988829 24778 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:36.033562 24817 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.039358 18844 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:25:36.049871 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.040532 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.048880 18843 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:36.041363 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:36.054618 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.056627 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.057219 18843 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:25:36.041817 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:36.059477 18846 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:36.059868 18844 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:36.061992 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.063205 18839 raft_consensus.cc:2368] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:25:36.065899 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:36.067189 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.068296 18846 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:36.069422 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.069940 18841 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:36.070185 18846 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:36.070941 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.071341 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.071554 18841 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:36.072590 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:36.072820 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.073176 18841 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:36.073663 18846 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:36.076575 19487 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:36.079643 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.075573 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:36.082463 19492 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:36.082949 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.080988 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.083912 18839 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:36.084169 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.085145 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.085701 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.086987 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.087998 18839 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:36.088899 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:36.092463 18839 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [14.7-16.8]
I20260709 12:25:36.093502 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:36.002362 24672 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:25:36.068404 24695 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.081913 24519 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.081959 24883 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:36.095052 24856 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.094313 24887 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:36.097144 24817 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.100868 18845 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:36.101604 18844 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:25:35.993294 24899 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.105974 18848 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:36.098076 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74934.3us
I20260709 12:25:36.112041 18841 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:36.095619 24845 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:36.098598 18846 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:25:36.131297 18846 pending_rounds.cc:85] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 8
I20260709 12:25:36.132704 18846 pending_rounds.cc:107] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 13.9
W20260709 12:25:36.133004 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52095us
I20260709 12:25:36.135326 18846 raft_consensus.cc:2889] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:36.127857 24947 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:36.138626 18842 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:36.138907 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.139072 18846 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:36.140105 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.141875 24944 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.142746 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.142484 24944 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.143375 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1045) took 1686 ms. Trace:
I20260709 12:25:36.144008 18772 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:36.143771 19489 rpcz_store.cc:276] 0709 12:25:34.456550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.456727 (+   177us) service_pool.cc:224] Handling call
0709 12:25:34.483245 (+ 26518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.441016 (+957771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.143128 (+702112us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54006ff254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:36.143314 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200546176}
I20260709 12:25:36.145349 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:36.145779 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.144882 24944 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:36.147082 24749 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:36.147789 24944 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:36.148056 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1070) took 2594 ms. Trace:
I20260709 12:25:36.148317 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.148517 18773 rpcz_store.cc:276] 0709 12:25:33.553463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.173826 (+620363us) service_pool.cc:224] Handling call
0709 12:25:34.174201 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.938802 (+1764601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.147842 (+209040us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540036c4d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:36.147982 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4056357760}
I20260709 12:25:36.148340 24944 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.153239 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.132323 24845 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.130044 24505 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:36.105759 24695 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:36.161629 24938 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:25:36.162849 24695 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:36.164222 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:36.164922 18771 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:36.166164 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.166712 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.166900 18916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2818) took 2524 ms (client timeout 1598 ms). Trace:
W20260709 12:25:36.167100 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.146661 18772 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:36.167565 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.157936 18917 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:36.167335 18916 rpcz_store.cc:269] 0709 12:25:33.633343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.638633 (+  5290us) service_pool.cc:224] Handling call
0709 12:25:36.157446 (+2518813us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000f6254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:36.157600 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313437696}
I20260709 12:25:36.168747 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:36.169253 24778 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.169914 24894 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:36.170086 24879 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.169824 24778 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.170554 24894 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.170689 24879 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.172801 24778 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:36.173082 24894 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.107496 24519 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.172852 24879 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:36.169497 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:36.169560 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.176205 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:36.176452 24519 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.176816 18916 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:36.115573 24883 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.179359 24883 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.122969 24856 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.182864 24757 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:36.183616 24899 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:36.170301 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.185096 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.186488 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.187075 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.188591 18765 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:36.169844 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.191037 18918 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:36.191183 18916 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:36.192082 18771 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:36.158013 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:36.197115 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.197901 18767 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:36.204205 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.206223 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.208477 18766 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:25:36.209561 24878 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:36.213356 24878 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:36.214716 24878 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:36.214836 18887 leader_election.cc:400] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:25:36.215143 24878 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:36.215881 24947 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:36.216200 24878 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.217190 24778 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:36.217978 24778 consensus_queue.cc:1243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:36.217949 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:36.218775 24894 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:36.219175 24894 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:36.219460 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:36.220551 24857 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:36.220259 24894 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.221576 24894 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.221515 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:36.224954 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:36.234606 18767 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:36.219206 24778 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:36.255326 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.256750 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.254287 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.218416 24878 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:36.136340 24884 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
W20260709 12:25:36.272354 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 146686us
I20260709 12:25:36.184293 24845 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.274919 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.282239 18913 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:36.277100 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.253830 24857 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:36.284058 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:36.284685 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.258261 24657 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:36.220389 24947 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.237794 24334 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.197418 24875 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:25:36.197588 24908 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:25:36.292728 24944 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:36.304690 24778 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:36.294687 24875 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:36.295087 24725 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.306658 24875 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:36.307428 24910 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.307598 24875 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.300101 24334 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.290079 24657 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.310652 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2385) took 1337 ms. Trace:
I20260709 12:25:36.311172 18768 rpcz_store.cc:276] 0709 12:25:34.973244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.011817 (+ 38573us) service_pool.cc:224] Handling call
0709 12:25:35.012238 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.645778 (+633540us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:35.735209 (+ 89431us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.841689 (+106480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.841779 (+    90us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:35.841853 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.310325 (+468472us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54002107d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:36.310382 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.310573 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8484,"prepare.queue_time_us":194939,"prepare.run_wall_time_us":40,"raft.queue_time_us":9240,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":12348,"spinlock_wait_cycles":1460058368,"thread_start_us":182311,"threads_started":2,"wal-append.queue_time_us":140498}
I20260709 12:25:36.311007 24657 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:36.313663 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.316617 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:36.317305 18916 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.320246 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.323625 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.289372 24857 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:36.335152 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 109338us
I20260709 12:25:36.332938 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.336064 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:36.331642 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:36.337981 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:36.338967 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61969.9us
I20260709 12:25:36.337380 18772 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:36.344442 18918 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:36.344437 18916 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:36.349314 18764 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:36.336380 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.354251 18918 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:36.282262 24847 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.365263 18918 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:36.322755 24948 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:36.344216 24857 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.374897 18918 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:25:36.343510 24749 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:36.347213 24910 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:36.352290 24506 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:36.346743 24334 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:25:36.406037 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 212587us
I20260709 12:25:36.411337 18847 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:36.429922 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.476402 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 337562us
I20260709 12:25:36.478717 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33726
I20260709 12:25:36.479455 18764 raft_consensus.cc:606] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Received request to transfer leadership
I20260709 12:25:36.479879 18764 raft_consensus.cc:614] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:36.372337 24491 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:36.478969 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.366564 24953 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:36.363390 24531 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 12:25:36.495754 18916 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:36.369408 24757 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 12:25:36.410743 24506 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:36.376243 24948 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.505690 18916 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:36.488471 24879 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.494997 24883 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:36.515790 18886 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.930s (SENT) [suppressed 30 similar messages]
I20260709 12:25:36.516319 18916 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:36.531942 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:36.502777 24506 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:36.533329 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 124311us
W20260709 12:25:36.544708 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.550699 18920 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:36.491032 24491 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:36.567636 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50341.7us
I20260709 12:25:36.568873 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.531807 24959 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.554432 24956 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:36.578632 19457 connection.cc:256] RPC call timeout handler was delayed by -1.0521984000001794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
I20260709 12:25:36.583213 24956 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.529210 24879 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.588716 19487 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:36.589311 19487 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:36.590327 19487 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.591784 19487 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:36.599220 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.573817 24757 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:36.600327 19490 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:36.609934 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.618222 19490 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:36.618654 19490 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:36.619419 19490 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.620327 19490 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.622066 19487 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:25:36.625600 19487 pending_rounds.cc:85] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 10
I20260709 12:25:36.585660 24961 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:36.625970 19487 pending_rounds.cc:107] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:25:36.626427 19487 raft_consensus.cc:2889] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:36.626286 24961 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:36.623585 24955 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:25:36.623415 24967 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:36.624365 24972 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:36.584275 24491 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.625013 24970 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:36.625105 24969 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:36.628831 24961 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:36.630730 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.639761 19485 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:36.640103 19490 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:25:36.631146 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54422.5us
I20260709 12:25:36.629532 24972 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.648904 24972 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:36.634773 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.650036 19484 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:25:36.635546 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.654601 24859 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:25:36.588707 24947 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:25:36.657629 24948 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:36.660488 24879 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:36.660928 24939 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.578s	user 0.000s	sys 0.002s
I20260709 12:25:36.643039 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:36.643800 24657 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.587215 24959 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.657869 24847 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:36.631935 24883 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:36.667709 24650 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.681473 24650 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.682430 24956 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:36.682674 24657 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:36.683928 24883 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:36.687740 24817 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:25:36.631942 24970 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:36.684345 24845 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:36.684336 24951 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:25:36.685577 24969 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.684263 24959 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:36.693323 24970 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.695849 24969 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:36.747394 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.749001 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.775089 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 200030us
I20260709 12:25:36.776806 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:36.769733 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 117901us
I20260709 12:25:36.792659 24491 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:36.792579 24963 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:25:36.793769 24491 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.794445 24491 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:36.758962 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 479356us
W20260709 12:25:36.809777 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 138136us
I20260709 12:25:36.811340 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.812511 24969 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:36.813776 24969 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.816509 24859 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:36.825986 24974 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:36.827798 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.836244 24894 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.002s
I20260709 12:25:36.839835 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:36.842553 24975 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:36.843487 24975 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:36.847810 24845 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:36.848639 18914 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2834) took 1331 ms (client timeout 1510 ms). Trace:
I20260709 12:25:36.849309 18915 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:36.849073 24972 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:36.851454 24961 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:36.852109 24961 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:36.853530 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1316) took 2728 ms. Trace:
I20260709 12:25:36.854104 24961 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.864037 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 2787) took 1171 ms. Trace:
I20260709 12:25:36.864650 18919 rpcz_store.cc:276] 0709 12:25:35.692443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.844634 (+152191us) service_pool.cc:224] Handling call
0709 12:25:36.863498 (+1018864us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b54000f5d54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:36.863776 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8817024}
I20260709 12:25:36.867096 24966 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:36.867794 24972 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:36.869478 24966 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:36.835615 24969 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.870501 24972 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:36.871084 24972 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:36.872812 24972 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:36.849313 18914 rpcz_store.cc:269] 0709 12:25:35.516593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.518559 (+  1966us) service_pool.cc:224] Handling call
0709 12:25:36.847957 (+1329398us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400154d54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:36.848330 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273179392}
I20260709 12:25:36.878376 18922 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:36.854250 18917 rpcz_store.cc:276] 0709 12:25:34.124675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.125090 (+   415us) service_pool.cc:224] Handling call
0709 12:25:36.157753 (+2032663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.168268 (+ 10515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.852745 (+684477us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54000f6250. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:36.853179 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4673767296}
I20260709 12:25:36.879233 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.880414 18914 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:36.881278 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.882032 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2781) took 1218 ms. Trace:
W20260709 12:25:36.882346 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.870030 24966 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:36.883199 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.884172 18918 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: [13.8-14.9]
I20260709 12:25:36.885141 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.886130 24982 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:36.886636 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:36.896770 24491 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.898381 24972 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:36.899372 24878 consensus_meta.cc:287] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.625s	user 0.016s	sys 0.008s
I20260709 12:25:36.905126 24953 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:25:36.908639 24957 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.384s	user 0.004s	sys 0.000s
I20260709 12:25:36.912770 18922 rpcz_store.cc:276] 0709 12:25:35.664036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.873081 (+209045us) service_pool.cc:224] Handling call
0709 12:25:36.874581 (+1001500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.879112 (+  4531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.881774 (+  2662us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000f5d50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:36.881949 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302083968}
I20260709 12:25:36.896135 24650 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.845784 24975 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.919693 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2852) took 1077 ms. Trace:
I20260709 12:25:36.921605 18918 rpcz_store.cc:276] 0709 12:25:35.840987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.399023 (+558036us) service_pool.cc:224] Handling call
0709 12:25:36.857563 (+458540us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b58001e5198. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:25:36.858089 (+   526us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:36.915059 (+ 56970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.918245 (+  3186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29786368}
I20260709 12:25:36.926601 18918 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:36.926216 24966 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.928182 24966 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:36.931443 24978 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:36.916994 24953 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:36.937686 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.946609 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.946811 24654 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:36.947925 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.946761 24861 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.950026 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.952015 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.954366 19489 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:36.946761 24953 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.939180 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.956039 24953 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:36.956602 24861 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.933948 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.959997 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.960104 24861 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.960911 19487 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:36.961591 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.938279 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.962848 19486 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 10.
I20260709 12:25:36.948135 24654 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.948233 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:36.969139 24491 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.937011 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.962855 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:36.936167 24910 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:36.973572 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:36.981258 19487 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:36.976846 24910 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:36.984849 24976 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:25:36.987543 24974 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:36.988065 24974 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:36.988816 18920 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:36.990028 18914 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:36.991138 24878 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:36.992189 24878 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.992695 24969 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.993500 24969 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:36.989360 24974 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:36.994921 24878 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:36.995838 24974 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:36.995985 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 622413us
I20260709 12:25:36.999166 24875 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:36.990162 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.999676 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:37.009383 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.010066 18913 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:37.011272 24278 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:37.012625 24969 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:37.013686 24856 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:37.014551 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:37.015707 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 138263us
I20260709 12:25:37.016582 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:37.032733 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:37.033373 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.037428 19483 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:37.015810 24961 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.015250 24903 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:37.045787 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 98758.7us
I20260709 12:25:36.983686 24978 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.054759 24878 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:37.059923 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2779) took 1396 ms. Trace:
W20260709 12:25:37.063617 24857 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.011s
I20260709 12:25:37.067382 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1046) took 2492 ms. Trace:
W20260709 12:25:37.069272 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69756.5us
I20260709 12:25:37.044776 24654 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:37.072561 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.039435 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:37.039058 24749 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:37.014333 24278 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:25:37.082530 18915 rpcz_store.cc:276] 0709 12:25:35.663338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.666887 (+  3549us) service_pool.cc:224] Handling call
0709 12:25:36.848245 (+1181358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.850034 (+  1789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.059603 (+209569us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400154d50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:37.059817 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2698881792}
I20260709 12:25:37.039788 24847 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:37.103631 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2888) took 1028 ms. Trace:
I20260709 12:25:37.037817 24384 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:37.104820 24384 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.104161 18843 rpcz_store.cc:276] 0709 12:25:36.058253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.060366 (+  2113us) service_pool.cc:224] Handling call
0709 12:25:36.080355 (+ 19989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.193093 (+112738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.193140 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.193777 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 12:25:36.525115 (+331338us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:36.815094 (+289979us) log.cc:844] Serialized 14 byte log entry
0709 12:25:36.907153 (+ 92059us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:37.051163 (+144010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.079051 (+ 27888us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b540041b4d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:37.079114 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.081580 (+  2466us) raft_consensus.cc:1685] finished
0709 12:25:37.081596 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.086175 (+  4579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268575,"prepare.queue_time_us":46882,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":264789,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":60843,"spinlock_wait_cycles":224337536,"thread_start_us":489071,"threads_started":2,"wal-append.queue_time_us":261409}
I20260709 12:25:37.083369 19488 rpcz_store.cc:276] 0709 12:25:34.574614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.574773 (+   159us) service_pool.cc:224] Handling call
0709 12:25:35.867781 (+1293008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.871763 (+  3982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.066775 (+1195012us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400136850. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:37.067080 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972897664}
W20260709 12:25:37.094004 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 59695.4us
W20260709 12:25:37.113178 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 132231us
I20260709 12:25:37.039022 24725 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:37.114598 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:37.102260 24847 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.122021 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.116205 24725 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:37.128249 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45890.4us
I20260709 12:25:37.131032 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.131286 24278 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:37.132084 24278 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:37.133162 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.133903 24695 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:37.136859 24978 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:37.125322 24847 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.138669 24384 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:37.139263 24942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.022s	sys 0.036s
W20260709 12:25:37.139703 24942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.022s	sys 0.036s
I20260709 12:25:37.131202 24903 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:37.141641 24903 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:37.145619 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 106311us
I20260709 12:25:37.147400 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:37.151909 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.152668 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:37.142127 24903 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:37.154699 18914 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:25:37.154968 24840 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:37.133358 24278 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.157541 24695 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:37.152683 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:37.158906 24910 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.160401 24725 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.161890 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:37.163231 24960 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:37.155267 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68014.6us
I20260709 12:25:37.168941 24970 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:37.192134 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.192538 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.193178 18767 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.194712 24840 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:37.194934 18770 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:37.195225 24840 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.195585 24840 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:37.196316 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.197184 18769 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.198323 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.198758 24853 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:37.199458 24960 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:37.191203 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.098829 24857 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.186074 18916 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:37.188427 19488 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:37.190058 24725 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.191186 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:37.191519 24947 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:37.200206 24988 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:37.207505 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55782.3us
W20260709 12:25:37.209110 24506 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.640s	user 0.013s	sys 0.008s
I20260709 12:25:37.213377 18771 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:37.210952 19485 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:37.207500 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.219671 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.226851 24506 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.234267 24695 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:37.225338 24910 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.237254 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:37.235733 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:37.235201 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.235321 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.245010 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.243753 24695 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:37.246502 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.234541 24491 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:25:37.246826 24506 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:37.247551 24491 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:37.248026 24491 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:37.251807 19488 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:37.252847 19492 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:37.254725 24919 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:37.255872 24884 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:37.256939 24903 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.258850 24960 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:37.259399 24960 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:37.260543 24960 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.235872 24853 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:25:37.263187 24695 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.228191 24988 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:37.266434 18670 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 8 to 11, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 11 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:37.275491 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:37.276214 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:37.276714 18922 raft_consensus.cc:2410] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:37.277693 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:37.279850 18913 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:37.268787 24519 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:25:37.269345 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 59303.6us
I20260709 12:25:37.280470 18670 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:37.282584 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.288062 24944 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.288769 24944 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.249560 24491 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.271306 24978 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:37.291369 24491 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.278053 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:37.283044 24974 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:37.294111 24974 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:37.294626 24974 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:37.267457 24988 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.254238 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.277819 24960 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:37.305696 18916 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:37.295966 24974 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.307193 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.308281 24974 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:37.308643 24903 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:37.317778 19492 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
W20260709 12:25:37.319159 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 154741us
W20260709 12:25:37.336221 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.340904 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:37.348486 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:37.352542 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 98407.2us
I20260709 12:25:37.355538 24757 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:37.357597 24919 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:37.361526 18915 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:37.362627 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.363178 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.364120 18772 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.364641 18768 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:37.317423 24947 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.366276 18765 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:37.363025 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.373003 18771 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:37.319027 24519 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:37.366040 18664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 290) took 21696 ms (client timeout 15000 ms). Trace:
I20260709 12:25:37.311187 24847 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:37.389540 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 43973.9us
I20260709 12:25:37.390573 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.386498 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:37.340863 24749 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:37.393729 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.391956 18767 raft_consensus.cc:2376] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16. Re-sending same reply.
I20260709 12:25:37.398720 24847 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:37.400090 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:37.400297 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.401021 18773 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.401053 24878 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.402271 24878 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.404830 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:37.409543 18737 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.411921 18737 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:37.415723 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:37.429602 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 198044us
W20260709 12:25:37.431790 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.342628 24875 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 12:25:37.362663 24978 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:25:37.414901 24491 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.425802 24853 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:37.445642 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:37.446532 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.425225 24866 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.429630 24506 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:37.454085 18773 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:37.452996 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:37.462791 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.456821 24519 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.463382 24883 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:37.469959 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.462661 24888 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 12:25:37.469949 18768 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:37.472173 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.473626 18764 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
W20260709 12:25:37.476202 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:37.478649 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.414137 24947 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.492250 19491 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:37.512363 18771 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:37.516415 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:37.374715 18664 rpcz_store.cc:269] 0709 12:25:15.669810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.670738 (+   928us) service_pool.cc:224] Handling call
0709 12:25:37.365734 (+21694996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:30.298589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:30.423509 (+124920us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:30.423647 (+   138us) write_op.cc:435] Acquired schema lock
0709 12:25:30.423736 (+    89us) tablet.cc:662] Decoding operations
0709 12:25:30.517363 (+ 93627us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:30.517471 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:30.517504 (+    33us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:25:31.107471 (+589967us) tablet.cc:701] Row locks acquired
0709 12:25:31.127162 (+ 19691us) write_op.cc:260] PREPARE: finished
0709 12:25:31.152434 (+ 25272us) write_op.cc:270] Start()
0709 12:25:31.156291 (+  3857us) write_op.cc:276] Timestamp: P: 1783599931142293 usec, L: 0
0709 12:25:31.156333 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:25:31.164404 (+  8071us) log.cc:844] Serialized 11276 byte log entry
0709 12:25:32.896976 (+1732572us) op_driver.cc:464] REPLICATION: finished
0709 12:25:33.303891 (+406915us) write_op.cc:301] APPLY: starting
0709 12:25:33.304015 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:33.660282 (+356267us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:33.660425 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:35.525431 (+1865006us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:35.526193 (+   762us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 12:25:35.526281 (+    88us) write_op.cc:312] APPLY: finished
0709 12:25:35.527149 (+   868us) log.cc:844] Serialized 252 byte log entry
0709 12:25:35.648907 (+121758us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:35.684849 (+ 35942us) write_op.cc:454] Released schema lock
0709 12:25:35.714194 (+ 29345us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:35.761855 (+ 47661us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:35.763889 (+  2034us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":404522,"apply.run_cpu_time_us":77595,"apply.run_wall_time_us":2439778,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125521,"num_ops":29,"prepare.queue_time_us":306227,"prepare.run_cpu_time_us":34635,"prepare.run_wall_time_us":1281866,"raft.queue_time_us":668601,"raft.run_cpu_time_us":37417,"raft.run_wall_time_us":402173,"replication_time_us":1693025,"spinlock_wait_cycles":3456,"thread_start_us":1226992,"threads_started":5,"wal-append.queue_time_us":761191,"wal-append.run_cpu_time_us":75932,"wal-append.run_wall_time_us":2897340}]]}
I20260709 12:25:37.516927 18772 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:37.517473 24725 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:37.518028 24334 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:37.518807 24334 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:37.519960 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.518137 24725 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:37.521514 24725 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.522742 18773 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:37.527199 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:37.530838 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.499643 24944 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:37.491214 24903 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:37.535374 24947 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:37.552948 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.554199 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:37.519974 24334 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.561594 18769 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:37.562492 18922 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:37.559670 24888 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:37.575224 19487 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:37.543560 24278 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:37.585337 24840 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:37.587000 24994 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:25:37.587391 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.588554 24888 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:37.590445 24999 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:25:37.591372 24888 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:37.592171 24695 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:37.592610 24695 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.592969 24695 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:37.598670 18719 auto_rebalancer.cc:893] Removing replace marker failed: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:25:37.599370 18719 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:25:37.599713 18719 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:25:37.603375 24908 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.604059 24908 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:37.607089 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.609171 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.610762 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.610896 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.611629 18773 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.611869 18772 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:37.612661 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.612872 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.613710 18772 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.613971 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.614807 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.615296 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.615612 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:37.616606 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbadce60e960476289740ec2afd0a5c8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:37.562068 24857 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:37.618085 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.619650 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.622177 18773 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:37.620280 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:37.637125 18772 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:37.647469 18913 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:37.544778 24988 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 12:25:37.671407 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:37.673146 18764 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:37.676967 24968 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:37.678959 24988 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:37.679942 24988 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.657021 18769 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:37.682570 24988 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:37.683684 24878 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:37.664117 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.685549 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:37.658282 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.646786 24856 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.679049 24982 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:37.667919 24840 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:37.630036 24908 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:37.697825 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.704383 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:37.705307 19486 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:37.706961 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.706238 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:37.710445 19484 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:37.720584 18771 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:37.717865 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.715691 18766 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:37.699978 24982 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:37.718533 24978 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.712076 24725 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.755089 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.759429 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.760859 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.770265 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.749544 24749 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.772639 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.779316 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.781955 18770 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:37.791661 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.793572 18771 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.794994 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.792256 24725 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.798527 25010 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:25:37.798933 24725 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:37.799321 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 69944.2us
W20260709 12:25:37.802007 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.805823 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:37.807467 24749 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.810519 18770 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.813512 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.814456 18764 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:37.814576 24875 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.814911 18766 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:37.815397 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.815563 25010 consensus_queue.cc:1243] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:37.816051 18768 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:37.816179 25010 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:37.816663 25010 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:37.816995 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.817762 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.818686 24749 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:37.819934 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:37.817708 18773 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:37.821543 19487 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:37.821905 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.822669 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.823324 18770 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [17.11-18.12]
I20260709 12:25:37.823405 18766 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:37.823352 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:37.825757 18765 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:25:37.826985 24278 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:37.827150 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.815254 24875 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.828809 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.829438 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.752630 24856 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.831470 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.834088 18764 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:37.820513 18768 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:37.835718 18767 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:25:37.837031 24974 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.528s	user 0.016s	sys 0.000s
I20260709 12:25:37.780757 24978 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.842027 24978 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:37.831313 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:37.847641 19492 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:37.816300 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.832034 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:37.829619 24875 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:37.748488 24695 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.834133 24982 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.856383 24982 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:37.857018 24695 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:37.848708 18772 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:25:37.854377 25012 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:25:37.858201 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:37.865746 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.870419 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:37.817695 25010 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:37.869077 24875 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:37.873415 24857 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.924780 18764 pending_rounds.cc:85] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 7
W20260709 12:25:37.910772 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48387.2us
I20260709 12:25:37.911338 18768 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:37.910149 18769 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:37.913406 19486 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:37.925288 18764 pending_rounds.cc:107] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 12:25:37.936542 18764 raft_consensus.cc:2889] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:37.938791 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.945353 18920 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:37.947485 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:37.948958 18919 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:37.912875 24875 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.921852 24969 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:37.953678 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.937714 24695 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:37.934880 24857 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.965900 24856 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:37.969699 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:37.921767 24970 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:25:37.958081 24875 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:37.958666 25010 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:37.961095 24919 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:37.986095 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 193955us
W20260709 12:25:37.988608 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.990777 24888 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.991736 24888 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:37.995115 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:37.995607 24857 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.000829 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:37.994204 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:38.004251 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.003515 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:38.016750 18845 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:38.019428 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:38.020488 19486 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:37.974838 24878 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:25:38.041710 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:38.044668 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48356us
I20260709 12:25:38.017118 24910 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.963619 24969 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.019312 24884 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:38.057787 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.066289 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.070726 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 67316.1us
I20260709 12:25:38.072121 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.070647 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.073994 24942 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.075042 25023 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:38.075645 25023 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:38.076043 25023 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.078574 24888 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.079449 25025 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.078743 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.081228 24695 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:38.081719 24695 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:38.082206 24695 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.082703 25025 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:38.083622 25025 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:38.086887 25025 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:38.087971 25019 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.166s	user 0.000s	sys 0.003s
I20260709 12:25:38.091543 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:38.099767 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:38.101234 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.106711 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.108101 18839 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:25:38.109606 24942 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:38.111644 19456 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.113001 24942 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:38.113669 24942 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:38.115154 24942 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.118902 24278 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:38.119488 24278 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.119974 24278 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.123781 24695 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.128222 24969 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.128823 24970 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:25:38.135031 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70648.6us
I20260709 12:25:38.130013 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.158047 24970 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.064967 24910 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.052207 24919 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:38.154040 25020 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 12:25:38.174865 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 239595us
W20260709 12:25:38.166162 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.174991 24970 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.206746 18843 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:25:38.207183 18844 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:38.207718 24919 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.208767 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.209645 18844 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:38.211115 25023 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.191501 18847 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:25:38.213375 18887 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.663s (SENT)
I20260709 12:25:38.214186 18847 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:38.162063 24975 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:25:38.215652 18847 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:38.217564 24975 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:38.207193 18843 pending_rounds.cc:85] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 12
I20260709 12:25:38.214319 25023 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.218811 18843 pending_rounds.cc:107] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:25:38.218336 24975 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.219146 18843 raft_consensus.cc:2889] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:38.176230 24969 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:38.221463 24969 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.224681 24969 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.189030 24875 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.227803 24875 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.194521 24847 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:38.228485 24847 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:38.228902 24847 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.174055 24878 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.232049 18914 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:25:38.234212 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 192604us
I20260709 12:25:38.240769 18766 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:38.240947 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 111057us
I20260709 12:25:38.241865 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:38.240787 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:38.243880 18846 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.244131 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:38.245003 24884 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.246309 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:38.247187 18919 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:38.248168 18913 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:38.249135 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:38.251277 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.217236 24910 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.271162 18847 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:25:38.271634 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:38.272411 18766 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
W20260709 12:25:38.274463 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.271647 18847 pending_rounds.cc:85] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 8
I20260709 12:25:38.277633 18847 pending_rounds.cc:107] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:25:38.277983 18847 raft_consensus.cc:2889] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:38.258821 24919 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:38.286580 24982 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.258896 24725 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:38.235936 24878 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:38.303853 18886 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.663s (SENT)
W20260709 12:25:38.301589 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 132182us
I20260709 12:25:38.306579 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:38.304486 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:38.310206 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:38.275782 24975 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:38.314612 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:38.301112 25025 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:38.321154 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:38.321879 19492 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.324822 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:38.325784 19484 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:38.298671 24725 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.299187 25035 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.360492 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:38.366228 18887 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.651s (SENT)
I20260709 12:25:38.366982 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:38.328286 24919 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:38.302955 24982 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.340330 24725 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:38.380178 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 81070.2us
I20260709 12:25:38.359946 24910 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.392473 19492 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
W20260709 12:25:38.396747 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 92933.2us
I20260709 12:25:38.373873 25041 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:38.359616 25025 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:25:38.405894 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.413374 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:38.362272 25035 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:38.391819 24695 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.424362 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:38.425384 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:38.434324 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74837.7us
I20260709 12:25:38.435525 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.437222 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.438151 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:38.439179 18766 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:38.438189 18840 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:38.441838 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.442600 18840 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:38.443117 18919 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:25:38.438282 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.449189 18844 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:38.403883 25010 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.450971 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.450834 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.449115 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:38.405018 25041 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:38.460354 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:38.463112 18766 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:38.462769 25041 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.464344 25041 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.466940 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:38.471949 24910 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:38.428046 24988 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:38.534650 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 191839us
I20260709 12:25:38.527642 18916 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:25:38.538736 18916 pending_rounds.cc:85] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 11
I20260709 12:25:38.539057 18916 pending_rounds.cc:107] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:25:38.539356 18916 raft_consensus.cc:2889] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:38.532397 18848 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:38.533145 25034 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:25:38.533560 24875 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:38.534642 25010 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.415859 25044 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
W20260709 12:25:38.535238 25026 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:25:38.542955 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:38.473193 24910 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:38.586299 24910 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:38.586556 25035 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:38.587736 24910 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:38.589584 24910 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:38.527374 25032 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 12:25:38.543206 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 95851.4us
I20260709 12:25:38.591271 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.592545 24982 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.593202 24947 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:38.454910 24919 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.595822 19483 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:38.598737 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.570106 24969 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:38.571707 24908 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:38.527172 24975 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:38.600343 24975 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.600497 25044 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:38.600808 24975 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:38.600934 25044 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:38.579080 24878 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:38.580042 24847 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.585143 24970 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.568815 24988 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.615833 18846 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:38.604259 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:38.623687 24725 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.607834 25010 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:38.627357 25010 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:38.628348 18840 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:38.629161 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.629755 24988 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.653097 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:38.574817 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:38.666682 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:38.458021 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.670544 18919 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:38.672884 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:38.673949 18920 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:38.675966 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.679255 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:38.682473 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.684258 18848 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:38.687662 18839 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:38.690574 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 115850us
I20260709 12:25:38.695286 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:38.699932 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 95947.2us
I20260709 12:25:38.601994 25044 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.702834 18846 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:38.704135 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.702288 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:38.705405 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.705669 18841 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.682085 24506 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:38.706715 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.707613 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:38.712649 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:38.711282 18738 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.724972 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.726541 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.726830 25044 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.727887 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.729087 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.730685 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:38.732197 18839 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:38.735909 24847 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.737532 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.738282 18843 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:38.739744 18843 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:38.745311 24725 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.749971 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.751004 18844 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:38.689996 24695 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:38.758715 24853 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:25:38.779114 24853 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:38.780879 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.720507 24857 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:25:38.760265 24278 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.636s	user 0.013s	sys 0.002s
I20260709 12:25:38.759658 24878 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:38.754081 24506 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:38.798345 24654 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.801432 18842 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:38.804100 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.823967 18844 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
W20260709 12:25:38.834023 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74771us
I20260709 12:25:38.835476 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:38.759452 24975 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.838539 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.839672 18841 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:38.841203 24875 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:38.841506 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.841745 24875 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:38.837899 24654 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:38.766639 24334 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:25:38.843343 24970 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.843721 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.844391 18844 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:38.844503 24654 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:38.842329 24875 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:38.845465 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:38.846122 18844 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:38.816427 24278 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:38.766832 24519 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:25:38.842265 18842 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:38.850101 24883 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:25:38.856315 18913 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:38.838522 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:38.869181 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.871462 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:38.873060 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.873735 19486 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:38.874082 18840 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:38.878890 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:38.891608 24975 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:38.896127 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:38.896709 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:38.896821 19483 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:38.897807 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:38.896894 19488 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.900142 18842 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:25:38.902585 24278 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:38.903586 18839 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:38.906739 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.907964 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:38.908746 19488 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:38.908828 19486 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:38.897282 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:38.913128 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:38.916703 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 216907us
W20260709 12:25:38.916883 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 158946us
I20260709 12:25:38.917696 18915 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:38.918164 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:38.920073 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:38.921746 18844 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:38.924700 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:38.925055 18913 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:38.923259 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:38.927620 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:38.928438 19488 raft_consensus.cc:2368] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:38.930784 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:38.931478 18915 raft_consensus.cc:2368] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:38.934643 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:38.936194 19486 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:38.939155 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 100744us
I20260709 12:25:38.940946 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:38.953469 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:38.926991 24278 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.923822 24883 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:38.929364 24947 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:38.927136 24334 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:38.951860 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:38.929724 24910 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:38.934773 24970 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:38.934437 24506 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:38.929490 24695 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:39.071864 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 118484us
I20260709 12:25:39.029685 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2877) took 1088 ms. Trace:
I20260709 12:25:38.975239 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:39.084790 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:39.014995 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.946346 24857 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:39.084961 18914 rpcz_store.cc:276] 0709 12:25:37.941423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.942632 (+  1209us) service_pool.cc:224] Handling call
0709 12:25:37.942916 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:38.232485 (+289569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.991790 (+759305us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b540027c4d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:39.029567 (+ 37777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664101120}
W20260709 12:25:39.037046 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53283.7us
W20260709 12:25:39.039537 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 87770.8us
I20260709 12:25:38.992347 24969 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:39.088359 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:39.087147 25035 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:39.036882 24910 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:39.043074 24506 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.084079 24695 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.035523 24866 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.040369 24970 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.031008 24278 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.092104 24857 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.106895 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:39.123261 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:38.962883 24908 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.148s
W20260709 12:25:39.138289 25040 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.680s	user 0.008s	sys 0.009s
I20260709 12:25:39.138633 25010 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:39.141513 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 202440us
I20260709 12:25:39.152230 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:39.109035 25035 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.117744 24910 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.040781 24883 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.122574 24506 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.116626 25058 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:39.128666 24695 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.170948 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:39.150825 24970 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:39.172503 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 65767.7us
I20260709 12:25:39.150341 24982 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:39.151553 24857 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:39.161372 25035 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:39.163622 24919 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:39.197131 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45011.3us
I20260709 12:25:39.182438 24974 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:39.174695 25058 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:39.186758 24969 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:39.159245 24866 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:39.214445 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbadce60e960476289740ec2afd0a5c8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:39.183017 24947 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:25:39.208061 24982 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:39.223310 18844 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:39.217922 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:39.207173 25075 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:39.229239 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:39.230165 18771 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:39.233312 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:39.236706 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:39.210005 24969 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:39.244122 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 159415us
I20260709 12:25:39.245348 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:39.210697 25058 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.247087 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:39.252782 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 68953.3us
I20260709 12:25:39.254674 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2732) took 1073 ms. Trace:
I20260709 12:25:39.225148 25060 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:39.259016 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:39.228150 25075 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.241984 24725 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.210422 24974 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.255124 18845 rpcz_store.cc:276] 0709 12:25:38.175927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.176099 (+   172us) service_pool.cc:224] Handling call
0709 12:25:38.185534 (+  9435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.210933 (+ 25399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.210966 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.211502 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:25:38.294457 (+ 82955us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:38.294520 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.294630 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.136495 (+841865us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:39.240788 (+104293us) raft_consensus.cc:1685] finished
0709 12:25:39.240808 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.249093 (+  8285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1842,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":122541824,"thread_start_us":82417,"threads_started":1,"wal-append.queue_time_us":179131}
I20260709 12:25:39.251890 24969 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:39.254313 24749 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:39.246368 24982 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.316306 18840 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:25:39.320278 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.266984 25075 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.318378 18771 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
W20260709 12:25:39.331928 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.310081 25024 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:39.278473 25057 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:25:39.349306 25081 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 12:25:39.353528 25062 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:25:39.354938 24975 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.388230 24975 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.390964 25074 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.391324 24975 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.359720 25075 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:39.363574 25068 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:25:39.391631 25074 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.366452 25010 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:39.393121 25010 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:39.394021 25074 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.310863 25060 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:25:39.369866 25085 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:39.435155 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 181474us
W20260709 12:25:39.370245 25067 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:25:39.371112 25061 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.368485 25080 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:39.402756 25075 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:39.405543 25010 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:39.408362 25079 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:25:39.415545 24866 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.418825 24883 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:39.420432 24974 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.422663 24982 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.346753 24278 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.455789 24969 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.336344 24947 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:25:39.444568 25074 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.354226 24506 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.475934 18771 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:25:39.481540 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:39.491972 18814 leader_election.cc:400] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:39.492388 18814 leader_election.cc:403] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:25:39.493454 18771 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: [19.13-19.13]
W20260709 12:25:39.491420 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 232488us
I20260709 12:25:39.498210 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:39.498375 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:39.464883 25061 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.506603 18769 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:39.507510 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:39.508041 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:39.508857 18769 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:39.510754 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:39.511145 18764 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:25:39.512202 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:39.513217 24506 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.513289 25083 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:25:39.516170 24988 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:39.516928 24988 consensus_queue.cc:1243] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:39.517956 25058 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.521148 24857 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.524132 24969 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.524225 24910 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.526998 24910 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.527657 25010 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.528712 24919 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:39.531814 24970 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.489224 25086 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:25:39.487129 25074 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.539527 25024 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:39.544174 18768 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:39.549330 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:39.549891 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:39.556108 25035 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.558609 24725 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 12:25:39.559587 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61919.2us
I20260709 12:25:39.468842 25080 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:39.574687 25063 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.344s	user 0.002s	sys 0.000s
I20260709 12:25:39.575958 25078 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:39.576431 25078 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:39.577679 25078 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.578766 24988 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:39.579216 25078 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:39.579358 24988 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.581696 24988 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.563095 25035 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.495941 24278 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 12:25:39.571547 24875 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.726s	user 0.015s	sys 0.000s
I20260709 12:25:39.576467 25074 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:39.570436 25046 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:39.605240 18913 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:39.607044 18918 pending_rounds.cc:85] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 7
I20260709 12:25:39.608039 18918 pending_rounds.cc:107] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 12:25:39.608310 18918 raft_consensus.cc:2889] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:39.609732 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:39.607641 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:39.611686 18922 raft_consensus.cc:2410] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:39.624414 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:39.618067 25023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.053s	sys 0.105s
I20260709 12:25:39.628293 18919 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:39.603259 25083 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.630811 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 385551us
I20260709 12:25:39.630229 25082 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:25:39.635051 25058 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.622825 24883 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:39.633383 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:39.633993 25050 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.652472 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 180620us
I20260709 12:25:39.653970 18771 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:39.606659 24875 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:39.627307 25023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.053s	sys 0.105s
W20260709 12:25:39.664651 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.686299 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:39.636015 24883 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:39.689155 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55874.6us
W20260709 12:25:39.689807 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 128979us
I20260709 12:25:39.691592 18913 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:39.662899 25096 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:39.705875 25049 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.053s	user 0.003s	sys 0.000s
I20260709 12:25:39.708659 25095 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.709379 25095 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.686480 24970 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.710681 24857 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.710896 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:39.711763 18916 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:39.712172 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.682286 24919 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:39.643786 25083 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:39.734862 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.719447 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 115347us
I20260709 12:25:39.737540 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:39.744702 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:39.749641 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55100.8us
I20260709 12:25:39.711855 25095 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.662287 25050 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.757121 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:39.758219 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.719033 24506 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.716828 25091 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:39.764927 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 148459us
I20260709 12:25:39.768101 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:39.763238 25095 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.785225 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:39.762665 24974 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:39.790916 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:39.793351 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:39.754976 24278 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:39.766957 25099 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.774891 24975 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:39.812155 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.783759 24857 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.820160 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:39.820329 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:39.821151 19490 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.769856 25023 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:25:39.821997 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:39.771934 24888 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:25:39.824661 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:39.790220 25046 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:39.770749 24506 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.796176 24878 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:39.772102 25091 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.831526 19484 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
W20260709 12:25:39.832888 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47733.2us
I20260709 12:25:39.838440 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:39.791700 25095 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.800230 24974 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.846453 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:39.842326 24695 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.002s
I20260709 12:25:39.838006 24988 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:39.855329 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:39.854319 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:39.857183 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:39.858548 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:39.881681 18847 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:39.862610 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:39.863399 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:39.887319 18848 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:39.864117 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:39.864766 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:39.866287 25050 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.866571 25090 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.828275 25106 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:25:39.867805 25089 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:39.868853 24506 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:39.897120 24506 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.896733 25046 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.897676 24506 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.900105 24506 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:39.900717 24506 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:39.834529 24975 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:25:39.869154 24974 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.869479 25095 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.871421 25105 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:39.858887 24875 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:39.872359 24883 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.874763 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:39.877851 25096 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:39.848800 24970 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:39.850586 25113 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.892016 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:39.915800 18841 raft_consensus.cc:2376] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15. Re-sending same reply.
I20260709 12:25:39.892758 18846 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 12:25:39.924278 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 109993us
I20260709 12:25:39.888911 24878 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.895805 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:39.924839 25122 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:39.902748 25105 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.929373 25104 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:39.861311 25035 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:25:39.929559 24878 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:39.922691 24988 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:25:39.933394 25091 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:39.922358 25113 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:39.936194 25117 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.937672 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:39.929423 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:39.861740 24695 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:39.923390 25083 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:39.948140 24857 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:39.958546 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:39.907475 19490 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:39.981158 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:39.999701 18769 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:39.983417 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 129155us
I20260709 12:25:39.988741 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:39.990067 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:39.988617 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51362.9us
I20260709 12:25:39.962690 25122 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:39.994814 25056 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.245s	user 0.024s	sys 0.005s
I20260709 12:25:39.994961 25123 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:39.996752 25105 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:40.016273 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 203647us
I20260709 12:25:40.024855 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.025848 18917 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:40.032263 19490 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:40.035231 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:40.037050 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.039361 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:40.053450 18922 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:25:40.063061 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:40.065860 19490 raft_consensus.cc:2410] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:25:40.029440 25060 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.066984 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:40.052976 24982 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:40.067260 25060 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.067899 24982 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.070024 25060 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:40.024770 25056 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.025s	sys 0.005s
I20260709 12:25:40.082759 18921 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:40.055110 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.074180 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.075811 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:40.087565 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:39.985412 25104 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.102494 19484 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:40.103015 18919 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:40.024348 25123 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:40.101292 18769 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:40.105924 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:40.114809 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.106961 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.116349 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.116935 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.114758 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:40.124975 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.127650 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.128527 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.128925 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.129181 18842 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:40.129494 18843 raft_consensus.cc:2376] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16. Re-sending same reply.
I20260709 12:25:40.130712 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.131847 18843 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:40.075676 25091 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:40.079437 24942 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.070364 24982 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:40.070793 25112 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:40.152688 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:40.072945 24884 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:40.070969 25092 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:40.160236 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 84954.4us
I20260709 12:25:40.185925 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:40.167295 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 52628.5us
I20260709 12:25:40.100687 24878 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:40.173156 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.174778 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.197904 18845 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.199450 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.174904 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.174029 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.009037 25117 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.100970 25010 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:40.175755 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.108084 25074 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.076352 24278 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 12:25:40.203609 18839 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:25:40.219175 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:40.312346 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 184217us
W20260709 12:25:40.314664 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 119039us
I20260709 12:25:40.315631 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.180603 25035 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:40.328225 18772 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:40.207831 25127 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:40.337498 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 194253us
I20260709 12:25:40.348881 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:40.349705 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.334092 25025 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.352020 18919 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
W20260709 12:25:40.334877 25108 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:25:40.214257 25095 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.136s
I20260709 12:25:40.323446 25035 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:40.319662 25060 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:40.181030 24942 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.255968 25010 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.375805 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.338819 25112 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:40.381374 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.334718 25119 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:40.383283 18842 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:40.355988 25074 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:40.395705 18843 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
W20260709 12:25:40.396400 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50199.1us
I20260709 12:25:40.397779 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.355527 25023 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.395334 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.400633 18917 raft_consensus.cc:2410] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:25:40.364305 24840 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:40.313247 25092 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.420902 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.370258 25035 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.213491 25122 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.379866 25105 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.427245 19486 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:40.427793 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.427232 24875 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:40.408910 25137 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:40.441231 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.425383 24695 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:40.447250 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.433017 24982 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:40.449025 18917 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:40.434924 24884 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:40.430675 25023 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:40.453291 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104505us
I20260709 12:25:40.454782 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.436848 24878 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.459537 24942 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:40.460484 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.335479 25123 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.424728 25074 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.358603 25127 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.440829 25122 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.461292 18919 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:40.437240 25113 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:40.467352 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.394735 25060 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.433022 25105 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.493723 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:40.494499 25105 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:40.495071 25120 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:25:40.496163 25133 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:25:40.479280 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.516433 18842 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:40.482604 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:40.517524 19488 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:40.512377 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.519315 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:40.519508 18812 leader_election.cc:400] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:40.483103 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.520557 18848 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:40.482698 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:40.521297 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.484066 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.484318 25142 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:40.491775 25092 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:40.426643 25112 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.499392 25060 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:40.449681 25137 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.468778 25025 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:40.501770 25074 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:40.491827 25091 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:40.503083 25010 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:40.503787 25117 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:40.506548 24519 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:40.508061 25127 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:40.508539 25104 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:40.509403 25130 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 12:25:40.483219 25118 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.470202 25119 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.510478 24982 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.512436 25023 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:40.513121 18845 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:40.522240 18846 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 11: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:40.521579 18839 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:40.520731 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:40.647539 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.527730 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:40.531682 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.535732 25035 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.514236 24974 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:40.545524 18917 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:40.556433 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:40.566036 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:40.569677 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 115001us
I20260709 12:25:40.672425 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.572702 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.573491 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.580004 25061 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:40.584123 25099 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:40.586807 25080 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:40.673651 18921 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:40.636695 25104 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.606345 25096 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:40.611815 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:40.630101 18918 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:40.559610 25142 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:40.641394 18916 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:25:40.680433 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 124103us
I20260709 12:25:40.644670 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:40.681107 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 160494us
I20260709 12:25:40.649170 18922 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.642573 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.681648 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:40.681880 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:40.565657 24519 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:40.684315 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.684693 18920 raft_consensus.cc:2410] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:40.685055 18839 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:40.685211 24519 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.685891 25035 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:40.676656 25099 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:40.686611 25023 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:40.687309 25099 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.688827 25099 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:40.689415 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.646536 24982 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:40.676519 18914 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:40.587908 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2755) took 1372 ms. Trace:
I20260709 12:25:40.668514 24875 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:40.682188 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52224.9us
I20260709 12:25:40.570012 25091 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:40.690927 18841 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:40.678668 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.571353 19488 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:40.695883 18844 rpcz_store.cc:276] 0709 12:25:39.215252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.239376 (+ 24124us) service_pool.cc:224] Handling call
0709 12:25:39.239707 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.283070 (+ 43363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:39.283102 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.283148 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:39.283179 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.587519 (+1304340us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b54003d9ad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:40.587589 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:40.587810 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99109760}
I20260709 12:25:40.708828 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:40.709558 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.715785 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:40.716650 19486 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.719153 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:40.674676 24749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.050s	sys 0.067s
I20260709 12:25:40.729290 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:40.730335 18766 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:25:40.730461 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:40.730531 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.732241 18773 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:25:40.679436 25096 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:40.695262 25080 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:40.734138 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.672479 25151 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.695004 25074 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:25:40.712188 25090 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.000s
I20260709 12:25:40.736197 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.714560 25065 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:40.737197 18765 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:25:40.740829 19483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.013s	sys 0.035s
I20260709 12:25:40.741812 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.748193 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.752533 19488 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:40.637531 24884 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.695122 25104 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:40.843946 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 171571us
I20260709 12:25:40.858592 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:40.859427 19483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.019s	sys 0.037s
W20260709 12:25:40.834228 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:40.825013 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 143458us
I20260709 12:25:40.840296 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:40.729198 24749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.050s	sys 0.067s
I20260709 12:25:40.827072 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:40.823383 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46526.3us
I20260709 12:25:40.721839 25141 raft_consensus.cc:2764] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:25:40.902930 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:40.903648 18765 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:40.725026 24974 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:40.745576 25080 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.776341 24654 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:40.867359 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:40.893420 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.735116 24919 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.159s
I20260709 12:25:40.873494 19486 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:25:40.874213 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 126108us
I20260709 12:25:40.725245 24910 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:40.714780 24888 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.730043 24960 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:40.741747 25078 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.741591 25035 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.899000 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.900985 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:40.904513 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.753686 25086 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:40.865806 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 253306us
I20260709 12:25:40.860286 25127 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:40.777007 25023 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:40.908725 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:40.948690 18765 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:40.861224 24875 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.871788 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.893187 25051 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:40.912637 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:40.900843 25154 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:25:40.909574 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:40.960620 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51132.2us
I20260709 12:25:40.961362 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:40.934478 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.921794 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.886760 25090 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.739357 25103 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.167s
I20260709 12:25:40.905963 24974 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.830585 25061 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 12:25:40.893854 25074 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:40.940085 18921 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:40.947084 18845 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:40.980263 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.981886 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:40.915633 25156 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:25:40.914755 25153 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:25:40.946993 18767 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:40.866262 25142 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.911736 25080 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.935284 25010 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:40.918829 25050 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:40.908128 24654 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:40.963032 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:40.967710 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46065us
I20260709 12:25:40.932709 25128 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.933807 24960 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.972085 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:40.973973 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:40.974906 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:40.975943 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:40.948417 25023 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.979703 25035 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:25:40.959453 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50803.4us
I20260709 12:25:40.951772 25112 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:40.960067 25051 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.966048 25057 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:40.972381 25092 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:40.977924 24974 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:40.940601 24910 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.961849 25149 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:40.977651 25125 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:41.018661 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:41.000137 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:41.019800 18767 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.983297 18921 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:40.962810 25086 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.945361 25078 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:40.977231 24878 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:41.007983 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:40.906349 25096 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.009549 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:41.017459 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:40.919905 25091 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:40.999396 24654 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:40.992743 25010 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:40.993866 25137 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:40.995884 25050 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:40.999042 24960 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:41.028644 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:41.029789 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:41.023079 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:41.212086 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 182363us
W20260709 12:25:41.212677 25160 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:25:41.033797 18922 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
W20260709 12:25:41.218437 25169 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:25:41.014755 25051 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.043442 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:41.094600 25096 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:41.095865 25050 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.100041 25104 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.100489 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:41.002601 25081 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 12:25:41.105953 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 88604.2us
I20260709 12:25:41.023687 25149 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:41.026163 25127 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:41.123395 25131 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:41.047371 25010 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.123785 18840 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: [14.7-17.9]
I20260709 12:25:41.125440 25086 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.127076 25023 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:41.009049 25128 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:41.105175 25156 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:25:41.024130 25057 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:41.135764 25154 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:25:41.147781 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 178907us
I20260709 12:25:41.041306 24878 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.165398 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:41.102676 25074 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.148067 25174 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:41.164561 25035 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:41.024605 25138 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:41.354476 25172 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.354789 25057 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.355116 25172 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.357328 24878 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.357529 25172 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:41.358795 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:41.359243 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2443) took 1216 ms. Trace:
I20260709 12:25:41.360236 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:41.360646 25080 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.361088 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2439) took 1402 ms. Trace:
I20260709 12:25:41.361351 25174 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.361595 18764 rpcz_store.cc:276] 0709 12:25:39.958217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.959377 (+  1160us) service_pool.cc:224] Handling call
0709 12:25:39.959906 (+   529us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:39.992751 (+ 32845us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:40.292180 (+299429us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.645582 (+353402us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.829741 (+184159us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b18004603c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:25:40.829998 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.838215 (+  8217us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.864044 (+ 25829us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.873627 (+  9583us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:40.899534 (+ 25907us) log.cc:844] Serialized 52 byte log entry
0709 12:25:40.907095 (+  7561us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:40.907394 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.910075 (+  2681us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.910274 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.910349 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.125596 (+215247us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18004603c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:41.360823 (+235227us) raft_consensus.cc:1685] finished
0709 12:25:41.360851 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.361010 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166250,"prepare.queue_time_us":1504607,"prepare.run_cpu_time_us":205,"prepare.run_wall_time_us":211,"raft.queue_time_us":154709,"raft.run_cpu_time_us":707,"raft.run_wall_time_us":90088,"spinlock_wait_cycles":157662080,"thread_start_us":468758,"threads_started":2,"wal-append.queue_time_us":471285}
I20260709 12:25:41.363521 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:41.364032 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:41.364393 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:41.205899 25123 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.159973 24960 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.221278 18921 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
W20260709 12:25:41.321966 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.387797 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.388072 25092 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:41.211089 25099 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.003s
W20260709 12:25:41.337954 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 111744us
I20260709 12:25:41.389364 25092 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.336630 25127 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.365911 25140 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:41.366291 24982 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.003s
I20260709 12:25:41.367117 19488 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:41.367581 25151 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:41.368072 19486 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:41.369002 25174 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:41.370880 18768 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.370966 24910 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.373653 18772 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 16. Ops: []
W20260709 12:25:41.210081 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 191480us
I20260709 12:25:41.435236 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:41.359649 18769 rpcz_store.cc:276] 0709 12:25:40.143314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.143462 (+   148us) service_pool.cc:224] Handling call
0709 12:25:40.173372 (+ 29910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.387258 (+213886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.387345 (+    87us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.421564 (+ 34219us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.464664 (+ 43100us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:40.497502 (+ 32838us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.529188 (+ 31686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.529276 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.358970 (+829694us) raft_consensus.cc:1685] finished
0709 12:25:41.358994 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.359151 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116299,"prepare.queue_time_us":32497,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":170917,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":18517,"thread_start_us":161169,"threads_started":2,"wal-append.queue_time_us":282447}
I20260709 12:25:41.330315 25149 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:41.347282 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.402488 24974 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.409626 25010 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.352490 25128 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.451913 18918 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:41.453233 25010 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:41.428977 25140 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.457553 25140 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:41.459412 25081 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:41.431174 25151 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:41.465090 25151 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:41.426236 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:41.339124 25117 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:41.372872 25035 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.361123 25138 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:41.441145 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:41.441416 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:41.410357 24654 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.445438 25099 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.472908 18921 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
W20260709 12:25:41.501292 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 60626.7us
I20260709 12:25:41.502164 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:41.505359 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 64034.5us
W20260709 12:25:41.496361 25122 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.022s	user 0.000s	sys 0.015s
I20260709 12:25:41.514186 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:41.518011 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 154048us
I20260709 12:25:41.519481 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:41.514735 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:41.520833 18771 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:41.497820 25117 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.430116 24982 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.500765 25099 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.500362 25106 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:41.529855 25122 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.509377 25065 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:41.513484 25087 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:41.536795 18768 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:41.537160 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:41.511050 25124 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:41.539857 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:41.543231 18843 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:41.519600 25131 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:41.546981 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:41.525904 25099 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.548424 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:41.549352 18768 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:41.527585 25117 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:41.552858 19487 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:25:41.554852 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:41.556010 18921 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.559207 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:41.559896 19488 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:41.542392 25087 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.550061 25140 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:41.547924 25082 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.566087 25176 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.569895 25051 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:41.568568 19456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.145s (SENT) [suppressed 27 similar messages]
I20260709 12:25:41.538754 25106 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.557790 25122 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:41.568001 25161 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:25:41.550616 25124 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.596516 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:41.597188 18916 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:41.598861 18767 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.000s
I20260709 12:25:41.598922 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:41.565639 25087 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.558887 24875 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:41.599301 18767 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:41.561232 25127 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:41.600657 24974 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:41.601737 24725 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:41.605616 25050 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:41.608928 25173 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
W20260709 12:25:41.592505 25168 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.454s	user 0.008s	sys 0.005s
I20260709 12:25:41.616182 19485 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:41.598165 25124 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:41.631791 25179 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:41.587052 25010 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:41.625378 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:41.631325 25074 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:41.643450 25074 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.616926 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:41.644960 19484 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:41.640002 18767 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:41.638882 18916 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:41.583149 25176 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.641846 25010 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.618767 24725 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:41.646838 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:41.613888 24875 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.657792 24725 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.660403 25074 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:41.664772 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:41.665710 19485 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.567530 25138 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.655840 25122 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:41.674783 25122 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:41.676501 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2758) took 1093 ms. Trace:
I20260709 12:25:41.676117 25122 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.676971 18842 rpcz_store.cc:276] 0709 12:25:40.583667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.583917 (+   250us) service_pool.cc:224] Handling call
0709 12:25:40.584453 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.638155 (+ 53702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.638187 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.639676 (+  1489us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.957996 (+318320us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:40.958058 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.958147 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.501515 (+543368us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:41.671203 (+169688us) raft_consensus.cc:1685] finished
0709 12:25:41.671237 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.676420 (+  5183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70219,"raft.queue_time_us":56745,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":17012,"spinlock_wait_cycles":289704704,"thread_start_us":242692,"threads_started":1,"wal-append.queue_time_us":340239}
I20260709 12:25:41.656661 24654 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:41.673532 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:41.667089 25187 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:25:41.661701 25051 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.703876 25050 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:41.717250 25188 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:25:41.673295 25149 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:41.735126 19485 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:41.738168 18846 raft_consensus.cc:2410] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:41.749933 25106 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:41.763315 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2769) took 1033 ms. Trace:
I20260709 12:25:41.763965 18841 rpcz_store.cc:276] 0709 12:25:40.729922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.730071 (+   149us) service_pool.cc:224] Handling call
0709 12:25:40.753344 (+ 23273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:41.216932 (+463588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:41.216968 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:41.217650 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 12:25:41.430727 (+213077us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:41.452194 (+ 21467us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.453049 (+   855us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.453457 (+   408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.563833 (+110376us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400284e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:41.563888 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.762930 (+199042us) raft_consensus.cc:1685] finished
0709 12:25:41.762964 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.763218 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21041,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":4211,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":80786,"spinlock_wait_cycles":1065098496,"thread_start_us":212640,"threads_started":1,"wal-append.queue_time_us":300466}
I20260709 12:25:41.679725 24982 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.741756 24875 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:41.742728 25010 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:41.672528 24725 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:41.739398 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:41.800555 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:41.802244 18921 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:41.804054 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:41.805862 25149 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:41.807929 25110 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:41.808548 25110 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:41.778647 24853 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:25:41.811955 24853 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:41.812304 24853 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:41.813148 24853 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.814092 25081 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.819573 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2763) took 1202 ms. Trace:
I20260709 12:25:41.818145 25176 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:41.809633 25110 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:41.820304 18843 rpcz_store.cc:276] 0709 12:25:40.616848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.621166 (+  4318us) service_pool.cc:224] Handling call
0709 12:25:40.621655 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:41.545066 (+923411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.819215 (+274149us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b5400285854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:41.819476 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118931712}
I20260709 12:25:41.814210 24853 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.832592 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:41.844859 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:41.846135 18920 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:41.926440 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.955390 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:41.956408 18914 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:41.961750 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:41.962769 18921 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.972043 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:42.010511 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.983027 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:42.021186 18921 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:42.025766 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:42.027998 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.033106 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.033756 18769 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:42.034837 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:42.036664 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.982779 25081 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:42.038019 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.819597 25151 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.031169 25051 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:42.046963 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.047986 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.052541 18767 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:42.038264 25123 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.040252 25081 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.055683 19490 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:42.059208 25117 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.061053 18765 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15.
W20260709 12:25:42.063738 25132 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.478s	user 0.002s	sys 0.011s
I20260709 12:25:42.063918 25117 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.065600 18773 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:42.068964 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.070120 18769 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:42.086352 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:42.094617 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.107023 18914 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:42.081974 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2771) took 1305 ms. Trace:
I20260709 12:25:42.118307 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.099138 25086 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:42.122710 25086 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:42.123862 25086 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.125428 25086 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.132933 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.133826 18917 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:42.110248 18846 rpcz_store.cc:276] 0709 12:25:40.776160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.777002 (+   842us) service_pool.cc:224] Handling call
0709 12:25:42.081578 (+1304576us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540041c3d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:42.081852 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938471680}
I20260709 12:25:42.137809 18922 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:25:42.104063 25081 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.094004 24725 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.055719 25051 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:42.109935 25080 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.131762 25119 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:42.175132 25135 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.012s	user 0.010s	sys 0.002s
I20260709 12:25:42.155128 25024 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:42.185938 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.188059 19485 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:25:42.103873 25123 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.195597 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.185120 25092 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:42.167337 25074 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:42.187222 24982 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:42.189597 25035 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:42.196925 24875 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:42.196751 25010 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:42.214582 25104 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:42.215241 25104 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:42.216498 25104 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.218182 25104 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:42.221700 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.223170 24334 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:42.223893 24334 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.225471 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2759) took 1636 ms. Trace:
I20260709 12:25:42.226613 24334 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:42.227667 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.222259 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.232461 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:42.233028 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 127754us
I20260709 12:25:42.185458 24725 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.236270 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:42.236652 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:42.193857 25024 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.240715 25175 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:42.201182 25092 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.225984 18847 rpcz_store.cc:276] 0709 12:25:40.588966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.589211 (+   245us) service_pool.cc:224] Handling call
0709 12:25:40.589738 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.694987 (+105249us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:41.610641 (+915654us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b18002ba440. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:25:41.655399 (+ 44758us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.776826 (+121427us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:41.777506 (+   680us) log.cc:844] Serialized 26 byte log entry
0709 12:25:41.777690 (+   184us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:41.779313 (+  1623us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.779660 (+   347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.810874 (+ 31214us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b18002ba440. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:42.224995 (+414121us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:42.225069 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:42.225145 (+    76us) raft_consensus.cc:1685] finished
0709 12:25:42.225166 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:42.225380 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24639,"prepare.queue_time_us":352794,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":91,"raft.queue_time_us":26572,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":23829,"spinlock_wait_cycles":213872896,"thread_start_us":128411,"threads_started":2,"wal-append.queue_time_us":127405}
I20260709 12:25:42.247787 19456 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.201701 25074 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.235397 25010 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.242883 24866 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.238373 25051 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.256213 25092 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:42.282140 25092 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.258445 25159 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.283900 25074 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:42.205439 24982 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.286283 24982 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.237861 24856 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:42.287194 24856 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.289959 24856 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:42.282140 25140 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.000s
I20260709 12:25:42.291252 25140 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:42.264071 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:42.265913 25087 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.646s	user 0.000s	sys 0.009s
I20260709 12:25:42.292610 25087 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.295107 25087 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.266516 24942 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:42.296056 25024 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.296525 24942 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:42.297025 24942 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:42.268201 24725 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.207672 25035 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.298076 24942 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.300648 24942 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.301240 25035 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:42.268396 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.269655 25123 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.270445 25151 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:42.303222 25151 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:42.303905 25010 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.304208 25083 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.243113 24875 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.306715 24875 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.247406 25175 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:42.308030 25175 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.308470 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:42.309527 25087 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:42.311067 24866 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:42.311725 24866 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:42.313921 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.378211 25175 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.382692 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1203) took 1019 ms. Trace:
I20260709 12:25:42.383198 19484 rpcz_store.cc:276] 0709 12:25:41.363697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.364287 (+   590us) service_pool.cc:224] Handling call
0709 12:25:41.364616 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:41.645480 (+280864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.382346 (+736866us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540080b954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:42.382613 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644262784}
I20260709 12:25:42.387708 18913 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:42.387846 24875 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:42.388582 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1363) took 1649 ms. Trace:
I20260709 12:25:42.388964 18913 rpcz_store.cc:276] 0709 12:25:40.739381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.739605 (+   224us) service_pool.cc:224] Handling call
0709 12:25:42.387241 (+1647636us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b58001e5198. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:25:42.387494 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.388309 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.388517 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10483584}
I20260709 12:25:42.417033 25199 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.422060 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.422909 18770 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:42.417737 25199 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:42.429836 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.431979 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:42.443375 18770 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:42.438978 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.444308 18773 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
W20260709 12:25:42.456933 25163 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.500s	user 0.008s	sys 0.006s
I20260709 12:25:42.458652 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.460191 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.461434 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.461548 24866 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:42.471467 25164 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 1.512s	user 0.016s	sys 0.032s
W20260709 12:25:42.474936 18771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3000) took 1745 ms (client timeout 1915 ms). Trace:
I20260709 12:25:42.475103 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:42.475399 18771 rpcz_store.cc:269] 0709 12:25:40.730247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.007597 (+277350us) service_pool.cc:224] Handling call
0709 12:25:42.474676 (+1467079us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540002e754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:42.474844 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121519360}
I20260709 12:25:42.476030 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:42.476069 25119 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.476760 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.476796 25119 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:42.473905 25137 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:25:42.477711 25119 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.473939 25078 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.478948 25058 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:42.479576 25058 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:42.480628 25058 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:42.483824 25178 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.258s	user 0.001s	sys 0.003s
I20260709 12:25:42.448861 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:42.372325 25087 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:25:42.478312 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:42.490411 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.520967 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:42.477736 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:42.522413 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44748.9us
I20260709 12:25:42.529175 18766 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:25:42.539074 19486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1201) took 1176 ms (client timeout 1563 ms). Trace:
W20260709 12:25:42.539649 19486 rpcz_store.cc:269] 0709 12:25:41.363046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.363204 (+   158us) service_pool.cc:224] Handling call
0709 12:25:42.538795 (+1175591us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b5400788554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:42.538961 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8721280}
I20260709 12:25:42.544319 25137 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.544943 25137 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:42.545446 25137 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.548141 24866 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.549764 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:42.552258 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.552717 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.555310 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 359756us
I20260709 12:25:42.555485 18769 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:42.559478 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.560464 18843 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:25:42.556406 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.561873 18913 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 12.
I20260709 12:25:42.562769 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:42.564930 18915 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.520370 24856 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.568295 18917 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:25:42.562769 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:42.562315 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1102) took 1006 ms. Trace:
I20260709 12:25:42.567165 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:42.576066 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 329975us
I20260709 12:25:42.576246 18846 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.571861 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.574059 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:42.578955 18766 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:42.579102 18767 rpcz_store.cc:276] 0709 12:25:41.556376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.056376 (+500000us) service_pool.cc:224] Handling call
0709 12:25:42.067688 (+ 11312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.067979 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:25:42.200102 (+132123us) log.cc:844] Serialized 14 byte log entry
0709 12:25:42.561845 (+361743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:42.561922 (+    77us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:42.561989 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.562080 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:42.562234 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":310172,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":2742,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2068,"thread_start_us":490220,"threads_started":2}
I20260709 12:25:42.585202 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:42.564517 25078 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:25:42.593204 18916 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:25:42.594615 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.580420 25144 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:42.599627 25144 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:42.602217 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.603018 18843 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:42.602072 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.605734 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:42.616704 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.617383 18844 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:42.618283 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.618922 18844 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:42.619750 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.620054 18846 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:42.621446 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:42.590886 24942 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:42.629040 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:42.612995 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.614246 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 355009us
I20260709 12:25:42.631580 25104 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:42.571801 24856 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.632870 24654 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:42.634651 24856 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.628890 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 2986) took 1925 ms. Trace:
I20260709 12:25:42.636046 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.636291 18772 rpcz_store.cc:276] 0709 12:25:40.703826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.705096 (+  1270us) service_pool.cc:224] Handling call
0709 12:25:40.729682 (+ 24586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:41.439161 (+709479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.628622 (+1189461us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002a0b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:42.628826 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480506240}
I20260709 12:25:42.622829 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.637765 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:42.638382 18843 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.639907 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:42.625198 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66735us
I20260709 12:25:42.625967 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.645182 18848 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:42.638288 18840 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:42.623937 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.648411 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.600145 25024 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.657405 25024 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:42.658885 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 124500us
I20260709 12:25:42.660339 25024 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.660847 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:42.661137 25024 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:42.603595 25144 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.604219 25010 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:42.650878 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.652649 18844 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:42.697536 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:42.697732 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbadce60e960476289740ec2afd0a5c8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:42.654680 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:42.698886 18913 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.656411 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.672968 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.700131 18843 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:42.674762 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.675565 25207 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:42.666867 25150 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.679785 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.708999 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.709163 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.680501 25140 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.595530 25175 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:25:42.683357 25199 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.637260 25106 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.691701 25081 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.005s
W20260709 12:25:42.694995 25198 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:42.633627 18737 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:42.716107 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 82578.6us
I20260709 12:25:42.717126 18772 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:42.713397 25204 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:42.715108 25203 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.715433 25140 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.721653 25140 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.722296 25051 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:42.700261 25201 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:42.726779 25051 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.726449 25119 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.727222 25051 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.722503 25061 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:25:42.726046 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.728655 18916 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:42.728790 25119 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.729712 18846 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:42.695995 25010 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:42.731262 25010 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.732504 25010 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.734016 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:42.734261 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:42.702164 18843 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:42.702533 18844 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:42.641007 25078 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:42.603592 25123 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:25:42.711766 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:42.740914 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.714437 18769 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:42.742254 18770 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:42.744580 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:42.745905 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:42.747391 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:42.736336 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110141us
I20260709 12:25:42.751534 18846 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:42.752270 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.752862 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.755822 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:42.758960 18843 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.768193 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.768949 18772 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:25:42.769224 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:42.756934 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.770534 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:42.751407 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:42.760972 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.765460 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:42.771673 19486 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:42.773698 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.775822 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.777333 18913 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:42.739584 25141 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:42.783721 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:42.760025 25203 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:42.760341 25204 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:42.762472 25035 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.760468 25201 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:42.762651 24875 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.772704 25205 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.763749 25117 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.760565 25074 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:42.725658 25081 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.713997 25207 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.713832 25150 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.725839 25106 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.774842 25078 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:42.776494 25092 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.749905 24856 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 12:25:42.835608 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:42.768648 24982 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:25:42.840925 18843 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:42.792652 25172 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.850174 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:42.797092 25151 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:42.788930 25141 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.775334 25175 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:25:42.798593 25204 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:42.865784 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.773269 24334 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:25:42.854525 25215 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.859118 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 107216us
I20260709 12:25:42.868815 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.832684 24875 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:42.864596 18772 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:42.863381 18848 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:42.885640 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:42.843282 25092 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.894690 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.894989 25215 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.897375 25215 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:42.898926 18915 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
W20260709 12:25:42.900286 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 128665us
I20260709 12:25:42.783488 25110 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 12:25:42.843847 25078 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:42.902477 18921 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:42.904184 18914 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:42.903999 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.909142 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:42.863462 25141 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.864511 25207 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.930516 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:42.942252 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:42.942575 25209 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:25:42.943068 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.930838 25223 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.952523 18842 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:42.953433 25137 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.901952 25092 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.906430 25078 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.955978 25137 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.929965 25215 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:42.960165 25106 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:42.900689 24875 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:42.965482 25167 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.867s	user 0.008s	sys 0.012s
I20260709 12:25:42.968502 25150 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:42.969159 18765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3003) took 2193 ms (client timeout 2017 ms). Trace:
I20260709 12:25:42.969350 18764 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:42.969733 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.970935 18915 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:42.971496 25122 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:42.971973 25122 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:42.972882 25122 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.971783 25207 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 12:25:42.975067 25212 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:25:42.975566 25104 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:42.975996 25104 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:42.976980 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.976864 25104 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.977733 24749 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:42.852190 25144 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:42.836153 25205 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:42.953866 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.945094 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.893167 25035 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:42.981731 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.949563 18913 raft_consensus.cc:2410] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:42.887830 25140 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:42.982371 25128 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:43.002745 25128 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:43.002656 25140 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.003850 25128 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.005210 25128 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.005882 25140 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:42.887503 25204 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:42.978188 24749 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:43.007494 24749 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.009045 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2877) took 2033 ms. Trace:
I20260709 12:25:43.009552 18922 rpcz_store.cc:276] 0709 12:25:40.975586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.213911 (+238325us) service_pool.cc:224] Handling call
0709 12:25:41.214301 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:42.147445 (+933144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.008731 (+861286us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400034dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:43.008972 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122995584}
I20260709 12:25:43.011888 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:43.012863 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:43.013974 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.014940 25035 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:43.016096 25035 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.018448 25150 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.019156 25150 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.021801 25150 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:43.023402 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2869) took 2051 ms. Trace:
I20260709 12:25:42.850533 25074 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.023862 18919 rpcz_store.cc:276] 0709 12:25:40.971906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.972024 (+   118us) service_pool.cc:224] Handling call
0709 12:25:40.987154 (+ 15130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:41.044688 (+ 57534us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:25:41.132434 (+ 87746us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.196692 (+ 64258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.196757 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:41.196805 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.483094 (+1286289us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:43.023164 (+540070us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b5400334354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:43.023216 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:43.023341 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6374,"prepare.queue_time_us":28061,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":6504,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":22141,"spinlock_wait_cycles":372384896,"thread_start_us":57414,"threads_started":1,"wal-append.queue_time_us":65848}
I20260709 12:25:43.028213 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:43.028867 25171 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.869s	user 0.000s	sys 0.012s
I20260709 12:25:43.028993 18842 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.030339 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1194) took 3005 ms. Trace:
I20260709 12:25:43.026079 25074 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.031769 25224 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:43.030787 19483 rpcz_store.cc:276] 0709 12:25:40.024608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.025044 (+   436us) service_pool.cc:224] Handling call
0709 12:25:40.075178 (+ 50134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.861021 (+785843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.861071 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.891966 (+ 30895us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.994407 (+102441us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:40.994695 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.994781 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:43.028213 (+2033432us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:43.030009 (+  1796us) raft_consensus.cc:1685] finished
0709 12:25:43.030030 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:43.030264 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16605,"raft.queue_time_us":180188,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":39854,"spinlock_wait_cycles":279867264,"thread_start_us":822773,"threads_started":2,"wal-append.queue_time_us":194587}
I20260709 12:25:43.032550 25144 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:43.034308 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:43.034878 24960 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.035545 18814 leader_election.cc:400] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:43.036036 18814 leader_election.cc:403] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:25:43.036734 25051 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.037554 25046 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:43.038302 25046 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:43.039351 24725 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:43.039772 24725 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:43.040398 25205 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:43.041106 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.040689 24725 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.041756 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:42.997839 18843 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:42.978318 25104 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.046564 24725 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.009119 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:43.049017 25141 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.050005 18848 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:42.984745 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:43.050756 18921 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.045084 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.006429 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:43.054268 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:43.055034 18917 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.026046 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:42.978190 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:42.969583 18765 rpcz_store.cc:269] 0709 12:25:40.776205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.359937 (+583732us) service_pool.cc:224] Handling call
0709 12:25:42.968938 (+1609001us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540029d1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:42.969090 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609461120}
I20260709 12:25:42.985433 24947 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:42.974201 25122 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:42.983477 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:43.067116 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:43.067123 18915 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:43.065021 18921 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:43.091528 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.098770 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.099642 19486 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:43.065915 24947 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:43.102188 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.110033 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.120198 19490 raft_consensus.cc:2410] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:25:43.092691 24960 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:43.104948 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:43.132233 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.133316 19490 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:43.135403 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.136183 19488 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:43.088681 24942 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:43.094238 25150 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:43.204885 18842 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:43.207676 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.073379 25141 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:43.209050 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 298645us
W20260709 12:25:43.209172 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.212288 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.219885 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.220286 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:43.220644 19488 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:25:43.221858 19491 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:43.230422 18812 leader_election.cc:400] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:43.205519 25074 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.204387 24866 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.206449 25024 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:43.205667 25203 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:43.150928 25078 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.228209 25201 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:43.232555 25142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.025s	user 0.016s	sys 0.028s
I20260709 12:25:43.244189 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.259404 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:43.248726 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:43.216840 25123 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:43.233443 25200 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:43.263253 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:43.277633 18770 raft_consensus.cc:2368] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:43.264724 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:43.265895 18773 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:43.268090 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:43.278267 18771 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:43.269704 19488 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:43.163141 24960 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.209232 24942 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.275900 18765 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:25:43.289551 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:43.314038 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:43.316218 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:43.211625 25150 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.318106 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:43.231083 25099 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:25:43.367815 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 49852.8us
I20260709 12:25:43.366976 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:43.391530 18768 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:43.248610 24866 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.394222 24866 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.383019 25201 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:43.396538 25010 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.000s
I20260709 12:25:43.397341 25010 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:43.385824 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:43.277468 25142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.064s	user 0.016s	sys 0.028s
I20260709 12:25:43.386817 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.287271 25223 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:43.388916 19489 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:43.389607 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:43.452936 19491 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:43.397897 25221 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:25:43.235816 24947 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.399379 19492 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:43.399979 18913 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:43.402743 25051 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.403335 18917 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:43.403760 24982 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:43.407289 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:43.488241 18770 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:43.412106 25078 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:43.287377 25200 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.242647 25074 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.367621 25149 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.312242 25123 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.385281 24942 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:43.492475 25092 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.001s
I20260709 12:25:43.440275 25150 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:43.443881 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.387625 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.456027 18767 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:43.457497 18845 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:25:43.389487 25204 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.510111 19488 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:25:43.468796 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.481945 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:43.512475 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.271220 25145 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.182s
I20260709 12:25:43.487166 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.441079 25141 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.457062 25151 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:43.502986 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:43.427356 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 113438us
I20260709 12:25:43.498854 25144 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.499231 25200 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:43.515964 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:43.508339 19490 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:43.492928 25223 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:43.512025 19489 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 11.
I20260709 12:25:43.453792 25010 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.520356 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.498569 24982 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:43.502449 24947 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.527436 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:43.521668 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.001s	sys 0.014s
W20260709 12:25:43.541940 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.002s	sys 0.015s
W20260709 12:25:43.542301 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 636327us
I20260709 12:25:43.492470 25024 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:43.533636 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:43.534564 18921 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
W20260709 12:25:43.536705 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:43.546814 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.548440 18846 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:43.548890 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:43.551072 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.552531 18839 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:43.553239 19484 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:43.524869 25237 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:43.555653 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:43.551802 18848 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:43.550019 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.554847 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:43.536118 25141 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.510685 25092 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.571007 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.567837 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:43.589077 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:43.589438 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.551855 25151 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:43.590961 18842 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:43.534041 25144 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.593089 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.593999 18846 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:43.594965 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:43.596006 19484 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:25:43.602934 18917 pending_rounds.cc:85] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 10
I20260709 12:25:43.603425 18917 pending_rounds.cc:107] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:25:43.603708 18917 raft_consensus.cc:2889] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:43.606622 24982 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:43.609220 25104 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 12:25:43.609315 25245 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:43.564539 25078 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:43.505544 25203 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.532500 25231 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:25:43.530151 25230 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:25:43.554458 25140 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:43.611258 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43953.2us
I20260709 12:25:43.611493 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:43.570261 25035 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:43.616235 25248 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.626706 25140 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:43.627625 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:43.627918 25241 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:43.628875 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:43.618043 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:43.630453 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:43.590324 25150 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.624027 18916 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 12: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:43.661969 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:43.632234 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:43.663635 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:43.636690 25230 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.628777 25035 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:43.632550 25238 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:43.618804 25245 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:43.633881 25074 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:43.667644 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:43.619242 25204 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.666332 24942 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:43.692615 24942 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.693091 24942 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.664927 25252 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:43.694938 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2952) took 1100 ms. Trace:
I20260709 12:25:43.695374 18845 rpcz_store.cc:276] 0709 12:25:42.594708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.594992 (+   284us) service_pool.cc:224] Handling call
0709 12:25:42.611234 (+ 16242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:43.508956 (+897722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.694634 (+185678us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54003278d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:43.694874 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1942670208}
I20260709 12:25:43.702920 25106 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:43.668756 25250 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:43.704432 25250 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.704857 25250 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.665601 25092 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.630074 25201 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:25:43.706792 25201 consensus_queue.cc:1243] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:43.634912 25078 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:25:43.623358 25149 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:25:43.667171 25058 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:43.691417 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:43.682741 24725 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.636s	user 0.013s	sys 0.001s
I20260709 12:25:43.717520 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:43.622915 25024 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.682299 25035 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:43.716238 25058 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.719000 25136 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.719592 25010 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:43.687950 25245 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:43.723170 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:43.747031 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:43.566375 25223 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:43.739931 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 125937us
I20260709 12:25:43.666375 25150 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.720176 25172 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:43.666671 25251 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:25:43.751231 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.758289 18847 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 12:25:43.759243 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.760138 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:43.761051 19491 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:43.761765 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.762625 18848 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:25:43.764575 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:43.727627 25106 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:43.762523 18844 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:43.737434 25058 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.772964 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.775056 18843 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:43.745092 25116 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.776757 19491 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:43.753685 25245 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:43.683925 25230 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.755379 25149 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.776599 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:43.752882 25172 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:43.712150 24942 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.763538 25123 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:43.781376 24875 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.820s	user 0.009s	sys 0.005s
W20260709 12:25:43.795727 25240 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:25:43.795535 24875 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.797295 18914 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:43.797513 25249 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:43.799889 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:43.800546 18914 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:43.781524 25116 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.779470 25140 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:43.791066 25172 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.806663 18847 pending_rounds.cc:85] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 7
W20260709 12:25:43.791872 25227 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.552s	user 0.000s	sys 0.004s
I20260709 12:25:43.793870 24960 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:43.772195 25106 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.807509 25106 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.806990 18847 pending_rounds.cc:107] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:25:43.810833 18847 raft_consensus.cc:2889] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:43.811717 25253 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 12:25:43.813395 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.820430 25200 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.821900 25150 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:43.823318 24749 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:43.824923 18914 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:43.807001 25172 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.820422 25106 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.829674 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:43.830914 25119 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:43.831274 25123 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:43.831749 25123 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:43.832147 25123 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:43.832525 25230 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.838704 19483 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:43.775794 25151 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:43.848405 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:43.833510 25244 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:43.915369 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:43.837739 25106 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.875101 25226 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:43.823400 25250 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.923920 25248 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.877264 25205 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:25:43.925209 25205 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:43.925563 25205 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:43.926378 25205 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.926738 25151 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:43.928074 25136 consensus_queue.cc:1175] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "43b520eabb65493abe84f4cf06806cba" responder_term: 17 status { last_received { term: 14 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:43.928929 25035 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.930353 18919 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:43.931579 25035 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:43.940232 25116 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:43.910953 25238 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:25:43.951323 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:43.919875 25122 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.002s
I20260709 12:25:43.911463 25244 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:43.927672 25205 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.945709 25058 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:43.986336 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:43.987361 25230 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.987946 25230 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:43.989235 18913 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:43.990577 25230 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:43.996270 18920 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:43.998113 25233 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.998924 25233 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:44.000347 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:44.001227 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.001597 25233 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.003965 19492 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:44.004320 19490 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:44.005117 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:44.005798 18920 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:44.002188 25233 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.006345 25144 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.011857 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:44.011448 19489 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:44.007007 25233 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.011718 18765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:44.014099 18765 raft_consensus.cc:606] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.014521 18765 raft_consensus.cc:614] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:44.014271 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:44.015002 25233 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.015198 18843 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:44.009562 18920 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:25:44.006860 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2463) took 1231 ms. Trace:
I20260709 12:25:44.009150 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:44.019848 25083 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.018095 18766 rpcz_store.cc:276] 0709 12:25:42.775050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.777199 (+  2149us) service_pool.cc:224] Handling call
0709 12:25:42.777519 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.777745 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:42.894062 (+116317us) log.cc:844] Serialized 14 byte log entry
0709 12:25:43.235712 (+341650us) log.cc:844] Serialized 14 byte log entry
0709 12:25:43.697727 (+462015us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b180048f2e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1
0709 12:25:43.698787 (+  1060us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b180048f2e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:43.995799 (+297012us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b180048f2e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219
0709 12:25:43.997443 (+  1644us) spinlock_profiling.cc:243] Waited 9.07 ms on lock 0x7b180048f2e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:25:44.006507 (+  9064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:44.006568 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:44.006621 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.006685 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:44.006787 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":776024,"prepare.queue_time_us":27551,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":8478,"raft.queue_time_us":783464,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":6631,"spinlock_wait_cycles":63127168,"thread_start_us":407731,"threads_started":2,"wal-append.queue_time_us":519007}
I20260709 12:25:44.020593 25083 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:44.022109 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.022949 25207 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:44.025249 25083 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.026789 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:44.007999 25226 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:44.029330 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:44.032677 25123 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.033363 25258 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:44.042073 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:44.043138 25237 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:44.045209 25123 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.048786 18845 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 12: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:44.045938 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:44.052094 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.054313 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:44.056353 18917 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:44.057241 18846 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:43.973991 25236 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260709 12:25:44.062883 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:44.063936 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:44.031009 25223 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.049700 25226 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:44.066838 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:44.069813 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 227784us
I20260709 12:25:44.070331 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.053172 25083 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.060192 25256 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:44.074725 25072 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:44.064805 25035 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:44.046775 24334 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:25:44.078703 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.061766 25245 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.086314 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.088641 18768 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:44.053313 25122 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:25:44.072314 25145 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:44.081568 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.066179 25104 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:44.088900 18767 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:25:44.080994 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.074915 24942 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.110548 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:44.074862 25228 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:44.111752 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:44.104971 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:44.112573 18767 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:44.090495 25245 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.061808 24506 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:25:44.093815 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.115988 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.116688 18770 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:44.077689 25256 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:44.119832 25261 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:25:44.120050 25256 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.072660 25244 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.081291 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.122902 18771 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:44.077085 25131 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:25:44.097596 25060 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:44.061873 25010 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:25:44.106703 25087 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:44.107436 25058 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.079792 25083 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.073401 25223 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.109041 24334 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:44.134109 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.111752 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.117254 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.115025 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.111140 25250 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.139334 18771 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:25:44.139789 18771 pending_rounds.cc:85] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 8
I20260709 12:25:44.119493 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.140074 18771 pending_rounds.cc:107] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:25:44.124282 25228 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:44.124325 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:44.115417 25145 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.137094 24519 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.137166 25083 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.140339 18771 raft_consensus.cc:2889] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:44.122110 25104 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:44.159451 25104 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.138015 24334 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:44.123524 24960 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:44.128386 24866 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:25:44.150136 25223 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.150830 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:44.177893 19484 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:44.155339 18772 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:44.146028 24875 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:44.158460 25149 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:44.164296 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51910.1us
I20260709 12:25:44.157089 25060 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:44.135682 25131 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:44.167586 18767 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:44.183547 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:44.188095 25145 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.198597 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.152083 25228 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.198596 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:44.203315 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.203895 25083 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:44.208593 24960 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:44.193843 25060 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:44.221632 18840 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:44.200544 25131 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:44.212064 25081 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.191958 25226 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.217772 25072 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:44.219307 25087 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:44.214294 25083 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:44.289976 25226 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.230353 25072 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.257488 25083 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:44.312765 25244 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.280663 24654 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:44.314832 24654 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.317306 24654 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.297435 18769 raft_consensus.cc:2410] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:44.318086 25117 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.319015 19489 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:44.318838 25117 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.292270 25060 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.323812 25142 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:44.324512 25142 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:44.329382 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:44.330700 18766 raft_consensus.cc:606] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.331183 18766 raft_consensus.cc:614] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:44.331276 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:44.294101 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.307633 18919 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:44.304116 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52302.9us
I20260709 12:25:44.211854 24334 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.291281 25081 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:44.280290 24749 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:44.311053 25072 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.323899 25060 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.308759 25200 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:44.349054 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.387770 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:44.390450 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47680.8us
I20260709 12:25:44.325637 25142 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.392856 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.411348 24654 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:44.412109 24654 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.412590 24654 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.411433 25176 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.415356 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2448) took 3456 ms. Trace:
I20260709 12:25:44.415481 25176 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.415802 18764 rpcz_store.cc:276] 0709 12:25:40.959347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.375623 (+416276us) service_pool.cc:224] Handling call
0709 12:25:42.969151 (+1593528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.969759 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.415082 (+1445323us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540029d1d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:44.415249 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3607381888}
I20260709 12:25:44.419025 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.422643 25087 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:44.431216 25176 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.439028 25142 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.441579 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.441883 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.443080 18767 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:44.444555 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:44.446410 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.447011 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.447741 18772 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:44.444556 18771 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:44.460073 25149 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:44.460925 25149 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:44.464071 25131 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.444633 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:44.468111 19489 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:44.475332 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.479257 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2465) took 1662 ms. Trace:
I20260709 12:25:44.479921 18769 rpcz_store.cc:276] 0709 12:25:42.817176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.817379 (+   203us) service_pool.cc:224] Handling call
0709 12:25:44.430765 (+1613386us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400211bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:44.479154 (+ 48389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3314205440}
W20260709 12:25:44.509024 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 121358us
I20260709 12:25:44.513427 18812 leader_election.cc:400] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:44.515894 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:44.549666 19483 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:44.550173 19491 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
W20260709 12:25:44.520352 25137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.038s	sys 0.046s
I20260709 12:25:44.469106 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:44.559073 24334 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:44.547614 25200 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:44.565477 25200 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.394061 25081 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.568390 25081 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.520540 24725 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.570473 24725 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:44.559466 25137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.039s	sys 0.046s
I20260709 12:25:44.389333 25258 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.573467 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:44.573757 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:44.574162 18841 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.535223 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.574776 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:44.575441 18844 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:44.575672 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:44.535701 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:44.576128 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 107112us
I20260709 12:25:44.576516 18767 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:44.385819 24875 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.539359 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.414083 25117 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.548429 19485 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:25:44.520889 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:44.588543 19485 pending_rounds.cc:85] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 12
I20260709 12:25:44.588831 19485 pending_rounds.cc:107] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:25:44.558080 18812 leader_election.cc:403] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:44.579180 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.589241 19485 raft_consensus.cc:2889] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:44.590231 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76986.6us
I20260709 12:25:44.591853 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:44.591717 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:44.529771 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:44.522097 25051 consensus_queue.cc:1175] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47b48b5c69f245b79ecb292eff89927f" responder_term: 15 status { last_received { term: 14 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:25:44.586257 18670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 165) took 59665 ms (client timeout 15000 ms). Trace:
I20260709 12:25:44.586501 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.588762 19484 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.565956 24654 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.590952 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.611677 18772 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:44.592144 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:44.396026 24749 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:44.582423 18916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2943) took 1700 ms (client timeout 1774 ms). Trace:
W20260709 12:25:44.615295 18916 rpcz_store.cc:269] 0709 12:25:42.882074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.883537 (+  1463us) service_pool.cc:224] Handling call
0709 12:25:44.582082 (+1698545us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b5400335254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:44.582307 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638122240}
I20260709 12:25:44.617077 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.584582 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:44.619529 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.548661 25131 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.594249 18843 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:44.583194 25207 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.599018 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:44.610329 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:44.654651 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62844.3us
I20260709 12:25:44.628134 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.641727 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:44.657446 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.647564 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:44.594295 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:44.649096 19485 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:44.585925 25223 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:44.651897 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:44.462146 25149 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.657295 24278 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:44.659992 18772 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:44.660039 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:44.664748 18767 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:25:44.666038 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.680918 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:44.687582 19491 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:44.610275 25117 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.676963 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:44.693372 24278 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:44.697667 18841 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
W20260709 12:25:44.670210 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.697553 24278 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:44.596468 18670 rpcz_store.cc:269] 0709 12:24:44.913993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.917882 (+  3889us) service_pool.cc:224] Handling call
0709 12:25:44.579573 (+59661691us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:37.939622 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:38.136774 (+197152us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:38.136833 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:25:38.136848 (+    15us) tablet.cc:662] Decoding operations
0709 12:25:38.137454 (+   606us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:38.137565 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:38.137599 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:25:38.138119 (+   520us) tablet.cc:701] Row locks acquired
0709 12:25:38.138175 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:25:38.138378 (+   203us) write_op.cc:270] Start()
0709 12:25:38.138584 (+   206us) write_op.cc:276] Timestamp: P: 1783599938138294 usec, L: 0
0709 12:25:38.138625 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:25:38.179016 (+ 40391us) log.cc:844] Serialized 907 byte log entry
0709 12:25:38.743593 (+564577us) op_driver.cc:464] REPLICATION: finished
0709 12:25:39.931609 (+1188016us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335e9c1ef0
0709 12:25:40.141265 (+209656us) write_op.cc:301] APPLY: starting
0709 12:25:40.176919 (+ 35654us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:40.480644 (+303725us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:40.480688 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:40.482070 (+  1382us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:40.482366 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:25:40.514579 (+ 32213us) write_op.cc:312] APPLY: finished
0709 12:25:40.514919 (+   340us) log.cc:844] Serialized 33 byte log entry
0709 12:25:40.749865 (+234946us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:40.802172 (+ 52307us) write_op.cc:454] Released schema lock
0709 12:25:40.837219 (+ 35047us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:40.931558 (+ 94339us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:40.937058 (+  5500us) write_op.cc:454] Released schema lock
0709 12:25:42.470794 (+1533736us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
Metrics: {"mutex_wait_us":838606,"reported_tablets":32,"spinlock_wait_cycles":24832,"child_traces":[["op",{"apply.queue_time_us":1281988,"apply.run_cpu_time_us":81690,"apply.run_wall_time_us":815299,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":412008,"prepare.run_cpu_time_us":27944,"prepare.run_wall_time_us":455489,"raft.queue_time_us":123670,"raft.run_cpu_time_us":36341,"raft.run_wall_time_us":1364794,"replication_time_us":604763,"spinlock_wait_cycles":89518208,"thread_start_us":1936935,"threads_started":5,"wal-append.queue_time_us":629829,"wal-append.run_cpu_time_us":77752,"wal-append.run_wall_time_us":3802836}]]}
I20260709 12:25:44.697232 18846 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:44.666229 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.709332 19484 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
W20260709 12:25:44.715775 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 386465us
I20260709 12:25:44.710774 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:44.585769 25078 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 12:25:44.710971 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.724880 18916 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
W20260709 12:25:44.725530 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.726234 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:44.678766 25223 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.591478 24875 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.731048 19487 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:44.720839 19483 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:44.698823 25205 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:44.666889 24960 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:44.736173 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:44.743254 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.695073 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:44.744930 19491 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:25:44.728327 18769 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:44.749800 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.677687 25025 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:44.653396 24866 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:44.688761 25110 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.713585 24278 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.667457 25233 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.703939 25238 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:25:44.760996 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:44.746271 25113 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.766499 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:44.771890 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 381719us
I20260709 12:25:44.698513 25024 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:25:44.679034 25207 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.766719 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:44.733321 24942 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:44.736512 25205 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.732573 25223 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:44.765277 25025 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:44.772425 24278 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:44.774006 18919 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.711966 25117 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.574018 25258 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.768791 24960 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.815629 25024 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:44.772946 25233 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.775509 24866 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.782716 25110 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.823846 25207 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.824015 25117 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:44.828387 25176 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:44.775220 25251 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:44.790758 25205 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:44.783721 25113 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.875764 24942 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:44.842531 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:44.848588 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1380) took 1815 ms. Trace:
W20260709 12:25:44.850092 25235 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.298s	user 0.004s	sys 0.000s
I20260709 12:25:44.850822 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2976) took 1086 ms. Trace:
W20260709 12:25:44.851147 25276 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:25:44.851330 18919 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:44.859329 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1101) took 1546 ms. Trace:
I20260709 12:25:44.915835 18917 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:44.919356 19488 rpcz_store.cc:276] 0709 12:25:43.313112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.313380 (+   268us) service_pool.cc:224] Handling call
0709 12:25:43.313842 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:43.510613 (+196771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.858847 (+1348234us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54005c21d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:44.859190 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450686336}
I20260709 12:25:44.865880 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:44.871420 25273 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:25:44.802006 25025 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:44.886926 19490 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:25:44.888329 18840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2968) took 2115 ms (client timeout 2106 ms). Trace:
I20260709 12:25:44.935719 25086 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:44.932852 18840 rpcz_store.cc:269] 0709 12:25:42.771281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.041442 (+270161us) service_pool.cc:224] Handling call
0709 12:25:44.868049 (+1826607us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540041afd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:44.886300 (+ 18251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2711756544}
W20260709 12:25:44.914721 25083 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
W20260709 12:25:44.893839 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 116656us
I20260709 12:25:44.898190 18767 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:25:44.885310 25256 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.000s
I20260709 12:25:44.839570 25058 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.888651 25024 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:44.913460 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 321836us
I20260709 12:25:44.916764 18845 rpcz_store.cc:276] 0709 12:25:43.764071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.764315 (+   244us) service_pool.cc:224] Handling call
0709 12:25:44.850460 (+1086145us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400285354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:44.850711 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610375552}
I20260709 12:25:44.915709 18921 rpcz_store.cc:276] 0709 12:25:43.033284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.069785 (+ 36501us) service_pool.cc:224] Handling call
0709 12:25:43.070145 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:43.544833 (+474688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.848324 (+1303491us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:44.848519 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067409280}
I20260709 12:25:44.922791 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:44.931814 18773 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:44.912505 25224 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.944449 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:44.945504 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:44.939816 19489 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:44.951596 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:44.936271 25086 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:44.939150 24654 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.914903 25251 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.945221 25024 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.959074 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:44.955042 25142 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 12:25:44.914714 25176 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.957525 25104 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:44.950873 25278 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:44.944962 25256 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.946126 25058 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.978704 25104 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.983712 25086 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:44.950026 25224 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:44.989542 18921 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:44.951042 25083 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.018128 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:45.020813 18919 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
W20260709 12:25:45.022186 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.025616 18920 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 16. Ops: []
I20260709 12:25:44.979295 24875 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:44.986852 25176 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:44.996757 25104 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:45.011812 24654 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.011454 25278 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:45.038065 25072 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
I20260709 12:25:45.086567 24278 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.087175 24278 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.090476 25224 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:45.091233 25224 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:45.091955 25224 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:45.097276 24278 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.053855 24875 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:45.035478 25117 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 12:25:45.078545 25244 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.765s	user 0.016s	sys 0.000s
I20260709 12:25:45.079245 24866 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.077913 24960 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:45.126134 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 431162us
I20260709 12:25:45.099638 25113 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.108143 25110 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.063934 24654 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.125887 25083 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.156709 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:45.132543 25282 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:45.157562 19489 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:45.098912 25072 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.131945 24875 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.165304 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.170368 24278 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:45.166121 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 195463us
I20260709 12:25:45.167224 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:45.159447 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:45.184342 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 400668us
I20260709 12:25:45.185385 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:45.189033 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.201362 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:45.206698 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 258492us
I20260709 12:25:45.200731 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:45.210139 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.188584 25058 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.134568 25278 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.217053 24278 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:45.225021 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:45.218776 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:45.187357 25251 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:45.225916 19489 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:45.229853 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:45.204106 25244 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.174678 24875 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:45.237039 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf32cd3655eb4943abc0cdbf54a32206 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:45.202766 25256 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:45.240633 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:45.207974 25293 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.223110 25078 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:45.238976 25083 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:45.253111 24278 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:45.256342 24278 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:45.271754 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:45.272383 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:45.273098 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63046.9us
I20260709 12:25:45.274295 19456 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.233636 25292 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:45.260319 25281 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:25:45.281913 24278 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.284384 24278 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:45.284695 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.285063 24278 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.258457 25078 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:45.254837 25287 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:45.259372 25058 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.287781 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:45.257221 24866 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:45.288434 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 101557us
I20260709 12:25:45.298167 19458 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:45.294191 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:45.268662 25083 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:45.249068 25223 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.308591 25301 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:45.309270 25301 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:45.309890 25296 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:45.286685 25089 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.311013 25207 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:45.311544 25131 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.007s
I20260709 12:25:45.311954 25287 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:45.313721 25072 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.315129 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:45.315035 25083 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.316949 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2477) took 1195 ms. Trace:
I20260709 12:25:45.309768 25301 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:45.322171 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.313264 25287 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.317390 18770 rpcz_store.cc:276] 0709 12:25:44.123937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.861740 (+737803us) service_pool.cc:224] Handling call
0709 12:25:44.862367 (+   627us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:44.885148 (+ 22781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:44.885193 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:44.886067 (+   874us) log.cc:844] Serialized 52 byte log entry
0709 12:25:45.129604 (+243537us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:45.129663 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.129768 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:45.316689 (+186921us) raft_consensus.cc:1685] finished
0709 12:25:45.316711 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:45.316885 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19233,"raft.queue_time_us":219,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4602,"thread_start_us":208336,"threads_started":1,"wal-append.queue_time_us":307731}
I20260709 12:25:45.269661 25256 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:45.304889 24278 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:45.384745 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 55549.2us
I20260709 12:25:45.274463 25299 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:25:45.295922 25078 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:45.404633 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:45.413362 18842 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:25:45.317015 25282 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:45.405594 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 97898.1us
W20260709 12:25:45.405563 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 158454us
I20260709 12:25:45.408430 18914 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:25:45.414093 24278 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:45.417629 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:45.400666 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 106590us
I20260709 12:25:45.416532 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.418998 18842 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:45.384990 25089 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:45.422639 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:45.423667 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:45.309293 25308 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:45.426741 19489 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:45.424897 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:45.427515 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:45.428059 18842 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:45.427932 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.428627 18843 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:45.430660 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:45.432063 25309 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:45.432941 25295 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:25:45.432708 25309 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.434738 18839 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:45.436326 25293 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:45.437018 25293 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.415544 25251 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:45.439049 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1217) took 2334 ms. Trace:
I20260709 12:25:45.439488 19486 rpcz_store.cc:276] 0709 12:25:43.104696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.106009 (+  1313us) service_pool.cc:224] Handling call
0709 12:25:43.106607 (+   598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:43.107084 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:43.107109 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:44.863547 (+1756438us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b18004199e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a
0709 12:25:44.864633 (+  1086us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b2c00075be8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:25:44.893039 (+ 28406us) log.cc:844] Serialized 26 byte log entry
0709 12:25:45.128208 (+235169us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:45.128249 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.128322 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:45.438780 (+310458us) raft_consensus.cc:1685] finished
0709 12:25:45.438807 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:45.438979 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2630,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":10806,"spinlock_wait_cycles":43262592,"thread_start_us":197068,"threads_started":1,"wal-append.queue_time_us":299122}
I20260709 12:25:45.444198 25256 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:45.444900 25256 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:45.398524 25207 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:25:45.447412 25207 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:45.447826 25207 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:45.448747 25207 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.308607 25172 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.109s
I20260709 12:25:45.408998 24654 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.306583 25058 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.469069 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.459049 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.472263 18842 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:45.461119 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.481415 18846 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:25:45.455498 25205 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.000s
I20260709 12:25:45.485822 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:45.492662 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:45.494552 18922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 2960) took 2421 ms (client timeout 2093 ms). Trace:
W20260709 12:25:45.495045 18922 rpcz_store.cc:269] 0709 12:25:43.061792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.066601 (+  4809us) service_pool.cc:224] Handling call
0709 12:25:45.482960 (+2416359us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:45.483128 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057609088}
I20260709 12:25:45.429890 25308 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:45.467906 25300 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260709 12:25:45.473912 25298 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:25:45.501485 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.467738 25149 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:45.509392 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.445888 25256 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:45.541730 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 87312.6us
I20260709 12:25:45.537267 24278 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.543314 25316 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.543969 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37870 (request call id 1) took 1508 ms. Trace:
W20260709 12:25:45.543321 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74312.6us
I20260709 12:25:45.495311 24654 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:45.504487 25207 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:45.498847 25294 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.502058 25083 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:45.506515 25110 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.498296 25308 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:45.485965 25145 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:25:45.557351 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1108) took 1038 ms. Trace:
I20260709 12:25:45.500530 25113 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:25:45.546912 18766 rpcz_store.cc:276] 0709 12:25:44.026191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.026585 (+   394us) service_pool.cc:224] Handling call
0709 12:25:45.534811 (+1508226us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400211bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af85853 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:45.534958 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697197952}
I20260709 12:25:45.495066 25205 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.547956 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.582948 19492 rpcz_store.cc:276] 0709 12:25:44.519143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.593523 (+ 74380us) service_pool.cc:224] Handling call
0709 12:25:44.648273 (+ 54750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:44.950991 (+302718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:44.951040 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:44.951573 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:25:45.131458 (+179885us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:45.131498 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.131569 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:45.557077 (+425508us) raft_consensus.cc:1685] finished
0709 12:25:45.557102 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:45.557282 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83709,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":24299,"thread_start_us":434491,"threads_started":2,"wal-append.queue_time_us":264837}
W20260709 12:25:45.579631 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 155568us
I20260709 12:25:45.593737 24278 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:25:45.595335 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47823.2us
I20260709 12:25:45.504688 24519 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:25:45.547664 25246 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:45.603348 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 185813us
I20260709 12:25:45.597289 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.598702 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.606972 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.595482 24278 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:45.506953 25104 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.609284 24278 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:45.553884 25025 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
W20260709 12:25:45.558015 25024 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.001s
I20260709 12:25:45.547307 24875 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:45.566313 25299 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.613634 24278 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:45.592423 25236 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.619238 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.618737 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.617277 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.581069 25089 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:45.624611 18848 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:25:45.593355 25290 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.592721 25244 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:45.597326 25286 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.614241 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.619284 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:45.640357 18842 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:45.640257 25312 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:45.641069 25236 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.623829 25025 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.657326 18841 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:45.605738 25145 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.583871 25294 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.643200 18843 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:45.546474 25149 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.615577 25309 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.615422 25246 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.643920 25223 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:45.729053 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 124910us
I20260709 12:25:45.648303 25089 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.641079 24875 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:45.706437 25312 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:45.643483 25299 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.750324 18846 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:25:45.626366 25024 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.756672 18846 pending_rounds.cc:85] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 8
I20260709 12:25:45.756973 18846 pending_rounds.cc:107] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:25:45.757257 18846 raft_consensus.cc:2889] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:45.750540 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:45.704066 25113 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.706144 25293 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.648667 25244 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.731626 25315 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:45.653168 25290 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.742677 25282 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.752081 25312 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:45.765182 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.703642 25145 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.772617 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.774976 18845 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:45.775493 25309 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:45.775942 25104 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.776103 25223 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:45.777007 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:45.777264 25205 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.652014 25286 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.777419 25089 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.757733 25058 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:45.816884 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 197681us
W20260709 12:25:45.820241 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.822114 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.827471 18842 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:45.752847 24875 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.842886 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.865947 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:45.771395 25315 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:45.868152 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:25:45.874514 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.868736 18846 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:45.869546 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.871240 18919 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:45.873243 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:45.877271 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.877508 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.766588 25113 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:45.772958 25293 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.093s
W20260709 12:25:45.875736 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 98813.5us
I20260709 12:25:45.878628 18842 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:45.881332 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.881533 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:45.882350 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:45.886992 24875 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:45.887995 25149 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.891186 25294 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:45.893934 25286 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.894760 25025 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:45.894963 25313 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:25:45.899505 25299 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:45.900452 25236 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.901749 25311 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.901768 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2911) took 1300 ms. Trace:
I20260709 12:25:45.904177 25246 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.905675 25024 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:45.883677 25295 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:25:45.883633 25061 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:45.908509 25320 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:25:45.880144 25104 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:45.909619 25113 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.911935 25244 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:45.894074 24866 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.001s
I20260709 12:25:45.865968 25309 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:45.899652 25290 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:45.917623 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.922022 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:45.923309 18842 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:45.902591 18914 rpcz_store.cc:276] 0709 12:25:44.601420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.791075 (+189655us) service_pool.cc:224] Handling call
0709 12:25:44.791584 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.417491 (+625907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.901475 (+483984us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400155254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:45.901692 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416571136}
I20260709 12:25:45.876870 25315 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:45.880385 25328 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.941774 18846 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:45.951534 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.953584 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:45.953801 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:45.886989 25317 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.997188 25317 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.964149 24982 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:45.999565 24982 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:45.969352 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:46.000661 19488 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:46.000459 24982 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.959957 24519 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:45.961617 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45825us
I20260709 12:25:46.015232 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:45.932633 24654 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:45.962213 25299 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:25:45.973868 25233 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:46.043783 19456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.003s
I20260709 12:25:45.974995 24725 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.976109 25200 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:45.979348 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:45.962875 25113 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:45.935879 25311 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.935698 25256 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:45.947618 25309 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:45.990957 25083 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:45.937103 24875 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:46.116112 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 112495us
I20260709 12:25:45.970947 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1102) took 1453 ms. Trace:
I20260709 12:25:46.010246 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.117117 18846 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:46.091260 24982 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:45.974648 25145 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:45.973451 25290 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.131s
I20260709 12:25:46.085813 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:45.972210 25301 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
W20260709 12:25:45.973129 25251 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.534s	user 0.004s	sys 0.007s
I20260709 12:25:46.090765 18839 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
W20260709 12:25:46.123481 25172 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.010s	sys 0.014s
I20260709 12:25:46.166656 18842 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
W20260709 12:25:46.168721 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 214950us
I20260709 12:25:45.933069 24866 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:46.050479 25292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.013s
I20260709 12:25:46.120510 18771 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:25:46.116897 19490 rpcz_store.cc:276] 0709 12:25:44.517187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.517383 (+   196us) service_pool.cc:224] Handling call
0709 12:25:44.866626 (+349243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.932390 (+ 65764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.970701 (+1038311us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54005c21d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:45.970874 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802070912}
I20260709 12:25:46.048202 18844 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:46.084360 19456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.010s	sys 0.006s
I20260709 12:25:46.123876 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:46.124372 18766 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:46.125326 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:46.125224 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:46.175091 18770 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:46.042058 25328 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.155324 25293 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:46.128521 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:46.128686 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 260619us
I20260709 12:25:46.152499 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:46.180554 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:46.181777 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:46.105381 25256 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.182611 25256 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.182806 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.183471 18919 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:46.185554 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.186854 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.186964 25250 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:46.187608 18921 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:46.187546 24866 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:46.097025 25329 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:46.188563 25329 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.188781 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:46.188966 25329 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:46.189559 18915 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:46.192090 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:46.115058 24519 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:46.194453 24519 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.194957 24519 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.195387 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.196740 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.197439 18917 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:46.097764 24654 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:46.159173 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73517.2us
W20260709 12:25:46.164877 18768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3019) took 2075 ms (client timeout 2017 ms). Trace:
I20260709 12:25:46.114238 25083 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:46.215122 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:46.216073 25299 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:46.215821 25083 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.094586 25237 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:25:46.216645 25299 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:46.217022 25237 consensus_queue.cc:1243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:46.217659 25299 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:46.214906 18768 rpcz_store.cc:269] 0709 12:25:44.089544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.096277 (+  6733us) service_pool.cc:224] Handling call
0709 12:25:46.164529 (+2068252us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540029d1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:46.164759 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753282816}
I20260709 12:25:46.175010 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:46.220263 18771 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:25:46.127736 24875 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:46.221659 24875 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.176553 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:46.223294 18772 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:46.127887 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:46.173122 25172 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.010s	sys 0.014s
I20260709 12:25:46.226742 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:46.177350 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.177888 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:46.154053 24947 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:46.102933 25327 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.214803 24654 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:46.173228 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 714694us
I20260709 12:25:46.225929 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:46.224268 18765 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
W20260709 12:25:46.048496 25078 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.004s
W20260709 12:25:46.177651 25292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.003s	sys 0.013s
W20260709 12:25:46.229003 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 103749us
I20260709 12:25:46.173460 25251 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:46.235009 18766 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
W20260709 12:25:46.224463 25313 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:46.239369 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:46.242691 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:46.249770 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:46.236011 19456 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:46.259079 19491 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:46.285404 18841 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:46.213907 25256 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:46.287467 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51535us
I20260709 12:25:46.232025 25293 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:46.293258 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.283063 19490 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:46.283067 18913 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:46.166100 25331 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:46.233495 25200 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:46.291548 24725 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:46.285739 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:46.289898 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.331784 18919 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
W20260709 12:25:46.262830 18886 connection.cc:256] RPC call timeout handler was delayed by -1.1476480639998954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 12:25:46.299459 25332 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:25:46.264256 25078 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.236565 24947 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.254510 25223 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:25:46.173585 25301 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.325696 25149 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.323995 18914 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:46.304337 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 126529us
I20260709 12:25:46.296610 25282 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.296835 25233 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:46.293236 25307 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.092s
I20260709 12:25:46.365352 18922 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:46.275480 25237 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:46.341480 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:46.343968 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58293.6us
I20260709 12:25:46.323418 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.381683 18917 raft_consensus.cc:2410] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:25:46.383085 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.384052 18917 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:25:46.254858 25327 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.331367 24725 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.336575 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.389389 24725 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:46.335884 24866 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.395134 24866 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.389712 18919 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:46.363296 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.400305 18913 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:46.349418 25103 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:46.343932 25292 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:46.320050 25339 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:25:46.380164 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:46.412369 19486 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 12:25:46.326288 25346 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.358440 24654 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:46.444329 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:46.436308 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56333us
W20260709 12:25:46.438414 18886 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 2.017s (SENT)
I20260709 12:25:46.364456 25233 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.449506 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
W20260709 12:25:46.450186 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.451622 18913 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:46.406543 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45701.8us
I20260709 12:25:46.357340 25336 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:46.446707 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:46.413115 25317 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.351327 25329 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.364825 25338 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.454747 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.455802 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:46.453986 25334 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:25:46.338240 25331 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.410490 25103 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:46.366101 25149 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.454176 25233 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:46.413537 25237 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.475553 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:46.496570 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:46.497515 25237 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:46.471575 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.498487 24866 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.499224 24866 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:25:46.499677 25308 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.902s	user 0.013s	sys 0.001s
I20260709 12:25:46.499750 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:46.500368 25308 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:46.502664 25343 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:25:46.477154 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.446874 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:46.449898 25046 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:46.404703 24519 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:46.512784 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 73349.4us
I20260709 12:25:46.436216 25292 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.506429 18918 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:46.466575 25311 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:46.515479 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:46.498055 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:46.526468 19490 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:46.483069 25103 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:46.523276 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:46.521488 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf32cd3655eb4943abc0cdbf54a32206 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:46.485240 25347 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
W20260709 12:25:46.494992 25335 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:25:46.477491 25336 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.499691 24866 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:46.541524 24866 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:46.542685 25336 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:46.482535 25327 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:46.550289 24519 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.491019 25333 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:46.421836 25293 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.508955 25046 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:46.513239 24654 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:46.517899 25237 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.473812 25338 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.485101 25349 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:46.560101 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:46.529487 25328 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.516355 25339 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.570436 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:46.571595 25149 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.561305 25046 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.622073 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.574787 24947 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.581873 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.561880 25333 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.557703 25336 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:46.573906 25331 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.558713 25256 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:46.565091 25340 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.561635 24654 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.620862 24519 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.631546 18919 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:46.633175 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.579031 25308 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:46.641942 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 195327us
I20260709 12:25:46.620788 24749 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.625839 25258 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:46.667302 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.603842 25106 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.677084 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.586279 25349 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:46.688725 25349 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:46.689747 25342 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:46.691056 25106 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.658444 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:46.693686 25106 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:46.680761 24982 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.002s
I20260709 12:25:46.681255 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.670032 25301 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.631048 25078 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:46.695411 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:46.674489 25336 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:46.709015 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.709686 18846 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:46.710582 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.680253 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:46.711377 18839 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.603729 24725 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.700573 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.701093 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:46.678507 25340 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.701819 25051 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:46.703181 18842 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:46.688136 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2983) took 1277 ms. Trace:
I20260709 12:25:46.704859 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.676348 24654 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:46.621563 24866 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.719260 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:46.721776 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.724931 18846 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:25:46.725909 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:46.715766 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 217811us
I20260709 12:25:46.715776 18845 rpcz_store.cc:276] 0709 12:25:45.410569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.410720 (+   151us) service_pool.cc:224] Handling call
0709 12:25:45.411066 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.821120 (+410054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.687849 (+866729us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540041c3d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:46.688060 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836392320}
I20260709 12:25:46.674154 25339 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:46.727742 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.741278 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.742276 18842 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:46.743759 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:46.729930 18917 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:46.766067 18842 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:46.714620 25301 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.740410 25329 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:46.739161 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.885953 18845 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:46.886183 25292 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:46.887212 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.731448 18846 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:46.680075 24519 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.763515 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.888586 18919 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:46.889267 18846 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:25:46.889645 18846 pending_rounds.cc:85] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 11
I20260709 12:25:46.889868 24519 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.890149 18846 pending_rounds.cc:107] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:25:46.715332 25051 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:46.890627 25051 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:46.889575 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:46.892243 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:46.893610 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:46.802560 25354 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:25:46.896641 18846 raft_consensus.cc:2889] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:46.887957 18845 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 13.
I20260709 12:25:46.898836 18844 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:46.899755 24725 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.901096 18845 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:46.901623 18839 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:46.890637 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.913440 18913 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:46.881863 25338 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.809710 25336 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.740490 25060 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:46.917279 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.887002 25301 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.738324 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:46.935062 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 196829us
I20260709 12:25:46.935364 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.936260 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:46.937077 25233 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.938158 25278 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:46.938301 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:46.939460 25355 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:46.940188 25355 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.940864 25355 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.942668 25301 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:46.910765 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:46.880012 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.887781 25340 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:46.948948 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.911792 25349 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.917757 25060 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.949659 25060 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.951004 25349 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:46.723390 25346 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:46.951853 24654 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:46.908555 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.921587 25046 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.955361 25292 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:46.956233 25292 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.957135 25046 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:46.962301 25290 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:46.963196 25290 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:46.925813 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.926630 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.972854 18921 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:46.973989 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.980902 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:46.981849 18921 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:46.928376 18919 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:46.985257 25292 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:46.939538 25278 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:46.985802 25233 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:46.986243 25278 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:46.986754 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.987533 25278 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.943367 25350 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:46.880491 25315 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.896s	user 0.014s	sys 0.003s
I20260709 12:25:46.944739 24506 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:46.991214 25315 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.924423 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:47.006374 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82023.7us
I20260709 12:25:47.011551 25356 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:47.012930 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2907) took 2945 ms. Trace:
I20260709 12:25:47.013425 18920 rpcz_store.cc:276] 0709 12:25:44.067771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.067897 (+   126us) service_pool.cc:224] Handling call
0709 12:25:44.068246 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.026232 (+957986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.012605 (+1986373us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54000e4554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:47.012853 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198553856}
I20260709 12:25:47.015391 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:47.008908 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:46.902745 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:46.976421 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.928156 25103 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:46.933239 25051 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:46.921887 25282 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.557s	user 0.015s	sys 0.002s
I20260709 12:25:46.962344 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:46.989269 24654 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.007068 25315 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:47.006798 24749 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.907513 25333 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.028825 18839 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:47.023090 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:47.028823 18921 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:25:47.034108 18842 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:25:46.991686 25350 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:47.026157 25110 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:47.028436 25356 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:47.030187 25282 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:47.040171 25350 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:47.028280 25283 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:25:47.047787 25110 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.054231 25283 consensus_queue.cc:1243] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:25:47.030709 25355 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.057058 25110 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.046361 25356 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:47.067943 25356 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.075910 25350 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.098115 25350 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.194661 25355 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:47.251694 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 458105us
W20260709 12:25:47.251694 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 313809us
W20260709 12:25:47.271343 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 248221us
I20260709 12:25:47.284328 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.285352 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.289388 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.290635 18917 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:47.286240 18920 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:47.301482 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:47.302004 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.302529 18920 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:47.334640 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:47.336333 19483 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:47.338261 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:47.340694 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:47.343189 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:47.355042 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:47.357033 24749 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:47.357823 24749 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.358217 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:47.360383 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:47.358289 24749 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.358148 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:47.184902 25316 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:25:47.446830 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 141202us
I20260709 12:25:47.498371 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:47.498857 25316 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:47.499399 18921 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.507025 25283 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:47.507520 25282 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:47.508186 25283 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:47.509101 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 151191us
I20260709 12:25:47.499254 25051 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.522859 25360 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.523845 25360 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.526626 25151 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.527669 25151 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.530745 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:47.531893 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:47.532867 19490 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:47.533506 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:47.534212 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:47.535383 19485 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:47.531723 19487 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:47.539618 18920 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:47.508208 25282 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:47.522945 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.554055 25376 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.554075 25078 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:47.555292 25078 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:47.555158 25376 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.555962 25078 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.560046 25360 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.561367 25290 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:47.563562 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.582836 25370 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.583981 25370 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.584599 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3034) took 2939 ms. Trace:
I20260709 12:25:47.585050 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:47.585131 18767 rpcz_store.cc:276] 0709 12:25:44.644630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.687372 (+ 42742us) service_pool.cc:224] Handling call
0709 12:25:44.739245 (+ 51873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.939630 (+200385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.550257 (+2610627us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001d6354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:47.584313 (+ 34056us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364590976}
I20260709 12:25:47.552922 25282 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:47.600539 25151 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.582733 25078 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.616130 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:47.619310 25283 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.620033 25200 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:47.621510 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 128592us
I20260709 12:25:47.622450 18920 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:47.623015 25228 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:25:47.623014 18840 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.008s
I20260709 12:25:47.600539 24749 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.634768 25278 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:47.637821 25370 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.638370 25333 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:47.639168 18846 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:25:47.642787 25051 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:47.643877 25369 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:47.662675 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 75802.8us
I20260709 12:25:47.669000 18921 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:47.661741 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2927) took 1479 ms. Trace:
I20260709 12:25:47.651383 25228 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.660308 25333 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.663208 18840 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:47.672055 18918 rpcz_store.cc:276] 0709 12:25:46.182272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.182483 (+   211us) service_pool.cc:224] Handling call
0709 12:25:46.182767 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.519813 (+337046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.609326 (+1089513us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540027ddd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:47.661484 (+ 52158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743777664}
W20260709 12:25:47.681752 18913 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.010s	sys 0.023s
I20260709 12:25:47.677779 25228 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:47.682937 25333 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:47.686618 25051 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.690464 25200 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.689317 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 2910) took 3080 ms. Trace:
I20260709 12:25:47.688475 25324 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:47.691491 25369 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.706621 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:47.716125 25286 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:47.716915 25286 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.717515 25286 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.718330 25283 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:47.742866 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:47.743481 25117 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:47.747143 25078 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.749323 25224 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:47.752453 25200 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.754470 25051 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.705263 18916 rpcz_store.cc:276] 0709 12:25:44.587537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.762301 (+174764us) service_pool.cc:224] Handling call
0709 12:25:44.762780 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.763068 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:25:45.134502 (+371434us) log.cc:844] Serialized 14 byte log entry
0709 12:25:45.551460 (+416958us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b1800329b00. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:47.646920 (+2095460us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b1800329b00. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287
0709 12:25:47.647252 (+   332us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:47.647342 (+    90us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:25:47.647508 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.647648 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:47.667367 (+ 19719us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9381,"prepare.queue_time_us":440182,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":42966,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8104,"spinlock_wait_cycles":18000384,"thread_start_us":616574,"threads_started":3,"wal-append.queue_time_us":164056,"wal-append.run_cpu_time_us":1016,"wal-append.run_wall_time_us":1001040}
I20260709 12:25:47.679427 25278 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.764210 25117 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.764300 25224 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.767444 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:47.764495 25384 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:47.766934 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:47.772486 25060 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.009s
I20260709 12:25:47.773232 25060 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.773419 25384 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.774691 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:47.774605 25358 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:25:47.775665 25358 consensus_queue.cc:1243] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:25:47.776711 25370 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:47.777309 25384 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.773904 25151 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:47.778111 25151 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:47.779253 25369 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.779527 25151 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.781564 25278 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.784624 25224 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:47.786171 25200 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:47.787101 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.787664 25117 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.788272 25200 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.797610 25131 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.798375 25131 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.801080 25131 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.802007 24749 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.804399 25060 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.806383 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:47.807224 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 80229.2us
I20260709 12:25:47.808887 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.810082 18767 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:47.813515 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.814476 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:47.815496 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:47.811733 25200 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.816434 18770 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:47.823770 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47802.8us
I20260709 12:25:47.825048 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.825919 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.827571 25224 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:47.832830 25200 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.834110 25286 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:47.839560 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66136.8us
I20260709 12:25:47.842586 18770 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:47.843700 25224 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:47.844545 25224 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:47.844655 18765 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:25:47.843791 18772 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:47.851121 18917 raft_consensus.cc:2410] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:25:47.862161 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.862381 25338 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:47.863608 18770 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:47.863675 25338 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:47.864295 25338 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:47.862445 18841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2816) took 2128 ms (client timeout 2063 ms). Trace:
W20260709 12:25:47.868176 18841 rpcz_store.cc:269] 0709 12:25:45.733741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.733957 (+   216us) service_pool.cc:224] Handling call
0709 12:25:47.861364 (+2127407us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400238f54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:47.862131 (+   767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961962880}
I20260709 12:25:47.869648 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 2993) took 1192 ms. Trace:
I20260709 12:25:47.869747 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1106) took 1608 ms. Trace:
I20260709 12:25:47.870245 18844 rpcz_store.cc:276] 0709 12:25:46.676581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.676799 (+   218us) service_pool.cc:224] Handling call
0709 12:25:47.869156 (+1192357us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b5400380c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:47.869409 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135308544}
I20260709 12:25:47.870479 19492 rpcz_store.cc:276] 0709 12:25:46.261536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.261706 (+   170us) service_pool.cc:224] Handling call
0709 12:25:46.262095 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:46.262511 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:25:46.286667 (+ 24156us) log.cc:844] Serialized 14 byte log entry
0709 12:25:46.724326 (+437659us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:46.728656 (+  4330us) log.cc:844] Serialized 26 byte log entry
0709 12:25:46.728815 (+   159us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:46.730118 (+  1303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.730232 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:47.863092 (+1132860us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b1800440b60. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:47.868874 (+  5782us) raft_consensus.cc:1685] finished
0709 12:25:47.869225 (+   351us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:47.869488 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14356,"prepare.queue_time_us":28021,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3511,"raft.queue_time_us":4342,"raft.run_cpu_time_us":4299,"raft.run_wall_time_us":52424,"spinlock_wait_cycles":14123264,"thread_start_us":427960,"threads_started":1,"wal-append.queue_time_us":596297}
I20260709 12:25:47.874577 25224 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.876775 25224 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.884895 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:47.875066 25312 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:47.850345 25356 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.010s
I20260709 12:25:47.865473 25338 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:47.862356 25350 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.678s	user 0.014s	sys 0.009s
I20260709 12:25:47.895217 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.898814 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.899235 25226 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:25:47.899933 25297 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:47.859982 25228 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.899956 25312 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.896154 25356 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.919844 25356 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.908896 25297 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.921948 25297 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.923588 25228 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.925654 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:47.926489 18769 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:47.931432 18920 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:47.933054 25348 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:47.933326 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.931388 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.918243 18918 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:25:47.921303 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:47.942642 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.943418 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.944325 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:47.944615 25309 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:47.944775 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.945062 18921 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:47.945713 18920 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:47.946744 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:47.947253 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3000) took 1260 ms. Trace:
I20260709 12:25:47.947682 18842 rpcz_store.cc:276] 0709 12:25:46.687074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.784108 (+ 97034us) service_pool.cc:224] Handling call
0709 12:25:47.946866 (+1162758us) spinlock_profiling.cc:243] Waited 86.9 ms on lock 0x7b54003be054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:47.947060 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199966464}
I20260709 12:25:47.948225 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:47.950908 25319 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 2.082s	user 0.021s	sys 0.017s
W20260709 12:25:47.953315 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68754us
I20260709 12:25:47.953908 25316 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.955533 25226 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.955865 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.956167 25316 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:47.957405 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1397) took 2218 ms. Trace:
I20260709 12:25:47.957170 25297 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.957834 18922 rpcz_store.cc:276] 0709 12:25:45.738694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.738803 (+   109us) service_pool.cc:224] Handling call
0709 12:25:45.739137 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.365817 (+626680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.956947 (+1591130us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b5400335c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:47.957230 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439683456}
I20260709 12:25:47.933854 25348 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:47.961935 18915 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:47.962787 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 2992) took 1635 ms. Trace:
I20260709 12:25:47.963109 25348 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.963819 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:47.965456 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.967820 18764 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:25:47.970184 25322 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:47.971252 18770 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:25:47.972282 25305 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:47.972833 25305 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:47.972965 25297 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.974152 25305 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.974959 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:47.975811 25305 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:47.977779 18921 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:47.975857 18765 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.976986 18769 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:25:47.987638 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:47.988188 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.988384 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2985) took 2577 ms. Trace:
W20260709 12:25:47.989210 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.989075 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:47.989096 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.990099 19491 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:47.990813 18772 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:47.991962 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:47.989204 18770 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:47.992594 18916 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.990025 25103 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:47.994707 25086 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.988862 18848 rpcz_store.cc:276] 0709 12:25:45.411221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.411372 (+   151us) service_pool.cc:224] Handling call
0709 12:25:45.411678 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.646088 (+234410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.987771 (+2341683us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54003bd154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:47.988145 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489172864}
I20260709 12:25:47.997153 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 2986) took 2585 ms. Trace:
I20260709 12:25:47.994788 18768 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:47.994925 25338 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:47.997658 18847 rpcz_store.cc:276] 0709 12:25:45.411538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.412854 (+  1316us) service_pool.cc:224] Handling call
0709 12:25:45.413132 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.499422 (+ 86290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:45.499453 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:45.499937 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:25:45.624570 (+124633us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:45.624613 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.404706 (+780093us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:46.404770 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:47.949916 (+1545146us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:47.996628 (+ 46712us) raft_consensus.cc:1685] finished
0709 12:25:47.996669 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:47.996926 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26417,"raft.queue_time_us":2467,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":1328,"spinlock_wait_cycles":212918400,"thread_start_us":124287,"threads_started":1,"wal-append.queue_time_us":316527}
I20260709 12:25:48.000458 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1107) took 1736 ms. Trace:
I20260709 12:25:47.963111 18915 rpcz_store.cc:276] 0709 12:25:46.327888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.328073 (+   185us) service_pool.cc:224] Handling call
0709 12:25:46.328483 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:47.961606 (+1633123us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b54001601a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8d1c0 00007f335af8e231 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c
0709 12:25:47.962466 (+   860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.962729 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79610752}
I20260709 12:25:48.000905 19486 rpcz_store.cc:276] 0709 12:25:46.264045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.264404 (+   359us) service_pool.cc:224] Handling call
0709 12:25:46.290095 (+ 25691us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:46.436182 (+146087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.999906 (+1563724us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400660654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:48.000279 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279999744}
I20260709 12:25:48.005196 24947 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:48.005741 24947 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:48.008558 19491 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:48.010895 19489 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:48.010353 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.012305 18920 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:48.011515 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:48.018167 18765 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:48.013347 25226 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.019739 18914 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:48.020844 19487 raft_consensus.cc:2368] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14.
I20260709 12:25:48.022925 24947 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.030938 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.031821 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3006) took 1126 ms. Trace:
I20260709 12:25:48.032136 18764 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 12:25:48.031958 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.032936 18846 rpcz_store.cc:276] 0709 12:25:46.905359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.905457 (+    98us) service_pool.cc:224] Handling call
0709 12:25:46.905760 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.676610 (+770850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.031442 (+354832us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b5400380254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:48.031738 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1474917248}
I20260709 12:25:48.037411 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:47.913208 25333 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:47.982662 25370 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:48.043794 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.044651 18772 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:48.046017 25310 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.046875 18770 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:48.046962 25310 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.049659 25226 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:48.050590 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 160212us
I20260709 12:25:48.053524 19486 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:25:48.056141 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.049973 25310 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.053064 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.066968 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.067924 18770 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:48.063720 25382 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:25:48.071627 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.058530 24947 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.072705 18769 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:25:48.084041 25286 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:48.085518 18916 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:48.063033 25377 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:48.088523 25377 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.088836 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.091719 25377 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.095407 18765 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:48.091996 24982 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:48.096829 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.103828 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.078681 25310 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:48.100138 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:48.110574 25386 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 12:25:48.107431 25051 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.112242 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.099287 25316 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:48.117431 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.118551 19487 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:48.120297 25316 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:48.121331 25358 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:48.122937 25358 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:48.123374 25358 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:48.124568 25358 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.126031 25358 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:48.117251 25051 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.134820 24866 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.137902 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.139014 25046 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:48.139505 25046 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:48.140478 25046 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.141368 25046 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:48.158443 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.099011 24982 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.169261 24982 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:48.171147 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 100442us
I20260709 12:25:48.170476 18663 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.172286 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.175203 25137 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:48.175359 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.151365 25376 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:48.179494 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.182456 19488 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:48.195694 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:48.211138 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.212411 18921 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:48.218461 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.185995 18767 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:48.201934 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2815) took 2541 ms. Trace:
I20260709 12:25:48.188513 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.224232 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.225049 18919 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:48.226819 19486 raft_consensus.cc:2410] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:25:48.226730 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.227698 24875 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.227962 25145 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:48.228420 24875 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.228751 25145 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.229455 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.230136 18916 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.227713 24725 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:48.224869 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.220644 18843 rpcz_store.cc:276] 0709 12:25:45.728457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.730544 (+  2087us) service_pool.cc:224] Handling call
0709 12:25:45.746020 (+ 15476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.797638 (+ 51618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:45.797694 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:45.797759 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:45.797819 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.155835 (+2358016us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b540041c8d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:48.163738 (+  7903us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.201724 (+ 37986us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117964032}
W20260709 12:25:48.201692 25282 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
W20260709 12:25:48.189858 19456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.561s (SENT) [suppressed 14 similar messages]
I20260709 12:25:48.223608 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.239478 25087 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:48.239804 19485 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 18. Ops: []
I20260709 12:25:48.240077 25104 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:25:48.241029 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.191854 25333 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:48.234684 24725 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.176726 25310 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.251477 18770 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: [13.11-17.13]
I20260709 12:25:48.253675 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:48.157306 25370 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.240073 25087 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:48.260249 18920 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:48.254050 24725 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.251816 25104 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.271746 18916 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:48.271991 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.266785 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.237624 25282 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.273311 19458 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.276499 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:48.279071 25145 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:48.280207 24875 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.281750 25051 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.261080 25087 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.282349 25333 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:48.277209 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.284773 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.173230 18663 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 13, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 13 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:48.290068 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.292058 19491 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:48.291131 19489 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:48.287216 25333 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.286239 25238 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:48.304124 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.304093 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.267668 25316 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.291517 25051 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:25:48.312090 18886 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.500s (SENT)
I20260709 12:25:48.317782 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.311698 18770 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:48.287269 25377 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.306252 25333 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:48.326414 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.319164 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:48.324084 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.284483 25104 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:48.325448 25390 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.283s	user 0.005s	sys 0.000s
I20260709 12:25:48.305034 25338 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:48.328507 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.324762 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.327220 19490 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:48.323546 25145 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:48.337355 25145 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:48.330009 25338 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:48.339455 25338 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:48.342371 25397 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:48.343042 25145 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.343942 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.304689 18663 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 17, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 17 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.334962 25377 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.336005 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.319742 25051 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:48.346362 19485 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:48.347458 18765 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:25:48.321933 24875 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:25:48.356408 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:48.347755 25394 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:25:48.359443 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.346735 25051 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:48.363991 19485 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:48.366034 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.366945 18920 raft_consensus.cc:2368] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15.
I20260709 12:25:48.370786 25312 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:48.378602 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.381470 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.398032 18919 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:48.400658 18920 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:25:48.364065 24875 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:48.407644 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.408023 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.374884 25310 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:48.408771 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.409022 18919 raft_consensus.cc:2368] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:25:48.402905 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:48.417680 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 275214us
I20260709 12:25:48.420801 25312 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:48.457295 25200 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.418138 25310 raft_consensus.cc:2764] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 12:25:48.457026 25123 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:48.443890 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.435647 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.433655 18737 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.441443 25256 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:48.440462 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf32cd3655eb4943abc0cdbf54a32206 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:48.445700 25287 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:48.470988 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:48.471807 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.471932 18916 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:48.421747 25396 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:25:48.442497 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:48.474808 19491 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:48.346364 18663 catalog_manager.cc:5697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.475642 25143 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:48.475838 25123 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.476820 25143 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:48.477258 25143 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:48.476452 18663 catalog_manager.cc:5697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 5 to 17, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 17 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.465309 25376 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:48.478665 25256 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.479244 25376 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.481590 25376 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:48.481956 25256 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.445639 25238 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.452633 25083 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.435372 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.488085 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.488531 18915 raft_consensus.cc:2410] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:25:48.489024 18767 raft_consensus.cc:2410] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:25:48.436383 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.451706 25104 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:48.478684 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45171.7us
I20260709 12:25:48.453832 24875 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.442957 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:48.456868 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.452165 25333 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.436389 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.462112 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.498660 19488 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:48.463954 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.478221 25143 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.501327 25143 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.434839 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.483326 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.502434 18917 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:48.502795 18773 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:48.485636 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.489509 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.490650 19483 raft_consensus.cc:2368] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:25:48.492678 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.503945 18765 raft_consensus.cc:2368] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:25:48.504415 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.492076 25338 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:48.510634 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 288821us
I20260709 12:25:48.514138 19487 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:48.519039 18920 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:25:48.520757 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49773us
I20260709 12:25:48.506604 25123 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.528484 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.515616 25238 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.499286 25051 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.511432 24866 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:48.533739 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.506182 25200 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.532549 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.524619 25316 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:48.534236 25310 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:25:48.541967 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:48.539790 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.542904 18765 raft_consensus.cc:2368] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20.
I20260709 12:25:48.511847 25287 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.547645 25310 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:48.547987 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.548251 25310 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:48.548887 18846 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:48.554577 18843 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
W20260709 12:25:48.557332 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66509.6us
I20260709 12:25:48.528391 25358 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:25:48.540438 25338 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:48.562796 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.564450 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.569274 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:48.574990 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50829.3us
W20260709 12:25:48.577921 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.578315 18769 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:25:48.581992 25145 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:48.582835 25145 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:48.583961 25145 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.564133 25377 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:25:48.591202 18846 raft_consensus.cc:2410] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:25:48.575855 25123 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:48.597625 18765 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.602994 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.605026 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.579510 25316 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:48.605708 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.605165 25104 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:25:48.562207 24866 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.614929 18843 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:48.620086 18769 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:25:48.629855 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.630115 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.630676 18920 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:48.622597 18886 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.570s (SENT)
I20260709 12:25:48.631994 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:48.621835 25137 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:48.627425 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:48.606248 25282 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:48.643648 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.643402 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.623291 25333 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:48.654620 18846 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:48.621924 25123 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:48.651799 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.634904 25104 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:25:48.655428 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 99636us
I20260709 12:25:48.633234 25137 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.543967 18663 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 14, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.667863 24947 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:48.670987 25312 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:48.674000 24506 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:48.674465 25072 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:48.675486 25087 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:48.655879 25046 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.514s	user 0.016s	sys 0.008s
I20260709 12:25:48.669190 25104 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.719606 25104 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:48.681607 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:48.721824 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.722680 25200 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.722883 18843 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:48.722833 18844 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:48.723798 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:48.724015 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:48.695919 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.646802 25370 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.672253 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:48.705260 25399 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 12:25:48.706624 25238 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.708464 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:48.732049 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61781.4us
I20260709 12:25:48.649266 25377 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:25:48.710525 18845 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:48.711007 25287 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.691500 24506 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:48.725479 25123 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.741394 24506 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:48.711787 25072 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:48.743185 25072 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.679224 25137 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:48.750538 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 145979us
I20260709 12:25:48.751274 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.753895 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.717358 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:48.724458 18839 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:48.729206 18920 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:48.731010 18846 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:25:48.724962 18766 raft_consensus.cc:606] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.709265 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:48.738121 18841 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:48.738332 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:48.733001 24725 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.739843 18845 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:48.739060 18663 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.755177 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.780323 18843 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:48.780848 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.781322 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.781870 18845 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:25:48.781114 18663 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 16, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 16 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:48.736613 25083 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:48.782728 25083 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:48.784192 18847 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:48.783807 25083 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.736793 25370 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:48.788731 25370 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:48.756541 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.757853 25377 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:48.752841 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:48.758256 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.758646 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.770558 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.772347 25087 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:48.717227 19492 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:48.774624 18766 raft_consensus.cc:614] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:48.775010 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57769.6us
I20260709 12:25:48.774834 18840 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:48.776288 18765 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:48.774832 19458 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:48.777523 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:48.798280 18846 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.789934 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.795593 18848 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:25:48.760233 25310 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.815388 25310 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:48.816294 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.817625 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:48.818656 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:48.820091 18921 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:48.821084 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:48.821772 18847 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:48.823671 18921 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:25:48.828436 18812 leader_election.cc:400] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:25:48.828778 18812 leader_election.cc:403] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:25:48.829761 18841 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:48.821084 18845 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:48.837615 18847 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:48.833910 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:48.829073 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54352.5us
W20260709 12:25:48.852738 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.810550 18814 leader_election.cc:400] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15.
I20260709 12:25:48.855269 18814 leader_election.cc:403] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:25:48.857599 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57960.7us
I20260709 12:25:48.827625 18764 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
W20260709 12:25:48.867919 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.794230 25377 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:48.834201 25282 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:48.884472 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:48.851960 25358 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:48.883970 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:48.886756 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76504.2us
I20260709 12:25:48.866138 25051 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:48.861775 25338 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:25:48.880716 25312 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:48.883903 25145 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:48.902297 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 43741.3us
I20260709 12:25:48.907622 25061 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.906136 18848 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:25:48.910983 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 209611us
I20260709 12:25:48.919091 18814 leader_election.cc:400] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:25:48.886371 25333 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:48.915357 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 144898us
I20260709 12:25:48.873756 25087 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:25:48.921322 18814 leader_election.cc:403] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 12:25:48.919056 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 145484us
I20260709 12:25:48.920018 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:48.900445 25358 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:48.922044 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:48.915840 25200 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:48.912211 25312 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:48.948727 25123 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:48.960443 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37870 (request call id 2) took 2530 ms. Trace:
W20260709 12:25:48.960789 25408 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:25:48.951783 25312 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.960942 18766 rpcz_store.cc:276] 0709 12:25:46.430109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.430301 (+   192us) service_pool.cc:224] Handling call
0709 12:25:48.960146 (+2529845us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b5400210cd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af85853 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:48.960310 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5230574464}
I20260709 12:25:48.934592 25377 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.943846 25333 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:49.025421 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 55246.8us
I20260709 12:25:48.924135 25061 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:48.955423 24947 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:49.033123 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.992758 25358 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:49.034946 18846 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:49.031677 18840 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:48.932899 25145 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:49.050671 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.053388 25376 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
W20260709 12:25:49.080770 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 164129us
I20260709 12:25:49.066699 25250 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15.
I20260709 12:25:49.087216 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:49.084944 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 165022us
I20260709 12:25:49.092821 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.080196 25322 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:49.096405 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.094842 18913 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:49.107370 18916 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:49.093736 25377 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:49.098081 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.067189 25137 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:49.100018 25409 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.004s
I20260709 12:25:49.099010 25238 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:25:49.148964 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50964.8us
I20260709 12:25:49.101122 25338 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:49.149694 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 69211us
W20260709 12:25:49.150151 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 99680.2us
I20260709 12:25:49.158079 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:49.147612 25046 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.168114 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:49.170998 18839 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
W20260709 12:25:49.171940 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 79083.6us
I20260709 12:25:49.146234 25305 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:25:49.069445 18663 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 17, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 17 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:25:49.175410 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 253458us
I20260709 12:25:49.159795 25427 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:49.181169 25143 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:25:49.191162 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:49.191781 18913 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:49.196005 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:49.189343 25072 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:25:49.216580 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56400us
I20260709 12:25:49.214740 19483 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:49.233107 25430 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:49.233806 25427 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:49.234589 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 75653.9us
W20260709 12:25:49.235040 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57028.7us
I20260709 12:25:49.208599 25322 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:49.184201 25370 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:25:49.212846 24866 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:49.216724 24725 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:49.222277 25072 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:49.247727 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 51815.4us
I20260709 12:25:49.254655 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.255159 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:49.237390 25145 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:49.226824 25046 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:49.257869 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:49.245133 25322 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.253769 25072 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:49.263163 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:49.263408 25104 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.004s
I20260709 12:25:49.265069 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.265718 25437 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:25:49.256460 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.266964 25305 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:49.276577 25333 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:49.282259 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:49.284734 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:49.309499 24506 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.000s
I20260709 12:25:49.311278 25145 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.287266 25322 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:49.311961 25145 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:49.314092 25420 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:25:49.316191 25145 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:49.238700 25433 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:25:49.322958 25433 consensus_queue.cc:1243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:49.323616 25433 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:49.324033 25433 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:49.290604 25414 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 12:25:49.342834 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56696.4us
W20260709 12:25:49.327304 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62315us
W20260709 12:25:49.336676 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 95852.7us
W20260709 12:25:49.316116 25432 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:49.309991 24506 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:49.373215 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52905us
I20260709 12:25:49.344545 25086 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.297333 25104 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:49.390846 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 90376.9us
W20260709 12:25:49.391561 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 47349.5us
I20260709 12:25:49.392562 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.354533 25046 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:49.325094 25433 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:49.393965 25086 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:49.404626 25086 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:49.400252 25310 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.000s
I20260709 12:25:49.407392 25110 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:49.407653 24506 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:49.407883 25110 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.408367 25110 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:49.421794 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56428.7us
I20260709 12:25:49.409794 25072 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:49.422261 25287 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:49.365731 25305 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:49.425981 25437 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:49.426152 25305 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:49.426627 25437 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.423900 25322 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:49.426538 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 272935us
I20260709 12:25:49.427232 25437 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.428701 25305 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:49.325994 18663 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 16, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 16 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:25:49.434980 25417 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.436s	user 0.002s	sys 0.003s
I20260709 12:25:49.434409 18663 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:49.420578 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.402917 25137 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:49.441885 18886 leader_election.cc:400] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14.
I20260709 12:25:49.448136 18886 leader_election.cc:403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:25:49.452087 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:49.457578 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:49.455673 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:49.487242 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 66779.2us
I20260709 12:25:49.488936 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.494501 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.468154 25310 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:49.491153 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:49.499212 18812 leader_election.cc:400] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:25:49.473028 25145 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:49.480190 25433 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:49.464382 25442 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14.
I20260709 12:25:49.486002 25051 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:49.491814 24947 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:49.507023 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56876.8us
I20260709 12:25:49.454334 25443 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:25:49.497673 24866 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:49.513199 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:49.513162 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:49.499452 25310 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.502658 24725 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:49.497689 25419 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:25:49.515655 25256 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:25:49.517715 25424 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.318s	user 0.000s	sys 0.004s
I20260709 12:25:49.518530 25448 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.490419 18663 catalog_manager.cc:5697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.511890 25051 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:49.530457 24866 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.503201 25145 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.594244 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:49.617069 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:49.610800 18922 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:25:49.540427 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:49.638386 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:49.550302 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:49.652675 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:49.649372 19492 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:49.596964 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:49.652076 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.655205 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:49.650677 24725 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.656363 24725 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:49.616775 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.657827 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:49.659294 18917 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:49.597265 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:49.615272 25312 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
I20260709 12:25:49.666739 18848 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:49.672188 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:49.545790 18886 connection.cc:256] RPC call timeout handler was delayed by -1.3050409679999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 12:25:49.674564 18886 connection.cc:256] RPC call timeout handler was delayed by -1.2580834440004764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 12:25:49.619707 25287 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:49.650254 24866 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.611950 25061 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:49.654172 24506 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:49.684053 25086 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:49.665663 25256 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:49.610499 24947 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:49.654053 25338 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:49.690169 18848 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:25:49.747119 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:49.707614 25287 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.707381 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:49.757341 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:49.670172 25310 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:49.538882 25104 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:49.721529 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46427.2us
I20260709 12:25:49.685441 25046 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:49.713862 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbadce60e960476289740ec2afd0a5c8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:49.538278 25110 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:49.745842 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:49.650832 25145 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:49.788492 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 219590us
I20260709 12:25:49.735095 25072 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:49.797408 18886 connection.cc:256] RPC call timeout handler was delayed by -1.2013601149997157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 12:25:49.770743 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:49.774968 18656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61170.1us
I20260709 12:25:49.691217 25312 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:49.749022 25453 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:25:49.674376 25448 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:49.805742 19492 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:25:49.746968 25338 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:49.799728 18842 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:49.757639 25322 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:49.835033 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.836320 18913 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:49.842388 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.854341 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:49.748747 24506 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:49.861157 24725 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:49.866946 18840 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:49.808110 25333 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.878132 18845 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:25:49.879149 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.884174 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:49.889288 18845 raft_consensus.cc:2368] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
W20260709 12:25:49.883754 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 222722us
I20260709 12:25:49.896788 18919 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:25:49.903453 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 112420us
I20260709 12:25:49.904783 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:49.801735 24947 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:49.907934 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:49.762550 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:49.918769 18764 raft_consensus.cc:606] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:49.919557 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:49.840058 25072 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:25:49.920435 18845 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:49.880419 25083 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:49.928031 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:49.882637 25312 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:49.945766 18845 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:49.957247 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:49.909037 25061 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:25:49.962574 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:49.963933 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56366.4us
I20260709 12:25:49.884595 25333 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:49.929176 25338 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:49.966650 25072 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:49.966878 25110 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:49.968253 18845 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:49.960544 18663 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 5 to 14. New cstate: current_term: 14 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:49.995836 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:49.996627 18845 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:49.996107 18663 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:49.997611 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:49.998174 18663 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:49.980794 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 68450.1us
I20260709 12:25:49.999393 25051 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:50.000929 18663 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 13, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 13 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:50.003104 18663 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 17, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 17 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.983417 25200 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.986109 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:49.974582 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.010645 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:50.014325 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:49.998323 18845 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:50.022176 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:50.024147 24725 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:50.024468 18845 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:50.029476 18922 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:25:50.029973 18922 pending_rounds.cc:85] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 10
I20260709 12:25:50.032615 18839 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:50.044251 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:50.045753 18847 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:50.010178 25072 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:50.055121 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 80643.9us
I20260709 12:25:50.048029 25110 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:50.056324 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:50.057441 24506 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:50.058961 25461 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:25:50.035219 18922 pending_rounds.cc:107] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:25:50.062340 18922 raft_consensus.cc:2889] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.056505 25110 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:50.070860 18841 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:50.062947 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:50.105376 18913 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:50.132187 18839 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:50.054880 25072 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:50.140326 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:50.142318 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 86080.4us
I20260709 12:25:50.148933 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:50.063081 25087 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.964517 25256 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.161783 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.162058 19487 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
W20260709 12:25:50.159780 25437 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.732s	user 0.015s	sys 0.000s
I20260709 12:25:50.030036 25412 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 12:25:50.165603 19456 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.561s (SENT)
I20260709 12:25:50.182049 25412 consensus_queue.cc:1243] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:50.182328 25463 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:50.166710 25448 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:50.167141 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:50.166739 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:50.183550 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:50.184154 19488 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:50.184222 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.185036 18839 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:50.184906 25437 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.186317 18846 raft_consensus.cc:2368] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 13. Current term is 14.
I20260709 12:25:50.189587 25046 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:50.194887 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.044240 25458 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:25:50.198963 25104 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:50.199604 25104 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:50.171645 25417 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:25:50.200536 25104 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.201483 25421 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.202036 25421 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.202793 25110 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.204295 25421 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:50.204406 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.205133 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:50.170262 25333 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:50.157444 25457 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 12:25:50.207456 19492 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: []
I20260709 12:25:50.207398 25448 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:50.208339 25312 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:50.176443 24866 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.213246 18848 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:50.170831 25430 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.214282 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:50.214972 19492 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:50.214825 25430 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.216359 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:50.217645 25430 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:50.163106 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 91135.1us
W20260709 12:25:50.179059 25433 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.669s	user 0.012s	sys 0.002s
I20260709 12:25:50.178654 25051 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:50.172937 24506 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:50.179780 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:50.070379 25464 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:50.048108 25200 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.178085 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:50.181455 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:50.238663 19486 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:50.239524 19483 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
W20260709 12:25:50.182631 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.167040 24947 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:50.183100 25463 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.184367 18847 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:50.206992 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.167372 18663 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 14, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 14 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.206290 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:50.227612 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:50.247537 18845 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:50.087025 25123 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:50.246364 19492 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:50.249912 18839 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:50.204524 25110 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:50.255352 18886 connection.cc:256] RPC call timeout handler was delayed by -1.1095601150000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 12:25:50.210254 25437 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:50.262231 25072 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.267159 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.267949 18765 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:50.270980 18887 leader_election.cc:400] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:25:50.271363 18887 leader_election.cc:403] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 12:25:50.280462 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 102482us
I20260709 12:25:50.251559 25464 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.263432 25448 raft_consensus.cc:2764] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:25:50.286324 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.270494 25433 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:25:50.287454 18771 raft_consensus.cc:2410] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:50.290170 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.290916 18770 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:50.293318 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:50.298475 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.298564 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.300587 18769 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:50.301781 18769 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:50.304337 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.307650 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:50.277235 25421 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.313236 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:50.310310 18767 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:50.311259 18768 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:50.293021 25051 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:50.292332 25448 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:25:50.257828 25123 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.320885 18913 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:50.335146 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:50.287470 25464 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:50.288039 25442 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:25:50.339354 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.342707 18773 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:50.349778 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:50.350772 19492 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:50.353469 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:50.360091 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:50.339324 25051 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:50.323603 25421 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.372072 25322 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:25:50.347847 25448 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:50.383526 25200 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:50.374941 25282 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:50.374506 25473 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:50.385867 25421 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:50.385897 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:50.387691 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:50.388831 18769 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:50.374159 25305 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:25:50.393460 25466 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.401s	user 0.005s	sys 0.000s
I20260709 12:25:50.409395 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:50.393218 18663 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:25:50.367666 24506 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:50.338707 24947 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:25:50.398298 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 125099us
I20260709 12:25:50.390894 19492 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:50.373605 19486 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:50.402053 18770 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:50.403157 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.412772 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.415459 18848 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:50.416914 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.465194 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:50.479964 18845 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:50.402851 25448 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:50.531729 25145 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.010s
I20260709 12:25:50.507344 24506 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:50.475183 18843 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 14.
I20260709 12:25:50.606426 24725 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.607151 24725 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.416283 25442 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:50.568616 25484 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:50.584877 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.585620 25086 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.506999 18663 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 13, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 13 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:50.589533 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.532928 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.482671 25051 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:50.530516 25310 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.014s
I20260709 12:25:50.407104 24866 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:50.500790 25287 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.000s
I20260709 12:25:50.405911 25282 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:50.636066 25282 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.635982 25287 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.489071 18771 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:50.639060 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.639782 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.640483 25287 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:50.641134 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.641955 18771 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:50.538211 25305 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.568307 25072 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:50.609794 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:50.634222 25377 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:50.614157 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:25:50.633031 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48274.7us
I20260709 12:25:50.605309 25145 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.633782 25484 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.633314 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.635247 25110 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:50.631937 25310 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.640069 18770 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
W20260709 12:25:50.569072 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 151861us
I20260709 12:25:50.651607 18663 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 15, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 15 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:50.656648 18844 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:50.656836 24725 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:50.660147 18917 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:50.645598 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.652587 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.661089 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.678133 18770 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:25:50.654465 18843 raft_consensus.cc:2376] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16. Re-sending same reply.
I20260709 12:25:50.661652 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:50.675405 18771 raft_consensus.cc:2376] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18. Re-sending same reply.
I20260709 12:25:50.689128 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.691146 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.692065 18769 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
W20260709 12:25:50.693846 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60677.5us
I20260709 12:25:50.694872 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.696096 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.659803 25310 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:50.645243 25086 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.663090 25477 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:50.699542 25477 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:50.699687 19456 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.700968 25086 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:50.700628 25477 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.701874 25477 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:50.702847 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.703927 25250 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:50.704367 25250 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:50.703296 18663 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 15, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 15 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:50.704771 25250 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:50.666612 25282 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.654831 25448 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:50.656405 25145 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:50.671219 25046 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.698921 18765 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:50.701165 25458 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:50.687844 25433 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:50.657087 25484 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:50.687059 25442 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.711901 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3015) took 1041 ms. Trace:
I20260709 12:25:50.708217 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.715642 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.721098 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.715883 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:50.645859 25305 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.652122 25377 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.720654 18840 rpcz_store.cc:276] 0709 12:25:49.670540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.671181 (+   641us) service_pool.cc:224] Handling call
0709 12:25:50.711733 (+1040552us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003499d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:50.711847 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248630144}
I20260709 12:25:50.707459 25437 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:50.707154 25145 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:50.726869 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.728889 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.733698 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.714834 25046 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.726482 25484 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:50.726472 25200 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:50.739535 25200 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:50.739998 25200 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.725327 25442 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.744839 25442 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:50.728586 24866 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:25:50.746450 24866 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:50.746850 24866 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:50.747741 25250 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.747829 24866 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.749477 24866 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:50.737042 25287 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:25:50.750772 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf32cd3655eb4943abc0cdbf54a32206 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:50.722977 25458 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:50.728852 25437 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:50.729606 25440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.009s	sys 0.014s
W20260709 12:25:50.750598 25445 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.728s	user 0.002s	sys 0.006s
I20260709 12:25:50.755487 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:50.760195 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:50.709066 24506 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.763371 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:50.764371 19486 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:50.756186 25440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.010s	sys 0.015s
I20260709 12:25:50.770098 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:50.770826 19492 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.773656 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.774770 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:50.775419 18847 raft_consensus.cc:2376] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18. Re-sending same reply.
W20260709 12:25:50.776465 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.764170 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:50.755827 25437 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.775975 18845 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:25:50.778434 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.756820 25287 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:25:50.770709 25440 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:50.791290 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.790712 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:50.795265 19492 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:50.792161 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:50.792830 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.766361 25473 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:50.796387 18845 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:50.801689 18768 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:25:50.799226 25282 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:50.799448 25287 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:50.805917 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:50.800702 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.803682 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.804378 19486 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:50.807586 18842 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:50.805512 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.800144 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:50.808789 18845 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:25:50.767096 25442 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:25:50.811520 18840 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:50.794502 25440 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:50.813786 25377 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:50.814008 25046 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:50.814170 25489 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:50.824177 25440 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.825414 25440 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.806232 25145 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:50.826718 25145 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.827185 25145 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:50.827338 25458 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.828481 25442 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:50.828900 25442 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:50.819272 25305 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:50.821012 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.831197 18765 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:50.810513 25358 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.835014 25358 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.802479 25464 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:50.801100 25473 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:50.842466 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:50.843194 18765 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
W20260709 12:25:50.840240 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48318.5us
I20260709 12:25:50.843798 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.840528 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.858243 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.806195 25287 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:50.809576 25433 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:50.863541 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.862555 18842 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:50.865859 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.866518 25046 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:50.866736 18845 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:50.867197 25046 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:50.869683 25046 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:50.875839 25338 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:50.872710 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:50.829802 25442 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:50.861848 25460 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.853s	user 0.004s	sys 0.001s
I20260709 12:25:50.862501 25473 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:50.913915 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:50.879801 25287 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:50.916707 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:50.862504 25489 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:50.917887 25046 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:50.924213 25489 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:50.998646 25358 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.017645 25442 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:51.035346 25490 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.030848 25484 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:51.039594 25490 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.042208 25490 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.050808 25358 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:51.051522 25358 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:51.052879 25493 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:51.054814 25358 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:51.056581 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.026413 25489 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:51.032029 25046 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 12:25:51.067178 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.070849 25377 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:25:51.071499 25377 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:51.091784 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 178373us
I20260709 12:25:51.092947 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:51.114331 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:51.115666 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:51.122777 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 206148us
I20260709 12:25:51.123798 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:51.131258 25145 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.045825 25200 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.128307 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:51.181929 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58228.9us
I20260709 12:25:51.216027 25145 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:51.217072 25145 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:51.221397 25145 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:51.222823 25145 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.173316 25481 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:51.072702 25377 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.134619 25437 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.226287 25250 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.228300 25123 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.230983 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:51.244763 18846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3012) took 1732 ms (client timeout 1526 ms). Trace:
W20260709 12:25:51.245380 18846 rpcz_store.cc:269] 0709 12:25:49.512653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.512786 (+   133us) service_pool.cc:224] Handling call
0709 12:25:51.244444 (+1731658us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b5400125054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:51.244657 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543234944}
I20260709 12:25:51.247007 18841 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:51.265292 18886 leader_election.cc:400] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20.
I20260709 12:25:51.254143 25377 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:25:51.293011 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74984.9us
I20260709 12:25:51.261775 25123 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:51.299943 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:51.302030 25484 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:25:51.302832 25455 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.340s	user 0.010s	sys 0.008s
I20260709 12:25:51.304899 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37870 (request call id 3) took 1591 ms. Trace:
I20260709 12:25:51.305351 18764 rpcz_store.cc:276] 0709 12:25:49.713146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.713290 (+   144us) service_pool.cc:224] Handling call
0709 12:25:51.304443 (+1591153us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b540012d020. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af08520 00007f335af85652 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6
0709 12:25:51.304816 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103951616}
I20260709 12:25:51.261392 25481 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:51.306965 25370 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:51.308756 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.304951 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1111) took 1283 ms. Trace:
I20260709 12:25:51.310107 18841 rpcz_store.cc:276] 0709 12:25:50.021948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.236562 (+214614us) service_pool.cc:224] Handling call
0709 12:25:51.246537 (+1009975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.247520 (+   983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.304742 (+ 57222us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400125050. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:51.304895 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272235264}
I20260709 12:25:51.312181 25370 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:51.301272 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:51.316886 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:51.319211 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 190999us
I20260709 12:25:51.320852 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3010) took 1819 ms. Trace:
I20260709 12:25:51.321463 18844 rpcz_store.cc:276] 0709 12:25:49.501259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.501415 (+   156us) service_pool.cc:224] Handling call
0709 12:25:49.509067 (+  7652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.683027 (+1173960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.320535 (+637508us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400205154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:51.320768 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2638741248}
I20260709 12:25:51.301024 25490 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:51.328768 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.319972 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:51.328881 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.296025 25502 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:51.333503 25503 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:51.333775 25502 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:51.334354 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.334995 25502 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.337117 25437 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.339969 25503 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:51.300899 25250 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.342760 25250 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.345605 25250 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.341452 25503 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.351902 24506 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.352569 24506 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.317209 25482 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:25:51.318341 25458 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:51.355683 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:51.319046 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:51.357069 25464 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:51.358338 25419 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:51.260664 25473 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.356130 25458 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:51.358266 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:51.330750 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:51.313215 25200 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.332621 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:51.359910 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:51.331904 18769 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:51.333827 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:51.331280 25481 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:51.367671 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:51.372779 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.374238 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:51.379364 18764 raft_consensus.cc:606] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:51.379900 18764 raft_consensus.cc:614] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:51.363341 25458 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:51.381371 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:51.381938 24506 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.366317 25426 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:51.363230 25508 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.388957 19486 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:51.364732 25482 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:51.370746 25464 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:25:51.402225 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:51.380051 25419 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.406800 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.407025 19492 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:51.406877 18769 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:25:51.408998 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.409375 19489 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:25:51.409587 18769 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:51.410986 19491 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:25:51.411936 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:51.412330 18770 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:51.412539 18767 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:51.413411 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:51.414067 18769 raft_consensus.cc:2368] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:25:51.418829 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:51.419673 19483 raft_consensus.cc:2368] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:25:51.422991 18767 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:51.393524 25426 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.396395 25282 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:51.438380 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.439189 18764 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:51.440668 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.441452 18767 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:51.450779 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.427919 25484 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:51.455235 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.374825 25370 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.456912 18769 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:51.455844 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.456955 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.448009 25426 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:51.466655 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:51.473316 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 113477us
I20260709 12:25:51.473632 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.474252 25512 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.474921 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:51.474972 25512 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.477392 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.477725 25512 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.478477 25377 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:51.478603 25305 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:51.400794 25508 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.479116 25512 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:51.479283 25498 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:51.480316 25358 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:51.480877 25508 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:51.478704 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:51.479121 25377 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.479115 25305 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:51.489125 18764 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:51.470701 25477 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.768s	user 0.003s	sys 0.012s
I20260709 12:25:51.504005 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:51.504777 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 172248us
W20260709 12:25:51.489454 25500 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:25:51.506490 18773 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:51.456023 25282 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:51.505893 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:51.501327 25508 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:51.473348 25145 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.501807 25305 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:51.502373 25370 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.500600 25473 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:51.529016 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:51.529974 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:51.538003 19487 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:51.528329 25477 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:51.571626 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:51.572355 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:51.576483 18886 leader_election.cc:400] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:25:51.525936 25442 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.580019 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.580868 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:51.586453 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 101089us
I20260709 12:25:51.565928 25464 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:51.600832 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:51.601223 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:51.588207 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:51.602260 18764 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.506490 25489 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.589862 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:51.590054 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:51.603430 19488 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:51.590492 25463 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.590739 18773 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:25:51.596349 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:51.597251 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:51.532019 25145 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.619481 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:51.598356 18843 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:25:51.566332 25508 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:51.604584 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:51.605453 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:51.628698 18913 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:51.606665 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:51.608907 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:51.630580 19491 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:51.611292 25514 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:25:51.611778 25433 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.728s	user 0.006s	sys 0.006s
W20260709 12:25:51.600154 25510 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 12:25:51.615655 25338 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.004s
I20260709 12:25:51.615978 18765 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:51.599156 25377 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:51.573773 25477 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.599830 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:51.670904 25477 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:25:51.671231 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71491.5us
I20260709 12:25:51.672024 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:51.672959 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:51.602712 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:51.617375 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:51.674816 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 72169.1us
I20260709 12:25:51.589459 18770 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:51.676316 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:51.618897 18841 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:51.679430 25490 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:51.679988 25490 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:51.680435 25490 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:51.682829 25377 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:51.623625 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:51.632751 18842 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:51.630074 18922 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:25:51.600284 25419 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:51.641294 18839 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:51.642668 18846 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:25:51.692634 18846 pending_rounds.cc:85] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 9
I20260709 12:25:51.692967 18846 pending_rounds.cc:107] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:25:51.693214 18846 raft_consensus.cc:2889] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:51.586330 25482 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:25:51.600509 25464 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.695974 25256 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:51.696393 25464 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:51.696590 25256 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:51.697139 25256 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:51.647096 25508 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.575220 25448 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
W20260709 12:25:51.648581 25496 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.650s	user 0.002s	sys 0.011s
I20260709 12:25:51.638424 25282 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.651238 25489 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:51.652694 25145 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:51.653410 18772 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 12:25:51.709583 18772 pending_rounds.cc:85] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 10
I20260709 12:25:51.705083 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:51.662998 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:51.669628 19487 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:25:51.679503 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3049) took 1617 ms. Trace:
I20260709 12:25:51.624837 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:51.686452 25458 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.687631 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:51.698889 18764 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:51.534605 25512 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:25:51.699157 18771 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:51.699525 18845 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:51.698633 25484 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:51.709973 18772 pending_rounds.cc:107] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:25:51.722338 18772 raft_consensus.cc:2889] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:51.659895 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.643586 25433 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:51.616657 25442 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:51.711253 18917 rpcz_store.cc:276] 0709 12:25:50.062517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.062663 (+   146us) service_pool.cc:224] Handling call
0709 12:25:51.679295 (+1616632us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54003539d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:51.679416 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336655616}
I20260709 12:25:51.710105 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:51.692044 25377 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:25:51.723596 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.704911 25423 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:51.720016 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:51.739781 18842 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:51.735070 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:51.743731 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:51.735818 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57647.9us
I20260709 12:25:51.754951 18843 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:51.700225 25426 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.756853 18768 raft_consensus.cc:2368] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:25:51.760200 18916 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:25:51.719648 24506 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:51.760804 18916 pending_rounds.cc:85] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 12
I20260709 12:25:51.746816 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:51.720872 25484 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.780073 18916 pending_rounds.cc:107] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:25:51.835088 18916 raft_consensus.cc:2889] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:51.812522 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.741859 25482 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:51.749590 25338 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:51.742003 25440 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:51.844601 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 97884.3us
I20260709 12:25:51.849614 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:51.749275 25463 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:51.852979 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.854524 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:51.836493 25492 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:25:51.859392 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:51.861474 18843 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:25:51.872669 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:51.875633 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:51.840736 25484 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:51.883896 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:51.889129 18842 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.882525 18843 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:51.900722 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3031) took 1124 ms. Trace:
I20260709 12:25:51.873914 25046 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:25:51.904412 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.874051 25440 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:51.928993 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:51.858847 25463 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:51.897149 25419 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:51.896749 25502 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:51.907347 25516 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.930806 25086 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:51.905139 18839 rpcz_store.cc:276] 0709 12:25:50.776436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.874502 (+ 98066us) service_pool.cc:224] Handling call
0709 12:25:50.874814 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.692218 (+817404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.900299 (+208081us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400071054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:51.900612 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762108672}
I20260709 12:25:51.953509 18848 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:51.956486 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:51.951538 25377 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.976343 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:51.977337 18840 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:51.966336 25492 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:51.953583 25463 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:51.961202 25046 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:51.994279 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 232859us
I20260709 12:25:51.968256 25528 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:51.975659 25377 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.002345 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:52.024821 19488 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:52.004333 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:51.979876 25523 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:52.006311 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 233360us
I20260709 12:25:52.022648 24725 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:52.027243 24725 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:52.034442 18839 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:51.966943 25419 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.037864 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:51.982331 25473 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.042567 18839 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:25:52.042202 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:52.032069 25521 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.043613 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:52.067063 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.067967 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.068853 18919 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:25:52.066365 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:52.074234 18917 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:52.077122 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.077776 18917 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 12.
I20260709 12:25:52.078023 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.079963 25521 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.080998 25426 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.081755 25426 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:52.082140 25426 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:52.078750 18919 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 11.
I20260709 12:25:51.969753 25502 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.086212 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:52.006755 25527 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.085870 18841 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:52.052367 25526 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:25:51.973927 25516 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.090571 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:52.094317 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:52.095172 18840 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:52.092403 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:52.045405 25358 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.043144 25534 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:52.093014 25521 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:52.128801 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 181253us
I20260709 12:25:52.101691 25442 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.147969 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:52.054816 25473 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.155234 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.155939 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:52.102624 24506 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:52.131661 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 146707us
I20260709 12:25:52.032845 25528 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.158300 18919 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.039671 25523 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.121551 25338 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:52.154695 25305 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
I20260709 12:25:52.139593 25358 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.163821 25046 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.173722 25473 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.151257 25458 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.094856 25527 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.143460 25534 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.179183 25533 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:52.180434 24506 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.181151 25530 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:52.182264 25477 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 12:25:52.144047 25441 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:25:52.268687 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:52.193328 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.202773 18770 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:52.203250 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:52.284926 18769 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:52.209081 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:52.214438 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 176626us
I20260709 12:25:52.216537 18915 raft_consensus.cc:2410] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 12:25:52.218942 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63056.5us
I20260709 12:25:52.157382 25537 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:52.249390 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.264822 19488 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:52.267058 18842 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
W20260709 12:25:52.292873 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.269466 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.183008 25442 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.080s
I20260709 12:25:52.294028 18918 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:25:52.287096 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.226040 25482 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:52.207214 25305 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.288954 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:52.298067 18843 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [14.11-16.12]
I20260709 12:25:52.299302 19483 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:25:52.300274 19483 pending_rounds.cc:85] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 13
I20260709 12:25:52.300521 19483 pending_rounds.cc:107] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:25:52.300854 19483 raft_consensus.cc:2889] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:52.215804 25536 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.285617 25530 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.161907 25426 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.276758 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.224548 25533 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:52.325978 18919 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:52.327971 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.355623 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:52.356606 19485 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:52.330196 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:25:52.354722 25481 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.979s	user 0.012s	sys 0.005s
I20260709 12:25:52.289314 25477 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.358585 25515 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:52.395370 19487 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:25:52.353232 25442 consensus_queue.cc:1243] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:25:52.309020 25542 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:52.406070 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78341.6us
I20260709 12:25:52.310851 24866 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.327414 25530 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.393607 25482 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:52.394142 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:52.381596 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104973us
I20260709 12:25:52.483676 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:52.411314 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:52.357030 25533 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.382236 25282 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:52.303411 25537 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.415304 19488 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:52.415669 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.326418 25536 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:52.473390 25490 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.005s
W20260709 12:25:52.479018 25544 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:25:52.390530 25419 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.476475 25557 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.525760 25557 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.526780 25536 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:52.527860 25256 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.830s	user 0.013s	sys 0.002s
W20260709 12:25:52.473652 25484 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.001s
I20260709 12:25:52.477116 25502 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.395042 25481 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:52.505000 19491 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:52.507225 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:52.538033 19490 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
W20260709 12:25:52.519940 25546 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 12:25:52.515508 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:52.519796 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 112605us
I20260709 12:25:52.511914 18922 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:52.362107 25559 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.169s
I20260709 12:25:52.359140 25541 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
W20260709 12:25:52.504817 25464 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.003s
I20260709 12:25:52.519131 25473 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:52.491500 25442 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:52.528100 25557 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.475476 25523 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.354355 25338 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.534433 18918 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:25:52.505000 25305 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.543725 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:52.550266 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 248170us
I20260709 12:25:52.479518 24866 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:52.536412 25503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.187s	user 0.020s	sys 0.005s
I20260709 12:25:52.529139 25482 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:52.556294 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 226198us
I20260709 12:25:52.446409 25542 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.566884 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:52.563288 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 190493us
I20260709 12:25:52.558513 18918 pending_rounds.cc:85] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 12
I20260709 12:25:52.552481 25516 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.522207 25490 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.550673 25442 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.551349 25282 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:52.560760 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.567996 25358 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.591980 25282 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:52.570815 24866 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.570571 25543 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:25:52.550881 25419 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.572234 18918 pending_rounds.cc:107] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:25:52.564867 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:52.563220 25377 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.005s
I20260709 12:25:52.536691 25256 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:52.565663 25503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.217s	user 0.020s	sys 0.006s
I20260709 12:25:52.557709 25515 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:25:52.557893 25473 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:52.543081 25484 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.587080 25442 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:52.589032 25557 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:52.590201 25490 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.597954 18841 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:52.573498 25527 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.571965 25482 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.598933 25046 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.630975 25477 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.631384 25377 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.632150 25484 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.632869 25484 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:25:52.633028 25557 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:52.633842 25377 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.567198 25523 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:52.553916 25464 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.593410 25282 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.634692 18920 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:52.640607 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75828us
I20260709 12:25:52.689273 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.634035 25484 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:52.618588 25551 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:52.614368 25485 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:52.642174 25535 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:52.621886 25537 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.634673 25559 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:52.631057 25046 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:52.609378 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48709.3us
I20260709 12:25:52.605890 18918 raft_consensus.cc:2889] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:52.672540 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:52.614764 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:52.692672 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:52.750078 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.712502 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:52.698333 25485 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:52.757048 25485 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.758977 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.760253 25046 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.711103 25541 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:52.764602 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 92180.5us
I20260709 12:25:52.766803 25503 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:52.767145 25527 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:52.768512 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:52.769858 25570 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:52.770359 25570 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.770783 25570 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.770006 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:52.771919 25533 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.772665 25503 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:52.773247 25503 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.773723 25503 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.640280 24725 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.699744 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:52.741902 25551 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.774945 19483 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:52.775058 25551 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.776754 24725 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:52.701871 25528 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.626607 25534 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.777974 25528 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.705660 25464 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.623323 25419 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.778540 25528 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:52.677389 25463 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.000s
I20260709 12:25:52.671262 25536 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:52.779734 25046 consensus_queue.cc:1175] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e2529a8cff04207bb1b07c108e16983" responder_term: 20 status { last_received { term: 19 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:52.780179 25463 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.780251 25536 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.708688 25482 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.674786 25256 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.676431 25530 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.784746 25551 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.698455 25535 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:52.788091 25535 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.788789 25536 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.790155 25530 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.790411 25485 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.791870 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:52.792835 25250 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:52.793280 25250 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.710131 25529 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:25:52.766958 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:52.793717 25250 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.794358 25567 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:52.793044 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.793728 25463 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.807410 25567 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:52.808137 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:52.809060 25377 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:52.809612 25377 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.790201 25419 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.810109 25377 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:52.814625 25567 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:52.815282 25567 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.817862 25567 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:52.819082 25551 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:52.819809 25551 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.822733 25551 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.825661 25377 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.815307 25528 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.828729 25377 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:52.835132 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.836867 25527 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:52.836294 25473 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:52.774248 25533 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:52.838764 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.840418 25566 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:52.843679 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.712966 19484 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:52.848938 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.696619 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:52.851979 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:52.852715 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:52.852596 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 156090us
I20260709 12:25:52.853468 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.864080 25503 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.697593 25484 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:52.874716 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:52.851279 25567 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:52.881547 25534 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:52.883458 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:52.875941 25377 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:52.911962 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.874814 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:52.885046 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:52.885563 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:52.923988 19487 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.886754 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:52.886777 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:52.887797 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:52.888643 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:52.925563 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:52.926375 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51662.7us
I20260709 12:25:52.888401 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:52.889209 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:52.864359 25529 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.924022 18764 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:25:52.891600 25540 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:52.935175 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:52.927584 18766 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:52.877945 25370 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 12:25:52.940879 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63138.3us
I20260709 12:25:52.942759 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:52.889233 25570 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:52.943717 19486 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:25:52.944347 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 345841us
I20260709 12:25:52.946214 24725 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:52.951887 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.953981 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.955787 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.957041 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:52.957909 18922 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:52.959122 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:52.960939 24725 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:52.965236 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:52.965915 18915 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:52.965437 18921 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:52.965965 18769 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:52.969094 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:52.979070 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67222.8us
I20260709 12:25:52.981765 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:52.935417 25515 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:52.937050 25540 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.929937 25464 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:52.997825 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:52.999230 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 315064us
I20260709 12:25:52.945729 25567 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:53.000792 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:53.014401 25540 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.988776 25338 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:52.991712 24506 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:53.023953 18886 leader_election.cc:400] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
W20260709 12:25:52.999032 25546 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:52.994897 25541 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:52.996475 25553 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:53.025723 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.020514 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2540) took 2745 ms. Trace:
I20260709 12:25:53.060087 18917 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:53.021735 25515 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:53.022261 25464 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.000456 25503 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.034667 24506 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.055531 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.042915 25571 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:25:53.022161 25543 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:25:53.045257 25338 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.079005 18918 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:53.056459 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:53.043087 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.038100 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:52.965060 25484 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.060878 18772 rpcz_store.cc:276] 0709 12:25:50.275489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.279565 (+  4076us) service_pool.cc:224] Handling call
0709 12:25:50.285198 (+  5633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.738090 (+1452892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.014871 (+1276781us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001d5954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:53.020446 (+  5575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3145745792}
I20260709 12:25:53.058743 25250 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.067721 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.067167 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.066042 25515 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.095472 18917 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:53.098067 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:53.100416 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62443us
I20260709 12:25:53.072539 25552 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:53.088250 25567 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:53.108206 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:53.108453 19487 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:53.065083 25541 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.112565 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.119362 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.120005 18772 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:53.103538 25515 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.105021 25571 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:53.111394 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.117884 25578 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:25:53.065106 25553 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.122766 25485 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:53.103590 25552 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:53.118891 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 137212us
I20260709 12:25:53.137943 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.141093 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:53.141105 18918 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.141820 19487 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:53.138818 18913 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:53.142829 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 2873) took 1548 ms. Trace:
I20260709 12:25:53.118984 25560 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:53.143402 18846 rpcz_store.cc:276] 0709 12:25:51.594308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.598503 (+  4195us) service_pool.cc:224] Handling call
0709 12:25:51.598836 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.693841 (+ 95005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.142505 (+1448664us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54003264d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:53.142737 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94240000}
I20260709 12:25:53.145045 18917 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:53.146826 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:53.147505 19487 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:53.132534 25484 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:53.106920 25442 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.149926 25560 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.160086 25560 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.162660 25540 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.167973 18915 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:53.152060 25578 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:53.150707 25570 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.176370 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.177385 18917 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:53.143839 25485 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.179734 25580 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:53.195978 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.181401 25529 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:53.192541 25559 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:53.204162 25559 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.203534 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1461) took 1588 ms. Trace:
I20260709 12:25:53.205971 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2559) took 1737 ms. Trace:
I20260709 12:25:53.205646 18916 rpcz_store.cc:276] 0709 12:25:51.615039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.616998 (+  1959us) service_pool.cc:224] Handling call
0709 12:25:51.626705 (+  9707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.835699 (+208994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.203266 (+1367567us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400181854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:53.203465 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305850752}
W20260709 12:25:53.205948 18768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2551) took 1879 ms (client timeout 1618 ms). Trace:
I20260709 12:25:53.206756 18771 rpcz_store.cc:276] 0709 12:25:51.468032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.468208 (+   176us) service_pool.cc:224] Handling call
0709 12:25:53.205757 (+1737549us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:53.205859 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508410624}
W20260709 12:25:53.207017 18768 rpcz_store.cc:269] 0709 12:25:51.326282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.327000 (+   718us) service_pool.cc:224] Handling call
0709 12:25:53.205723 (+1878723us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54002a0b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:53.205859 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898857344}
I20260709 12:25:53.210382 25464 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.211038 25442 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:53.211139 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.212014 18771 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:53.212950 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.181943 25580 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:53.211804 25533 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:53.191819 25540 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.226853 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.227752 18771 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:53.227977 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.229293 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.230160 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.230590 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.230927 18921 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:53.244555 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:53.244603 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:53.246755 18773 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:53.246781 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.252298 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.254608 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.180809 25578 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.212515 25523 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:53.258780 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.180423 25552 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.258961 25523 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.260070 25552 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:53.261606 25523 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.262717 25523 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:53.209360 24506 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.255349 18914 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:53.272006 18918 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:53.273411 18768 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:53.274871 25578 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.227370 25580 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.277966 18768 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:53.215560 25533 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:53.279420 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.226423 25338 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.286105 25588 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.290269 25588 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.236696 25559 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.305299 25596 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:53.311592 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.311939 25287 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:53.312482 18914 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:53.313508 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.314144 18917 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.315348 25553 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.321925 25485 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.293390 25588 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.327862 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.329042 18921 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:53.331161 19492 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:25:53.324508 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77811us
I20260709 12:25:53.296945 25541 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.333367 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.331975 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.324287 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:53.357379 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:53.358594 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:53.358872 18845 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:53.359647 25287 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:53.360253 25287 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:53.350586 25580 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.350558 25533 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.360925 25595 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:53.361178 25533 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:53.361671 25545 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.362298 25545 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.362974 25512 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.363237 18841 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:53.363610 25512 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.364388 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.365067 18841 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:53.365828 25512 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.352694 19487 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:53.388064 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3063) took 1321 ms. Trace:
I20260709 12:25:53.380102 18914 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:25:53.332499 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:53.333959 25588 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:53.397437 18913 rpcz_store.cc:276] 0709 12:25:52.066870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.067942 (+  1072us) service_pool.cc:224] Handling call
0709 12:25:52.068336 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.143023 (+1074687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.387782 (+244759us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000e4054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:53.387976 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2461396352}
W20260709 12:25:53.403157 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.395658 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.337365 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.368261 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1126) took 1519 ms. Trace:
I20260709 12:25:53.333355 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.361445 25595 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.380976 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3040) took 1336 ms. Trace:
I20260709 12:25:53.428381 18848 rpcz_store.cc:276] 0709 12:25:52.044394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.044542 (+   148us) service_pool.cc:224] Handling call
0709 12:25:52.044825 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:52.126285 (+ 81460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:52.126338 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:52.126436 (+    98us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:52.126496 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.380665 (+1254169us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:53.380749 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:53.380907 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183567744}
I20260709 12:25:53.371335 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.371825 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1127) took 1523 ms. Trace:
I20260709 12:25:53.430980 18847 rpcz_store.cc:276] 0709 12:25:51.848782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.848915 (+   133us) service_pool.cc:224] Handling call
0709 12:25:51.849273 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:51.904986 (+ 55713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.905045 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:52.641512 (+736467us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b2c0005b308. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:25:52.641978 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:25:52.938521 (+296543us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:53.371163 (+432642us) log.cc:844] Serialized 14 byte log entry
0709 12:25:53.371380 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.371454 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:53.371493 (+    39us) raft_consensus.cc:1685] finished
0709 12:25:53.371609 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:53.371758 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457207,"raft.queue_time_us":34408,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":60276,"spinlock_wait_cycles":91821312,"thread_start_us":296079,"threads_started":1,"wal-append.queue_time_us":353467}
I20260709 12:25:53.378989 18840 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:53.437325 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:53.390590 24866 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:53.366027 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.411460 25588 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.443627 18841 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:53.444872 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.445712 25588 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:53.333103 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.446599 25580 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.397599 18914 pending_rounds.cc:85] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 13
I20260709 12:25:53.447448 18914 pending_rounds.cc:107] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:25:53.447774 18914 raft_consensus.cc:2889] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:53.448132 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.410981 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:53.449072 18840 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:53.449707 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:53.411852 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74617.4us
I20260709 12:25:53.451047 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.451115 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.410696 25512 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:53.433928 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.397893 18842 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.454504 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.409931 18844 rpcz_store.cc:276] 0709 12:25:51.848429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.851345 (+  2916us) service_pool.cc:224] Handling call
0709 12:25:51.884100 (+ 32755us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:52.088232 (+204132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:52.088278 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:52.121968 (+ 33690us) log.cc:844] Serialized 52 byte log entry
0709 12:25:52.229102 (+107134us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:52.482143 (+253041us) log.cc:844] Serialized 14 byte log entry
0709 12:25:52.624197 (+142054us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b180005ea20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:25:53.367257 (+743060us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b180005ea20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:25:53.367553 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 12:25:53.367832 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.367921 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:53.367977 (+    56us) raft_consensus.cc:1685] finished
0709 12:25:53.367994 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:53.368185 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":765557,"prepare.queue_time_us":1146075,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":77,"raft.queue_time_us":120647,"raft.run_cpu_time_us":587,"raft.run_wall_time_us":24016,"spinlock_wait_cycles":26431104,"thread_start_us":499892,"threads_started":4,"wal-append.queue_time_us":377594}
I20260709 12:25:53.443516 25543 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.366110 25545 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.451735 18839 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:53.435865 25595 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:53.452634 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.452999 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:53.371763 25532 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:25:53.439781 18848 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:53.469444 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.469564 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:53.457897 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:53.463433 18842 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:53.464272 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:53.439889 25592 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:53.361316 25287 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.456779 18840 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:53.470667 18839 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:53.471210 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.471267 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.472049 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.472285 18840 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:53.473289 18842 raft_consensus.cc:2410] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:25:53.476114 18848 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:53.478499 24725 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:53.467213 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:53.455024 25568 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.022s	sys 0.045s
I20260709 12:25:53.481233 24725 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:53.481945 24725 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:25:53.481325 25568 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.022s	sys 0.046s
I20260709 12:25:53.482362 24725 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.483858 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.487028 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.488451 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.489267 18847 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:53.494676 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.499128 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.500500 18839 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:25:53.501648 18848 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 12:25:53.478312 25592 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.480738 25521 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:53.485939 25512 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:53.515419 18913 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:25:53.515859 18913 pending_rounds.cc:85] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 15
I20260709 12:25:53.516180 18913 pending_rounds.cc:107] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:25:53.516559 18913 raft_consensus.cc:2889] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:53.516605 24725 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.514333 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.485742 25597 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:25:53.522639 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51516.7us
I20260709 12:25:53.524271 18843 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:53.493525 25541 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:53.478216 25553 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:53.525799 18841 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:53.464859 25543 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.530223 18841 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:53.511132 25536 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:53.489625 25545 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:25:53.536952 24725 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.512072 25592 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.539106 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:53.539386 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:53.520769 25559 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:53.526988 18843 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:53.546213 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:53.547565 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:53.524873 25597 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.550007 18847 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:53.542912 25086 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.551528 25086 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.553838 25086 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.554633 18765 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.534293 25561 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:53.528517 25541 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:53.566625 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.560534 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.541877 25536 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.531628 25145 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:25:53.588967 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.592720 18917 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:53.560086 25559 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:53.556581 25597 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:53.566785 25541 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:53.597045 24725 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:25:53.578481 25312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.698s	user 0.034s	sys 0.019s
I20260709 12:25:53.575891 25536 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.604962 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.605896 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.605794 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.610987 18914 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:53.607040 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.602047 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.608425 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.606681 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.611392 18843 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:53.626561 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.626202 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.627831 18843 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 13: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:53.585458 25553 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:25:53.598743 25533 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:53.628196 18765 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:53.628403 18841 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:25:53.629896 18847 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:53.610417 25312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.738s	user 0.035s	sys 0.019s
I20260709 12:25:53.599895 25607 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.613204 18913 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:25:53.636013 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.616544 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.627683 25508 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:53.633945 25563 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.647126 25559 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.641868 25086 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:53.608150 25523 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
W20260709 12:25:53.667014 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 174224us
I20260709 12:25:53.651042 25607 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:53.665172 25596 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:25:53.655952 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.661398 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.655333 25508 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:25:53.650238 25602 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:25:53.669572 25607 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:53.654793 25515 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.006s
I20260709 12:25:53.677976 25596 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:53.678254 25515 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.629132 25533 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.679669 25508 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.680295 25512 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:53.680900 25533 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.678663 25596 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:53.682266 25596 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:53.684818 19484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1281) took 2147 ms (client timeout 2137 ms). Trace:
W20260709 12:25:53.685360 19484 rpcz_store.cc:269] 0709 12:25:51.537674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.585749 (+ 48075us) service_pool.cc:224] Handling call
0709 12:25:53.684501 (+2098752us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54005c17d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:53.684683 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518113408}
I20260709 12:25:53.611389 25532 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:25:53.687602 25561 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.688277 25561 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.691447 25440 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.691922 25543 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.693207 25523 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:53.693688 25523 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:53.694669 25523 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.693886 25536 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.697057 18767 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:53.699041 25536 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.701562 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.702498 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.702744 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.703431 18921 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:53.703747 25523 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:53.698199 25573 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.796s	user 0.001s	sys 0.001s
I20260709 12:25:53.706472 25607 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.713567 25515 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.715121 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.716629 25426 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.717129 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:53.668637 25600 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.128s	user 0.004s	sys 0.001s
I20260709 12:25:53.719208 25618 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:53.720319 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.721997 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.722704 18918 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.732604 25561 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:53.733170 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.736294 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3064) took 1669 ms. Trace:
I20260709 12:25:53.736756 18920 rpcz_store.cc:276] 0709 12:25:52.067215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.068577 (+  1362us) service_pool.cc:224] Handling call
0709 12:25:52.068897 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:52.690950 (+622053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.736043 (+1045093us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:53.736228 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300731264}
I20260709 12:25:53.742008 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.742816 18919 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
W20260709 12:25:53.743382 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82124us
I20260709 12:25:53.768172 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.769358 18840 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:53.769637 19492 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:53.770975 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:53.771561 25595 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.707541 25541 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.775705 25541 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.776937 18844 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:53.777305 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1279) took 2240 ms. Trace:
I20260709 12:25:53.778141 18845 raft_consensus.cc:2368] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23.
I20260709 12:25:53.779697 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:53.781551 25542 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:53.788779 25563 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:53.789837 25613 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:53.740025 25597 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.793265 25613 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:53.808306 19483 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:53.792439 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:53.809847 18913 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:25:53.777662 19485 rpcz_store.cc:276] 0709 12:25:51.536919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.537052 (+   133us) service_pool.cc:224] Handling call
0709 12:25:51.570179 (+ 33127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:52.360747 (+790568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.777039 (+1416292us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540079ed54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:53.777211 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797988736}
I20260709 12:25:53.748618 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:53.799693 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53975.2us
I20260709 12:25:53.798357 18918 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
W20260709 12:25:53.812354 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63880.7us
I20260709 12:25:53.820732 18847 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:53.815461 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.820744 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.824434 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.812569 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.827680 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.844764 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:53.840704 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.845829 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:53.794898 25592 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.819885 25498 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.818750 25448 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:53.817241 25423 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:53.850338 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 210026us
I20260709 12:25:53.857352 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:53.813020 25608 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:25:53.858043 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:53.797170 25607 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.818217 25502 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:25:53.849911 25542 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:53.890022 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.844651 25533 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:53.891312 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:53.892212 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.839785 25540 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:53.899832 24725 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:53.923363 24725 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.923905 24725 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:53.839367 25571 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:53.847236 25482 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:53.906742 18918 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:53.859234 25484 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:25:53.914017 24506 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:53.933051 24506 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:53.934103 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:53.935051 18919 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.855542 25312 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:53.855998 25448 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:53.926286 19485 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:53.930823 18913 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:53.859453 25552 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:25:53.889276 25561 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.875604 25580 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:25:53.950730 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.956521 18841 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:25:53.958472 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.959543 18848 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:53.922518 25515 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:53.966080 19490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 1133) took 1561 ms (client timeout 1824 ms). Trace:
I20260709 12:25:53.916869 25527 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:25:53.863844 25498 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.937682 25571 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:25:53.966607 19490 rpcz_store.cc:269] 0709 12:25:52.393650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.395744 (+  2094us) service_pool.cc:224] Handling call
0709 12:25:53.954658 (+1558914us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b5400720454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:53.954792 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122581248}
I20260709 12:25:53.969018 24506 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.886976 25423 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.931531 25482 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:53.974136 25607 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.957625 25123 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:53.975069 18847 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:53.975564 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:54.023103 18848 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.938474 25145 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:53.977681 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:54.024782 18842 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.874805 25613 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.972240 25508 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:53.979691 25200 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:53.982775 25250 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:53.984452 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:53.986744 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:53.987442 24725 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:53.988206 18738 leader_election.cc:400] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23.
I20260709 12:25:53.986301 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:54.049022 18738 leader_election.cc:403] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:54.049702 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61653.6us
I20260709 12:25:54.050688 19486 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:53.945969 25448 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.926719 25338 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:25:54.019428 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.052248 19488 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:53.939360 25596 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 12:25:54.026046 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 118644us
I20260709 12:25:54.029981 24506 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:54.054440 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:54.048882 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62235.5us
I20260709 12:25:54.014644 25527 consensus_queue.cc:1243] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:54.015527 25571 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.075840 18842 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:54.025882 25482 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:54.078874 24725 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:54.098003 18919 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
W20260709 12:25:54.079001 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 190386us
I20260709 12:25:54.091512 18839 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:54.052064 25543 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:54.043864 25123 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:53.993292 25426 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 12:25:54.098416 25559 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:25:54.096580 25563 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:25:54.110817 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:54.123034 18847 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:54.107532 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:54.014693 25464 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:25:54.126776 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.059303 25515 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:25:54.130803 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.131865 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.140277 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.132791 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.134142 18773 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:54.130692 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.137828 18848 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:54.143751 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.144434 18764 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:54.144655 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:54.147539 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.102825 25596 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:54.100226 25597 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:54.159037 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.106036 25123 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.111375 25592 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.044402 25145 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.115291 25563 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:54.160559 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1129) took 2591 ms. Trace:
I20260709 12:25:54.051331 25508 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.106849 25529 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:25:54.139374 25464 consensus_queue.cc:1243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:54.139014 25338 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:54.170415 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 159009us
I20260709 12:25:54.106600 25426 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:54.177788 18764 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:25:54.139611 25312 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:54.187393 24506 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:54.166967 18768 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:54.203497 25508 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.161077 25543 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:54.190303 19491 rpcz_store.cc:276] 0709 12:25:51.569045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.634726 (+ 65681us) service_pool.cc:224] Handling call
0709 12:25:51.635091 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:52.542900 (+907809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.160163 (+1617263us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400720bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:54.160455 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807262464}
I20260709 12:25:54.155571 25596 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.221849 25596 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.199167 25533 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:54.223284 25596 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:54.223675 25533 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.218291 18847 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:54.190140 25563 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.234081 24506 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:54.212296 25426 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.267190 25423 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:54.268748 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.270430 25312 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.268276 25571 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.298866 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:54.298836 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 163092us
W20260709 12:25:54.306725 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 93454.4us
I20260709 12:25:54.304302 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.310034 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:54.303211 25498 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:54.323004 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.324267 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.320279 25535 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.350127 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.321338 25623 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.357916 25623 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.360446 25623 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:54.361436 25623 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:54.361830 25623 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:25:54.362800 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.311383 25637 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.356259 25312 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:54.371269 19488 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:54.356974 25635 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:54.370136 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.372510 19483 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:25:54.298048 25563 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.374948 25145 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.321234 25627 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:54.309811 25426 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.332667 25642 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:25:54.383633 25426 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.386740 25440 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:54.387374 25440 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.389480 25440 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:54.375300 25563 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.392231 25595 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.392455 24866 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:54.393069 24866 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:54.374177 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.399176 25523 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:54.399673 25523 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.336479 25634 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:54.400599 25523 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.401387 25634 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.353492 25533 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:54.401947 25523 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.413012 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.402434 25533 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:54.406483 25580 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:54.406736 25441 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:54.407207 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.411581 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:54.414547 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:54.415434 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 107676us
I20260709 12:25:54.418983 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.423859 25484 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:54.424338 25484 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:54.362218 25623 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.418967 25441 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.425450 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:54.426318 19487 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:54.406203 25542 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:54.431708 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.433108 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.433885 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:25:54.416308 25533 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.401952 25634 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.409612 25482 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.442440 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:54.410033 25448 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.446311 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.447059 25571 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:54.450870 25653 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:25:54.436640 25629 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.439428 25498 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:54.438819 25648 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 12:25:54.461211 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 138285us
I20260709 12:25:54.453644 25482 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:54.457784 25626 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:54.459021 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.394151 24866 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.440187 25433 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:54.479465 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:54.463510 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.480324 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.481048 18764 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:25:54.468381 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:54.440817 25631 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:54.475553 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:54.440671 25642 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:54.463989 25610 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:54.492867 25610 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:54.465404 25448 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:54.493831 25610 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.495221 25610 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.488304 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:54.497020 25654 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.497884 25529 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:54.498250 19458 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:54.498428 25529 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.499132 25654 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:25:54.499718 25630 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.171s	user 0.004s	sys 0.000s
I20260709 12:25:54.499760 25529 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.499667 25654 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:54.503204 25654 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.504117 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:54.504976 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:54.505805 25532 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:54.505713 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.506503 25532 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.507153 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.507400 25532 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.508350 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.512389 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.513381 25627 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:54.514516 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.483449 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.519001 18767 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:54.463507 25441 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:54.483757 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.484174 25592 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:54.484550 19486 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:54.482108 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.486856 25642 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:54.488889 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.473944 25542 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.489624 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.490480 24866 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:54.444072 25423 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:25:54.490780 18842 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:54.551440 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:54.491418 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:54.552330 18917 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:54.473716 25629 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.482995 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.496940 25498 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:25:54.515614 25615 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.557s	user 0.000s	sys 0.002s
I20260709 12:25:54.486976 25653 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:54.483474 18773 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:25:54.526772 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:54.561957 18919 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:25:54.504910 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1287) took 1825 ms. Trace:
I20260709 12:25:54.529275 18764 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 21 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 12:25:54.529171 18769 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:54.529660 18916 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:54.470497 25535 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:54.563144 19489 rpcz_store.cc:276] 0709 12:25:52.679703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.682578 (+  2875us) service_pool.cc:224] Handling call
0709 12:25:53.954888 (+1272310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.955092 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:53.955123 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:53.955165 (+    42us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:25:53.955204 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.955262 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.504743 (+549481us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400720450. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:54.504849 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854877056}
I20260709 12:25:54.513193 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:54.535164 18768 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:54.536844 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.537914 18921 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 12:25:54.568141 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55035us
I20260709 12:25:54.538717 18913 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:54.543159 25523 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:25:54.571683 25563 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:54.572307 25563 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.573357 25563 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.575017 25536 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:54.575891 25536 consensus_queue.cc:1243] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:54.576617 25441 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:54.577004 25441 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.547766 25634 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.534468 25642 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.474152 25626 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:25:54.541872 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.550169 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:54.553834 18771 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:54.556382 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.557515 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.485450 25631 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:54.602535 25631 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.564440 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.606787 18769 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:54.565783 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:54.602897 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:54.610904 18914 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.566622 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:54.479571 25433 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.611936 25433 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:54.559960 25648 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:25:54.558924 25498 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:54.615300 25498 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:54.566967 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.533761 25627 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:54.578310 25541 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:54.578858 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:54.620117 25541 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.620388 19491 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:54.488045 25596 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:25:54.621358 25541 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.636897 25541 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.565392 25448 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:54.638609 25448 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:54.639817 25448 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.605885 25370 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:25:54.644809 25370 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:54.645438 25370 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:54.646826 25370 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.550985 25542 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.596786 18918 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: [14.12-18.13]
I20260709 12:25:54.615339 25648 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:54.586905 19490 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:54.591967 25634 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.650995 25433 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.651909 25448 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:54.659318 18769 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:25:54.660580 19491 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:25:54.731784 25653 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:54.681305 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.759941 18764 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.682349 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:54.683323 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 133234us
I20260709 12:25:54.684473 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:54.685277 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:54.762821 18773 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.689422 18914 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:54.764887 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:54.697643 25200 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.699092 18845 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:54.699891 18843 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:54.700264 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:54.700547 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:54.700977 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:54.701356 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:54.769034 18844 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:54.700505 25498 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.711750 18913 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:54.713591 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:54.771395 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 89125.4us
I20260709 12:25:54.773182 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:54.773584 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:54.715413 18922 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:54.717439 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:54.683593 25423 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:54.545982 25484 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.565713 25571 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:54.549503 25592 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.680754 25515 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23.
W20260709 12:25:54.744997 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:54.752533 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.577996 25441 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.672036 25631 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.766373 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:54.793076 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:54.700469 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:54.775463 18919 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:25:54.775800 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75313.6us
I20260709 12:25:54.772511 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:54.795290 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:54.778678 18921 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:54.742453 25648 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:54.799993 19492 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
I20260709 12:25:54.788105 18922 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:25:54.779152 25628 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:54.757280 25591 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:54.796180 24725 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:54.804638 18913 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:54.796898 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:54.800582 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:54.801262 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.779181 25490 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:54.816613 18768 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:54.816618 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:54.823169 18920 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:54.822314 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:54.824484 18919 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:54.826815 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.797899 25484 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.812749 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:54.798267 25482 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:54.799000 25541 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.861048 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:54.801602 25370 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.801602 18764 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:54.862113 18921 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:54.863638 18764 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:54.834249 25652 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.815882 25619 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:54.835616 25648 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.831615 25531 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:54.803866 25628 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:54.808880 25653 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:25:54.843457 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.814594 25552 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.783771 25423 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.777145 25200 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:54.861130 25656 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:25:54.804692 25643 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:54.797559 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:54.790053 25571 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.820673 25490 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:54.913167 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:54.847512 25637 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:54.919641 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 122146us
I20260709 12:25:54.791085 25626 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.932729 18914 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.934412 24725 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.936219 24725 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.862030 25541 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.909974 25628 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.821115 25591 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.958976 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:54.963438 18919 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:54.971221 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:54.933475 25623 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.011749 18921 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
W20260709 12:25:54.983680 25658 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:25:54.916499 25531 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.928676 25619 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:54.939576 25613 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:25:55.019340 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.957302 25521 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:25:54.956969 25643 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:25:54.992540 25437 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:54.983440 25490 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:54.994958 25433 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.997305 25423 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:54.998823 25498 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:54.999801 25571 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:55.000255 25200 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:55.000815 25542 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.893534 25652 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:54.924490 25588 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:55.001670 25592 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.002826 25631 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:54.925881 25653 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:55.044663 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.004753 18768 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:54.964738 25654 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:55.007174 18772 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:25:55.008906 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:55.015518 18920 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:55.015626 18914 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:55.016336 24725 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.017381 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:55.018610 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:55.025938 25632 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.711s	user 0.003s	sys 0.003s
I20260709 12:25:55.038617 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:55.040693 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:55.041975 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:55.040756 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:55.033489 25659 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.142s	user 0.000s	sys 0.004s
I20260709 12:25:55.032699 25482 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.032452 25312 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.032186 25523 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.920085 25552 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.103246 25523 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.104872 25552 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:55.000814 25642 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.053810 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.107987 18768 raft_consensus.cc:2368] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:55.109501 18772 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:55.111523 25642 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:55.113735 25663 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:25:55.122941 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:55.073796 25531 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:55.136261 24866 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.578s	user 0.017s	sys 0.010s
I20260709 12:25:55.138727 25541 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.027029 25437 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.068881 18917 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:55.075493 25498 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:55.078924 25542 raft_consensus.cc:2764] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:25:55.079670 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1134) took 1755 ms. Trace:
I20260709 12:25:55.079809 25312 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.080608 25482 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.080875 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:55.083309 18918 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:55.085717 25653 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.086726 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.170624 18770 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:55.090061 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:55.090371 25623 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.092298 25652 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:55.094210 25533 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 12:25:55.126215 25441 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:55.061272 25619 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.100124 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.102720 19490 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:25:55.139053 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf32cd3655eb4943abc0cdbf54a32206 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:25:55.188350 18656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 49364.2us
I20260709 12:25:55.054273 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:55.118052 18914 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:55.190027 18914 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:55.148017 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:25:55.191110 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 92755.9us
I20260709 12:25:55.186383 25533 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.192425 25287 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:25:55.192957 25287 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:55.193629 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:55.193845 25287 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.158994 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:55.194911 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:55.195732 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:55.196096 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:55.196873 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:55.198659 24866 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:55.200156 25652 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:55.073786 25629 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.201151 25652 consensus_queue.cc:1243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:25:55.162775 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.163549 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:55.133939 25591 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:55.162824 18846 rpcz_store.cc:276] 0709 12:25:53.323853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.323992 (+   139us) service_pool.cc:224] Handling call
0709 12:25:53.354170 (+ 30178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:53.391344 (+ 37174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:53.391390 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:54.516431 (+1125041us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b2c0005b308. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:25:54.516923 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:25:54.757109 (+240186us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:54.757149 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.758449 (+  1300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:55.079365 (+320916us) raft_consensus.cc:1685] finished
0709 12:25:55.079385 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:55.079602 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9386,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4271,"spinlock_wait_cycles":7806720,"thread_start_us":239760,"threads_started":1,"wal-append.queue_time_us":273857}
I20260709 12:25:55.161059 18773 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:55.142179 25437 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:55.185038 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.169320 18766 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 9. (term mismatch)
I20260709 12:25:55.208083 18766 pending_rounds.cc:85] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 8
I20260709 12:25:55.208357 18766 pending_rounds.cc:107] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 20.9
I20260709 12:25:55.208602 18766 raft_consensus.cc:2889] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.195034 18916 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:55.209447 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:55.209940 18769 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: [13.11-18.13]
I20260709 12:25:55.210117 18764 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:55.211058 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.203225 18886 leader_election.cc:400] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:55.214550 18886 leader_election.cc:403] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:55.214825 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:55.215372 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 134589us
I20260709 12:25:55.215508 25531 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:55.216291 25531 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:55.216888 25531 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:55.217228 25531 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:55.217583 25531 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:55.217916 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:55.218590 25338 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:55.215541 18772 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:55.219117 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:55.219331 18916 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:25:55.220026 25596 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:55.220441 25643 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:55.220618 25671 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 12. Current term is 13.
I20260709 12:25:55.220441 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:55.222007 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:55.223899 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:55.228524 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:55.230108 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:55.232100 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.234452 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:55.234637 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:55.235036 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:55.239125 18770 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:25:55.232471 25377 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.241715 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.245700 18846 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 12:25:55.184813 25502 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.248067 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:55.252234 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.233812 18764 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:25:55.187988 25536 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:55.244463 25484 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:25:55.258420 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.258828 25536 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.253590 25312 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:55.242566 25448 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:55.261536 25448 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:55.250823 25377 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.258028 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:55.262594 25448 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.241580 25633 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:55.167639 25628 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.267056 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:55.214860 25370 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 12:25:55.301592 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:55.273826 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.275640 18917 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:25:55.303579 18845 raft_consensus.cc:2368] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:25:55.303896 18844 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 19 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:25:55.219403 25338 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:25:55.237742 25654 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:55.296819 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.305953 18846 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
W20260709 12:25:55.297513 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.246433 25631 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:55.241191 25610 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:55.246114 25535 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:25:55.231781 25552 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:55.292642 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.329605 18918 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:55.299615 25633 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:55.335841 25529 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:55.333802 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 166899us
I20260709 12:25:55.336684 25529 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:55.273904 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:55.313122 25631 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.353060 25508 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.265722 25502 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.349188 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:55.360059 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 86289.4us
I20260709 12:25:55.327601 25490 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.370824 25508 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.369004 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:55.346138 25633 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:55.334776 25637 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:55.375128 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:55.368620 25535 consensus_queue.cc:1243] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:55.370407 25631 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:55.369767 25591 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:55.404592 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:55.403367 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:55.383172 25599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.024s	sys 0.027s
I20260709 12:25:55.421905 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:55.422178 18844 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:55.422298 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.423529 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:55.426187 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.431918 18841 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:55.398830 25437 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:55.416523 25599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.025s	sys 0.027s
I20260709 12:25:55.399372 25482 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:55.437487 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:55.445609 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.447407 18887 leader_election.cc:400] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:25:55.447916 18887 leader_election.cc:403] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:25:55.406677 25586 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:55.407889 25498 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:55.425772 25464 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.401141 25490 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.462572 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:55.463064 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:55.434836 25610 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:55.428411 25591 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:55.506273 18773 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:55.482833 25586 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:55.481787 18771 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:25:55.510681 18771 pending_rounds.cc:85] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 9
I20260709 12:25:55.515166 18771 pending_rounds.cc:107] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:25:55.455724 25482 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:55.442869 25437 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.515722 18771 raft_consensus.cc:2889] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.443285 25637 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:25:55.463207 25484 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:25:55.462589 25563 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:55.518496 25678 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:25:55.528560 25502 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:55.532943 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 113420us
I20260709 12:25:55.509513 25670 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:55.512370 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49882.2us
I20260709 12:25:55.536801 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:55.529292 25591 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.516644 25642 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.538877 25628 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:55.547778 25563 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:55.480760 25498 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.554140 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:25:55.550804 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 147506us
I20260709 12:25:55.577309 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:55.570947 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:25:55.548333 25681 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:25:55.543747 18773 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
W20260709 12:25:55.566978 25673 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:25:55.582082 18766 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
W20260709 12:25:55.598675 25680 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:25:55.599010 25679 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:55.599642 25679 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:55.600591 25679 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:55.610985 25677 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:25:55.633973 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63109.9us
W20260709 12:25:55.645772 25676 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:25:55.587385 25508 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.566738 25670 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.657431 25532 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:25:55.657951 25532 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:55.673473 25490 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.674147 25536 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.580585 25586 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.679471 25648 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:55.681990 25613 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.006s
I20260709 12:25:55.569872 25484 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:25:55.699291 18839 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
W20260709 12:25:55.698141 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 464374us
I20260709 12:25:55.700948 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:55.714831 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:55.716077 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.658213 25670 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:55.718595 18770 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:25:55.707945 19484 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:25:55.728777 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:55.734140 25515 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:55.700098 25521 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.723769 25426 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:55.750778 18919 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:25:55.758522 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:55.759547 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:55.760202 18919 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:55.754159 24725 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.761108 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.761049 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:55.761845 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.762729 18843 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:55.755362 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.762967 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:55.761108 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:55.768106 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:55.768594 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.769330 18919 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:55.767643 24725 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.782141 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.783531 18842 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:25:55.717571 25531 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.758373 25613 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.787981 25502 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.757918 25437 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:55.787076 25633 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.757891 25490 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:55.772336 25508 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:55.770325 24866 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:55.765151 25441 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.693329 25563 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.812170 18848 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:25:55.733361 25532 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.770037 25596 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:55.812824 18921 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:55.798336 25498 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.798985 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.785656 25686 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:55.801601 25484 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.801944 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.788295 25536 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.827135 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:55.792476 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:55.809701 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:55.815237 18770 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:55.802449 24725 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.757917 25521 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.814538 25596 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:55.820560 25484 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.812405 25540 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 12:25:55.908689 25540 consensus_queue.cc:1243] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:55.909538 25541 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:55.910004 25541 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:55.904675 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:55.888180 25695 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:25:55.910032 25484 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:55.912345 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.810708 25490 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.914098 18773 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:25:55.914289 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:55.915272 25668 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.657s	user 0.005s	sys 0.000s
I20260709 12:25:55.894070 18767 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:25:55.915863 25490 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:55.916157 18767 pending_rounds.cc:85] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 13
I20260709 12:25:55.917330 18767 pending_rounds.cc:107] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:25:55.889312 25502 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:25:55.918223 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1311) took 1225 ms. Trace:
I20260709 12:25:55.918588 25502 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:55.844403 25515 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.919106 25502 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:55.919765 25531 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:55.806573 25684 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.114s
W20260709 12:25:55.889758 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61359us
I20260709 12:25:55.925738 18772 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:55.928620 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.929529 18772 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
W20260709 12:25:55.939283 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.843852 25698 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:55.918660 19485 rpcz_store.cc:276] 0709 12:25:54.693141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.694597 (+  1456us) service_pool.cc:224] Handling call
0709 12:25:54.694927 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:54.695300 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:54.695326 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:54.736919 (+ 41593us) log.cc:844] Serialized 26 byte log entry
0709 12:25:55.047640 (+310721us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:55.047684 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:55.047768 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:55.914587 (+866819us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:25:55.917887 (+  3300us) raft_consensus.cc:1685] finished
0709 12:25:55.917913 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:55.918154 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":14183680,"thread_start_us":276924,"threads_started":1,"wal-append.queue_time_us":419121}
I20260709 12:25:55.921263 25541 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.922688 18915 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:55.956470 18773 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 12:25:55.957615 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:55.967136 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 140070us
I20260709 12:25:55.967427 18919 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:55.968613 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:55.917870 18767 raft_consensus.cc:2889] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.969378 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:55.970378 18919 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:55.973136 18919 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:55.896363 18914 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:55.889976 25696 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:25:55.976105 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:55.977208 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:55.976068 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:55.807466 25613 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.012388 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.013969 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:55.874706 25338 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.867069 25542 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.023818 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46711.3us
I20260709 12:25:56.025135 24725 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:56.030405 25552 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:55.821002 25699 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.192s
I20260709 12:25:55.821182 25536 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.033018 25633 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:56.031263 25552 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.043744 25536 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.044339 25536 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:56.044519 25552 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:56.044857 25536 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.047713 25536 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:55.975966 25683 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.014358 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:56.008555 25541 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.023702 25338 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.055912 25613 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:56.056644 25613 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:56.057014 25613 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.057344 25338 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.032502 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:56.058770 19485 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:56.008119 25619 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:55.920310 25502 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.919526 25515 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:55.921511 25508 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 12:25:55.830264 25631 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.051501 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:56.048949 25542 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:55.979700 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.018018 18914 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:56.006515 18919 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: [14.12-18.13]
I20260709 12:25:55.952597 25698 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.076252 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.079797 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.083364 19484 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:56.083189 18919 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:56.087252 18919 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:25:56.087638 18919 pending_rounds.cc:85] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 13
I20260709 12:25:56.087865 18919 pending_rounds.cc:107] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:25:56.088119 18919 raft_consensus.cc:2889] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:56.089473 18915 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:56.086942 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:56.090673 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 133198us
I20260709 12:25:56.091579 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:56.057350 25613 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:56.095173 24866 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:56.095722 24866 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.096108 24866 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.096681 25542 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:56.096827 25515 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.070008 25619 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.058209 25702 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:56.097441 25619 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.097682 25702 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.098111 25702 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:56.070753 25683 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.102589 25698 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.085736 25626 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.104020 25586 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:56.104600 25586 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.105049 25586 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:56.092644 25654 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:25:56.108340 25654 consensus_queue.cc:1243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:56.108444 25591 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:56.109231 25591 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.111773 25591 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:56.111933 25631 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:56.112634 18917 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:56.116080 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:56.082154 25498 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:56.126053 18914 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:25:56.129253 18914 pending_rounds.cc:85] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 11
I20260709 12:25:56.082357 25679 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:56.129805 18914 pending_rounds.cc:107] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:25:56.107290 25623 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:56.130227 18914 raft_consensus.cc:2889] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:56.137764 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3048) took 1107 ms. Trace:
W20260709 12:25:56.140107 18738 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.617s (SENT) [suppressed 24 similar messages]
I20260709 12:25:56.136302 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:56.138487 18914 rpcz_store.cc:276] 0709 12:25:55.029896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.117283 (+ 87387us) service_pool.cc:224] Handling call
0709 12:25:55.117859 (+   576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:55.895844 (+777985us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b5400054c20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af0906f 00007f335af81f60 00007f335af837de 00007f335af8db49 00007f335af8e416 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62
0709 12:25:56.137385 (+241541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.137685 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90729728}
I20260709 12:25:56.142270 19484 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:56.094062 25652 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:25:56.127157 25502 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:56.160244 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:56.168272 25698 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:56.168808 25698 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.169179 25698 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:56.176980 25377 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.144994 25679 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.189460 25679 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.135844 25700 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:56.140995 25623 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.205494 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:56.214330 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:56.215596 19485 raft_consensus.cc:2410] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:25:56.218612 25631 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:56.222957 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:56.133615 25498 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.210538 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:56.231761 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:56.237776 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:56.240136 18886 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:56.243692 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:56.244737 19487 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:56.252023 25682 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:56.252538 25682 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:56.253502 25682 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.248600 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:56.239935 25377 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:56.204526 25700 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.245430 25552 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:56.270797 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:56.249881 25633 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:56.247367 25670 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:56.273834 25626 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:56.283607 25508 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:56.298851 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:56.284083 25623 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:56.282274 25698 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.292825 25700 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:56.294188 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:56.309482 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.336992 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.338006 18765 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:25:56.340891 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.335114 25287 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:56.354903 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.355780 18766 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:56.328419 25682 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:56.328817 25592 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.360154 25592 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.339947 25508 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.364835 25508 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:56.296958 25633 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.372231 25633 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:56.332144 25626 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.376907 25626 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:56.377607 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:56.378829 25338 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:56.379428 25338 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.379921 25338 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:56.378825 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.384343 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.384902 24866 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.385171 18767 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:25:56.345445 25542 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:56.389164 18765 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:56.401168 18770 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:56.405968 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.410741 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:56.409194 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 269104us
W20260709 12:25:56.419543 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 205473us
W20260709 12:25:56.421664 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 182263us
I20260709 12:25:56.423676 18765 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:25:56.428054 18765 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:56.429455 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:56.430378 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.434540 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:56.392280 25702 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.397567 25619 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.440896 25682 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:56.442461 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:56.398150 25541 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:25:56.414426 25542 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.440199 25631 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.454146 25592 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.453327 25716 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:56.480813 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53178.7us
I20260709 12:25:56.463384 25686 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:25:56.476469 25498 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.468631 25631 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:56.546852 25719 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:25:56.484889 25721 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.549410 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.563458 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.564388 18766 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:56.565454 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:56.566088 18766 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:56.566772 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.567507 18772 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:25:56.568481 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.571818 25523 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:56.572875 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.574337 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.569645 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:56.592485 18916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3034) took 2026 ms (client timeout 1642 ms). Trace:
W20260709 12:25:56.592996 18916 rpcz_store.cc:269] 0709 12:25:54.566071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.566344 (+   273us) service_pool.cc:224] Handling call
0709 12:25:56.592275 (+2025931us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540008e654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:56.592408 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341585152}
I20260709 12:25:56.579488 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.595692 18915 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:25:56.596776 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.594152 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.597807 18772 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:25:56.599642 18919 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 14: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:56.601395 18922 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:56.605654 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.607782 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1181) took 1774 ms. Trace:
I20260709 12:25:56.594379 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.612334 18916 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:56.613704 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:56.614777 18916 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.546993 25631 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:56.608404 18769 rpcz_store.cc:276] 0709 12:25:54.815527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.844679 (+ 29152us) service_pool.cc:224] Handling call
0709 12:25:55.209665 (+364986us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:55.210349 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.590094 (+1379745us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540017b1d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:56.590237 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838386560}
I20260709 12:25:56.621232 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3111) took 1800 ms. Trace:
I20260709 12:25:56.620913 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.622180 18919 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:56.607539 18915 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:56.621716 18920 rpcz_store.cc:276] 0709 12:25:54.821454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.146909 (+325455us) service_pool.cc:224] Handling call
0709 12:25:55.147479 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:55.222040 (+ 74561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:55.222089 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:55.236453 (+ 14364us) log.cc:844] Serialized 26 byte log entry
0709 12:25:55.435481 (+199028us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:55.435523 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.594952 (+1159429us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b54000e3b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:56.595008 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:56.595062 (+    54us) raft_consensus.cc:1685] finished
0709 12:25:56.595076 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:56.621160 (+ 26084us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3972,"raft.queue_time_us":6052,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5562,"spinlock_wait_cycles":170443136,"thread_start_us":139049,"threads_started":1,"wal-append.queue_time_us":418400}
I20260709 12:25:56.658885 18916 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:56.672425 18739 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:56.673511 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:56.672434 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 186970us
I20260709 12:25:56.681564 18920 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:25:56.683486 18920 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:56.683981 18916 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:25:56.685187 18916 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:56.679664 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:56.688747 18913 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 13.
I20260709 12:25:56.674296 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:56.694077 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:56.681301 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:56.556008 25498 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.574556 25732 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.585562 25542 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.695243 25592 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:56.714838 25592 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:56.715317 25592 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:56.596763 25613 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.720765 25613 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.726323 25731 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:56.726723 25736 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:56.727180 18842 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:56.727305 25731 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.729004 25741 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:56.729672 25741 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.732236 25741 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:56.732831 25741 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.751253 18766 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:56.755321 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1489) took 1607 ms. Trace:
I20260709 12:25:56.755831 18918 rpcz_store.cc:276] 0709 12:25:55.148404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.207382 (+ 58978us) service_pool.cc:224] Handling call
0709 12:25:55.207770 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:55.330241 (+122471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.754880 (+1424639us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540027ced4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:56.755235 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279569152}
I20260709 12:25:56.695286 25716 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:56.696609 25631 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.695297 25727 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.698760 25541 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:56.550316 25721 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.761619 25629 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:56.792415 19458 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:56.767288 25716 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:56.710213 25498 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.797889 25623 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.806694 25735 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:56.758172 25741 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.779498 25541 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.833590 18918 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:56.846912 25734 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:56.848637 25729 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:56.849150 25729 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:56.850641 25729 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.854075 18919 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: [14.12-18.13]
W20260709 12:25:56.861521 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:56.803158 25586 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.697s	user 0.015s	sys 0.000s
I20260709 12:25:56.737058 25732 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.787192 25629 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:56.796430 25619 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:56.799575 25702 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:56.874871 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.780385 25631 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.811277 25716 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.863454 25541 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.781878 25727 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.869279 25738 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:56.957553 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:56.957970 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:56.967868 18918 raft_consensus.cc:2376] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18. Re-sending same reply.
W20260709 12:25:56.970948 25287 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.000s
I20260709 12:25:56.971553 25287 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:56.943719 25702 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.862609 25623 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:56.873422 25586 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:56.996186 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:56.942493 25735 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
W20260709 12:25:56.993114 25338 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.613s	user 0.015s	sys 0.000s
I20260709 12:25:56.972507 25714 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:57.006256 25633 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.631s	user 0.014s	sys 0.000s
I20260709 12:25:56.973604 25731 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:56.995707 25743 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:56.969210 25542 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:25:57.017249 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.002997 25740 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:57.030498 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.060564 18918 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:57.025822 25714 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.003273 25702 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:57.066910 19456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.037s
W20260709 12:25:57.067343 19456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.002s	sys 0.037s
I20260709 12:25:57.019141 25338 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.028888 25490 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:56.974174 25738 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.028829 25744 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:57.066730 25714 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:57.009985 25629 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.029183 25633 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.056686 25743 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:57.108515 25737 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:25:57.124402 18918 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:57.112128 25629 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:57.127956 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.128804 18918 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:57.078758 25490 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.131044 25535 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.131675 25535 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.132004 25338 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:25:57.133195 25745 consensus_queue.cc:1175] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 19 status { last_received { term: 19 index: 13 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: [14.12-18.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:57.133932 25535 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.136883 25750 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.137727 25750 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:57.141672 25733 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:25:57.143128 25724 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:25:57.144856 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3129) took 1032 ms. Trace:
I20260709 12:25:57.145423 18914 rpcz_store.cc:276] 0709 12:25:56.112239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.143281 (+ 31042us) service_pool.cc:224] Handling call
0709 12:25:56.143822 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.144442 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.144490 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:56.196334 (+ 51844us) log.cc:844] Serialized 26 byte log entry
0709 12:25:56.447879 (+251545us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:56.447966 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.448089 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.144578 (+696489us) raft_consensus.cc:1685] finished
0709 12:25:57.144598 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.144774 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1737,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3919,"thread_start_us":199555,"threads_started":1,"wal-append.queue_time_us":708068}
I20260709 12:25:57.150791 25727 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.152473 25702 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.153606 25586 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.165706 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:57.166486 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.167006 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:25:57.118474 25739 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:25:57.168830 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:57.170722 18914 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:57.163781 25755 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.066339 25740 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.081765 25744 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:57.257607 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.126092 25721 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.133255 25490 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.173911 25648 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:57.273658 18914 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
W20260709 12:25:57.287753 25592 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.572s	user 0.013s	sys 0.000s
I20260709 12:25:57.288268 25592 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.289031 25484 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:57.289866 25484 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:57.291144 25484 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.253937 25756 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:57.172147 25533 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.175076 25631 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.202556 25732 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.263474 25586 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:57.275796 25750 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.264719 25702 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:57.279670 25623 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.279906 25648 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.225124 25736 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:57.319716 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:57.321834 18914 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:57.306006 25751 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:57.274279 25755 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.339396 25752 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:57.339146 25623 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:57.343086 18914 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:57.319931 25648 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:57.310762 25586 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:57.343640 25746 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:25:57.340210 25623 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:57.355892 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 102346us
I20260709 12:25:57.317384 25702 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.359141 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:57.340140 25752 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.321218 25592 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.364387 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:57.347937 25747 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:57.365403 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.366688 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.353556 25738 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.367751 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.374786 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:57.375272 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:57.375514 19488 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:25:57.376140 19483 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:57.380245 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:57.381258 19484 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:57.382546 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:57.383795 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3084) took 1268 ms. Trace:
I20260709 12:25:57.384208 18842 rpcz_store.cc:276] 0709 12:25:56.115483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.115694 (+   211us) service_pool.cc:224] Handling call
0709 12:25:57.383539 (+1267845us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400206054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:57.383728 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402989440}
W20260709 12:25:57.385279 25754 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:25:57.363525 25694 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.219s
W20260709 12:25:57.393170 25749 log.cc:927] Time spent T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:25:57.394420 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1501) took 1200 ms. Trace:
I20260709 12:25:57.394888 25750 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:57.395576 25750 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:57.394316 25692 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:57.396581 25750 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.399973 25752 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.401302 25758 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:57.405795 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2608) took 2837 ms. Trace:
I20260709 12:25:57.370854 25633 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.338641 25751 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.384300 25757 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:57.407898 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3050) took 1587 ms. Trace:
I20260709 12:25:57.408222 25757 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:57.408313 18922 rpcz_store.cc:276] 0709 12:25:55.820059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.013934 (+193875us) service_pool.cc:224] Handling call
0709 12:25:56.592445 (+578511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:56.601945 (+  9500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.407680 (+805735us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b540008e650. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:57.407833 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329732352}
I20260709 12:25:57.410154 25586 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.370136 25533 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:57.406235 18771 rpcz_store.cc:276] 0709 12:25:54.569561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.599052 (+ 29491us) service_pool.cc:224] Handling call
0709 12:25:54.599459 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:55.531612 (+932153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.405523 (+1873911us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54000aebd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:57.405728 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027996544}
I20260709 12:25:57.411223 25533 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:57.411660 25533 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:57.414671 25746 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:25:57.417896 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.420269 25702 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.370360 25747 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.422554 25542 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.423177 25542 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.424312 25559 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.424993 25559 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.425637 25542 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.428076 25542 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.429615 25542 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.431454 18922 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:57.432675 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.432972 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.428169 25559 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.433617 18922 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:57.468026 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:57.469110 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.417789 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1143) took 2364 ms. Trace:
I20260709 12:25:57.435650 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.446678 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:57.470384 18840 rpcz_store.cc:276] 0709 12:25:55.053019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.053235 (+   216us) service_pool.cc:224] Handling call
0709 12:25:55.053800 (+   565us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:55.059357 (+  5557us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:55.164570 (+105213us) log.cc:844] Serialized 14 byte log entry
0709 12:25:56.589484 (+1424914us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b1800430120. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:25:56.814763 (+225279us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:56.874231 (+ 59468us) log.cc:844] Serialized 78 byte log entry
0709 12:25:56.874460 (+   229us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:57.023400 (+148940us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.024731 (+  1331us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.026508 (+  1777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.051209 (+ 24701us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.417432 (+366223us) raft_consensus.cc:1685] finished
0709 12:25:57.417465 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.417698 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32141,"prepare.queue_time_us":502242,"prepare.run_cpu_time_us":165,"prepare.run_wall_time_us":38535,"raft.queue_time_us":9607,"raft.run_cpu_time_us":12080,"raft.run_wall_time_us":76703,"spinlock_wait_cycles":92194304,"thread_start_us":371936,"threads_started":2,"wal-append.queue_time_us":1814257}
I20260709 12:25:57.474015 18773 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:57.433964 18766 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:57.438097 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.440369 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.477553 18771 raft_consensus.cc:2410] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:57.437160 18919 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:57.423573 25747 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.471612 25743 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.394956 18915 rpcz_store.cc:276] 0709 12:25:56.193612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.681416 (+487804us) service_pool.cc:224] Handling call
0709 12:25:56.681747 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.778245 (+ 96498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.778505 (+   260us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:56.779093 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:25:56.998017 (+218924us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:56.998083 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.998189 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.394142 (+395953us) raft_consensus.cc:1685] finished
0709 12:25:57.394165 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.394330 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18363,"raft.queue_time_us":262170,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":13469,"thread_start_us":295389,"threads_started":2,"wal-append.queue_time_us":315033}
I20260709 12:25:57.382269 25698 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.481019 25623 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.482306 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3120) took 1732 ms. Trace:
I20260709 12:25:57.482749 18917 rpcz_store.cc:276] 0709 12:25:55.750170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.750315 (+   145us) service_pool.cc:224] Handling call
0709 12:25:57.482082 (+1731767us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54000348d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:57.482238 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812464384}
I20260709 12:25:57.354761 25541 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.409868 25757 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.401815 25744 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.428403 25529 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.498425 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:57.499440 18769 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:57.498054 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:57.510460 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56741.4us
I20260709 12:25:57.511802 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.516455 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.518854 18919 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:57.523366 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.527494 19483 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:25:57.532027 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.536217 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1173) took 2099 ms. Trace:
I20260709 12:25:57.536713 19492 rpcz_store.cc:276] 0709 12:25:55.437135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.437307 (+   172us) service_pool.cc:224] Handling call
0709 12:25:55.437654 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.158113 (+1720459us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b180044cd40. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af83bfb 00007f335af8e64b
0709 12:25:57.158289 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.158325 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.158954 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 12:25:57.304880 (+145926us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:57.304936 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.305111 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.523142 (+218031us) raft_consensus.cc:1685] finished
0709 12:25:57.523165 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.536127 (+ 12962us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8337,"raft.queue_time_us":107273,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4864,"spinlock_wait_cycles":30799616,"thread_start_us":263756,"threads_started":2,"wal-append.queue_time_us":199168}
I20260709 12:25:57.551690 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.552501 18766 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:25:57.559126 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.560714 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.562577 18766 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:25:57.563684 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:57.564447 18915 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:57.566272 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.567538 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:57.568013 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.568676 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.501227 25727 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:57.499611 25287 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:57.501175 25542 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.586881 25287 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.572109 18914 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:57.523552 25743 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.587965 19485 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:25:57.588302 25743 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.588429 19485 pending_rounds.cc:85] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 12
I20260709 12:25:57.590157 19485 pending_rounds.cc:107] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:25:57.569854 25633 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:57.559514 25670 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.044s	sys 0.044s
I20260709 12:25:57.578382 25748 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.579061 25484 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.591001 25633 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.523808 25702 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:57.591006 25670 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.045s	sys 0.045s
I20260709 12:25:57.592155 25702 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.593673 25633 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.579689 25755 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.590502 19485 raft_consensus.cc:2889] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:57.591315 25748 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.596546 25702 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.596571 25748 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.502956 25529 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.597873 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.598842 24866 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.599520 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:57.608325 19492 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:57.603943 25741 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.604226 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:57.562690 25723 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:25:57.605443 25498 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.605301 25727 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.552229 25744 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:57.562594 25747 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.573611 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:57.625051 18919 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:57.626093 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.635015 18914 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:57.636363 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:57.636555 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.591641 25484 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.622867 25744 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.590931 25743 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.607426 25287 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.638581 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:57.619488 25502 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.450s	user 0.012s	sys 0.004s
I20260709 12:25:57.623548 25741 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:57.647993 25716 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.702s	user 0.015s	sys 0.000s
I20260709 12:25:57.622511 25755 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:57.628526 25626 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:57.620242 25533 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.627667 25748 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:57.655547 25744 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:57.659842 25651 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:57.663084 25619 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.627305 25747 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.671730 25755 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.685389 25727 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.688166 25441 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:57.673229 25748 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.694919 25441 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:57.696111 25729 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:57.697034 25748 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.696337 25441 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.670446 25741 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.698077 25441 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:57.699452 25596 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.699862 25648 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.700613 25596 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:57.683877 25529 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.669185 25716 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.692922 25619 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.685503 25751 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.680999 25651 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.706759 25651 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:57.691990 25484 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.707535 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1176) took 1494 ms. Trace:
I20260709 12:25:57.682946 25533 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:57.678460 25714 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.002s
I20260709 12:25:57.709843 25714 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.713281 25567 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:57.713913 25567 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:57.695152 25532 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:57.715036 25567 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.716526 25567 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:57.702176 25648 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.707955 19486 rpcz_store.cc:276] 0709 12:25:56.213261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.213457 (+   196us) service_pool.cc:224] Handling call
0709 12:25:56.217033 (+  3576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:56.248986 (+ 31953us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:56.443435 (+194449us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.705802 (+1262367us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b180042a780. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287
0709 12:25:57.705911 (+   109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:57.705960 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:57.706007 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.707272 (+  1265us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b5400216bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:57.707322 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.707467 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8659,"prepare.queue_time_us":289136,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":4415,"raft.queue_time_us":243905,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":133,"spinlock_wait_cycles":75723008,"thread_start_us":267281,"threads_started":3,"wal-append.queue_time_us":552007}
I20260709 12:25:57.723806 25716 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.726696 25541 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.726989 25626 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.727521 25626 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:57.733506 25741 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.733642 25747 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.736835 25521 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.737875 25683 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.742278 25740 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:57.744685 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:57.745721 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.746703 25734 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.747274 25734 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.749439 25734 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.750118 25714 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.751919 25563 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:57.752066 25626 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.754354 25626 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.768306 25619 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:57.765946 25735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.015s	sys 0.020s
W20260709 12:25:57.770594 25735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.015s	sys 0.020s
I20260709 12:25:57.771783 25742 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:57.772176 25742 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:57.773129 25742 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.16, Last appended by leader: 16, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.774274 25742 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:57.754164 25744 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.778517 25686 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.758652 25648 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:25:57.779114 25686 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.782440 25686 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.782502 25744 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:57.755275 25755 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:57.768998 25651 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.788609 25651 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.831991 18767 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:25:57.836180 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.836274 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.837177 18764 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:57.838214 18769 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:25:57.838735 18765 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:25:57.839421 18768 raft_consensus.cc:2410] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 20 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:25:57.841025 18773 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
W20260709 12:25:57.843797 18770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2621) took 1506 ms (client timeout 1534 ms). Trace:
W20260709 12:25:57.844534 18770 rpcz_store.cc:269] 0709 12:25:56.337411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.338074 (+   663us) service_pool.cc:224] Handling call
0709 12:25:57.843153 (+1505079us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b540002d354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:57.843513 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129630464}
I20260709 12:25:57.847340 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3132) took 1419 ms. Trace:
I20260709 12:25:57.848085 18765 rpcz_store.cc:276] 0709 12:25:56.428214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.429125 (+   911us) service_pool.cc:224] Handling call
0709 12:25:57.846951 (+1417826us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540029dbd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:57.847244 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3222888704}
W20260709 12:25:57.849223 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.851394 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:57.856439 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.858760 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:57.860060 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 2925) took 3370 ms (client timeout 1617 ms). Trace:
I20260709 12:25:57.860916 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.861686 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.862124 18842 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:25:57.860086 18840 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:25:57.863339 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:57.860613 18839 rpcz_store.cc:269] 0709 12:25:54.489172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.491147 (+  1975us) service_pool.cc:224] Handling call
0709 12:25:57.859579 (+3368432us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003bd154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:25:57.859818 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2637245184}
I20260709 12:25:57.864253 18841 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:57.864594 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:57.864959 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.865365 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.866482 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.866640 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:57.867805 18842 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:57.870613 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.871721 18766 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:57.880569 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.881724 18771 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:25:57.861924 18843 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:57.883913 18843 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:57.884196 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.885080 18767 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:57.886535 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.864260 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:57.887997 18843 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 12:25:57.866194 18841 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:57.903282 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.904431 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.904783 18848 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:57.905224 18765 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:25:57.895401 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.907258 18844 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:57.898005 18845 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:57.903541 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:57.906009 18846 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:57.911809 18771 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:57.896672 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:57.932122 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.939079 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.943554 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.945099 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:25:57.644259 18919 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:57.950732 18917 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:57.951152 18914 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:57.951270 18922 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:57.934019 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:57.968079 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:57.970144 18842 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:57.975163 25532 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:57.975625 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1495) took 2613 ms. Trace:
I20260709 12:25:57.975920 25532 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:57.976123 18921 rpcz_store.cc:276] 0709 12:25:55.362659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.362981 (+   322us) service_pool.cc:224] Handling call
0709 12:25:55.379579 (+ 16598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:55.813296 (+433717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.974938 (+2161642us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54000f6254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:57.975387 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995874048}
I20260709 12:25:57.978799 25716 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.979609 25716 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.982875 25541 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:57.983086 25521 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:57.983932 25541 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:57.985451 25521 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:57.988803 25596 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:57.990015 25596 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.990782 25563 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.991454 25563 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.992985 25596 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:57.993816 25596 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:57.994732 25523 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:57.995756 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3063) took 1424 ms. Trace:
I20260709 12:25:57.995523 25523 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:57.996253 18913 rpcz_store.cc:276] 0709 12:25:56.571153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.689711 (+118558us) service_pool.cc:224] Handling call
0709 12:25:56.741159 (+ 51448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.062570 (+321411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.062604 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.063104 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:25:57.119479 (+ 56375us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:57.119533 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.994721 (+875188us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400334854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:25:57.994800 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.994877 (+    77us) raft_consensus.cc:1685] finished
0709 12:25:57.994896 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.995399 (+   503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71691,"raft.queue_time_us":191331,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":135,"spinlock_wait_cycles":305365248,"thread_start_us":172401,"threads_started":2,"wal-append.queue_time_us":232870}
I20260709 12:25:57.998670 25490 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:57.998765 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:57.999574 25490 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.000789 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:58.001761 18768 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:25:57.994094 25563 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.004827 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:58.014846 25631 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:58.015725 25508 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:58.014276 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:58.009256 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:58.016673 18846 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:58.015167 25531 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.986323 25521 raft_consensus.cc:2764] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:25:58.014295 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:57.977479 25532 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.002732 25426 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.031047 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:58.003154 25523 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.004398 25490 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.007184 25596 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:58.014880 25619 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:58.015756 25631 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.010067 25716 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.036867 25426 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.039189 25508 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.033003 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:58.043242 25596 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.043977 25684 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.076745 18771 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:58.050866 25683 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:58.057353 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:58.059077 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 125371us
I20260709 12:25:58.059429 25755 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:58.060577 25541 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.064407 18666 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 14 to 16, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 16 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.030191 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:58.038059 18770 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:58.083204 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:58.084892 18842 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:58.012240 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67288.9us
I20260709 12:25:58.044531 18764 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:25:58.078411 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:58.081552 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:58.091827 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:58.093551 18765 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:25:58.039669 25619 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:58.106724 25619 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:58.112473 18845 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:58.081120 25684 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:58.114540 18772 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.007s	sys 0.025s
W20260709 12:25:58.115046 18772 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.007s	sys 0.025s
I20260709 12:25:58.116510 25654 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.117404 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.117303 25654 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.076377 25631 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:58.118469 18916 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:58.097585 25531 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.120353 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:58.121564 25531 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:58.098673 18773 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:25:58.122577 25714 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:25:58.099184 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:58.139065 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 126753us
I20260709 12:25:58.124790 25441 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:58.122586 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.140399 25441 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.141153 18919 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:25:58.143160 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:58.144100 25508 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.144286 19490 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:25:58.149892 18773 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:25:58.140430 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:58.125869 25426 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.116523 25684 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.124848 24866 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:58.123129 25742 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.166311 25755 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:58.126365 25683 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.208514 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:58.209008 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76800.1us
I20260709 12:25:58.194725 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:58.177692 18766 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:58.178959 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:58.211687 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:58.220821 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:58.176506 18768 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:25:58.172544 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:25:58.224731 18764 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:25:58.235916 18842 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:25:58.192044 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51864.7us
I20260709 12:25:58.246774 18917 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:25:58.192637 25426 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:25:58.250749 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 161495us
I20260709 12:25:58.188902 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:58.238500 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:58.250914 25426 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.259179 25426 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:58.268045 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.250828 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:58.284361 25771 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:25:58.287817 25744 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:25:58.288499 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.288599 25744 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:58.289314 25744 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:58.238794 24866 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.292109 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:58.284457 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:58.298168 18764 raft_consensus.cc:606] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:58.298696 18764 raft_consensus.cc:614] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:58.300860 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:58.301816 18768 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:58.296252 18848 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
W20260709 12:25:58.313838 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63645.6us
W20260709 12:25:58.316413 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.324738 18846 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:58.322808 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:58.337314 25426 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:58.338548 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44634.5us
W20260709 12:25:58.339125 25782 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:25:58.343163 25755 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.346215 25684 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:25:58.346946 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 113919us
W20260709 12:25:58.354628 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.306694 25532 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:58.247280 25742 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:58.376406 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57552.6us
I20260709 12:25:58.375128 18770 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:25:58.358026 19490 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:25:58.389385 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:25:58.382977 25786 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 12:25:58.372901 25532 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.404295 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:58.413034 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:58.419687 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:58.413736 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:58.421993 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:58.422972 18915 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.858s	user 0.007s	sys 0.011s
I20260709 12:25:58.423113 25426 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.424337 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:25:58.377370 25684 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.409333 25532 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:58.423362 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:58.423461 18915 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:25:58.446779 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:25:58.447572 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54118.3us
I20260709 12:25:58.446547 19492 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:25:58.447561 19486 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:25:58.449580 19490 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:58.451741 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:58.452150 25651 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:58.452481 18766 raft_consensus.cc:606] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:58.452814 25651 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.452970 18766 raft_consensus.cc:614] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:58.453439 25651 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:58.458746 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:58.458746 25626 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:58.459722 25626 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.460335 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:58.461370 25531 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:58.461787 25531 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.462133 25531 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:58.462294 25752 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:25:58.467432 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:58.462152 25626 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:58.469369 25626 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:58.469847 25626 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:58.470299 25626 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:58.474979 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:58.476981 25651 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.480551 25729 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:58.484522 25729 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.485018 25729 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:58.486656 25740 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:58.487262 25740 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.487758 25740 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:58.490357 25683 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:25:58.491861 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:58.499073 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47826.2us
I20260709 12:25:58.568701 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:58.569731 25683 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.575765 25683 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.578071 25683 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.578756 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:58.581713 25654 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.584594 24866 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.587159 25521 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:58.588199 25752 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:58.588975 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:58.598686 19486 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
W20260709 12:25:58.606034 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 76188.4us
I20260709 12:25:58.609268 25752 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:58.613693 25752 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:58.612391 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.619014 18917 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:58.620252 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:58.609733 18766 raft_consensus.cc:606] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:58.621646 18766 raft_consensus.cc:614] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:58.627297 18768 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:58.611681 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:58.651125 19490 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:58.612849 25654 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:25:58.657876 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46487.2us
I20260709 12:25:58.660702 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:58.674628 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:58.675730 18915 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 14: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:58.676939 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.657152 25654 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:58.631969 25631 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:58.689560 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 77985.6us
I20260709 12:25:58.691934 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.691954 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.692524 25688 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:58.693017 18916 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:58.694746 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.695740 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.696794 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.699641 25441 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.711086 25654 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.712642 25684 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.713048 25531 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:58.718994 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 89322.9us
W20260709 12:25:58.732246 25619 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.625s	user 0.021s	sys 0.000s
I20260709 12:25:58.722316 25742 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:58.732415 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:25:58.721065 18922 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:25:58.733289 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:58.738934 18773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:58.742120 18773 raft_consensus.cc:606] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:58.742661 18773 raft_consensus.cc:614] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:58.736543 18918 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
W20260709 12:25:58.740028 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 279796us
W20260709 12:25:58.745540 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57986.4us
W20260709 12:25:58.746209 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 269922us
I20260709 12:25:58.737092 18920 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:25:58.750669 18914 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:58.750669 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.753217 18921 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:58.765236 18915 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:58.760326 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:58.771548 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.776991 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.773967 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:58.782608 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.746680 25619 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:58.786046 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 318794us
I20260709 12:25:58.760226 24866 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:25:58.807528 25531 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.827036 25531 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.827746 25531 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.790238 25521 raft_consensus.cc:2764] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:25:58.809370 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 88677.4us
I20260709 12:25:58.832294 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:58.833623 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:58.811218 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:58.815474 25532 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.822695 25654 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:58.836876 18773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:25:58.844753 18773 raft_consensus.cc:606] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:58.845383 18773 raft_consensus.cc:614] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:58.835177 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:58.846928 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:58.786258 25596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.019s	sys 0.026s
I20260709 12:25:58.841331 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:58.855010 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.860805 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:25:58.857681 25596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.020s	sys 0.026s
I20260709 12:25:58.852923 25531 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.862157 25426 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:25:58.861549 25714 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:58.880334 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.887425 18920 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:25:58.899979 25729 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.902516 25699 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:58.903043 25699 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.903461 25699 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:58.903873 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:58.904918 18914 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:25:58.906024 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:25:58.906019 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 486395us
I20260709 12:25:58.881239 25426 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.879549 25742 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:58.882452 18917 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
W20260709 12:25:58.920684 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 109594us
I20260709 12:25:58.891198 25596 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:58.927381 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:58.890431 25651 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:58.890740 25631 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.931646 25532 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.908798 25714 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:58.928444 25619 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:58.906582 24866 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:58.920260 25729 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.934279 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:58.943075 25596 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.949076 18916 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:25:58.941202 18915 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:25:58.923007 25531 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:58.924495 25426 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:25:58.880363 25752 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.903481 25626 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:58.942519 25742 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:58.972080 25596 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:58.973202 25531 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:59.011998 25531 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.014532 18666 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 10 to 14, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 14 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.019361 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:59.020258 18916 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:59.020067 18666 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 10 to 13, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 13 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.000720 25626 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:58.973476 25683 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:59.007547 25740 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.010s
I20260709 12:25:58.996770 25532 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:59.015887 25752 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:58.976397 25631 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:25:59.022806 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 88649.1us
I20260709 12:25:58.977470 24866 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:59.000118 25714 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:58.956668 25508 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 12:25:59.034159 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:59.072156 18738 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.617s (SENT)
I20260709 12:25:59.079479 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:59.087234 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.088616 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.092151 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.038959 25683 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.045585 25740 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.069469 25631 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.116448 24866 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.118553 25742 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.127048 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:59.094082 25532 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:59.084462 25441 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 12:25:59.132707 25744 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.843s	user 0.003s	sys 0.016s
I20260709 12:25:59.162468 18919 raft_consensus.cc:2368] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18.
W20260709 12:25:59.141987 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 375199us
I20260709 12:25:59.167383 18886 leader_election.cc:400] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:25:59.167728 18886 leader_election.cc:403] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:25:59.168830 25796 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:59.169524 25796 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:59.170485 25795 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:25:59.168787 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.172974 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.173995 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.174908 25626 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:59.175431 25626 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.174728 25795 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:59.175833 25626 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.176208 25795 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:59.177510 25795 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.180115 25683 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.131038 25752 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
W20260709 12:25:59.182719 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 142304us
I20260709 12:25:59.170678 25797 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:25:59.163290 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:59.140798 25532 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.138644 25799 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:59.138048 25426 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.200695 25531 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.202692 18920 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:25:59.187077 25683 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:59.191084 25532 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.140094 25699 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:59.216859 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 326550us
I20260709 12:25:59.185125 25744 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.239171 25531 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:59.170537 25796 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.227599 25631 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:59.253575 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1202) took 1111 ms. Trace:
I20260709 12:25:59.254750 18913 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:25:59.208302 25797 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.234107 25755 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:59.244311 25683 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:25:59.261108 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:59.268838 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.255548 25688 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:59.213824 25799 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.274081 25735 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.276628 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:59.277555 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:59.278813 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:59.279515 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:59.292837 18768 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:59.280441 25596 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.281538 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:59.286067 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 315262us
I20260709 12:25:59.264577 25683 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:59.296810 18765 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:59.300820 18766 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:25:59.271360 25755 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:59.312077 18773 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:59.314430 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 531293us
I20260709 12:25:59.298197 25740 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:59.303043 25683 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.321648 25596 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:59.352954 25651 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.353451 25797 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.353806 25699 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:59.353663 25651 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.356154 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.356503 25651 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.356976 18913 raft_consensus.cc:2368] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16.
I20260709 12:25:59.359539 19458 leader_election.cc:400] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16.
I20260709 12:25:59.359905 19458 leader_election.cc:403] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:59.361135 25751 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:59.356544 25626 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.345870 25729 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:25:59.367543 25729 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:25:59.367957 25729 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:59.368983 25729 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.366959 25626 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:59.329882 18768 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:59.330734 18666 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.239723 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:59.332734 25809 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:59.334739 25815 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:25:59.337659 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:25:59.338441 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 497218us
W20260709 12:25:59.374558 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 282482us
I20260709 12:25:59.382766 18767 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
W20260709 12:25:59.383424 18737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.008s
W20260709 12:25:59.383823 18737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.008s	sys 0.008s
W20260709 12:25:59.384161 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 523432us
I20260709 12:25:59.377990 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.342592 25532 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.344153 25755 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.381172 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.254186 18771 rpcz_store.cc:276] 0709 12:25:58.136850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.147723 (+ 10873us) service_pool.cc:224] Handling call
0709 12:25:58.168439 (+ 20716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.229921 (+ 61482us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:58.539102 (+309181us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.245882 (+706780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:59.245940 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:59.245993 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.248012 (+  2019us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.248192 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16203,"prepare.queue_time_us":120917,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":23987,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":18260,"spinlock_wait_cycles":1894784,"thread_start_us":902140,"threads_started":3,"wal-append.queue_time_us":515761}
I20260709 12:25:59.384963 18920 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
W20260709 12:25:59.390319 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52753.8us
I20260709 12:25:59.402812 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:59.405992 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:59.381047 25809 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:59.411994 25809 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:59.412420 25744 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:59.348869 25735 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.414712 25684 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:59.415202 25684 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.411809 18666 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 8 to 9, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 9 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:59.388799 25596 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:59.415997 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.415645 25684 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.404510 25699 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:59.415345 25735 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.425201 25596 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.428015 18666 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 16 to 17, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 17 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.429173 25596 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.429983 25596 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:59.399854 25654 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:25:59.405020 25797 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.421854 25699 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.405441 25729 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.438778 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1205) took 1291 ms. Trace:
I20260709 12:25:59.424280 25742 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:59.444654 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 265326us
I20260709 12:25:59.472715 18666 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:59.475168 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 72454.6us
I20260709 12:25:59.446980 18769 rpcz_store.cc:276] 0709 12:25:58.147191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.147534 (+   343us) service_pool.cc:224] Handling call
0709 12:25:58.181079 (+ 33545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.246542 (+ 65463us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:25:58.723555 (+477013us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.438294 (+714739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:59.438367 (+    73us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:59.438455 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.438552 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.438708 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32239,"prepare.queue_time_us":152476,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":239076,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":967094,"threads_started":3,"wal-append.queue_time_us":540750}
I20260709 12:25:59.507372 18666 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 12 to 13, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 13 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.473874 25654 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:25:59.508811 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 92908.4us
I20260709 12:25:59.481976 25531 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.485795 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.513914 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:59.514699 18768 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:59.515836 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:59.516515 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.516592 18769 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:25:59.517903 18666 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 9 to 14, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 14 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.520524 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.521291 18913 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:25:59.522413 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:59.523020 18917 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:59.521216 18666 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 7 to 13, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 13 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.524760 18666 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:59.529145 25508 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:59.531926 25699 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.482913 25651 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.532845 25651 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.535054 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.535441 25651 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.535914 18921 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:25:59.536386 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:59.536908 18916 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:59.537047 18769 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:25:59.537248 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:59.526161 18666 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 10 to 14, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 14 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.531678 25508 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:25:59.539485 18666 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 5 to 10, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 10 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:25:59.549901 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:59.550727 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:59.551584 18920 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:59.561854 18917 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:25:59.454634 25797 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:59.567843 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 82186.1us
W20260709 12:25:59.579815 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66145us
I20260709 12:25:59.600193 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.601051 18920 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 11.
I20260709 12:25:59.596762 25626 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:59.602181 25626 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:59.602645 25626 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:59.603695 18663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 291) took 23710 ms (client timeout 15000 ms). Trace:
I20260709 12:25:59.589987 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.606745 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.607963 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.608913 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.609910 18739 leader_election.cc:400] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18.
I20260709 12:25:59.609560 25683 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.610694 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:59.615298 25699 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:59.617509 25426 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:59.618057 25441 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:59.620900 25532 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.621779 25833 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:59.622460 25688 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:59.622665 25825 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:59.610221 18739 leader_election.cc:403] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:25:59.515355 25654 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.641180 25654 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.552374 25821 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:59.627660 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43865.8us
I20260709 12:25:59.582319 25714 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:25:59.645936 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.647329 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:59.649425 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:59.582168 25531 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.628813 25699 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:59.654596 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:59.654632 19485 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:25:59.653462 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.661862 25714 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.665784 25821 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.668252 25714 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:59.668406 25820 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.641678 25751 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16.
I20260709 12:25:59.664259 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:59.639195 25688 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:59.649148 25825 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:25:59.689560 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62142us
I20260709 12:25:59.691457 25651 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:59.699790 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:59.693068 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.663141 25699 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.659422 25833 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:59.668268 25821 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.663621 25799 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.711031 25810 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:25:59.717856 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44423.3us
I20260709 12:25:59.722064 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:59.726065 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:59.727953 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:25:59.732476 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.733282 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:25:59.734038 19488 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:25:59.724010 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.727093 19486 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:59.695151 25714 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:25:59.713557 25796 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:59.717767 25810 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.736121 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:59.745193 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.750833 25837 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:59.751483 25837 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:59.708797 25651 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.753364 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:59.752465 25837 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.759506 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.760169 25531 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:25:59.760764 25532 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:59.761210 25532 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:25:59.761590 25532 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.764288 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.765033 18920 raft_consensus.cc:2376] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23. Re-sending same reply.
I20260709 12:25:59.757773 25755 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:59.748885 25843 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:25:59.768304 25843 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.756117 25797 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:25:59.770648 25825 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.744140 25441 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:25:59.779443 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.780761 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:59.781569 18765 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:59.749737 25771 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:59.740820 25688 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:25:59.749779 25810 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:59.788792 25771 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:25:59.822074 18920 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:59.749312 25796 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:25:59.825582 18922 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:59.826680 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:25:59.827584 18917 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.822752 18920 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:25:59.830281 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.831887 25688 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:59.834794 25843 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:25:59.835942 25796 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.836433 25441 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:25:59.837570 25441 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:25:59.838517 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 112970us
W20260709 12:25:59.839531 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.839453 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:25:59.840474 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.845363 18768 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 14: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:25:59.849346 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 139332us
I20260709 12:25:59.846732 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:59.853345 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:59.854509 18772 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:25:59.856024 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:25:59.860039 18769 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
I20260709 12:25:59.862713 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.870843 18765 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:59.881031 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:59.882362 18768 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:25:59.869624 18920 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.888481 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:25:59.897964 25771 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:59.906913 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44288.7us
I20260709 12:25:59.909829 18920 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:59.890637 25742 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:59.910167 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:25:59.916311 18917 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:25:59.926936 25651 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:25:59.604242 18663 rpcz_store.cc:269] 0709 12:25:35.892677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.892942 (+   265us) service_pool.cc:224] Handling call
0709 12:25:59.603382 (+23710440us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:51.313046 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:51.463804 (+150758us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:51.465283 (+  1479us) write_op.cc:435] Acquired schema lock
0709 12:25:51.465337 (+    54us) tablet.cc:662] Decoding operations
0709 12:25:51.635384 (+170047us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:51.635484 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:51.635518 (+    34us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:25:51.637509 (+  1991us) tablet.cc:701] Row locks acquired
0709 12:25:51.637591 (+    82us) write_op.cc:260] PREPARE: finished
0709 12:25:51.637795 (+   204us) write_op.cc:270] Start()
0709 12:25:51.637982 (+   187us) write_op.cc:276] Timestamp: P: 1783599951637720 usec, L: 0
0709 12:25:51.638026 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:25:51.905499 (+267473us) log.cc:844] Serialized 8559 byte log entry
0709 12:25:52.597921 (+692422us) op_driver.cc:464] REPLICATION: finished
0709 12:25:53.291886 (+693965us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335e9c1ef0
0709 12:25:53.540047 (+248161us) write_op.cc:301] APPLY: starting
0709 12:25:53.547916 (+  7869us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:53.846487 (+298571us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:53.855877 (+  9390us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:54.593307 (+737430us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:54.593785 (+   478us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 12:25:54.593857 (+    72us) write_op.cc:312] APPLY: finished
0709 12:25:54.731235 (+137378us) log.cc:844] Serialized 196 byte log entry
0709 12:25:55.095607 (+364372us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b
0709 12:25:55.465648 (+370041us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:55.516371 (+ 50723us) write_op.cc:454] Released schema lock
0709 12:25:55.528372 (+ 12001us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:55.528897 (+   525us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:55.528932 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":758406,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":896037,"apply.run_cpu_time_us":95727,"apply.run_wall_time_us":2007792,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96219,"num_ops":22,"prepare.queue_time_us":212958,"prepare.run_cpu_time_us":22343,"prepare.run_wall_time_us":923149,"raft.queue_time_us":128989,"raft.run_cpu_time_us":68757,"raft.run_wall_time_us":888801,"replication_time_us":959703,"spinlock_wait_cycles":38399232,"thread_start_us":1888187,"threads_started":5,"wal-append.queue_time_us":1100032,"wal-append.run_cpu_time_us":16112,"wal-append.run_wall_time_us":2384977}]]}
I20260709 12:25:59.931141 18764 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:25:59.860786 25833 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:59.936708 25684 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.000s
I20260709 12:25:59.937261 25684 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:25:59.938570 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44514.9us
I20260709 12:25:59.938725 25755 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:59.921087 25735 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:59.940069 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:25:59.867573 25809 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:25:59.952179 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:59.953974 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:59.959280 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.960247 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:25:59.966777 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 213472us
I20260709 12:25:59.969413 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.973803 19486 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:25:59.974375 19488 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:25:59.976843 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:25:59.978436 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:59.945324 25735 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.958170 25816 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:59.979957 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:25:59.971375 25831 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:25:59.992295 25849 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:59.983644 18916 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:25:59.977669 25799 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:25:59.984055 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:25:59.984716 25836 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:59.996703 25836 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.997179 25836 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:59.984812 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:25:59.985689 18919 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:59.985967 25842 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:25:59.986450 25844 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:00.002226 19487 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:25:59.982148 25735 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:00.025060 18919 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:00.036423 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.037019 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:25:59.999449 25849 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:00.039710 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.039759 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.040956 18840 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:26:00.006798 25816 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:00.043500 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.010774 25844 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:00.036290 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.050983 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:00.052307 18843 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:00.050107 18845 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:00.055225 18771 raft_consensus.cc:2368] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:00.054494 18843 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:00.058557 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.058785 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.059423 18844 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:00.059542 18839 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:00.060104 25811 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.060506 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.061079 18839 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:00.060878 18843 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.061442 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.061991 18843 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.067025 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:00.068368 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.018618 25426 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:26:00.071316 18839 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:00.007047 25714 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:26:00.072571 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.072959 18764 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:26:00.073336 18839 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:00.073599 18841 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:26:00.075155 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.060652 25811 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.076601 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:00.067431 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:00.080395 18771 raft_consensus.cc:2368] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21.
I20260709 12:26:00.081614 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.082914 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:00.082177 18845 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:26:00.083570 18918 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:00.046125 25626 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.095532 19487 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:00.055270 25820 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18.
I20260709 12:26:00.098309 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.056950 25844 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:00.035686 25532 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.105880 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.097869 18847 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:00.112855 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.116585 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.118319 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.112977 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:00.120246 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.118994 18845 raft_consensus.cc:2376] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17. Re-sending same reply.
I20260709 12:26:00.124826 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.124948 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:00.128788 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.079380 25848 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:26:00.135456 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.135576 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:00.131294 19487 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
W20260709 12:26:00.143368 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 120988us
I20260709 12:26:00.106922 25684 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.160285 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.160353 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.134198 25820 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:00.166821 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:00.151727 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:00.170571 18918 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:00.175138 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 98603us
I20260709 12:26:00.143045 25755 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.171640 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.152814 25854 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:00.187033 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.187757 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:00.189586 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:00.190800 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.191262 18841 raft_consensus.cc:2376] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17. Re-sending same reply.
I20260709 12:26:00.194810 19488 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:00.195190 19486 raft_consensus.cc:2368] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23.
I20260709 12:26:00.199276 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.200163 18913 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:00.196159 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.204330 18918 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:00.150276 25699 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.177625 25820 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:00.208688 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:00.209486 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.215369 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.216154 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.217605 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.258097 18843 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:00.257601 18771 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:00.258596 18922 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.260030 18915 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:00.220639 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.222327 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.226421 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.262529 18842 raft_consensus.cc:2376] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20. Re-sending same reply.
W20260709 12:26:00.231527 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.249583 19486 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
W20260709 12:26:00.250257 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45146.8us
I20260709 12:26:00.152566 25816 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.219338 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:00.220132 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:00.192751 25805 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.210s
I20260709 12:26:00.214066 25810 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.181689 25755 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:00.252650 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 185730us
I20260709 12:26:00.265564 18846 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:00.274336 25809 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:00.274930 25823 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:00.275559 25823 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.276114 25755 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:00.251678 25854 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:00.264537 18841 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:00.253959 25849 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:00.279697 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:00.282323 18915 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:26:00.287753 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.266173 25795 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.289558 19490 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:00.291585 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:00.254284 25821 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:26:00.292598 18771 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:00.295728 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.296391 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:00.320753 18764 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:00.281487 25714 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.303757 25683 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.309386 25532 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:00.310338 25654 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.669s	user 0.014s	sys 0.000s
I20260709 12:26:00.338564 25654 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.341239 25654 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.312474 25699 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.342841 19491 raft_consensus.cc:2368] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:00.343091 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.313087 25811 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.317689 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.346024 18921 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:00.328250 18922 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:00.330476 18840 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:00.280731 25810 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.273716 25805 consensus_queue.cc:1243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 43b520eabb65493abe84f4cf06806cba log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:26:00.335137 18913 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:00.335964 18918 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
W20260709 12:26:00.348310 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.352013 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:00.353667 18769 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:00.355249 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.356032 18917 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.357259 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.358048 18922 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:00.358871 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.363019 18914 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
W20260709 12:26:00.363762 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44464.2us
I20260709 12:26:00.371100 25862 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:00.372385 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 92746.6us
I20260709 12:26:00.374756 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:00.375501 18771 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:00.351423 25735 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.374069 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:00.382539 18920 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:26:00.382970 18920 pending_rounds.cc:85] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 14
I20260709 12:26:00.383713 19490 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:00.389055 25626 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:00.391054 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.383221 18920 pending_rounds.cc:107] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:26:00.393008 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.393519 18920 raft_consensus.cc:2889] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:00.393919 18913 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:00.302109 25844 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.381233 25833 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.371928 25862 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.400816 18917 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 12.
I20260709 12:26:00.402019 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:00.353001 25714 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.415609 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:00.392027 25836 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.418946 18772 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:00.420348 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:00.369033 25795 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.424002 25795 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:00.426678 19487 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:00.427091 19492 pending_rounds.cc:85] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 11
I20260709 12:26:00.427505 19492 pending_rounds.cc:107] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:26:00.427769 19492 raft_consensus.cc:2889] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:00.392663 25820 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.428975 18918 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:00.430804 25862 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.432457 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.432994 25859 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:00.433326 19485 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:00.433566 25859 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:00.434077 25859 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:00.438967 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:00.439944 18914 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:00.407660 25861 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:00.371279 25854 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.441362 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:00.432262 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:00.427114 18917 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:26:00.448156 18913 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:00.451463 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:00.455787 18922 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:00.457544 18913 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:00.467664 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.342104 25849 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.469799 18921 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:00.474114 18917 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:00.447569 25735 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.484747 25818 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:00.454905 25861 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:00.539091 25861 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:00.426681 25836 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.455909 25714 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:00.487259 18914 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.489141 18918 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:26:00.490022 25855 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.279s	user 0.000s	sys 0.004s
I20260709 12:26:00.490535 25860 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:00.470624 25833 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:00.561014 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.472151 25805 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.483174 18913 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:00.552896 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:00.559816 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.571708 19490 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:00.574755 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:00.575691 18886 leader_election.cc:400] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23.
I20260709 12:26:00.576345 18886 leader_election.cc:403] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:26:00.575829 18765 raft_consensus.cc:2368] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
W20260709 12:26:00.577750 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110711us
I20260709 12:26:00.579485 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:00.569113 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:00.595170 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.596429 18767 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.556497 25531 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:26:00.488793 25816 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:26:00.597158 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:00.598265 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:00.600809 18918 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:00.601049 18764 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:26:00.604521 18773 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:00.561609 25860 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:00.615839 25874 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
W20260709 12:26:00.620729 25872 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:26:00.624747 18766 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:00.625515 18773 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:00.626996 18765 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:00.586982 25626 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:00.652192 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45739.8us
W20260709 12:26:00.654367 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53931.4us
I20260709 12:26:00.659284 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:00.594271 25795 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23.
W20260709 12:26:00.662974 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.598562 25837 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:00.667860 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 183884us
I20260709 12:26:00.664161 18886 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:00.688050 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:00.637280 25860 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:00.690090 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.588133 25805 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.596230 25799 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 12:26:00.660558 25863 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:00.710574 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 46489.1us
I20260709 12:26:00.673735 25626 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:00.696532 25837 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:26:00.717530 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49446.1us
I20260709 12:26:00.709441 25755 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:00.723801 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52424.9us
I20260709 12:26:00.723686 18918 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:00.723762 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:00.742517 25885 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.743147 25885 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.745565 25885 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:00.736940 25816 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:00.746945 25816 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:00.747967 25805 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:00.747889 25816 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:00.749969 25816 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.719041 25818 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:26:00.752416 25818 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:00.724275 25755 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.754040 18769 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 12:26:00.774681 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50988.1us
I20260709 12:26:00.776101 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:00.776158 25854 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:00.723618 25795 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 12:26:00.741346 25878 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:00.746114 25885 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:26:00.797318 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:00.799141 25837 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.801095 25626 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:00.804919 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:00.809921 25873 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:26:00.781169 25755 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:00.781893 25854 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:00.854079 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 141670us
I20260709 12:26:00.850033 25714 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:00.859316 25714 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.738164 25859 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:00.790717 25857 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:00.791257 25878 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:00.872748 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 147975us
I20260709 12:26:00.851414 25854 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:00.892604 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 98461.4us
I20260709 12:26:00.872797 25441 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.876478 25849 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:00.887135 25854 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.891027 25863 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:00.872833 25857 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:01.005157 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50505.2us
W20260709 12:26:01.023895 25880 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:26:01.031338 25714 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.032366 25885 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:01.032824 25885 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:01.034857 25863 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.037106 25859 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.033746 25885 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.049360 19490 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:26:01.050674 25714 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.051225 25714 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.053447 25714 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:01.055032 25795 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:01.049844 25885 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.004709 25849 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:01.059490 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.060864 25857 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.061148 25849 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.017004 25878 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.076030 25878 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:01.078801 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 185106us
I20260709 12:26:01.079695 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:01.082023 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:01.093499 19492 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:01.094771 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:01.097946 25823 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.102707 25596 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:01.104637 18918 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:01.106154 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:01.109011 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:01.112015 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:01.114820 25888 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:01.115307 25888 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:01.116155 25888 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.117522 25888 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:01.128348 25844 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.131752 25818 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:01.132402 25818 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:01.138032 25883 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.174s	user 0.000s	sys 0.002s
I20260709 12:26:01.141636 25631 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:01.163231 25631 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:01.164521 25631 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:01.144021 25868 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.565s	user 0.001s	sys 0.001s
I20260709 12:26:01.148823 25811 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:01.170699 25811 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:01.171890 25811 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.173518 25811 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:01.156139 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.156913 25834 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:01.176246 25834 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.180276 25834 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:01.184324 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:01.186115 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:01.186663 25821 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:01.202472 19492 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:26:01.154160 25771 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:01.189730 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.133523 25818 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.204644 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:01.216964 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.220805 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:01.221704 18915 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:01.209462 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.236s (SENT) [suppressed 49 similar messages]
I20260709 12:26:01.230921 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:01.237784 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.693s (SENT)
W20260709 12:26:01.222519 25861 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.004s
W20260709 12:26:01.254317 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.215736 25857 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:01.259271 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.233343 25860 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:26:01.260367 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:01.209321 25821 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:01.266506 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 156106us
I20260709 12:26:01.270287 25887 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:26:01.278378 25885 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:01.279306 25885 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:01.280157 25631 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:01.282666 25818 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:01.274202 25825 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:26:01.280220 25885 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.286931 19490 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:01.290012 25894 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.290743 25894 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.294165 25858 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:26:01.298151 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.299072 19457 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.785s (SENT)
I20260709 12:26:01.299817 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:01.224646 25834 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 12:26:01.224241 25771 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.273183 25859 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:01.315768 19492 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 12:26:01.321839 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84076.7us
W20260709 12:26:01.322892 18887 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.525s (SENT)
I20260709 12:26:01.286696 25854 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.310453 25426 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:01.332199 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.268138 25861 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.273375 25860 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:01.335677 18887 leader_election.cc:336] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.533s (SENT)
W20260709 12:26:01.341867 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.317250 25859 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.315071 25858 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:01.343317 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:01.324157 25596 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:01.358518 18887 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.557s (SENT)
I20260709 12:26:01.359148 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:01.356393 25626 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:01.363620 25816 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 12:26:01.312510 25862 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:26:01.345157 25859 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:01.381634 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.024s
I20260709 12:26:01.347968 25426 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:01.386729 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.011s	sys 0.024s
W20260709 12:26:01.406162 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.016s	sys 0.010s
I20260709 12:26:01.417171 25858 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.418182 25771 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.418841 25426 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:01.421953 25755 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
I20260709 12:26:01.416179 25834 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:01.427388 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.016s	sys 0.010s
W20260709 12:26:01.464861 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 579986us
W20260709 12:26:01.466183 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 195426us
I20260709 12:26:01.357753 25596 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:01.439862 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81365.6us
W20260709 12:26:01.450999 18812 connection.cc:256] RPC call timeout handler was delayed by -1.7905332840000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 12:26:01.360188 25821 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:01.467990 18812 connection.cc:256] RPC call timeout handler was delayed by -1.6447332839998126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 12:26:01.469703 18812 connection.cc:256] RPC call timeout handler was delayed by -1.5205332840000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 12:26:01.411386 25626 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:01.472901 18812 connection.cc:256] RPC call timeout handler was delayed by -1.440433283999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 12:26:01.462116 25862 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:01.473304 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3265948079997543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 12:26:01.473876 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:01.454600 25894 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:01.464241 25900 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:01.484944 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:01.497510 25854 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:01.497855 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:01.499390 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.492395 25900 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:01.501657 25896 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:26:01.501938 25799 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.502789 25900 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.466857 25755 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.483999 25860 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:01.526510 18915 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:01.527973 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:01.523098 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:01.523470 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:01.518699 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.539382 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.540717 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.548491 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 63640.4us
I20260709 12:26:01.549778 18919 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:01.552939 25771 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.554309 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:01.558779 18914 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:26:01.486459 25862 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.574054 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:01.577632 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 317379us
I20260709 12:26:01.547279 25901 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:26:01.582028 25901 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:01.582481 25901 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:01.579450 25531 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:01.583539 25531 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.572737 25816 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:26:01.582518 25903 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:26:01.532685 25886 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:01.585909 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:01.510893 25799 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.515758 25905 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:26:01.602816 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:01.612344 18764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.010s	sys 0.025s
W20260709 12:26:01.604594 25897 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:26:01.617353 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:01.556617 25771 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:01.615299 18764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.011s	sys 0.026s
I20260709 12:26:01.606750 25441 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:26:01.622090 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.608247 25860 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:26:01.630368 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 56483.8us
W20260709 12:26:01.631109 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 355257us
I20260709 12:26:01.616043 25857 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:01.619786 25816 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:01.641568 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:01.609891 25854 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 12:26:01.650431 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.650713 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:01.634315 25820 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:01.650976 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:01.615716 25825 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:26:01.639292 25651 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:01.652941 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 159140us
I20260709 12:26:01.668855 18915 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:26:01.669977 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:01.672142 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 373115us
I20260709 12:26:01.676647 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:01.678053 18920 raft_consensus.cc:2410] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:26:01.676740 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:01.655192 25531 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:01.679903 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:01.700713 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.763953 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.664s (SENT)
I20260709 12:26:01.764918 18919 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:26:01.764884 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 109748us
I20260709 12:26:01.653903 25907 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:01.656052 25849 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:01.782073 18915 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:01.786623 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 135723us
W20260709 12:26:01.791172 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 115143us
I20260709 12:26:01.673920 25844 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:01.803264 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.670s (SENT)
W20260709 12:26:01.804445 18887 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.739s (SENT)
I20260709 12:26:01.681560 25596 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.804885 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:01.806582 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.985s (SENT)
I20260709 12:26:01.811906 25894 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:01.813355 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.044s (SENT)
I20260709 12:26:01.813472 25899 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:26:01.814095 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.814056 25899 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:01.815137 25899 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.816847 25899 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:01.679668 25651 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.823683 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2658) took 1200 ms. Trace:
I20260709 12:26:01.793642 25849 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:01.833421 18887 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.757s (SENT)
I20260709 12:26:01.797693 25885 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:01.851284 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 72873.8us
I20260709 12:26:01.828447 18764 rpcz_store.cc:276] 0709 12:26:00.623287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.623431 (+   144us) service_pool.cc:224] Handling call
0709 12:26:00.623819 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:00.624317 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:00.624347 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:00.881839 (+257492us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b2c00057528. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:26:00.882283 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:26:01.633350 (+751067us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:01.633412 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:01.633888 (+   476us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:01.817377 (+183489us) raft_consensus.cc:1685] finished
0709 12:26:01.817399 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.823600 (+  6201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17235,"raft.queue_time_us":120,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":26359,"spinlock_wait_cycles":28130560,"thread_start_us":621650,"threads_started":1,"wal-append.queue_time_us":710272}
I20260709 12:26:01.855511 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:01.863839 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 76274.9us
I20260709 12:26:01.825809 25596 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:01.870321 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:01.824676 25911 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.847555 25849 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:01.882261 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:01.878674 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:01.848063 25755 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.883021 18920 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:01.887843 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:01.877359 25860 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:01.872737 25811 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.009s
I20260709 12:26:01.853353 25906 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 12:26:01.874276 25799 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:01.853166 25859 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:01.889285 25887 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:01.817905 25857 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:01.893945 25862 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:01.906373 25916 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:01.893167 25854 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 12:26:01.933547 25917 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 12:26:01.944872 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.935204 25908 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:26:01.949626 19490 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:01.882107 25911 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:01.950495 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.914503 25596 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:26:01.942935 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.831s (SENT)
I20260709 12:26:01.953219 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:01.951821 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.956960 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:01.965886 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:01.966661 19491 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:01.939424 25916 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.952332 25894 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.953092 25596 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:01.974637 25912 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:26:02.003764 19491 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:01.993909 25859 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:02.009375 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66471.2us
I20260709 12:26:01.981220 25921 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:01.973984 25916 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:02.014305 18886 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:01.973870 25836 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:01.969460 25805 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:26:01.991451 25596 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:02.011647 19457 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.902s (SENT)
W20260709 12:26:02.001469 25631 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.003s
I20260709 12:26:02.009375 25888 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.017421 25893 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:02.016621 25441 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.983546 25901 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.033135 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.033493 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:02.018239 25921 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:02.029546 18917 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
W20260709 12:26:02.029518 19457 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.087s (SENT)
I20260709 12:26:01.971143 25860 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:02.045655 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.048581 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:02.049039 18917 pending_rounds.cc:85] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 11
I20260709 12:26:02.057418 18917 pending_rounds.cc:107] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:26:02.057754 18917 raft_consensus.cc:2889] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:01.989684 25894 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.049340 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:02.072042 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.083494 18769 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:02.054634 25825 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.084466 18771 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:02.087510 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.086064 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.089712 25825 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.090699 25893 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:02.091408 25914 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:26:02.091789 25893 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.092300 25825 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:02.092602 25932 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:26:02.026551 25888 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.093765 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.094861 25888 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:02.095388 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.096242 25911 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.096612 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:02.097179 25834 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.630s	user 0.012s	sys 0.000s
I20260709 12:26:02.097656 25834 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:02.098517 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 65108.7us
I20260709 12:26:02.098634 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.099407 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:02.100843 18812 leader_election.cc:400] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:02.101929 18773 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 20. Ops: []
I20260709 12:26:02.102715 25811 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:02.106182 18773 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:02.108929 18773 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:02.047982 25935 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.111864 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.102013 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:02.113936 18773 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
W20260709 12:26:02.087555 25878 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.011s	user 0.015s	sys 0.001s
I20260709 12:26:02.116828 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:02.082756 25905 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:02.138674 19491 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:02.185591 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.186951 18771 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:02.188156 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:02.188722 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 71970.5us
I20260709 12:26:02.189038 18769 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:02.192795 25887 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.117187 25834 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:02.178613 25836 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.194895 25836 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.197414 25836 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:02.192837 25933 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:26:02.085299 25818 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 12:26:02.117120 25811 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:02.179831 25805 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.179646 25901 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:02.056227 25441 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.212240 18773 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:02.215364 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.178565 25921 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.224876 18764 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
W20260709 12:26:02.228097 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.228832 18769 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:02.225960 18771 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
W20260709 12:26:02.222289 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.232404 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.232892 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.233322 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.234063 18842 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:02.233376 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.240756 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.245934 18768 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.208300 25811 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:02.250931 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:02.252665 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.253360 18773 raft_consensus.cc:2376] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14. Re-sending same reply.
I20260709 12:26:02.253489 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.254423 18842 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
W20260709 12:26:02.259135 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 229642us
I20260709 12:26:02.254781 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.263411 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.263890 18766 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:26:02.264334 18770 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:02.265692 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:02.269416 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.177174 25935 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.272248 18916 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:02.237133 25906 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.278106 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.283296 18846 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:02.273897 18766 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:02.270933 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.277117 18839 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:02.277709 25910 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.514s	user 0.004s	sys 0.000s
I20260709 12:26:02.278786 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.290207 18840 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:02.279531 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.289422 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:02.296147 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.223999 25805 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.257207 25811 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:02.303913 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.304685 18766 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:02.304889 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1362) took 1018 ms. Trace:
I20260709 12:26:02.305320 19487 rpcz_store.cc:276] 0709 12:26:01.285966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.295559 (+  9593us) service_pool.cc:224] Handling call
0709 12:26:01.295997 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:01.296416 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:01.296444 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:01.304065 (+  7621us) log.cc:844] Serialized 52 byte log entry
0709 12:26:01.472225 (+168160us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:01.472291 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:01.472389 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:02.277076 (+804687us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:02.304506 (+ 27430us) raft_consensus.cc:1685] finished
0709 12:26:02.304529 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:02.304789 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81917,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":25680,"spinlock_wait_cycles":19980544,"thread_start_us":138782,"threads_started":1,"wal-append.queue_time_us":328458}
I20260709 12:26:02.306926 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.307734 18847 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:26:02.309168 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:02.313386 18769 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:02.330762 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:02.335284 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:02.336763 25836 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:02.337226 25836 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:02.337638 25836 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:02.339249 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:02.343258 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.343508 18770 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:26:02.347837 18766 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
W20260709 12:26:02.348904 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.360594 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.362663 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:02.361562 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.300340 25911 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:02.369807 18768 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:02.375166 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.375865 18846 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:02.348074 25887 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:02.371641 25893 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:26:02.393463 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.346589 25825 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:02.382035 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:02.374989 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:02.400620 18916 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:26:02.293927 25906 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.349970 25888 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:26:02.369417 25531 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:26:02.410665 25893 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:02.424551 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.428074 19483 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:02.376366 25631 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 21.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:26:02.382963 25887 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.497279 25887 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.506848 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.517890 18843 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:02.528381 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.498631 25861 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.525833 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.534140 18843 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:02.516284 25885 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.664s	user 0.015s	sys 0.000s
I20260709 12:26:02.539364 18848 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:26:02.528115 25944 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.531890 25887 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.550837 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.560854 18769 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:02.448410 25936 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.205s
I20260709 12:26:02.560936 18843 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:02.563961 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.564685 18844 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:02.568975 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.557713 18846 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:02.569648 18844 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:02.570111 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.570581 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.570748 18846 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:02.571208 18844 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:02.573259 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:02.572755 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 190802us
I20260709 12:26:02.574757 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:02.537663 25894 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:02.576740 18772 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:02.540688 25893 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:02.577713 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.528355 25924 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.218s
I20260709 12:26:02.579257 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:02.591637 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.593745 18843 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:26:02.595314 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.595994 18843 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 14.
I20260709 12:26:02.597522 18769 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:02.597154 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.600440 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.601125 18843 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:02.618438 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.620448 18846 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:02.622324 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.624799 18769 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:02.585497 25805 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:02.627367 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:02.629212 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.571998 25887 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:02.628698 25939 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:26:02.564544 25944 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:02.640643 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.615213 25935 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.619531 25651 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.618361 25906 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.650723 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.601230 25878 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:26:02.655372 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:02.658742 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:02.658182 18846 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:02.645527 25881 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:26:02.659001 25946 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:26:02.674163 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.674978 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.682765 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:02.685825 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:02.690225 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.665444 25596 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.639s	user 0.013s	sys 0.004s
I20260709 12:26:02.692255 18848 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:02.696985 25957 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:02.697567 25957 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.697948 25957 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:02.702379 18844 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:02.664733 25881 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:02.708312 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.711277 18844 raft_consensus.cc:2376] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19. Re-sending same reply.
I20260709 12:26:02.715548 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.716553 18848 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:26:02.707103 25651 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:02.725602 18844 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:26:02.726678 18844 pending_rounds.cc:85] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 12
I20260709 12:26:02.727015 18844 pending_rounds.cc:107] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:26:02.730096 18844 raft_consensus.cc:2889] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:02.740638 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 113497us
I20260709 12:26:02.742976 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3129) took 1078 ms. Trace:
I20260709 12:26:02.744670 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.743433 18917 rpcz_store.cc:276] 0709 12:26:01.664176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.664325 (+   149us) service_pool.cc:224] Handling call
0709 12:26:01.778843 (+114518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:02.116700 (+337857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:02.742303 (+625603us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540027ced4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:02.742902 (+   599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575624960}
I20260709 12:26:02.746681 18918 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 11. Current term is 12. Ops: []
W20260709 12:26:02.746923 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.718286 25936 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:02.741235 25907 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.936s	user 0.011s	sys 0.004s
I20260709 12:26:02.753046 18844 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:26:02.753599 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.662385 25893 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.707916 25596 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.758713 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:02.749061 25878 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.764407 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.764819 19487 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:02.727762 25651 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.771536 25913 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:26:02.788362 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.772970 25901 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.009s
I20260709 12:26:02.838723 18769 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:02.763269 25907 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:02.844022 25953 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:26:02.844974 25651 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:02.845494 25960 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:26:02.846431 25771 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:02.848340 25596 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:02.851294 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:02.853215 25887 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.853816 18839 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:26:02.857501 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.859543 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.841694 25899 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.024s	user 0.010s	sys 0.005s
I20260709 12:26:02.787115 25913 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:02.839859 25885 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.869907 18842 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:26:02.864722 25771 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.813155 25878 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.893981 25913 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.895522 25913 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:02.784782 25881 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.885284 25948 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.869553 25885 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:02.908037 25949 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:26:02.909823 25965 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:26:02.915580 18767 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:02.917157 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:02.917933 25955 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.927450 25955 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.929877 25955 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:02.931927 25911 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.551s	user 0.014s	sys 0.000s
W20260709 12:26:02.932343 25836 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.005s
I20260709 12:26:02.934789 25836 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.885869 25771 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.939837 25911 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:02.947118 18764 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:02.910229 25966 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 12:26:02.921706 25849 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.015s	user 0.011s	sys 0.003s
W20260709 12:26:02.922821 25916 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.902s	user 0.013s	sys 0.001s
I20260709 12:26:02.922565 25948 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.957433 25957 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:02.959136 25849 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:02.992566 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:02.993386 18845 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:02.994751 25878 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.994776 18847 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:26:02.996731 25849 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:02.996866 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:02.997541 18765 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:02.964167 25916 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.000710 19488 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:03.001896 25916 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:02.999910 25937 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.952s	user 0.003s	sys 0.000s
I20260709 12:26:03.001931 25771 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.004391 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1189) took 1062 ms. Trace:
I20260709 12:26:03.005123 25885 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:03.005014 19492 rpcz_store.cc:276] 0709 12:26:01.941995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.949325 (+  7330us) service_pool.cc:224] Handling call
0709 12:26:03.003327 (+1054002us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800106598. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:26:03.003628 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.003895 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:03.003936 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:03.003994 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:03.004038 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.004113 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.004274 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3400064}
W20260709 12:26:03.008447 25919 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.099s	user 0.004s	sys 0.001s
I20260709 12:26:03.014922 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1562) took 1545 ms. Trace:
I20260709 12:26:03.015380 18913 rpcz_store.cc:276] 0709 12:26:01.469538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.469711 (+   173us) service_pool.cc:224] Handling call
0709 12:26:01.481014 (+ 11303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:01.481440 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:01.481476 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:01.482066 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:26:01.660452 (+178386us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:01.660501 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:01.660579 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:03.007737 (+1347158us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:03.014490 (+  6753us) raft_consensus.cc:1685] finished
0709 12:26:03.014527 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.014836 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1515,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6528,"spinlock_wait_cycles":6659328,"thread_start_us":172928,"threads_started":1,"wal-append.queue_time_us":370274}
I20260709 12:26:03.003577 25948 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:03.019440 25811 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.005s
I20260709 12:26:03.020597 25881 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.004040 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3137) took 1054 ms. Trace:
I20260709 12:26:03.026582 18920 rpcz_store.cc:276] 0709 12:26:01.949928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.950622 (+   694us) service_pool.cc:224] Handling call
0709 12:26:01.950962 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:01.953663 (+  2701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:01.953692 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:01.957025 (+  3333us) log.cc:844] Serialized 26 byte log entry
0709 12:26:02.046991 (+ 89966us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:02.047059 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:02.047175 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:02.453619 (+406444us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4800062358. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:26:02.999237 (+545618us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:03.003815 (+  4578us) raft_consensus.cc:1685] finished
0709 12:26:03.003838 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.003976 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2331,"raft.queue_time_us":4971,"raft.run_cpu_time_us":2116,"raft.run_wall_time_us":495953,"spinlock_wait_cycles":22483456,"thread_start_us":40948,"threads_started":1,"wal-append.queue_time_us":64207}
I20260709 12:26:03.005121 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.040884 18845 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:03.039361 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:03.020373 25811 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.042896 18914 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:26:03.045552 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82185.6us
I20260709 12:26:03.053929 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3136) took 1104 ms. Trace:
I20260709 12:26:03.054456 18919 rpcz_store.cc:276] 0709 12:26:01.949539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.950711 (+  1172us) service_pool.cc:224] Handling call
0709 12:26:01.971941 (+ 21230us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:02.187284 (+215343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:02.187336 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:02.226334 (+ 38998us) log.cc:844] Serialized 52 byte log entry
0709 12:26:02.558808 (+332474us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:02.558851 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.053472 (+494621us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540027c4d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:03.053534 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:03.053590 (+    56us) raft_consensus.cc:1685] finished
0709 12:26:03.053604 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.053857 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17557,"raft.queue_time_us":31979,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":339266304,"thread_start_us":278384,"threads_started":1,"wal-append.queue_time_us":476481}
I20260709 12:26:03.059617 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.060405 18842 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:03.061537 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.062373 18842 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
W20260709 12:26:03.064602 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.067740 25905 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:26:03.068209 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.064772 25894 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:26:03.069615 25531 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:03.070328 25531 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:03.070427 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.071254 19483 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:03.065320 18848 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:26:03.072315 18848 pending_rounds.cc:85] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 10
I20260709 12:26:03.072564 18848 pending_rounds.cc:107] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:26:03.072803 18848 raft_consensus.cc:2889] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.073359 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.071650 25531 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.074043 18847 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:03.075147 25531 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:03.075342 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.075994 18847 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.065429 25955 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:26:03.068217 25905 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:03.083649 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:03.085104 25894 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:03.085551 25894 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.085907 25894 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:03.092363 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.093940 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.101126 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:03.067780 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.105517 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.102365 18842 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:03.108013 25911 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:03.108644 25911 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:03.109894 25441 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.103058 25833 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.111052 25833 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.109647 25911 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.113291 25833 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.115617 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.116318 18840 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:03.117259 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.117823 25834 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:03.118268 25905 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.119040 25834 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:03.119516 25905 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:03.119851 25834 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:03.119901 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.121531 18840 raft_consensus.cc:2410] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:26:03.121356 25834 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.123842 25834 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.117209 25974 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:26:03.123924 18840 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:03.133899 25936 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:03.140409 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.145648 25936 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:03.146379 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3167) took 1053 ms. Trace:
I20260709 12:26:03.147990 18771 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:03.147790 25926 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:03.116824 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.142772 18841 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:03.104728 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.149657 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.149940 18845 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:26:03.098816 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:03.144562 25811 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.158056 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.161010 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:03.161382 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62669.6us
I20260709 12:26:03.160506 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.147137 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.146857 18767 rpcz_store.cc:276] 0709 12:26:02.093357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.093469 (+   112us) service_pool.cc:224] Handling call
0709 12:26:03.146159 (+1052690us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54001c2354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:03.146308 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773935872}
I20260709 12:26:03.157258 19456 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.163007 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.163975 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.164903 18840 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:03.166136 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.167739 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.159509 25651 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:03.174955 25849 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:03.175464 25849 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.175884 25849 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:03.176611 25893 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.177237 25893 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.178509 25755 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:03.178710 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.148666 25926 consensus_queue.cc:1243] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:26:03.179483 18845 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:26:03.180217 25893 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.180454 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.161280 25833 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:03.181282 18845 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:03.181633 25833 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:03.182644 25833 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:03.184165 19457 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.827s (SENT)
I20260709 12:26:03.184695 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.185256 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.186237 19492 raft_consensus.cc:2410] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:26:03.168763 18840 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:03.189074 18840 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:03.189560 18840 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:03.186996 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:03.191901 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.194540 18842 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:03.196632 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.197039 18844 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:03.198050 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.201339 25907 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:03.201891 25907 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:03.202842 25907 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.204800 25925 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:03.198167 18847 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:03.206256 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.198905 18840 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.200817 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:03.209448 18840 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:03.212798 18842 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:03.214619 18847 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:03.195991 25906 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.213270 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.200294 25441 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:03.228475 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.230952 18847 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:26:03.230836 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.233632 18842 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:03.208536 25859 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:03.233075 25441 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.237527 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.241225 25441 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:03.242774 25894 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.240509 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.251222 18844 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:26:03.216909 25926 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:03.252666 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.258543 25426 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.259434 25426 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.272734 18840 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:26:03.274127 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.255905 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.277302 18847 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 18 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 15.
I20260709 12:26:03.234051 25911 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.235826 25859 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.285439 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.254956 25926 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.294504 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.295640 18847 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:03.296473 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.297073 18887 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.198s (SENT)
I20260709 12:26:03.297472 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.267446 25925 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:03.309502 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.311007 18840 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:03.262609 25426 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.290539 25859 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.329661 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:03.335320 25972 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:26:03.308072 25911 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:26:03.299944 25441 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.341957 25441 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:03.299860 25926 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:03.356088 25980 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:26:03.330353 18844 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:03.359660 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.361228 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.363897 18842 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:26:03.364537 25863 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:03.365010 25863 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:03.329509 25894 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.344751 25849 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.367628 19486 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:03.318625 25955 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:03.327050 25925 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:03.369194 25849 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:03.369700 25925 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.366026 25863 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.371843 25863 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.372713 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.376129 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3169) took 1280 ms. Trace:
I20260709 12:26:03.377135 18765 rpcz_store.cc:276] 0709 12:26:02.095287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.095422 (+   135us) service_pool.cc:224] Handling call
0709 12:26:02.095754 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:02.997922 (+902168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.375789 (+377867us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:03.376040 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073524992}
I20260709 12:26:03.383919 18840 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:03.389434 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.387740 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.391054 25836 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:03.393736 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.397785 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:03.403209 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 106160us
I20260709 12:26:03.406124 18847 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:03.398574 19486 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:03.408324 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.410357 18847 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21. Re-sending same reply.
I20260709 12:26:03.410730 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.411095 18840 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:03.412011 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.407984 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:03.376348 25859 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.411361 18844 raft_consensus.cc:2376] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14. Re-sending same reply.
I20260709 12:26:03.417341 25531 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.390595 25906 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:03.418334 25894 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:03.416954 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.421276 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.421729 19490 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:03.421582 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.420822 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.435211 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 3011) took 1060 ms. Trace:
I20260709 12:26:03.411345 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.471342 18847 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:26:03.469681 18840 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:03.472370 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.472553 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.473763 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.474776 18843 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:03.475348 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.415848 25955 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.473817 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:03.465930 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.438269 18842 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:03.470831 18839 rpcz_store.cc:276] 0709 12:26:02.505691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.518270 (+ 12579us) service_pool.cc:224] Handling call
0709 12:26:03.434873 (+916603us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400380c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:03.435101 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718232960}
I20260709 12:26:03.480278 18840 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:03.477744 18812 connection.cc:256] RPC call timeout handler was delayed by -2.5418740149998484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
I20260709 12:26:03.481316 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:03.481773 18812 connection.cc:256] RPC call timeout handler was delayed by -2.4878740150002159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 12:26:03.482210 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 224867us
W20260709 12:26:03.482214 18812 connection.cc:256] RPC call timeout handler was delayed by -2.476174015000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:26:03.482887 18812 connection.cc:256] RPC call timeout handler was delayed by -2.4194740150001053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 12:26:03.483218 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.483934 18843 raft_consensus.cc:2376] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18. Re-sending same reply.
I20260709 12:26:03.484923 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.485554 18843 raft_consensus.cc:2376] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22. Re-sending same reply.
I20260709 12:26:03.487108 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.487882 18843 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:26:03.488768 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.489485 18843 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:03.491631 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.492498 18843 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:03.478964 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.493311 18847 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 18 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 15.
I20260709 12:26:03.494318 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.494994 18847 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21. Re-sending same reply.
I20260709 12:26:03.495972 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.497148 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.498314 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.399472 25936 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:03.483198 18812 connection.cc:256] RPC call timeout handler was delayed by -2.3996740150000733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 12:26:03.503512 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.499694 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.436826 25531 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:03.503850 18812 connection.cc:256] RPC call timeout handler was delayed by -2.3978740150000704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 12:26:03.506302 18812 connection.cc:256] RPC call timeout handler was delayed by -2.3708740150000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 12:26:03.506755 18812 connection.cc:256] RPC call timeout handler was delayed by -2.2907740149998972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 12:26:03.507149 18812 connection.cc:256] RPC call timeout handler was delayed by -2.1944740150001962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
I20260709 12:26:03.491084 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.507344 18844 raft_consensus.cc:2376] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19. Re-sending same reply.
I20260709 12:26:03.505234 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.505321 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:03.507580 18812 connection.cc:256] RPC call timeout handler was delayed by -2.1161740150000696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 12:26:03.510743 18812 connection.cc:256] RPC call timeout handler was delayed by -1.6580740150002384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2676s for a response
W20260709 12:26:03.505030 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf32cd3655eb4943abc0cdbf54a32206 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:03.511173 18812 connection.cc:256] RPC call timeout handler was delayed by -1.5194740150000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28300000000000003s for a response
I20260709 12:26:03.511333 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.510215 18840 raft_consensus.cc:2376] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18. Re-sending same reply.
I20260709 12:26:03.509791 19484 raft_consensus.cc:1217] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Deduplicated request from leader. Original: 19.13->[21.14-23.15]   Dedup: 23.15->[]
I20260709 12:26:03.503239 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.513240 19484 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: [21.14-23.15]
W20260709 12:26:03.511389 18656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70930.5us
I20260709 12:26:03.513438 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.514375 18840 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:03.509238 18842 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:26:03.515472 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.515511 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.515861 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.516501 18840 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:03.526090 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.516546 18842 raft_consensus.cc:2376] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22. Re-sending same reply.
I20260709 12:26:03.498059 25894 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:03.518501 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.519618 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.509671 19489 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:26:03.521589 18767 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:26:03.535113 18766 raft_consensus.cc:2376] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22. Re-sending same reply.
W20260709 12:26:03.535652 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.523509 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.536684 18839 raft_consensus.cc:2410] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:26:03.525523 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.537158 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.538125 18769 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:03.537091 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.529431 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.530830 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.540239 18842 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:03.533756 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.541900 18842 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:03.532684 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.545328 18770 raft_consensus.cc:2376] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18. Re-sending same reply.
W20260709 12:26:03.518208 18812 connection.cc:256] RPC call timeout handler was delayed by -1.380874015000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2984s for a response
I20260709 12:26:03.532743 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:03.546718 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2116740149999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31720000000000004s for a response
I20260709 12:26:03.537246 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:03.547111 18812 connection.cc:256] RPC call timeout handler was delayed by -1.1540740149998783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32360000000000005s for a response
W20260709 12:26:03.525127 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110329us
I20260709 12:26:03.543294 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.547772 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:03.532823 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.549925 18844 raft_consensus.cc:2410] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:26:03.549048 18845 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:03.552852 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.550264 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:03.554028 18916 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:03.542380 19490 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:03.546955 18840 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:03.548823 18843 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:26:03.546121 18842 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:26:03.557351 18839 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 12:26:03.558024 25979 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:26:03.558987 25531 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:03.559092 18772 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:03.559701 25531 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:03.560273 25531 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.560813 18767 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:26:03.561425 25957 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:03.564800 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.570518 25859 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:03.571825 18764 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:03.573519 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:03.576125 25982 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:26:03.576912 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1371) took 1126 ms. Trace:
I20260709 12:26:03.570571 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:03.577610 19488 rpcz_store.cc:276] 0709 12:26:02.450165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.450361 (+   196us) service_pool.cc:224] Handling call
0709 12:26:02.471163 (+ 20802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.001101 (+529938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.576499 (+575398us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400536454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:03.576805 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217316608}
I20260709 12:26:03.581218 25531 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:03.576965 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.582945 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3163) took 1527 ms. Trace:
W20260709 12:26:03.583451 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.583475 18765 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:03.588871 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1170) took 1208 ms. Trace:
I20260709 12:26:03.534181 25755 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.500309 25955 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.583467 18768 rpcz_store.cc:276] 0709 12:26:02.055590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.085803 (+ 30213us) service_pool.cc:224] Handling call
0709 12:26:03.582725 (+1496922us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001d5454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:03.582863 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360141568}
I20260709 12:26:03.589397 18841 rpcz_store.cc:276] 0709 12:26:02.375032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.375312 (+   280us) service_pool.cc:224] Handling call
0709 12:26:02.375629 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.156013 (+780384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.582856 (+426843us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400020b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:03.583078 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763748736}
I20260709 12:26:03.590749 18773 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:03.524068 25596 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:26:03.594489 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.596524 18770 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:03.598912 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:03.601002 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:03.601859 18844 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.602859 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.603533 18768 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:03.604048 18913 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
W20260709 12:26:03.605372 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57697.3us
W20260709 12:26:03.611740 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.612257 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.612620 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.612994 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.613306 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.613252 18768 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:03.615536 18913 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:03.601011 25957 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.620668 18770 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:03.621634 25894 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.630870 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.634720 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:03.634989 25983 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:26:03.635458 18769 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:26:03.637668 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.632884 25888 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:03.639148 25888 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:03.640437 25888 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.641947 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.622160 18916 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
W20260709 12:26:03.622931 18887 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.533s (SENT)
W20260709 12:26:03.645025 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.664s (SENT)
I20260709 12:26:03.645445 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.649399 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.595662 25755 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.650043 18770 raft_consensus.cc:2376] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20. Re-sending same reply.
I20260709 12:26:03.652099 25755 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.652667 25936 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:03.648372 25957 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:03.657963 18887 leader_election.cc:336] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.741s (SENT)
I20260709 12:26:03.658533 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.660949 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:03.660406 18887 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.845s (SENT)
I20260709 12:26:03.664139 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.678483 18768 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:03.669411 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:03.669492 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.670624 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:03.671419 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:03.672209 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:03.680460 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:03.669411 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:03.681277 18919 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:03.675784 25955 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:03.676429 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 377662us
I20260709 12:26:03.677597 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.669795 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:03.680029 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.687525 18769 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.689327 18845 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 12:26:03.689775 18845 pending_rounds.cc:85] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 14
I20260709 12:26:03.690008 18845 pending_rounds.cc:107] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 12:26:03.690237 18845 raft_consensus.cc:2889] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.689157 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:03.691102 18922 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:03.691212 18887 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.872s (SENT)
I20260709 12:26:03.691402 18846 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:26:03.691749 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.693153 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:03.693873 18841 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:03.694655 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:03.694571 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56991.7us
I20260709 12:26:03.695631 18842 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:03.695586 18839 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.695902 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.697427 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.700102 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3181) took 1484 ms. Trace:
I20260709 12:26:03.700588 18771 rpcz_store.cc:276] 0709 12:26:02.215713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.248597 (+ 32884us) service_pool.cc:224] Handling call
0709 12:26:03.147590 (+898993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.148426 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.699869 (+551443us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54001c2350. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:03.700031 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011263744}
I20260709 12:26:03.702590 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3182) took 1486 ms. Trace:
I20260709 12:26:03.702916 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:03.704653 18887 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.916s (SENT)
I20260709 12:26:03.705268 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3030) took 1110 ms. Trace:
W20260709 12:26:03.705854 18887 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.011s (SENT)
I20260709 12:26:03.706506 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.710529 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.715076 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.717202 18839 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:03.718016 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.718976 18842 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:03.703166 18773 rpcz_store.cc:276] 0709 12:26:02.215990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.270740 (+ 54750us) service_pool.cc:224] Handling call
0709 12:26:03.583656 (+1312916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.593430 (+  9774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.702304 (+108874us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001d5450. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:03.702497 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951976192}
I20260709 12:26:03.713876 25985 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:26:03.690138 25755 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.686838 25441 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:03.705668 18848 rpcz_store.cc:276] 0709 12:26:02.595328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.776269 (+180941us) service_pool.cc:224] Handling call
0709 12:26:03.064933 (+288664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.073480 (+  8547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.705058 (+631578us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001090d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:03.705205 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515248896}
W20260709 12:26:03.738832 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 547036us
I20260709 12:26:03.728423 18846 pending_rounds.cc:85] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 9
I20260709 12:26:03.739672 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.739951 18846 pending_rounds.cc:107] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:26:03.740315 18846 raft_consensus.cc:2889] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.685760 25894 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:03.733098 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.721630 25531 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:03.744413 18845 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:03.744753 25834 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:03.733865 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.747658 18770 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:26:03.748728 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:03.749029 18765 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:26:03.734472 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 550292us
I20260709 12:26:03.734683 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.721184 25426 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:26:03.757763 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61939.6us
I20260709 12:26:03.758975 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:03.736619 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.097s (SENT)
I20260709 12:26:03.716074 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:03.761096 19489 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
W20260709 12:26:03.772284 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56308.4us
I20260709 12:26:03.722560 25881 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:03.742959 25863 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:03.777951 18922 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:26:03.776386 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:03.776762 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.773275 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:03.785506 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.754052 25837 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:03.752396 25944 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:03.730705 25991 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:26:03.781613 25911 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:26:03.760677 25836 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:26:03.726037 25955 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:26:03.752437 25926 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.788602 25992 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:03.760324 25651 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:03.752436 25906 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:03.797601 18842 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:03.779208 25964 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:03.755225 25441 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.758790 25893 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.792045 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:03.803387 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.809234 25991 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:03.810030 25755 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:03.806097 25886 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:03.806310 25811 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:03.810703 25894 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:03.811292 25911 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:26:03.811384 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52532.6us
I20260709 12:26:03.813365 25834 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:03.813941 25626 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:26:03.815042 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78496us
W20260709 12:26:03.876654 18887 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.121s (SENT)
I20260709 12:26:03.877178 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.815796 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.822809 18769 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:03.724362 18844 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:26:03.842962 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50981.1us
I20260709 12:26:03.844190 26005 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:03.847692 25998 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:26:03.850638 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 98743.9us
I20260709 12:26:03.879968 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:03.862581 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 85911.1us
I20260709 12:26:03.863065 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:03.864780 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.867115 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.885243 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:03.885949 18767 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:03.853021 25905 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:03.846117 25964 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:03.886515 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.853705 25755 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:03.855841 25886 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:03.894806 18767 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:26:03.895747 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.887609 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:03.903352 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.857215 25957 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:03.861052 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 112389us
I20260709 12:26:03.898113 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.858898 25992 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:03.873142 25811 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.907454 18773 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:26:03.903429 25900 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:03.926668 25900 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:03.927225 25900 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.911857 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:03.913196 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:03.897003 25998 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:03.928138 25998 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.915691 25893 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:03.917825 25837 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:03.872741 25911 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:03.930384 25837 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:03.931099 25911 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.931354 25837 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.932323 25911 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:03.932637 25837 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:03.927661 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56507.8us
W20260709 12:26:03.925127 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.925298 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:03.926752 18845 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:03.922065 25957 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.923595 25626 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.939592 25755 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:03.940191 25626 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:03.940971 25755 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:03.941066 25926 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.895558 25905 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.942057 25905 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.900625 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:03.936666 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:03.938045 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 84297.7us
I20260709 12:26:03.954310 18842 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:26:03.959712 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 72158.1us
I20260709 12:26:03.900437 25964 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:03.964089 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.965372 25915 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:03.937103 25811 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:03.966629 25957 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:03.909245 25886 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:03.978063 18846 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:03.978749 18922 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
W20260709 12:26:03.969295 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57523.3us
I20260709 12:26:03.981001 18812 leader_election.cc:400] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:03.981385 18812 leader_election.cc:403] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:03.975544 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:03.975880 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:03.983314 18845 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.966118 25915 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:26:03.990270 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.994813 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 118190us
I20260709 12:26:03.973564 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:03.997409 18887 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.124s (SENT)
W20260709 12:26:04.010210 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.010028 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:03.963613 25945 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:04.006376 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:04.018338 18845 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:03.968341 25966 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:04.025767 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44968.9us
I20260709 12:26:03.997758 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:04.028694 18812 leader_election.cc:400] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21.
I20260709 12:26:04.029130 18812 leader_election.cc:403] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:04.007407 25959 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
W20260709 12:26:04.039203 18887 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.334s (SENT)
I20260709 12:26:04.053398 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:04.023516 26008 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:04.047959 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50286.2us
I20260709 12:26:04.039559 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.031044 25945 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:04.054220 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.995529 25596 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:26:04.045485 25906 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:04.058995 25836 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:04.052469 25821 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:04.032120 25936 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:26:04.025614 25894 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:26:04.068536 25626 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:04.053283 25992 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.041105 25893 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:04.096279 26008 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:04.079322 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.372s (SENT)
I20260709 12:26:04.118803 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:04.085783 25859 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:26:04.119664 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 113330us
W20260709 12:26:04.097990 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 92533us
I20260709 12:26:04.047644 25903 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21.
I20260709 12:26:04.095629 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:04.102766 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:04.043819 25849 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:26:04.078891 25755 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:04.020810 25957 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:26:04.101738 25926 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:26:04.124087 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:04.124393 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 84914.4us
I20260709 12:26:04.134611 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:04.125522 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.091902 25915 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.102681 25836 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:04.110816 25821 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.111064 25944 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:04.123687 19492 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:04.118227 26008 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.130010 25893 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:04.142774 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63509.7us
I20260709 12:26:04.144747 25906 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.152973 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:04.148032 25441 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:04.155223 25863 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:04.145857 25836 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:04.155773 25863 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:04.156072 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.156721 25863 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.157830 25863 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:04.144807 25821 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.121170 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:04.160481 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.162065 25834 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:04.137717 25945 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.162876 25834 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:04.163338 25834 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:04.163378 26021 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:04.163843 25834 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.164160 26021 consensus_queue.cc:1243] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 17.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:26:04.162632 26009 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:04.127084 25966 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:04.139742 25596 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:04.182108 26017 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:04.183058 26017 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:04.187640 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:04.190969 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.910s (SENT)
I20260709 12:26:04.164788 25905 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.170837 25966 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.173058 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.173301 25836 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.173782 25957 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:04.174100 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:04.199235 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.174510 25903 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:04.201258 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:04.192185 18887 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.236s (SENT)
I20260709 12:26:04.174428 25893 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:26:04.205397 26013 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:26:04.207166 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.206976 25886 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.203258 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:04.175942 26019 raft_consensus.cc:2764] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:26:04.216295 18887 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.702s (SENT)
I20260709 12:26:04.219786 25905 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:04.222489 25893 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:04.225091 25959 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:04.225627 25959 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:04.222505 25836 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:04.226555 25959 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.211159 25886 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:04.227993 25959 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:04.193146 25894 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:04.234063 25894 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.239182 18812 leader_election.cc:400] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:26:04.239786 18812 leader_election.cc:403] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 12:26:04.267130 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127057us
I20260709 12:26:04.274837 19485 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260709 12:26:04.275786 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56096.6us
I20260709 12:26:04.215545 25881 raft_consensus.cc:2764] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:26:04.277966 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:04.249395 25957 raft_consensus.cc:2764] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 12:26:04.283855 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 85960.1us
W20260709 12:26:04.281010 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 90303.6us
I20260709 12:26:04.290048 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:04.272527 25944 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:26:04.217187 25964 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.272830 25886 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:04.296967 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:04.258113 25926 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:26:04.242945 25903 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.304177 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.308488 18917 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:04.288456 25596 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:04.310268 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:04.312526 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.307428 25859 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:04.315572 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.318958 26019 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:04.343847 18922 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:26:04.311986 25944 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:04.316450 25888 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:04.300635 25886 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.316377 25894 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:04.362494 25964 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:04.364634 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74665.4us
W20260709 12:26:04.372042 26024 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:26:04.374814 25966 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:04.354969 25859 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:04.378996 25859 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.356900 25945 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:04.391148 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.365693 25907 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:04.400777 18922 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:04.316094 25905 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260709 12:26:04.411402 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45847.9us
I20260709 12:26:04.412945 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:04.420771 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 105280us
I20260709 12:26:04.422480 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.399299 25811 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.401950 25821 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.423710 26019 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:04.427410 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:04.423646 25907 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:04.429092 25907 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.424775 26034 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:26:04.427469 26031 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:04.431180 26021 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:04.431756 26021 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:04.408260 25596 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.425127 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:04.424575 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.405377 25998 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.429425 25821 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:04.436720 18914 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:04.398711 26008 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.438959 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:04.432667 26021 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.440677 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.464134 19489 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:04.452483 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:04.454802 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:04.473620 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:04.456115 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:04.473969 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:04.473634 18921 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:26:04.455297 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:04.444864 18844 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:26:04.475463 18920 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:04.476182 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.455703 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:04.477075 18842 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 18 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 16.
I20260709 12:26:04.477440 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.478292 18915 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:26:04.478324 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.478986 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.479461 18840 raft_consensus.cc:2368] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20.
I20260709 12:26:04.481655 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:04.474510 18919 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:04.482425 18839 raft_consensus.cc:2376] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20. Re-sending same reply.
I20260709 12:26:04.483526 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:04.484298 18839 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:04.495031 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:04.495582 18843 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 24 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
W20260709 12:26:04.495947 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.496353 18840 pending_rounds.cc:85] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 15
I20260709 12:26:04.496670 18840 pending_rounds.cc:107] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 17.16
W20260709 12:26:04.496820 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.496904 18840 raft_consensus.cc:2889] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:04.498658 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:04.502514 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:04.503252 18922 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:04.504271 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:04.504892 18922 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:04.505064 18764 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:04.509749 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:04.511294 18914 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:04.513278 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.439666 26030 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:04.514830 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.526443 18846 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:04.517777 18922 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:04.519134 18914 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 12:26:04.528546 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:04.519335 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.523151 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.532428 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:04.533391 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.524094 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.534199 18845 raft_consensus.cc:2376] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20. Re-sending same reply.
I20260709 12:26:04.535527 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.536301 18845 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:04.532577 18920 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:04.534189 18846 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:04.539214 18915 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:04.539973 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:04.541608 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.443792 26019 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:04.550307 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.467059 25991 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:04.499075 25905 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:04.543068 18843 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:04.552876 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.554493 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:04.542447 18766 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:26:04.465409 25998 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:04.561820 18887 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.908s (SENT)
W20260709 12:26:04.572031 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.980s (SENT)
I20260709 12:26:04.569921 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:04.513685 26015 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:04.558380 18839 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
W20260709 12:26:04.615347 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.627414 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:04.510813 25903 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:04.531459 26031 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:04.529161 25945 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:04.641453 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.567552 18841 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:04.604764 18767 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:26:04.580122 19457 leader_election.cc:400] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20.
W20260709 12:26:04.654443 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82441.9us
W20260709 12:26:04.676752 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.987s (SENT)
I20260709 12:26:04.677196 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:04.551342 26019 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.677994 19457 leader_election.cc:403] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:04.671693 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:04.684988 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 105058us
W20260709 12:26:04.686638 19457 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.724s (SENT)
I20260709 12:26:04.692023 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:04.693033 18766 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:04.690217 18845 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
W20260709 12:26:04.695815 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 174717us
I20260709 12:26:04.560971 25991 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:04.708170 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:02.228464 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:04.668560 26003 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.725317 18766 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:26:04.565209 26036 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.155s
I20260709 12:26:04.691885 25915 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:26:04.687664 26019 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:04.687896 26015 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:04.686116 25886 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:04.751573 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74857us
I20260709 12:26:04.712456 25998 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.677511 26031 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.552119 25959 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:04.734467 25863 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:04.625245 25964 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.085s
W20260709 12:26:04.787874 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47787.8us
I20260709 12:26:04.799916 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:04.736515 26003 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.630010 25834 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:04.816534 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:04.801493 26034 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:26:04.819537 25900 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.892s	user 0.013s	sys 0.001s
I20260709 12:26:04.801826 26030 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:04.776479 25998 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:04.918339 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.818805 25811 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:04.940446 18764 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
W20260709 12:26:04.946143 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 113760us
I20260709 12:26:04.956147 18764 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:04.820822 25985 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 12:26:04.795073 25991 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.995028 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:05.001168 18841 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:04.989886 18764 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:26:04.824832 26043 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
W20260709 12:26:05.034538 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76680.6us
I20260709 12:26:05.037422 18920 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:05.037438 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:04.942051 26046 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:05.044224 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:05.044605 18839 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:05.046042 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:05.071532 18916 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:05.071802 18842 raft_consensus.cc:2376] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22. Re-sending same reply.
I20260709 12:26:05.072511 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:05.073076 18842 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: [19.14-21.15]
I20260709 12:26:04.965339 26008 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:04.926791 25900 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.075107 18842 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:26:05.060602 18919 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.001s
I20260709 12:26:05.076171 18919 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:05.069887 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:05.068732 18845 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 12:26:05.085954 18764 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
W20260709 12:26:05.092307 19457 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.189s (SENT)
I20260709 12:26:04.989828 26018 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 12:26:04.826933 26015 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:04.990152 26041 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.113s
W20260709 12:26:05.107287 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53256.5us
W20260709 12:26:05.185458 26040 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:26:05.059285 25991 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:05.199090 18842 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 12:26:05.101056 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.004s	sys 0.007s
W20260709 12:26:05.200301 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.005s	sys 0.007s
W20260709 12:26:05.200639 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 670304us
I20260709 12:26:05.087067 26046 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.244580 26002 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.245354 26002 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.178961 26029 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:05.060204 25907 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.167s
W20260709 12:26:05.248867 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 255976us
I20260709 12:26:05.251144 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:05.198638 26041 consensus_queue.cc:1243] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:26:05.097924 26049 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:05.272594 19457 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.371s (SENT)
I20260709 12:26:05.259473 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:05.275096 18848 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:05.278121 18916 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:05.240375 26046 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:05.326364 25900 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:05.327983 26044 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:26:05.329485 26076 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:05.329797 26039 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 12:26:05.085799 26030 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:05.343286 26062 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:26:05.343804 26002 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.330142 26076 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.347394 26076 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.355057 18848 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:05.323822 26031 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:05.359539 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 108461us
I20260709 12:26:05.333515 25834 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.369211 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:05.370361 18770 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 12:26:05.373584 18657 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbadce60e960476289740ec2afd0a5c8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 47b48b5c69f245b79ecb292eff89927f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:05.375090 26037 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
I20260709 12:26:05.380071 26074 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.379223 26061 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:05.380762 26074 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.381034 26061 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.351245 26003 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:05.390645 25998 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:05.393612 25998 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:05.398200 25915 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.003s
I20260709 12:26:05.398742 25915 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20.
I20260709 12:26:05.401115 26010 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:05.401691 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:05.416149 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:05.422837 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:05.424559 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:05.358713 26002 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:05.368393 25900 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:05.404381 26008 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.464905 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:05.409089 25893 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:05.438881 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:05.486408 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47630.9us
I20260709 12:26:05.404253 25888 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:05.428216 25863 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:05.437520 25531 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:05.491654 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:05.492576 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:05.436182 25992 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:05.435087 25964 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:26:05.437083 26019 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.672s	user 0.000s	sys 0.012s
I20260709 12:26:05.505389 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:05.506320 18922 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:05.436568 26003 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:05.500651 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:05.481786 25945 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:05.518093 18920 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:26:05.498090 25888 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.539420 26074 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.513803 26019 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:05.555177 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 186082us
I20260709 12:26:05.496950 25900 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 12:26:05.541404 26047 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.303s	user 0.002s	sys 0.000s
I20260709 12:26:05.544646 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1208) took 1556 ms. Trace:
I20260709 12:26:05.544488 26064 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:26:05.546900 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:05.504575 25992 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.557955 19489 rpcz_store.cc:276] 0709 12:26:03.988767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.989354 (+   587us) service_pool.cc:224] Handling call
0709 12:26:03.989790 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:04.495825 (+506035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.544334 (+1048509us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54005b36d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:05.544578 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090106112}
I20260709 12:26:05.561512 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3213) took 1060 ms. Trace:
I20260709 12:26:05.566489 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3214) took 1065 ms. Trace:
I20260709 12:26:05.567133 18767 rpcz_store.cc:276] 0709 12:26:04.501487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.501675 (+   188us) service_pool.cc:224] Handling call
0709 12:26:04.502072 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:04.676065 (+173993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.566068 (+890003us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54001d4f54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:05.566363 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235181440}
I20260709 12:26:05.569396 18846 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:05.563853 18773 rpcz_store.cc:276] 0709 12:26:04.501083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.501199 (+   116us) service_pool.cc:224] Handling call
0709 12:26:04.541557 (+ 40358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:04.762484 (+220927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:04.762518 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:04.763041 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:26:05.242707 (+479666us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:05.250818 (+  8111us) log.cc:844] Serialized 14 byte log entry
0709 12:26:05.561141 (+310323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.561230 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:05.561276 (+    46us) raft_consensus.cc:1685] finished
0709 12:26:05.561290 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:05.561440 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75500,"prepare.queue_time_us":30206,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":269851,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5643,"thread_start_us":983406,"threads_started":3,"wal-append.queue_time_us":612257}
I20260709 12:26:05.557955 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:05.489168 25894 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:05.549721 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:05.480074 26002 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.401757 26010 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.504949 25964 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:05.510203 26003 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.486526 26008 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.592792 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1202) took 1112 ms. Trace:
I20260709 12:26:05.592958 26019 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.550608 25945 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.593672 26051 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:05.594193 26063 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.594821 26063 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.595444 26003 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:05.596308 25945 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.593273 18847 rpcz_store.cc:276] 0709 12:26:04.480526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.480655 (+   129us) service_pool.cc:224] Handling call
0709 12:26:04.480952 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:04.481337 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:04.481368 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:04.509167 (+ 27799us) log.cc:844] Serialized 26 byte log entry
0709 12:26:04.769318 (+260151us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:04.769382 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.769492 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:05.540639 (+771147us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:05.592470 (+ 51831us) raft_consensus.cc:1685] finished
0709 12:26:05.592493 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:05.592722 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5318,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":30473,"spinlock_wait_cycles":11825536,"thread_start_us":138505,"threads_started":1,"wal-append.queue_time_us":479192}
I20260709 12:26:05.597249 26063 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:05.497695 25863 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.598155 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:05.599571 18847 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:05.600606 25863 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.519235 25531 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:26:05.562260 25992 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:05.590144 25811 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:05.602156 25811 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.593189 26008 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:05.607359 26079 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:05.612006 25992 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.613742 18847 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:26:05.573524 26064 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:05.615116 25992 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:05.623104 26057 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:26:05.571502 26074 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:05.626886 26002 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.635510 26074 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.635776 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:05.636202 26074 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:05.637997 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3193) took 1692 ms. Trace:
I20260709 12:26:05.638477 18917 rpcz_store.cc:276] 0709 12:26:03.945683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.945888 (+   205us) service_pool.cc:224] Handling call
0709 12:26:03.946318 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:04.308956 (+362638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.637725 (+1328769us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54000f6c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:05.637915 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832421120}
I20260709 12:26:05.640815 26003 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.628013 25964 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:05.582707 26084 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.647061 26084 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.647879 26010 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.649755 26084 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.614683 26064 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:05.650231 25888 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:05.651298 26064 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.652953 18922 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:05.652876 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:05.665441 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.668295 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.670354 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.670821 19490 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:05.652850 25888 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.673787 25888 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.607463 26063 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:05.720702 26041 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.713541 25888 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:05.757539 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3163) took 1246 ms. Trace:
I20260709 12:26:05.690642 25894 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:05.749876 25849 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.757994 18846 rpcz_store.cc:276] 0709 12:26:04.511213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.551874 (+ 40661us) service_pool.cc:224] Handling call
0709 12:26:04.561592 (+  9718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:05.570092 (+1008500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.757285 (+187193us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003282d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:05.757473 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305540480}
I20260709 12:26:05.745810 26002 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:05.758271 25894 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:05.756726 25881 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:05.760082 25881 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:05.759912 26002 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.760977 25881 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.760560 25894 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.728235 26011 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.763370 26002 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.763109 26011 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.765067 26027 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:05.765731 26011 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.765798 26063 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:05.767181 26063 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.690249 26046 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.771770 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:05.773607 26046 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.773702 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:05.776602 18922 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:05.756302 26003 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:05.759138 25849 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.779197 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:05.780659 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.781466 25849 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.783322 26041 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.784119 26009 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:05.784554 26009 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.784883 26009 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:05.789779 26061 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.781392 19485 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:05.789615 26041 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:05.797194 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.799933 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:05.800902 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.801926 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.802067 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:05.801435 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:05.808837 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:05.809732 19492 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:05.809894 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:05.838244 19486 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:05.840394 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.846377 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.848413 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.851728 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:05.805976 26046 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:05.862676 26046 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.863174 26046 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:05.806198 26036 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:05.867651 26036 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.868772 26074 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.870074 19484 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:05.816748 26052 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:05.870764 26052 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:05.871191 26052 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:05.872103 26074 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.876029 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:05.876863 18922 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:05.860616 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3215) took 1358 ms. Trace:
I20260709 12:26:05.879783 18770 rpcz_store.cc:276] 0709 12:26:04.501767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.502310 (+   543us) service_pool.cc:224] Handling call
0709 12:26:04.531946 (+ 29636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:05.371438 (+839492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.860200 (+488762us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:05.860511 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927347456}
I20260709 12:26:05.884402 19487 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:05.887712 26089 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.888582 26089 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.893905 19491 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:26:05.900617 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1242) took 1393 ms. Trace:
I20260709 12:26:05.731331 26010 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:05.902773 26010 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.905519 26010 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.901304 18768 rpcz_store.cc:276] 0709 12:26:04.507389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.507515 (+   126us) service_pool.cc:224] Handling call
0709 12:26:04.530939 (+ 23424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:04.803079 (+272140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:04.803116 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:04.819109 (+ 15993us) log.cc:844] Serialized 26 byte log entry
0709 12:26:05.200470 (+381361us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:05.246756 (+ 46286us) log.cc:844] Serialized 14 byte log entry
0709 12:26:05.270193 (+ 23437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.900120 (+629927us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54001c1954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:05.900199 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:05.900276 (+    77us) raft_consensus.cc:1685] finished
0709 12:26:05.900399 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:05.900552 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46486,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":97589,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":625255680,"thread_start_us":295071,"threads_started":2,"wal-append.queue_time_us":590971}
I20260709 12:26:05.908284 25881 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:05.913247 25811 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.915699 26089 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.915979 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3042) took 1969 ms. Trace:
I20260709 12:26:05.916347 18844 rpcz_store.cc:276] 0709 12:26:03.946198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.951082 (+  4884us) service_pool.cc:224] Handling call
0709 12:26:03.951457 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:04.475416 (+523959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.915685 (+1440269us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54003bd654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:05.915911 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133971712}
I20260709 12:26:05.920226 26009 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.921708 19485 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:05.870218 26036 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:05.893138 25964 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.924753 19492 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:26:05.919047 18922 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:05.927227 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:05.928606 26083 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:05.929306 26083 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:05.931995 25959 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.932797 25959 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.930533 26083 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:05.938912 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1201) took 1458 ms. Trace:
I20260709 12:26:05.939404 18840 rpcz_store.cc:276] 0709 12:26:04.480202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.480343 (+   141us) service_pool.cc:224] Handling call
0709 12:26:04.496135 (+ 15792us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:04.502775 (+  6640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:04.502804 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:04.503890 (+  1086us) log.cc:844] Serialized 52 byte log entry
0709 12:26:05.407158 (+903268us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b18004b99a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9
0709 12:26:05.407780 (+   622us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b18004b99a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:26:05.489828 (+ 82048us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:05.509693 (+ 19865us) log.cc:844] Serialized 14 byte log entry
0709 12:26:05.518466 (+  8773us) log.cc:844] Serialized 14 byte log entry
0709 12:26:05.537364 (+ 18898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.537458 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:05.621994 (+ 84536us) raft_consensus.cc:1685] finished
0709 12:26:05.622019 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:05.636980 (+ 14961us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b48000030d8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:26:05.938707 (+301727us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5400071050. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:05.938836 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23555,"prepare.queue_time_us":39499,"prepare.run_cpu_time_us":150,"prepare.run_wall_time_us":1971,"raft.queue_time_us":37332,"raft.run_cpu_time_us":6849,"raft.run_wall_time_us":1132965,"spinlock_wait_cycles":79768832,"thread_start_us":81795,"threads_started":1,"wal-append.queue_time_us":1114812}
I20260709 12:26:05.942256 25959 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:05.926522 25964 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:05.948509 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.948766 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:05.954811 18916 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:05.955235 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:05.955330 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:05.967314 18913 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:26:05.956408 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:05.969614 18919 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:26:05.957216 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:05.971212 18914 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:05.973785 19487 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:05.961474 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:05.974515 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.962780 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.977437 26089 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:05.977702 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.950790 25893 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.971825 26017 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:05.978986 25893 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.979996 26017 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:05.978775 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:05.955549 25888 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:26:05.985117 18922 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:05.984133 18841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.012s	sys 0.013s
I20260709 12:26:06.007063 19486 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:05.986207 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:05.998453 18841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.012s	sys 0.013s
W20260709 12:26:06.009773 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.008s	sys 0.021s
W20260709 12:26:06.010186 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.008s	sys 0.021s
W20260709 12:26:06.010483 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 527475us
I20260709 12:26:06.011909 18840 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:06.012795 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.013185 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.013875 18840 raft_consensus.cc:2376] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15. Re-sending same reply.
I20260709 12:26:06.016505 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.015472 18846 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 12:26:06.021198 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47994.8us
I20260709 12:26:06.017459 18843 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:06.023808 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.028640 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:06.030184 18843 raft_consensus.cc:2410] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:26:05.982147 25893 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:06.030706 18840 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:06.034596 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.034765 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:06.039247 19488 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:26:06.037663 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:05.950469 25964 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:06.041546 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:06.048430 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.056061 18840 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:26:06.057657 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:06.058881 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.064155 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:06.065586 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.035457 26089 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:06.071674 18840 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:05.950647 26036 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 12:26:06.076458 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:06.075690 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 424463us
I20260709 12:26:06.037220 25974 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.046168 25957 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:06.036712 25811 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:06.082692 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:06.071367 26030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.018s	sys 0.015s
I20260709 12:26:06.081952 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.032701 25944 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:26:06.128780 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.062749 25945 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.130381 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:06.082129 26018 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.019s	sys 0.019s
I20260709 12:26:06.067277 26048 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:26:06.117161 18840 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:06.127727 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:06.139266 18887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.018s	sys 0.020s
I20260709 12:26:06.141462 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.077913 26019 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:06.143536 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:06.148326 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:06.145931 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.107396 26041 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:06.113548 25811 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:06.060038 26061 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:06.145121 18887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.019s	sys 0.020s
I20260709 12:26:06.150295 26067 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:26:06.151141 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.138082 26042 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:06.151844 26045 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:26:06.138173 25945 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.152637 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.152947 18919 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:26:06.153484 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.155138 26082 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:06.176656 25811 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:06.079600 26034 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 12:26:06.127995 26030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.022s	sys 0.015s
I20260709 12:26:06.063680 25964 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.201555 26082 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:06.210355 26082 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:06.211066 25964 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:06.075798 25893 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:06.213375 25893 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.215938 25893 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:06.218369 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:06.131758 25957 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.220557 18848 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:26:06.219050 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3058) took 1171 ms. Trace:
I20260709 12:26:06.184465 26025 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:06.077176 25959 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:06.080511 26017 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:06.130430 25944 consensus_queue.cc:1243] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:26:06.138736 26018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.020s	sys 0.025s
W20260709 12:26:06.164443 26021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.015s	sys 0.015s
I20260709 12:26:06.177466 25821 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:26:06.240670 26021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.016s	sys 0.015s
I20260709 12:26:06.240742 25821 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:06.242129 25821 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.243433 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3065) took 1083 ms. Trace:
I20260709 12:26:06.243697 25821 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:06.177868 26091 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:06.069123 25992 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:26:06.077472 26015 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.089s
I20260709 12:26:06.151552 26077 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 12:26:06.106901 25974 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:06.185865 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 698180us
I20260709 12:26:06.261132 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:06.148576 26019 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.115151 26011 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:26:06.159607 26002 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:06.165529 25441 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.106487 25863 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.093s
I20260709 12:26:06.157016 26029 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:06.164387 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.221755 18841 rpcz_store.cc:276] 0709 12:26:05.048052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.078997 (+ 30945us) service_pool.cc:224] Handling call
0709 12:26:05.179660 (+100663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:05.357906 (+178246us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:26:05.409534 (+ 51628us) log.cc:844] Serialized 14 byte log entry
0709 12:26:05.925805 (+516271us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b48000030d8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:26:06.008311 (+ 82506us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:06.008819 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:26:06.008957 (+   138us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:06.009350 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 12:26:06.009575 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:06.009652 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:06.218748 (+209096us) raft_consensus.cc:1685] finished
0709 12:26:06.218780 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:06.218957 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140865,"prepare.queue_time_us":65399,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2140,"raft.queue_time_us":162281,"raft.run_cpu_time_us":2512,"raft.run_wall_time_us":581358,"spinlock_wait_cycles":21647872,"thread_start_us":598397,"threads_started":1,"wal-append.queue_time_us":796961}
I20260709 12:26:06.189532 26041 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:06.172652 26046 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.243919 18847 rpcz_store.cc:276] 0709 12:26:05.160456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.615092 (+454636us) service_pool.cc:224] Handling call
0709 12:26:05.615701 (+   609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:05.616289 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:05.616342 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:05.617630 (+  1288us) log.cc:844] Serialized 26 byte log entry
0709 12:26:05.806583 (+188953us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:05.806623 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:05.806689 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:06.243151 (+436462us) raft_consensus.cc:1685] finished
0709 12:26:06.243172 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:06.243344 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13165,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":3546,"thread_start_us":188481,"threads_started":1,"wal-append.queue_time_us":500158}
I20260709 12:26:06.245122 19491 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:06.145473 26089 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:06.248422 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.200593 26052 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:06.306238 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45442.7us
I20260709 12:26:06.269318 26091 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:06.329457 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 165140us
I20260709 12:26:06.341517 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.254920 26009 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:06.250885 26061 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:06.270689 26008 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:06.351154 26008 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:06.351740 26068 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:06.352243 26068 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:06.353235 26068 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.355818 26008 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.338200 18887 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:06.357846 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:06.359229 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:06.360359 25991 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:06.360769 25991 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:06.238050 26025 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.361140 25991 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:06.315596 25531 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:06.362613 25531 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.362994 26025 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:06.319156 25441 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.363795 25888 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:06.364248 25888 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:06.364645 25888 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:06.365573 25441 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:06.367096 25992 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.367548 25974 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:06.367837 26064 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:06.370882 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:06.371603 19486 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:06.361145 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:06.307580 26019 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:06.332499 25959 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:06.304244 26002 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.271128 26034 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:06.315783 26084 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:06.344026 19489 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:06.345019 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:26:06.334447 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.378659 18771 raft_consensus.cc:2368] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:06.380554 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:06.363059 25531 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:06.370107 18671 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 9 to 10, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 10 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.373202 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:06.390442 19483 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:06.405491 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:06.372033 25881 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:06.377882 25863 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:06.413968 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 69048.8us
I20260709 12:26:06.419157 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:06.413231 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 289884us
I20260709 12:26:06.391197 26068 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:06.427753 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 251465us
I20260709 12:26:06.397184 26002 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:06.397521 25992 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:06.437377 18921 pending_rounds.cc:85] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 9
I20260709 12:26:06.433394 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:06.397823 26084 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:06.405706 25964 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:06.445271 18738 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:06.411495 25441 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:06.433039 26008 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:06.443305 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:06.465689 18920 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:26:06.443275 18921 pending_rounds.cc:107] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:26:06.466462 18921 raft_consensus.cc:2889] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:06.417541 25959 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:06.421294 26091 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.451882 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:06.447623 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:06.443074 25992 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.440002 26065 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:26:06.461716 25441 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.411882 25894 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:26:06.468469 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.410948 26034 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.468518 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:06.442163 25944 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:06.455765 25881 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:06.459019 26015 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:06.433396 25863 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.534830 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:06.498874 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.500910 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.509179 18767 raft_consensus.cc:606] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.446574 26077 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:26:06.464883 25911 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:06.525743 18920 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:06.489444 25441 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:06.488201 25992 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:06.536171 18767 raft_consensus.cc:614] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:06.509959 25907 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:06.552460 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.555652 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.572084 18764 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
W20260709 12:26:06.551898 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 146519us
W20260709 12:26:06.572773 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114436us
I20260709 12:26:06.573590 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.457073 26041 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:06.568028 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 123441us
I20260709 12:26:06.486461 26091 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.530052 25881 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:06.535808 26097 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:06.575804 18769 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:06.578936 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:06.581897 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:06.547370 25957 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:06.595541 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:06.569629 26099 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:26:06.532008 26063 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 12:26:06.614498 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:06.603245 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.615927 18766 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:06.601907 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 150125us
I20260709 12:26:06.604777 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:06.471439 26061 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.622982 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:06.556525 25944 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:26:06.625020 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.631405 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:06.593361 25945 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:06.632892 18766 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:06.641356 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.642191 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:06.602945 26097 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.602594 25881 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:06.637996 18848 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:06.639025 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:06.643230 18840 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:06.643710 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.607857 26046 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:06.615763 26052 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:06.554152 26084 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.602248 26025 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:06.648566 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.665720 18767 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:06.651093 26104 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:26:06.668081 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.668766 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.652365 26075 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:06.673290 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:06.674728 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:06.675403 18915 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:06.636109 25964 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.652899 25900 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:06.602697 26015 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:26:06.653460 26002 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.683495 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3066) took 1522 ms. Trace:
I20260709 12:26:06.636231 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.656968 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:06.612210 25959 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:06.659637 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:06.660632 18920 raft_consensus.cc:1217] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[12.7-15.9]   Dedup: 12.7->[14.8-15.9]
I20260709 12:26:06.661545 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.662791 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:06.663311 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49938.8us
I20260709 12:26:06.644089 18919 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:26:06.640509 25893 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:06.578516 25907 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.651847 26091 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:06.669691 18845 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:06.698241 18841 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:06.672405 26034 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:06.645288 26114 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:06.679605 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:06.709007 18842 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.668875 18840 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:06.709806 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:06.640086 25957 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:06.683079 18918 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:26:06.656394 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:06.702446 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.714764 18766 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:06.715557 18773 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:06.710574 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:06.698922 18920 pending_rounds.cc:85] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 7
I20260709 12:26:06.728451 18920 pending_rounds.cc:107] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:26:06.728840 18920 raft_consensus.cc:2889] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:06.683969 18839 rpcz_store.cc:276] 0709 12:26:05.160742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.677050 (+516308us) service_pool.cc:224] Handling call
0709 12:26:05.677411 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:05.678111 (+   700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:05.678145 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:05.689066 (+ 10921us) log.cc:844] Serialized 26 byte log entry
0709 12:26:06.096622 (+407556us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:06.096691 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:06.096810 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:06.683252 (+586442us) raft_consensus.cc:1685] finished
0709 12:26:06.683278 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:06.683429 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"thread_start_us":406940,"threads_started":1,"wal-append.queue_time_us":545457}
I20260709 12:26:06.646523 26003 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:06.685550 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:06.701197 18848 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:06.699833 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:06.658905 26097 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:06.702858 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76010.6us
I20260709 12:26:06.704381 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:06.706305 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:06.770911 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 68612.8us
I20260709 12:26:06.792369 18919 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:06.771507 18913 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:06.777668 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.789517 18839 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:06.799144 18839 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 12:26:06.712713 26101 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:26:06.663600 26110 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:26:06.826850 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:06.812408 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:06.828299 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51012us
W20260709 12:26:06.814693 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.182s (SENT) [suppressed 32 similar messages]
I20260709 12:26:06.708947 26084 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:06.668133 26026 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 12:26:06.825420 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.834875 18918 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:06.842732 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.843439 18773 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:06.684491 26025 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.844316 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.831128 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.697885 26115 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.129s
I20260709 12:26:06.790107 26034 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.847851 18766 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:06.708263 25911 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 12:26:06.775308 26003 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:06.696960 25900 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.855490 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:06.698725 25964 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.808059 26114 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:06.859668 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:06.860402 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.876399 18773 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:06.877995 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:06.703936 25893 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.839987 26009 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:06.870198 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:06.811550 26046 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:26:06.895939 26002 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:06.874967 25957 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:06.899418 26048 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:06.902920 26114 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.904309 25900 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:06.899070 25957 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.866101 26109 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:06.909919 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:06.919651 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 90232.7us
I20260709 12:26:06.875810 26030 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:26:06.899101 26113 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:26:06.928176 18842 raft_consensus.cc:2410] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:26:06.881171 26019 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:06.977185 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:06.961827 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 335482us
W20260709 12:26:06.979094 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 164451us
I20260709 12:26:06.889982 26009 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:06.989480 18773 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:06.996081 18768 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:06.929085 26030 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.997933 18767 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:06.884115 25987 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:26:07.005416 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:06.989168 26064 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.001s
I20260709 12:26:07.010946 18847 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:06.965886 25964 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:06.988160 25991 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.626s	user 0.013s	sys 0.000s
I20260709 12:26:06.890264 25959 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:06.990486 26009 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:07.007375 26030 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:06.979840 26003 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.066228 25991 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.191471 18846 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
W20260709 12:26:07.193653 26128 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:26:07.196931 25531 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.001s
I20260709 12:26:07.197584 25531 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.199043 18916 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
W20260709 12:26:07.200284 26129 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:26:07.201496 25531 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:07.210183 25957 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.213208 26019 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.167055 25907 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.190431 26003 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:07.186952 26064 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:07.227644 26068 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.001s
W20260709 12:26:07.265393 25888 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.900s	user 0.016s	sys 0.000s
W20260709 12:26:07.282721 26121 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:26:07.283893 26137 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:26:07.284530 25881 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.000s
I20260709 12:26:07.259037 25893 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:07.302234 25881 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:07.296804 25441 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.003s
I20260709 12:26:07.320075 25441 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.326565 26098 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:26:07.328364 26136 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:26:07.329216 26026 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:07.331799 26026 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:07.332746 26026 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.334717 25886 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:07.335202 25886 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:07.336124 18766 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:07.336123 25886 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.338603 25881 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:07.340374 26103 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.878s	user 0.000s	sys 0.007s
W20260709 12:26:07.341771 26118 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.446s	user 0.002s	sys 0.000s
I20260709 12:26:07.344523 18770 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:07.345237 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1211) took 1488 ms. Trace:
I20260709 12:26:07.345652 19483 rpcz_store.cc:276] 0709 12:26:05.856835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.857814 (+   979us) service_pool.cc:224] Handling call
0709 12:26:05.862334 (+  4520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:06.400774 (+538440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:07.344964 (+944190us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54006ffc54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:07.345168 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213845760}
I20260709 12:26:07.346340 25863 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:07.355520 18922 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:26:07.356010 18922 pending_rounds.cc:85] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 11
I20260709 12:26:07.356232 18922 pending_rounds.cc:107] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:26:07.356454 18922 raft_consensus.cc:2889] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:07.357573 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.358589 18773 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:26:07.261327 26064 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.298852 25888 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.371096 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.334054 26026 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:07.359560 26008 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.890s	user 0.013s	sys 0.000s
I20260709 12:26:07.389990 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:07.340422 25991 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:07.393882 18922 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:26:07.392985 18914 raft_consensus.cc:2376] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20. Re-sending same reply.
I20260709 12:26:07.395887 18922 pending_rounds.cc:85] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 9
I20260709 12:26:07.396350 18922 pending_rounds.cc:107] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:26:07.396750 18922 raft_consensus.cc:2889] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:07.386588 26123 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.476s	user 0.000s	sys 0.004s
W20260709 12:26:07.388116 25992 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.811s	user 0.014s	sys 0.001s
I20260709 12:26:07.402438 18915 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
W20260709 12:26:07.404839 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60171.3us
I20260709 12:26:07.364785 26098 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:07.399425 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 414855us
I20260709 12:26:07.415153 18768 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 12:26:07.405345 26082 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.194s	user 0.016s	sys 0.004s
I20260709 12:26:07.418643 26082 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:07.426369 25811 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.206s	user 0.011s	sys 0.003s
I20260709 12:26:07.426877 25811 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.427672 26082 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.405505 25992 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.434033 18914 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:26:07.434679 19486 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:07.435101 26025 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.438206 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2682) took 1314 ms. Trace:
I20260709 12:26:07.438846 18771 rpcz_store.cc:276] 0709 12:26:06.123907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.124016 (+   109us) service_pool.cc:224] Handling call
0709 12:26:07.437907 (+1313891us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54002a1554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:07.438114 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408779136}
W20260709 12:26:07.446909 18917 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.007s	sys 0.013s
I20260709 12:26:07.447939 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.448751 18771 raft_consensus.cc:2376] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17. Re-sending same reply.
I20260709 12:26:07.449211 25888 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:07.447542 18917 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.008s	sys 0.013s
I20260709 12:26:07.452344 25992 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.453707 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.429220 25811 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:07.454335 26084 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 12:26:07.467924 18764 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:26:07.415521 26098 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:07.479022 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:07.480901 26061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.022s	sys 0.020s
I20260709 12:26:07.493119 26064 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.497392 18918 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
W20260709 12:26:07.504472 26097 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
I20260709 12:26:07.505138 26097 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.511598 26025 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.512329 26025 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.514533 26064 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:07.515421 26045 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:07.515175 26064 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.515908 26045 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:07.516911 26045 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.518600 26064 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.519717 26064 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.520404 26064 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.522521 26098 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:07.524317 26084 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.524953 26084 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.525364 26009 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.527755 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3207) took 1091 ms. Trace:
I20260709 12:26:07.528806 26097 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:07.528195 18921 rpcz_store.cc:276] 0709 12:26:06.436090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.436763 (+   673us) service_pool.cc:224] Handling call
0709 12:26:06.437159 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:06.537100 (+ 99941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:06.537131 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:06.557268 (+ 20137us) log.cc:844] Serialized 52 byte log entry
0709 12:26:06.882037 (+324769us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:06.959467 (+ 77430us) log.cc:844] Serialized 14 byte log entry
0709 12:26:06.962691 (+  3224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:06.962822 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:07.508377 (+545555us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b4800062358. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:26:07.524236 (+ 15859us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b1800486220. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:26:07.527518 (+  3282us) raft_consensus.cc:1685] finished
0709 12:26:07.527541 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:07.527690 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3780,"prepare.queue_time_us":93090,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":10588,"raft.queue_time_us":6626,"raft.run_cpu_time_us":10680,"raft.run_wall_time_us":555016,"spinlock_wait_cycles":74824064,"thread_start_us":270761,"threads_started":1,"wal-append.queue_time_us":428492}
I20260709 12:26:07.518335 26045 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:07.531701 18921 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 12:26:07.533627 18921 pending_rounds.cc:85] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 11
I20260709 12:26:07.533958 18921 pending_rounds.cc:107] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:26:07.534303 18921 raft_consensus.cc:2889] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:07.535696 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 123136us
I20260709 12:26:07.537876 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.544474 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.546120 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:07.492300 26061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.022s	sys 0.020s
I20260709 12:26:07.546856 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.544566 26021 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:07.546859 18770 raft_consensus.cc:2376] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21. Re-sending same reply.
I20260709 12:26:07.521931 26030 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.532902 26009 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.550046 25959 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:07.560047 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.562341 18767 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:07.557652 25441 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.574693 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:07.575580 19483 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:07.575639 26030 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.577943 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:07.577310 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.569205 26025 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.582501 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.589883 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:07.590842 19484 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:07.591657 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3175) took 1578 ms. Trace:
I20260709 12:26:07.592105 18846 rpcz_store.cc:276] 0709 12:26:06.013128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.028263 (+ 15135us) service_pool.cc:224] Handling call
0709 12:26:07.591474 (+1563211us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400195354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:07.591576 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327825280}
I20260709 12:26:07.593238 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.594930 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:07.596335 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.605078 25881 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.605985 25811 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:07.606024 25881 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.567551 25959 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.615180 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.615938 25959 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.617340 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.606683 25811 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.619234 25821 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:07.620029 25821 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:26:07.620147 26100 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.177s	user 0.002s	sys 0.002s
I20260709 12:26:07.620651 25811 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.624495 25945 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:07.625136 25945 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.630499 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1252) took 1036 ms. Trace:
I20260709 12:26:07.630762 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.631048 18767 rpcz_store.cc:276] 0709 12:26:06.594473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:07.004769 (+410296us) service_pool.cc:224] Handling call
0709 12:26:07.005050 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:07.564296 (+559246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:07.630159 (+ 65863us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540029dbd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:07.630420 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281059584}
I20260709 12:26:07.633232 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1219) took 1259 ms. Trace:
W20260709 12:26:07.638581 26124 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.927s	user 0.008s	sys 0.003s
I20260709 12:26:07.638796 25957 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:07.639009 25881 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.639472 25957 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:07.642086 26102 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.180s	user 0.000s	sys 0.004s
I20260709 12:26:07.643620 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1396) took 1865 ms. Trace:
I20260709 12:26:07.642154 25957 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.645222 26010 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:07.645677 26010 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:07.644058 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3221) took 1146 ms. Trace:
I20260709 12:26:07.647238 18765 rpcz_store.cc:276] 0709 12:26:06.497233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.497381 (+   148us) service_pool.cc:224] Handling call
0709 12:26:06.497869 (+   488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:06.510353 (+ 12484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:06.510462 (+   109us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:06.511116 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 12:26:06.599114 (+ 87998us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:06.599156 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:06.601741 (+  2585us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:07.637840 (+1036099us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:07.643732 (+  5892us) raft_consensus.cc:1685] finished
0709 12:26:07.643756 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:07.643986 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36640,"raft.queue_time_us":16088,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":2411,"spinlock_wait_cycles":5953408,"thread_start_us":36212,"threads_started":1,"wal-append.queue_time_us":175660}
I20260709 12:26:07.648599 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:07.638594 26019 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.649430 26019 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:07.649935 26135 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 12:26:07.652338 26019 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.654332 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:07.656798 25886 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:07.658747 26084 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.660646 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.661646 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:07.586954 26064 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.663033 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:07.663705 25849 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:07.663379 25926 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:07.669035 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 1253) took 1065 ms. Trace:
I20260709 12:26:07.671012 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.675369 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1386) took 2011 ms. Trace:
I20260709 12:26:07.675951 19489 rpcz_store.cc:276] 0709 12:26:05.664442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.664620 (+   178us) service_pool.cc:224] Handling call
0709 12:26:05.664999 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:06.400774 (+735775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:07.675065 (+1274291us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400590e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:07.675292 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561104640}
I20260709 12:26:07.675371 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3225) took 1173 ms. Trace:
I20260709 12:26:07.677562 18764 rpcz_store.cc:276] 0709 12:26:06.501817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.581629 (+ 79812us) service_pool.cc:224] Handling call
0709 12:26:07.675204 (+1093575us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b5400210cd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:07.675315 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986332544}
I20260709 12:26:07.678849 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.644049 19490 rpcz_store.cc:276] 0709 12:26:05.778307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.781342 (+  3035us) service_pool.cc:224] Handling call
0709 12:26:05.781688 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:05.782065 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:05.782101 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:05.782570 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:26:06.185466 (+402896us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:06.185507 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:06.185580 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:07.641412 (+1455832us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:07.643261 (+  1849us) raft_consensus.cc:1685] finished
0709 12:26:07.643288 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:07.643546 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22948,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":23258,"spinlock_wait_cycles":20139392,"thread_start_us":402528,"threads_started":1,"wal-append.queue_time_us":625098}
I20260709 12:26:07.684638 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3237) took 1147 ms. Trace:
I20260709 12:26:07.685099 18768 rpcz_store.cc:276] 0709 12:26:06.537077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.998146 (+461069us) service_pool.cc:224] Handling call
0709 12:26:06.998519 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:07.415703 (+417184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:07.684395 (+268692us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400211bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:07.684579 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957501184}
I20260709 12:26:07.685514 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:07.686738 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:07.687484 19489 raft_consensus.cc:2368] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:07.688241 26139 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:07.689493 26084 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:07.689738 26139 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:07.690320 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.691818 26064 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.692418 26064 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.693893 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.695041 26064 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:07.695120 18666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 167) took 44140 ms (client timeout 15000 ms). Trace:
I20260709 12:26:07.696067 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.698443 26140 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:07.699057 19489 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
W20260709 12:26:07.701577 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.702286 25811 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:07.703266 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3182) took 1032 ms. Trace:
I20260709 12:26:07.703037 25811 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.703756 18915 rpcz_store.cc:276] 0709 12:26:06.671238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.676021 (+  4783us) service_pool.cc:224] Handling call
0709 12:26:06.676354 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:07.403687 (+727333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:07.702982 (+299295us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b5400034dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:07.703194 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669378944}
I20260709 12:26:07.705278 18773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:07.705961 18773 raft_consensus.cc:606] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.707240 26019 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.707687 25811 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.707785 26019 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.708464 25811 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.708907 26010 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.710146 26010 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:07.710235 26019 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.711112 26064 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.711385 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.711628 26064 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.712706 25859 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:07.708968 25811 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.713871 26064 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.714883 26019 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.715396 26019 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.715930 25811 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.716615 25811 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:07.717149 25811 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.717547 26019 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.719038 26064 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:07.719513 25811 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.719374 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.719914 25957 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:07.748814 25957 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.751096 25957 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.751770 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.721146 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:07.719687 26064 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.722626 18846 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:07.723116 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:07.753041 18845 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:07.753583 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:07.723237 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:07.723740 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:07.754220 18846 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:07.754455 18840 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:07.722818 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:07.755177 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.755502 18921 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:07.755703 18841 raft_consensus.cc:2376] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18. Re-sending same reply.
I20260709 12:26:07.725939 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.725836 26139 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:07.756726 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:07.757642 18915 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:07.757917 18841 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.754122 26064 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.759420 18915 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:07.754110 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:07.760334 26045 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:26:07.760990 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:07.764765 18840 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 12:26:07.765434 26139 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:07.765801 26139 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:07.766083 18840 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:07.727471 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.791425 18845 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:26:07.791626 18917 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:07.791718 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:07.730464 25881 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:07.792577 18840 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:07.792491 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:07.793015 25881 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.633673 19486 rpcz_store.cc:276] 0709 12:26:06.373791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.373950 (+   159us) service_pool.cc:224] Handling call
0709 12:26:06.374286 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:07.435148 (+1060862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:07.632960 (+197812us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006743d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:07.633166 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2438265600}
I20260709 12:26:07.795217 18848 raft_consensus.cc:2410] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:26:07.797025 26140 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:07.669763 18766 rpcz_store.cc:276] 0709 12:26:06.603190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.877590 (+274400us) service_pool.cc:224] Handling call
0709 12:26:07.668655 (+791065us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b540036c4d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:07.668922 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051101952}
I20260709 12:26:07.798775 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.799929 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.800673 18766 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:07.801410 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.731694 18844 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:07.803365 18844 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:07.804561 18844 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 12:26:07.808178 25881 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:07.732331 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.733235 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:07.736023 18812 leader_election.cc:400] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:07.809062 18812 leader_election.cc:403] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 12:26:07.809526 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73684.4us
I20260709 12:26:07.684576 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.811281 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:07.739024 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:07.812211 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.812321 18843 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:07.739764 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:07.740329 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:07.742722 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 138740us
I20260709 12:26:07.812983 25957 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:07.817071 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.819324 26069 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:07.821440 26069 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:07.822181 26069 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:07.823547 26069 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.694054 18671 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.744709 26165 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:07.827652 26165 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:07.828076 26165 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:07.812310 25811 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:07.829201 26165 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.755939 18914 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:07.724475 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.756461 25894 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:07.766695 26139 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:07.831514 25894 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.831931 26139 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:07.833850 25894 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:07.766685 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81276.2us
I20260709 12:26:07.726788 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:07.768466 26134 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:07.770809 26119 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.771180 26003 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:07.773041 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.773751 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:07.775059 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:07.696498 18666 rpcz_store.cc:269] 0709 12:25:23.543978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.544148 (+   170us) service_pool.cc:224] Handling call
0709 12:26:07.683830 (+44139682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:59.875456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:59.876195 (+   739us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:59.876250 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:25:59.876286 (+    36us) tablet.cc:662] Decoding operations
0709 12:25:59.877662 (+  1376us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:59.877764 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:59.877797 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:25:59.903429 (+ 25632us) tablet.cc:701] Row locks acquired
0709 12:25:59.903486 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:25:59.903679 (+   193us) write_op.cc:270] Start()
0709 12:25:59.903842 (+   163us) write_op.cc:276] Timestamp: P: 1783599959903603 usec, L: 0
0709 12:25:59.903880 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:25:59.925459 (+ 21579us) log.cc:844] Serialized 5055 byte log entry
0709 12:26:00.209801 (+284342us) op_driver.cc:464] REPLICATION: finished
0709 12:26:00.371338 (+161537us) write_op.cc:301] APPLY: starting
0709 12:26:00.371451 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:00.742993 (+371542us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:00.743117 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:01.087385 (+344268us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:01.295764 (+208379us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:26:01.295869 (+   105us) write_op.cc:312] APPLY: finished
0709 12:26:01.296435 (+   566us) log.cc:844] Serialized 121 byte log entry
0709 12:26:01.655739 (+359304us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.670506 (+ 14767us) write_op.cc:454] Released schema lock
0709 12:26:01.767050 (+ 96544us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:01.830581 (+ 63531us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.834646 (+  4065us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2620252,"reported_tablets":32,"spinlock_wait_cycles":481536,"child_traces":[["op",{"apply.queue_time_us":161109,"apply.run_cpu_time_us":42600,"apply.run_wall_time_us":1431392,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58545,"num_ops":13,"prepare.queue_time_us":174468,"prepare.run_cpu_time_us":20256,"prepare.run_wall_time_us":136310,"raft.queue_time_us":184639,"raft.run_cpu_time_us":5701,"raft.run_wall_time_us":87703,"replication_time_us":286196,"thread_start_us":606159,"threads_started":5,"wal-append.queue_time_us":442509,"wal-append.run_cpu_time_us":53344,"wal-append.run_wall_time_us":2408165}]]}
I20260709 12:26:07.780515 18841 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:07.840979 18847 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:07.784157 18920 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:07.783210 18846 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:07.786761 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.787936 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.788348 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.843268 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:07.843911 18764 raft_consensus.cc:2368] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:07.788878 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.789049 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.789196 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.789855 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.789930 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:07.846340 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71360.8us
I20260709 12:26:07.846722 18769 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:26:07.790143 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.847856 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:07.848367 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.829864 25811 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:07.751969 25945 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.836841 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:07.852537 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:07.836388 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.850381 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:07.855891 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:07.857339 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.858775 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.862522 18840 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:07.862782 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.864804 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.865363 18812 leader_election.cc:400] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:07.866338 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:07.869720 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.870997 18845 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:07.840171 26134 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.873772 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:07.880311 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:07.881839 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:07.845079 25881 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:07.852963 26098 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:26:07.895006 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.900261 18773 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:07.852689 25886 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:07.860703 25811 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:07.854188 25992 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:07.897091 18812 leader_election.cc:400] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18.
I20260709 12:26:07.874261 25888 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:07.886108 25821 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.853103 26003 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.944391 19490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:26:07.945138 19490 raft_consensus.cc:606] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:07.945533 19490 raft_consensus.cc:614] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:07.919085 26141 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:07.919526 26098 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:07.895392 26134 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:07.867861 26075 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:07.924074 18846 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:07.872803 25894 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:07.894693 26008 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:26:07.895524 26165 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.927137 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:07.971020 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43973.7us
I20260709 12:26:07.972842 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:07.892468 25991 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:07.934137 25888 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:07.928687 25992 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:07.868507 26140 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:26:07.922171 26115 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:07.872991 26002 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.055s
I20260709 12:26:07.852025 26119 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:07.953969 18841 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:26:07.872735 25863 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:08.007395 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:07.966667 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.967036 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:08.009090 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:08.014550 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.015836 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.983203 26003 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:07.975737 25991 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.965447 25894 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:07.987540 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.988384 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.990610 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.991986 25957 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:07.992291 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.993784 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:08.042771 18767 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:07.996273 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:07.997635 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.998426 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:07.999315 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:08.000160 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:08.003966 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.001698 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:08.014690 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 132970us
I20260709 12:26:07.983814 25886 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:08.002529 25888 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:08.021082 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:08.035013 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:07.947744 25821 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.022318 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:08.060222 18847 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:08.060494 18841 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:26:08.061956 18847 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:08.062674 18841 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:26:08.003928 25992 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:08.025231 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:08.041021 25894 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:08.043114 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 162888us
I20260709 12:26:08.071684 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.073304 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.017849 26002 consensus_queue.cc:1243] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 23.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:26:08.047420 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.046175 18771 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
W20260709 12:26:08.075883 26172 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:26:08.078851 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:08.080819 25821 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:08.049341 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47742.3us
I20260709 12:26:08.084309 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.085299 26141 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:08.085672 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:07.953083 26052 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:26:08.024632 25991 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:08.023881 26114 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.091295 18764 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 12:26:08.060038 25945 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.004308 26084 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.093853 26165 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:08.067457 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:08.094094 26083 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:08.094908 18773 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:08.040673 26019 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.095815 26019 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.096920 18772 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:26:08.098243 26019 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:08.099092 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:08.099798 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.100015 26018 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:08.101375 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.101563 26018 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:08.102242 26171 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:26:08.093997 26084 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.102355 26018 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:08.110345 26018 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.110893 25991 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.109046 26119 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:08.113935 25881 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:08.085702 26141 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:08.105942 26084 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:08.116731 26019 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:08.117419 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:08.118251 18772 raft_consensus.cc:606] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.119133 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.120316 25957 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:08.120500 26175 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.120309 26115 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:26:08.121934 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74615.4us
I20260709 12:26:08.065454 25959 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:08.121927 26115 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:08.047066 25886 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.123222 25886 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:08.123569 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:08.127226 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54017.6us
I20260709 12:26:08.127395 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.128302 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.129513 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.115571 26141 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.140240 26141 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:08.018543 26090 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:26:08.147867 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 102212us
I20260709 12:26:08.131206 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:08.113395 25991 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:08.136153 25863 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:08.136183 26064 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:08.136828 25957 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.137429 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.138497 26175 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:08.143297 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:08.186833 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.165407 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.168049 26008 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:08.200071 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 62731us
I20260709 12:26:08.202080 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.205823 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.210594 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.211949 18916 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 21 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:26:08.210124 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.213595 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.214535 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.215055 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.215873 18919 raft_consensus.cc:2410] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:26:08.147294 26010 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:08.217468 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52159.9us
I20260709 12:26:08.218187 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:08.214732 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.215255 18918 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 13.
I20260709 12:26:08.218678 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.221704 18916 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:08.223551 25992 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.207288 25959 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:08.226045 25992 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:08.227350 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.232403 18914 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:08.167132 25863 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:08.232677 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.210073 26008 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.210724 26175 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:08.221290 26064 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:08.164539 26003 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:26:08.230804 25991 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:08.193136 26114 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 12:26:08.200915 26098 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:26:08.241704 26008 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:08.244690 26176 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:08.238297 25863 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:08.246722 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:08.260054 26176 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:08.235692 25888 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.258667 25886 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.283349 26176 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.245216 26175 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.287467 26134 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.287981 26175 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:08.292454 26174 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
I20260709 12:26:08.296356 26134 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:08.336282 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.343740 18769 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:08.347259 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:08.367208 26175 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.368324 26175 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.370815 26134 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:08.371917 26134 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.376266 26131 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:08.377095 26131 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.377655 26131 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:08.378408 18914 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:26:08.380446 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.384259 26134 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:08.241562 25811 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:08.388716 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 155859us
I20260709 12:26:08.394747 26025 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:08.389690 26003 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.405125 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:08.409037 26034 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:26:08.363410 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 116642us
I20260709 12:26:08.445331 18772 raft_consensus.cc:606] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:08.455044 18848 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:08.455296 25888 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:08.459170 18919 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:26:08.459924 25811 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:08.469336 26115 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:08.469516 25894 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.471541 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:08.472946 18772 raft_consensus.cc:606] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.473380 25894 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:08.473767 18772 raft_consensus.cc:614] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:08.476750 25991 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:08.476846 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:08.478068 25991 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.500761 18916 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:08.503705 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.508267 25886 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:08.509577 25945 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:08.523850 26175 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:08.525419 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 178550us
I20260709 12:26:08.437443 26034 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:08.540674 25881 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:08.541523 25881 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.542094 25881 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:08.543247 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:08.548584 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.551605 26090 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:26:08.553069 26090 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:08.552695 26131 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.553640 26090 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:08.557596 18915 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:08.558631 18917 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 12:26:08.559065 26131 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:08.561034 18918 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:08.567619 26090 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.571384 18922 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:26:08.572008 18922 pending_rounds.cc:85] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 10
I20260709 12:26:08.572309 18922 pending_rounds.cc:107] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:26:08.572618 18922 raft_consensus.cc:2889] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:08.482249 25991 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:08.579986 25959 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:08.583354 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.595424 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:08.599531 18917 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:08.596271 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.595558 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:08.600916 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 101812us
I20260709 12:26:08.611016 26052 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:08.614753 18772 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:26:08.616930 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 87120.7us
I20260709 12:26:08.618824 26188 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.626856 18916 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:08.628633 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:08.632367 25959 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:08.632833 25959 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.633301 25959 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:08.633797 19489 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:08.634133 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:08.642328 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.580513 26034 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.667152 25849 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:26:08.671202 26165 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:08.671901 25849 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:08.672416 25849 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:08.672207 26165 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.659130 25886 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:08.674639 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:08.681015 18914 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:08.686474 25811 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:08.685971 25886 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.687562 25811 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.689918 18913 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:08.692529 25821 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:08.693163 26199 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:26:08.694357 25821 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:08.694825 26139 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:08.695011 25821 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:08.695472 26139 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:08.696552 26195 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:26:08.696667 25821 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.701017 25849 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.682232 26034 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:08.702188 26090 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:08.711122 18922 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:08.713677 26198 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.252s	user 0.003s	sys 0.000s
I20260709 12:26:08.718192 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:08.718922 26194 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.174s	user 0.003s	sys 0.001s
I20260709 12:26:08.719969 25945 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.725852 18917 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:08.690155 25886 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:08.705541 25849 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:08.727339 25811 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:08.741165 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50131us
I20260709 12:26:08.747761 18922 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:08.752740 26142 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:08.756506 25834 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:26:08.740676 26098 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.758296 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:08.758092 26098 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.758991 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:08.759313 18839 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:08.761263 26098 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:08.759002 18847 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:26:08.765985 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 144684us
I20260709 12:26:08.696964 26139 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.761533 25945 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 12:26:08.779345 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.780275 25821 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:08.808142 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:08.815322 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53996.5us
I20260709 12:26:08.807848 26011 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.819593 26011 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.813884 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:08.823549 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:08.838598 18917 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:08.840384 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:08.851109 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:08.854562 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:08.855010 26201 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:26:08.854835 26025 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:08.855752 18765 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:26:08.855986 26025 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:08.856495 26025 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:08.857434 26202 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:26:08.854866 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:08.859170 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:08.860212 18846 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:08.860916 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:08.861902 18839 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:08.845841 26098 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.867734 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:08.868892 18770 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:08.852032 26011 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:08.871541 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 89139.6us
I20260709 12:26:08.857753 26025 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.877743 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:08.885648 26141 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:08.886204 26141 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:08.888810 26141 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.890666 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:08.891705 18773 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:08.890627 26141 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:08.903672 18921 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:08.904168 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:08.906531 26204 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:26:08.913575 26188 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:26:08.892292 26008 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.006s
I20260709 12:26:08.919023 19483 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:08.907145 26025 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:08.925215 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.929823 25987 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:08.930555 25834 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:08.930773 25987 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.931311 26139 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:08.929908 26011 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:26:08.933259 25987 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:08.933782 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.935652 26027 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:08.929550 26192 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.173s	user 0.000s	sys 0.002s
W20260709 12:26:08.937933 25863 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.007s
W20260709 12:26:08.945389 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:08.945996 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.927614 25881 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.971131 18764 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:08.971311 26064 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.971976 26064 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:08.928242 26008 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.946491 25863 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:08.991640 18773 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:08.965654 26165 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:08.998356 18845 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:26:08.974383 26064 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.002496 18919 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
W20260709 12:26:09.013157 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 109134us
I20260709 12:26:09.016880 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:09.018209 18916 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:08.970328 26027 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.029747 25859 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:26:09.035341 26008 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:09.036650 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:09.050374 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.051273 18913 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:09.055686 25987 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:09.055940 25849 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:09.056468 25987 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:09.057715 26196 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:09.058193 26196 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:09.058447 26034 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:09.055739 25859 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:09.060542 25859 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:09.060949 25859 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:09.061717 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.059376 26196 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.087105 26196 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:09.091753 25811 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:09.092383 25811 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:09.093021 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.100598 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.100936 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.100786 26068 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:09.101716 19485 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:09.102140 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:09.093659 25811 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:09.103356 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.104295 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:09.104549 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.092391 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:09.110649 26139 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:09.111162 18847 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:09.112457 26196 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:09.112694 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:09.114102 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:09.091782 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.057984 25987 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.160867 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:09.062130 25859 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:09.165051 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43988.3us
I20260709 12:26:09.166313 25859 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:09.168143 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:09.170464 25849 consensus_queue.cc:1175] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47b48b5c69f245b79ecb292eff89927f" responder_term: 23 status { last_received { term: 23 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 23 index: 12 } }
I20260709 12:26:09.171396 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:09.172227 18842 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:09.173310 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:09.163662 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:09.164785 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:09.176129 18846 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:09.176839 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:09.165163 18847 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:09.174261 18842 raft_consensus.cc:2410] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:26:09.197410 19491 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
W20260709 12:26:09.199842 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 142307us
I20260709 12:26:09.205876 19485 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:09.206560 26008 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:09.209297 26008 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.209776 26008 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:09.222807 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.233965 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.234912 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.235741 18920 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:09.236094 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 122752us
W20260709 12:26:09.240756 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.226073 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:09.226670 25959 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.004s
I20260709 12:26:09.244284 19487 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:09.216746 25881 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.250039 25863 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:09.254806 26027 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.255159 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:09.256520 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:09.257545 26203 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:26:09.258476 18840 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:09.247045 25987 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:09.257220 25894 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:26:09.250540 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.263531 26008 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.215693 26188 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:26:09.266901 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 162828us
I20260709 12:26:09.241801 26064 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.269264 26064 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.269250 26008 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:09.271236 26008 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:09.271767 26008 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:09.272627 26064 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.272847 26008 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.276747 25863 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:09.249588 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:09.220304 25991 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:09.303923 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 83174.7us
I20260709 12:26:09.361768 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:09.362246 25991 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.365254 25991 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.249182 25959 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:09.311020 25821 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.005s
W20260709 12:26:09.375321 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:09.376708 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74066.5us
I20260709 12:26:09.378085 26025 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:09.400063 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:09.400887 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 144450us
W20260709 12:26:09.413650 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 162714us
I20260709 12:26:09.389211 26025 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:09.425527 26219 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:09.426815 26025 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:09.443073 25959 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:09.446527 26218 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:26:09.386240 25859 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.448099 25859 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.425804 26223 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.450904 26223 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.453649 26223 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.425630 25881 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:09.456250 25881 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.458709 25925 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:09.459882 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.460173 25925 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:09.460668 25925 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:09.428423 26219 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.462472 26219 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:09.425606 26045 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:26:09.409085 26220 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.475776 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.476660 19483 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
W20260709 12:26:09.480475 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57458.9us
I20260709 12:26:09.490862 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:09.508143 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:09.539259 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 48534.2us
I20260709 12:26:09.539395 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.540323 19483 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 26 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:26:09.493047 25863 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:09.547781 18918 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:26:09.549543 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.551496 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.552407 18773 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
W20260709 12:26:09.554503 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50801.7us
I20260709 12:26:09.461758 25925 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.555657 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:09.556964 26228 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:09.509130 25881 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.489588 26223 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:09.509130 25859 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.549682 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.549515 18920 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:09.569167 26228 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:09.573025 26223 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.575109 26215 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.502545 26188 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:26:09.547796 26229 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:09.510216 26220 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.509821 25821 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:26:09.545126 26045 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:09.580266 26219 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.581418 26025 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.582000 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:09.582979 25863 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.585028 18914 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:09.587395 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:09.586750 26228 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:09.591228 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44544.4us
I20260709 12:26:09.596395 26045 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:09.601925 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.604990 26025 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.607092 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:09.607616 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:09.608429 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:09.607663 26225 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:09.609434 26225 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:09.609669 26228 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.595810 26229 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:09.610852 26229 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:09.610440 26225 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.600556 25991 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:09.611567 25991 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:09.611853 26225 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:09.612646 25991 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.599541 26215 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.618578 26215 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.619285 26215 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:09.619774 26230 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:09.612022 25881 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:09.620271 26230 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:09.620796 25881 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.621254 25881 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:09.616338 26045 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.603137 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:09.624266 18913 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:09.624207 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.627959 19487 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:09.632717 25925 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:09.634675 18913 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:09.598695 26220 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.598695 26219 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.640354 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.642863 26223 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.647121 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:09.646030 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.647447 18773 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:09.650473 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:09.654892 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 67592.9us
I20260709 12:26:09.661242 18768 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:26:09.621990 26228 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:26:09.683885 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 74242.6us
I20260709 12:26:09.684582 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.685405 18772 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: [14.8-15.9]
I20260709 12:26:09.685335 18773 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:09.687265 25859 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:09.689455 26215 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:09.690016 26215 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:09.691584 26215 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.695292 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:09.696216 26215 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:09.700129 26027 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:09.700728 26027 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.701165 26027 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:09.706965 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:09.717193 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:09.716466 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:09.664589 25991 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:09.718811 18848 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:09.716717 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:09.661784 26220 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:09.718508 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:09.719944 18770 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:26:09.721330 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:09.735514 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.732678 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:09.686005 26228 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:09.621474 26230 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.738556 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:09.738835 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.740545 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:09.741776 18913 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:09.720490 26045 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:09.744277 19487 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:09.727653 26219 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:09.742867 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:09.748937 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:09.750483 18843 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:09.754715 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.756506 26141 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:09.762861 18839 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:26:09.765329 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.735656 26098 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:09.767050 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:09.774117 18847 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:09.732591 26238 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.778934 26238 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.780206 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:09.781013 18768 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:09.781908 26240 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.782883 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.783252 26228 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.746208 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.791528 18764 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:09.798926 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.745944 26045 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:09.803565 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.797017 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.806221 18767 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:09.815672 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:09.809963 18848 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
W20260709 12:26:09.822757 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 103658us
I20260709 12:26:09.823369 26141 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.827101 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.769026 26219 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:09.815096 26098 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.833586 18772 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:09.835078 26229 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.838865 18841 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:26:09.839241 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3208) took 1293 ms. Trace:
I20260709 12:26:09.845412 18843 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:09.804761 26240 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.784789 26236 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:09.859295 25886 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:09.873899 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:09.862136 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.807353 26045 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:09.870815 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:09.879994 18765 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:26:09.863912 26220 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:09.884188 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:09.865888 26142 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.867210 25959 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.886288 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.887331 18917 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 26 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:26:09.885906 25886 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.894439 26219 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.895515 25886 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.891264 26141 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.888449 26018 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:09.898311 26018 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:09.898921 26141 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.899375 26018 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.900755 25881 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.903669 25881 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.906222 18767 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:09.904277 25959 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.872536 26236 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.908154 18764 raft_consensus.cc:2410] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:26:09.885689 18847 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:09.912662 19483 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:09.916836 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:09.920508 26064 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:09.921594 26064 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.923738 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:09.923199 25834 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:09.924741 26146 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:09.925181 25886 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:09.925225 26146 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:09.926576 26146 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:09.927351 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.927846 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:09.929193 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:09.929699 26236 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:09.930622 25881 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:09.931088 25881 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:09.929410 26064 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.931496 25881 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:09.932775 26064 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:09.939987 26098 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:09.940585 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.941891 26229 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:09.944887 26236 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.950248 25959 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.952891 26240 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.953969 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:09.918545 26142 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:09.954849 26236 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:09.956084 18767 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:26:09.956801 26142 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:09.960095 26230 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:09.868499 18919 rpcz_store.cc:276] 0709 12:26:08.554935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:08.561893 (+  6958us) service_pool.cc:224] Handling call
0709 12:26:08.562366 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:09.007374 (+445008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:09.838778 (+831404us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54000348d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:09.839116 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000144768}
W20260709 12:26:09.971127 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 89627.9us
I20260709 12:26:09.948071 26027 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:09.968502 18768 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:26:09.973222 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:09.978434 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:09.983852 18773 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:09.985100 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:09.990768 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:09.974028 26229 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:09.992807 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:09.991329 26098 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.997709 26248 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:09.997910 26098 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:09.998754 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.001915 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:10.002561 25886 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:10.003237 25886 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.003731 25886 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.003943 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:10.004987 26098 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:09.982426 26240 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:10.012218 26027 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.015730 26233 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.016372 26233 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.006454 25959 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:10.015729 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:10.018981 25959 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:10.019912 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:10.020385 26011 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:10.021238 26233 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:10.021458 26064 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:10.022249 26064 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:10.024310 26011 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:10.020128 25959 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.006778 26225 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:10.027187 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:10.006547 26008 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:10.032807 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.054610 18846 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:10.035194 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3222) took 1250 ms. Trace:
I20260709 12:26:10.043061 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:10.045220 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:10.032807 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:10.056897 18915 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:10.059417 26226 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.062865 26008 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.063493 26008 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:10.063139 26226 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.064414 25886 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.065853 26226 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.068823 25881 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.070793 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:10.071774 19485 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.073024 26165 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.073675 26165 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.053942 26245 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:10.075152 26245 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.075805 26245 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:10.055895 18916 rpcz_store.cc:276] 0709 12:26:08.784940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:08.785151 (+   211us) service_pool.cc:224] Handling call
0709 12:26:08.785650 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:09.022414 (+236764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:10.034923 (+1012509us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400334854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:10.035127 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521599744}
I20260709 12:26:10.088002 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:10.088506 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 84658.5us
W20260709 12:26:10.090652 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 96520.3us
W20260709 12:26:10.093173 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56264.6us
I20260709 12:26:10.085937 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:10.096946 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.102169 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:10.097506 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:10.098443 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.046614 26011 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:10.105540 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:10.101378 18738 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.553s (SENT)
I20260709 12:26:10.106710 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:10.107126 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.107820 25881 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.108672 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.109411 18765 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:10.096724 25894 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:10.110836 26027 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:10.110966 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 133908us
I20260709 12:26:10.111811 18773 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:10.115622 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.116312 18846 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:26:10.116055 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.115931 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:10.120078 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:10.121356 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.127442 18842 raft_consensus.cc:2368] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:26:10.133534 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.134510 18773 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:10.137643 18922 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:10.145715 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.146067 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:10.113168 26064 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:10.115425 26225 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:10.083688 26229 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.150209 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.124344 26233 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:10.151784 18846 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:10.118780 25894 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:10.161585 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:10.173223 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 153367us
W20260709 12:26:10.155354 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.112954 26220 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.178056 26220 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.180773 25811 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.186122 25834 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.187062 25834 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.117476 26240 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:26:10.194335 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.195259 18842 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:10.146687 26215 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:10.197782 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 89604.6us
I20260709 12:26:10.201231 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:10.204149 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:10.155359 26188 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:10.211563 25863 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.212047 26256 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:10.212306 25863 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:10.214665 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:10.215294 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.214872 26011 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:10.212090 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80905.1us
I20260709 12:26:10.218055 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:10.218952 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44665.9us
I20260709 12:26:10.220974 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:10.230293 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:10.216392 26011 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:10.205288 25991 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:10.157347 25925 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:26:10.207749 25945 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:10.235416 19485 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:10.238306 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:10.241407 26247 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:26:10.226891 25849 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:10.249970 26248 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:10.250690 26248 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:10.251682 26248 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.226512 26188 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:10.234476 26098 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:10.255160 18847 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:26:10.234850 26225 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:10.249768 18915 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
W20260709 12:26:10.246498 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 122135us
I20260709 12:26:10.217670 26215 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.279598 18921 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:10.234728 26231 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.210s
I20260709 12:26:10.291311 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:10.296917 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.297343 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.300033 18765 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:10.265107 26225 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.315240 26225 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:10.283551 25811 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:10.315889 25811 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.316301 25811 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:10.290021 26255 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:26:10.340752 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120540us
I20260709 12:26:10.344347 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:10.280534 25881 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:10.371311 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51504.1us
I20260709 12:26:10.282259 25859 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.282289 26233 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:10.380002 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:10.375388 18770 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:10.374157 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:10.286424 26258 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:10.389698 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:10.393863 19485 raft_consensus.cc:2368] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:26:10.338733 26165 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.398113 19487 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
W20260709 12:26:10.399101 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.320518 26230 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 12:26:10.373616 26256 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:10.278829 25894 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.381295 26240 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.455607 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.453897 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.458616 19490 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:10.461405 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.458674 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:10.468757 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.433591 26229 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.433318 25863 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.480588 18770 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:10.388919 25859 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.477046 18913 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:10.453370 26220 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.390252 26263 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 12:26:10.454649 26098 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:10.493788 26272 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:10.495096 26229 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:10.495462 26268 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:10.456998 25834 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:10.522655 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:10.496436 26045 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.004s
I20260709 12:26:10.497155 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:10.501775 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.502663 26264 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:10.505717 25886 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.465473 25959 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.510464 26229 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.510195 26272 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:10.555634 26254 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 12:26:10.556145 26268 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:10.556612 26260 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:26:10.560742 25859 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.510170 26256 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.569155 26233 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.571331 25821 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:10.529181 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:10.571977 18767 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:10.466447 26240 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.432523 26188 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.583155 19489 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:26:10.590082 25834 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:10.602012 26008 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.000s
I20260709 12:26:10.581625 19491 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:10.586334 26045 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.570933 25863 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.624608 18886 leader_election.cc:400] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:26:10.570529 26098 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.602627 26027 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:10.627130 18886 leader_election.cc:403] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:10.630242 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.611917 25859 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:10.636034 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 432001us
W20260709 12:26:10.636862 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 248707us
I20260709 12:26:10.636914 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:10.624673 26008 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.641805 18764 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:10.643404 18771 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:10.595527 26264 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.643953 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.644418 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:10.656561 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.634619 25959 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.610046 26268 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.660722 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:10.663250 26098 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:10.664333 26245 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.006s
I20260709 12:26:10.664808 26245 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.665266 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.666160 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:10.666473 18917 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.666209 18922 raft_consensus.cc:2410] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:26:10.668670 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:10.674190 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.675591 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:10.675736 26045 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.676343 18913 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:10.688949 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.668488 26146 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:10.628437 25834 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.680788 26268 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.680938 18769 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:10.682330 26225 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.684358 18919 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:10.684784 26264 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.642212 25859 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.685500 26008 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:10.686105 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.704880 18914 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:10.705888 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:10.706282 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:10.687120 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:10.639497 25863 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.715528 26279 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.692636 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:10.716276 26279 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.622684 25821 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.718591 26273 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:10.718835 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:10.719599 19491 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:10.719290 26273 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.644966 26263 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:10.641090 26271 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.695379 18916 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:10.696864 26215 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.707665 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:10.711740 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.706683 26268 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.738775 26268 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.739248 25811 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.741459 26268 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.742463 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.743127 26279 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.743453 18840 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:26:10.744526 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.745853 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:10.724023 26263 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.747051 26263 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:10.748028 26272 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.734578 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:10.715269 25886 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.720726 18766 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:10.721915 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:10.723392 18887 leader_election.cc:400] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
W20260709 12:26:10.757140 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49636.1us
I20260709 12:26:10.758227 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:10.727885 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:10.760720 19491 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:10.726842 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.735663 26139 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:10.736294 18843 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.736948 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:10.762084 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:10.737898 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.738080 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.741556 25811 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.746734 18842 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:10.713415 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:10.751185 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.770661 18915 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 24 because replica has last-logged OpId of term: 22 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 9.
I20260709 12:26:10.720726 26229 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.765807 18916 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:10.714762 19489 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:26:10.720373 25821 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.725414 26264 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:10.759544 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:10.731032 26027 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:26:10.777451 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 90493.1us
I20260709 12:26:10.781102 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.784970 18767 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 24 because replica has last-logged OpId of term: 22 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 9.
I20260709 12:26:10.778424 18917 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 14.
I20260709 12:26:10.796145 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:10.696023 25959 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.801651 18914 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:10.768239 26272 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:10.803648 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.804819 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:10.802211 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:10.771057 26011 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.000s
I20260709 12:26:10.798287 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:10.776886 26279 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:10.803871 26229 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:10.780725 26268 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:10.782588 26264 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.823237 18919 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:10.823796 18843 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 12:26:10.826079 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:10.809710 26272 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.809129 26238 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:10.834717 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:10.835354 18845 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:26:10.835551 18848 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:10.836417 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:10.811216 26027 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:10.839455 18768 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:10.795163 25886 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:10.851576 25886 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.844208 26225 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:10.824316 26229 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.854041 26229 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:10.813494 26248 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:10.840418 18841 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:10.874933 18771 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:10.831079 26264 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:10.844208 25863 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:10.844703 26253 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:10.845124 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:10.846460 26277 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:10.846383 26027 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.826952 26139 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:10.848703 25959 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.882987 26253 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.830588 26279 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:10.822700 26258 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:10.862251 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57507.6us
I20260709 12:26:10.838842 26272 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:10.884215 18845 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: [18.9-20.10]
I20260709 12:26:11.092872 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:11.092872 26258 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.093904 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:11.094576 18845 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:11.095381 26258 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.097612 26215 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:10.884734 18842 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:26:11.099188 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.099411 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:11.100013 18842 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:11.100668 25849 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.101235 25849 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:10.888685 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:10.890357 26273 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:10.874851 26268 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.018858 26139 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.894879 26248 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:11.022255 25834 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.927785 26064 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:11.025216 25987 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:10.886569 26240 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:11.021713 26229 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.122802 26263 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.123492 26229 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:11.125387 26271 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19.
I20260709 12:26:11.126454 25859 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.126652 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 1253) took 1088 ms. Trace:
I20260709 12:26:11.127024 18847 rpcz_store.cc:276] 0709 12:26:10.038079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:10.038248 (+   169us) service_pool.cc:224] Handling call
0709 12:26:11.126319 (+1088071us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400238f54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:11.126507 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349779712}
I20260709 12:26:11.135542 26273 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:11.136212 26273 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:11.137137 26273 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.141780 25859 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:11.142678 25859 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.145596 25859 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:11.119172 26064 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:11.151839 26064 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.153097 26064 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:10.894845 26253 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:11.018613 26279 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.045135 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3230) took 1323 ms. Trace:
I20260709 12:26:11.163362 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.051214 19457 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:11.054982 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3239) took 1029 ms. Trace:
I20260709 12:26:11.058311 25863 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.061152 26264 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.071492 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.073916 26225 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.075556 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.075865 18917 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:11.185616 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:11.186677 18917 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:10.888760 26238 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
W20260709 12:26:11.194496 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 143404us
I20260709 12:26:11.196035 18845 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:10.894723 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:10.862516 26245 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:10.883425 26277 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:11.100742 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:11.114689 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 225958us
I20260709 12:26:11.212541 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:11.120285 25987 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:11.120855 25849 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.163344 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.165167 18919 rpcz_store.cc:276] 0709 12:26:10.025940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:10.026891 (+   951us) service_pool.cc:224] Handling call
0709 12:26:11.054768 (+1027877us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54000e4054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:11.054894 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451468544}
I20260709 12:26:11.167980 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.163938 18921 rpcz_store.cc:276] 0709 12:26:09.721923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.722895 (+   972us) service_pool.cc:224] Handling call
0709 12:26:11.044880 (+1321985us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b5400335c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:11.045025 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249378688}
I20260709 12:26:11.182173 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.183516 18918 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:11.216154 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.193658 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:11.217423 18914 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:11.217793 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:11.200104 18766 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:11.200429 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.218820 18847 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:11.145959 26272 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.201212 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.247116 18917 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:11.246328 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:11.238091 18671 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 166) took 63976 ms (client timeout 15000 ms). Trace:
I20260709 12:26:11.204902 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.205852 18922 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:11.205914 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.207509 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.260684 18845 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:11.220656 26268 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.221153 25859 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.222759 26271 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:11.208928 26259 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:11.223599 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.224251 26263 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.226747 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:11.227206 26287 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:11.228914 19489 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:26:11.276048 18840 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:11.277009 26272 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:11.277362 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.233178 25987 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.215397 26248 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.278919 25987 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:11.279181 26248 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.281610 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:11.235249 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.193420 25863 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.282330 19492 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:11.283432 26259 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.283846 26259 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:11.284034 18913 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:26:11.284154 25863 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:11.203171 26240 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:11.285120 26240 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:11.286459 25849 consensus_queue.cc:1175] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47b48b5c69f245b79ecb292eff89927f" responder_term: 21 status { last_received { term: 20 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:11.278290 18840 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:26:11.183086 25834 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.287912 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:11.200578 26225 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.237740 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:11.238873 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.239950 26264 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:11.240753 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 183346us
I20260709 12:26:11.241405 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.241693 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:11.242770 25945 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:11.243470 26238 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:11.216346 26277 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:11.246328 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:11.310796 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.311777 18915 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
W20260709 12:26:11.260708 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54918us
I20260709 12:26:11.207582 18841 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:11.265516 18846 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:11.265779 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.266835 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:11.267927 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:11.314327 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.270063 18842 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:11.265517 26245 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:11.287514 26240 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:11.236559 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.229388 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2717) took 1484 ms. Trace:
I20260709 12:26:11.252190 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:11.288453 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:11.337826 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 85714.1us
I20260709 12:26:11.338171 18840 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:11.301304 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:11.338837 18768 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:11.304471 18770 raft_consensus.cc:2368] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24.
I20260709 12:26:11.315923 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.312870 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.331265 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:11.342454 18845 raft_consensus.cc:2368] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:26:11.332159 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.288058 25834 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.331274 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:11.343362 18847 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:11.335188 18921 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 24: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:11.337509 18769 rpcz_store.cc:276] 0709 12:26:09.744770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.744933 (+   163us) service_pool.cc:224] Handling call
0709 12:26:10.680729 (+935796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:10.703769 (+ 23040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:11.229159 (+525390us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54000aebd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:11.229308 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143699840}
I20260709 12:26:11.346491 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:11.281638 26248 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:11.365064 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.359174 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.363489 18917 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:11.364123 18842 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:11.369316 18918 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:11.373745 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:11.375727 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.376652 18846 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:26:11.379756 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.380735 18918 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:11.382849 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.387001 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.390026 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.334780 26252 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:11.391299 18771 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:11.394070 18848 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:26:11.394599 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:11.396492 18773 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:11.394688 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:11.398640 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.359659 26263 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:11.352568 26268 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:11.352802 26266 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:11.401121 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.353735 26262 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.294862 25859 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.407342 18769 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:11.400390 26256 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:11.351821 25945 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.413456 26262 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.413887 26256 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:11.414670 26256 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:11.416227 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:11.416792 18843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.021s	sys 0.006s
I20260709 12:26:11.413084 18771 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:11.417963 18768 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:11.419037 18814 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:11.417622 18843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.022s	sys 0.006s
I20260709 12:26:11.415623 25945 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:11.256003 18671 rpcz_store.cc:269] 0709 12:25:07.262048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.295293 (+ 33245us) service_pool.cc:224] Handling call
0709 12:26:11.237816 (+63942523us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.027076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.028001 (+   925us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.028059 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:26:08.028083 (+    24us) tablet.cc:662] Decoding operations
0709 12:26:08.028676 (+   593us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.028808 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.028855 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:26:08.029334 (+   479us) tablet.cc:701] Row locks acquired
0709 12:26:08.029365 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:26:08.029588 (+   223us) write_op.cc:270] Start()
0709 12:26:08.029778 (+   190us) write_op.cc:276] Timestamp: P: 1783599968029509 usec, L: 0
0709 12:26:08.029819 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.030893 (+  1074us) log.cc:844] Serialized 907 byte log entry
0709 12:26:08.083648 (+ 52755us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b
0709 12:26:08.682920 (+599272us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.708732 (+ 25812us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335e9c1ef0
0709 12:26:08.855849 (+147117us) write_op.cc:301] APPLY: starting
0709 12:26:08.855999 (+   150us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:08.858186 (+  2187us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:08.858216 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:08.895118 (+ 36902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:08.895447 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:26:08.895513 (+    66us) write_op.cc:312] APPLY: finished
0709 12:26:08.895942 (+   429us) log.cc:844] Serialized 33 byte log entry
0709 12:26:08.905228 (+  9286us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.905371 (+   143us) write_op.cc:454] Released schema lock
0709 12:26:08.905436 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:08.908369 (+  2933us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.908399 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2858912,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":166002,"apply.run_cpu_time_us":6417,"apply.run_wall_time_us":52519,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":191092,"prepare.run_cpu_time_us":16923,"prepare.run_wall_time_us":212296,"raft.queue_time_us":383140,"raft.run_cpu_time_us":59586,"raft.run_wall_time_us":171687,"replication_time_us":638923,"spinlock_wait_cycles":33290112,"thread_start_us":847789,"threads_started":4,"wal-append.queue_time_us":240563,"wal-append.run_cpu_time_us":48477,"wal-append.run_wall_time_us":1627944}]]}
I20260709 12:26:11.425455 26259 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.413372 18666 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 16, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 16 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:11.428188 26259 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.405282 26252 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.428220 18666 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.434540 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.403227 26245 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:11.454798 18765 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:11.456393 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.458230 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:11.458880 18917 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:11.459276 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53469.6us
I20260709 12:26:11.460072 18666 catalog_manager.cc:5697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 21, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 21 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:26:11.461006 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57153.9us
I20260709 12:26:11.461577 18914 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:26:11.462365 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.452824 25945 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:11.468327 18773 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:11.470661 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.415669 26262 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:11.465204 18666 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 16, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 16 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.474148 18918 raft_consensus.cc:2393] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 24: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:11.480253 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.429939 26266 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:11.483940 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:11.485541 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.486459 18915 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:26:11.486989 18915 pending_rounds.cc:85] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 8
I20260709 12:26:11.486795 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:11.487354 18915 pending_rounds.cc:107] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:26:11.487567 18772 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:11.487740 18915 raft_consensus.cc:2889] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:11.486749 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.486217 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:11.490703 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.457324 26263 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:11.473068 18666 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:11.546913 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:11.489377 18887 leader_election.cc:400] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:26:11.556564 18887 leader_election.cc:403] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:26:11.556607 19492 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
W20260709 12:26:11.557246 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68016.1us
I20260709 12:26:11.558022 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:11.548026 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.549700 18842 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:11.484088 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:11.554977 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70960.1us
W20260709 12:26:11.569458 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 106963us
I20260709 12:26:11.558820 18839 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:11.546114 26238 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.572477 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.577741 18773 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:11.490187 26245 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:11.547430 26268 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:11.573441 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:11.550072 26264 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:11.573134 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:11.580364 26266 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.600186 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.600448 26225 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:11.603515 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.571950 26259 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:11.576663 25863 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:11.604986 25863 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.604650 26259 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.605404 25863 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:11.609624 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:11.610591 18843 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:11.613008 18847 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:26:11.613441 18847 pending_rounds.cc:85] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 13
I20260709 12:26:11.613657 18847 pending_rounds.cc:107] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:26:11.613888 18847 raft_consensus.cc:2889] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:11.567901 18666 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.571022 26272 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 12:26:11.620504 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 370064us
I20260709 12:26:11.546954 26253 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.616403 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:11.577806 26025 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:11.545931 26273 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 12:26:11.582779 26238 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:11.625442 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:11.636454 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 144580us
I20260709 12:26:11.637140 18842 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:11.637470 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:11.624019 18913 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:11.627391 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.644605 18917 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:26:11.593708 26248 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.630971 18772 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:26:11.632939 18843 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
W20260709 12:26:11.628069 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55023.3us
I20260709 12:26:11.651005 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:11.623324 18666 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 20, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 20 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.656504 19491 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:11.658455 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:11.663439 18666 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 15 to 18, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 18 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.642004 26238 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.643280 26027 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:11.593559 26282 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 12:26:11.672294 18767 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:11.671734 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.665323 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:11.679491 18764 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:11.645181 26025 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:11.694315 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:11.647349 26233 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
I20260709 12:26:11.673069 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.665323 26262 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:11.664930 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:11.695874 18913 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:11.669374 26228 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:11.680954 18666 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 21, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 21 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:11.669885 26268 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:11.622656 26302 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:11.669687 25881 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:11.684383 26240 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:11.709100 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:11.661283 26064 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:11.686358 26027 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.748457 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:11.788175 18840 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:11.751878 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:11.671023 26248 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.752522 26228 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.710035 26139 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:11.720273 26262 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:11.798426 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 186097us
I20260709 12:26:11.674496 26223 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:26:11.758984 26025 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:11.760113 26293 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:26:11.760346 26064 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:26:11.761227 26294 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:26:11.767957 26240 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.770807 25945 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:11.746156 26259 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:11.774730 25881 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.724233 26245 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:26:11.784252 25863 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.701206 26252 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.705827 26236 raft_consensus.cc:2764] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:26:11.663203 26277 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:11.788393 18843 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:11.674276 26165 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:26:11.758846 25859 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.796197 18839 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:26:11.789105 18841 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:11.795750 18666 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 18, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 18 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:11.759196 26296 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:26:11.722079 26268 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.708655 25974 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:11.871994 26268 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:11.806903 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:11.798322 26011 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:11.797809 26139 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:11.873068 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66289.7us
I20260709 12:26:11.873368 26139 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:11.747599 26302 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.878693 26302 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:11.881059 26251 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:11.881718 26251 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:11.795221 26027 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:11.882099 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:11.797938 26279 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:11.800379 26262 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:11.891876 26297 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 12:26:11.896510 18844 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:11.897421 26277 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:11.900727 18845 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:26:11.885931 26251 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.903743 25863 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:11.835608 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:11.831236 26064 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:11.862105 26263 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:11.863236 26253 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:11.917222 26064 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:11.919438 26299 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.234s	user 0.003s	sys 0.000s
I20260709 12:26:11.925243 26228 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:11.927875 26240 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:11.871214 25881 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:11.872047 25974 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:11.809796 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 100812us
I20260709 12:26:11.844408 18666 catalog_manager.cc:5697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 8 to 11, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 11 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:11.933034 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:11.932816 18666 catalog_manager.cc:5697] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 4 to 14. New cstate: current_term: 14 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:11.934947 18666 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 18, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 18 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.940776 18666 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 18, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 18 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:11.945746 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 267005us
I20260709 12:26:11.946887 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:11.950942 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 326400us
I20260709 12:26:11.953550 18666 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.937222 25974 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:11.967360 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:11.969784 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.944082 25859 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:11.959018 18666 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 16, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 16 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:11.955022 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:11.975214 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:11.995078 18666 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:11.980859 26165 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:11.910465 26238 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:11.954414 26263 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:12.008422 26238 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:12.009310 18916 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
W20260709 12:26:12.011915 26256 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.000s
I20260709 12:26:12.012543 26256 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.013793 18842 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:12.018913 26139 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.024065 26215 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:26:12.028164 26300 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 12:26:12.030790 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.031913 26027 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:12.037127 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 82178.8us
I20260709 12:26:12.027916 26308 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:12.041154 18666 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:12.044234 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:11.980585 26240 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:12.051007 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.038679 18842 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:12.038118 18886 leader_election.cc:400] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24.
I20260709 12:26:12.051924 18767 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:12.054543 18886 leader_election.cc:403] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:26:11.996773 26277 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:12.047756 18666 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 7 to 17, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 17 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:12.039698 26238 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:12.058179 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 83094.3us
W20260709 12:26:12.059041 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 394150us
I20260709 12:26:11.991415 26228 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 12:26:12.022125 26262 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.047775 26226 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:12.066111 18666 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 21, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 21 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.076571 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:12.081915 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:12.049619 26215 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.086194 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:12.051717 26240 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.092279 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:12.093797 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:12.095168 26248 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:12.096244 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:12.091251 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:12.056646 26277 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:12.054790 26308 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.122035 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.108703 26240 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:12.135110 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:12.108482 25859 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:12.115345 26277 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:12.145018 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 107056us
I20260709 12:26:12.146220 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:12.147878 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:12.148887 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:12.149484 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:12.145375 25859 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:12.097568 26304 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:26:12.161324 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:12.104159 26226 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.135870 26312 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.109308 26215 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.165370 18848 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:12.173409 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:12.146142 26233 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24.
I20260709 12:26:12.184278 26312 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.187423 26312 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.164465 26306 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:12.187918 25834 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:12.194381 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.194933 26268 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.195955 26253 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:12.197085 18847 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:12.197459 26268 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.198678 26289 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:12.199156 26289 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:12.167251 25849 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:12.200063 26289 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.201251 26289 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:12.201005 25849 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.203527 25849 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.160765 26011 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:26:12.204824 18839 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:12.208279 26318 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:12.152496 26258 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:12.209601 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:12.157984 26266 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:12.210431 18917 raft_consensus.cc:2368] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21.
I20260709 12:26:12.213065 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.160854 25859 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:12.223306 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:12.161008 26310 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:12.224298 18840 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:12.225446 18814 leader_election.cc:400] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21.
I20260709 12:26:12.228005 18814 leader_election.cc:403] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:26:12.229261 18848 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:12.229238 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:12.230175 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:12.230600 18919 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:12.156941 26248 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 12:26:12.231195 19485 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:26:12.232509 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:12.208788 26318 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:12.232973 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.209230 25863 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:12.245441 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:12.242347 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:12.244371 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:12.214252 26266 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:12.166224 25974 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:12.254904 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 132966us
I20260709 12:26:12.227006 26256 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:12.265738 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 139723us
I20260709 12:26:12.276472 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.266772 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:12.235105 25881 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.240376 25945 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21.
I20260709 12:26:12.250308 26279 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.276124 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:12.241671 26310 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:12.224023 26233 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:26:12.286374 26233 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:12.269488 26225 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.269765 26266 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:12.292420 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.238421 26258 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.292398 26225 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.293517 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.304517 25987 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:12.276140 26253 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:26:12.286003 26310 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.331491 18921 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:12.333221 26314 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:12.333762 26314 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:12.279493 26302 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.315254 26328 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:12.309753 26326 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:26:12.340127 26139 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.302237 26306 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:12.341674 26306 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.342175 26306 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:12.316766 26316 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:26:12.351393 26228 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:12.357810 26025 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:12.383390 26165 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:12.384246 26165 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:12.410079 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 116642us
I20260709 12:26:12.416711 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:12.417922 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:12.418601 18915 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:12.415789 18917 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:12.420928 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:12.421762 18921 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:12.425144 18841 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.002s
I20260709 12:26:12.430936 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:12.435093 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:12.472640 18914 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:12.427579 18916 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:12.473241 19492 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:12.444764 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:12.426648 18841 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:12.429447 26318 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.428881 26240 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.479208 18844 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:12.479171 26236 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:12.482795 26240 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:12.478235 26318 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:12.482987 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:12.484735 18915 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:12.443295 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:12.489295 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72382.1us
I20260709 12:26:12.503165 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:12.504216 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.508848 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.422370 25894 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.500579 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:12.425915 26139 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.443039 26226 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:12.445724 25974 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.440384 26027 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:12.436467 26262 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:12.437987 26225 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:12.436992 26258 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:12.523985 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:12.437770 26308 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.408417 26228 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:12.541112 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 262820us
I20260709 12:26:12.544358 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:12.547168 18847 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:12.547437 26165 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.519035 26313 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:26:12.519029 25881 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:12.430970 26268 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 12:26:12.554170 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:12.555616 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:12.510864 26215 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.558563 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:12.511843 26279 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:12.572662 18847 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:12.575285 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:12.577615 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:12.580220 18848 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:12.576134 19492 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
W20260709 12:26:12.591964 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.592137 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:12.594815 18847 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:12.597416 19492 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:26:12.545159 26226 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:12.582682 26323 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:26:12.601716 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:12.564007 26225 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:12.618125 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.604631 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:12.530705 25894 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.607761 18767 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:12.538630 26139 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.617380 19485 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:12.623664 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:12.628182 19457 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:12.623783 19490 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:12.596983 25863 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:12.619979 26226 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.620710 26225 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:12.630928 26325 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:26:12.632126 25974 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.632364 18764 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:26:12.631670 26226 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:12.599359 25881 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:12.632916 25974 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:12.595489 26238 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:26:12.634558 26225 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:12.587738 26229 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:26:12.634315 25881 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.635493 26228 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:12.636679 25894 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:12.647557 18848 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:12.648913 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:12.666272 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:12.667428 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.668120 18768 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:12.668059 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.668797 18771 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:12.668882 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.670493 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.671154 18771 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:12.671392 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.672207 18770 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:12.675158 18769 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:12.678557 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.682539 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.683399 18773 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:12.684549 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.685415 18766 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:12.686932 18768 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:12.688890 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.690569 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.628827 26310 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:12.695668 26335 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 12:26:12.664229 25945 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:26:12.696237 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.698076 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.695716 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.624719 26248 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:26:12.678846 26025 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:12.609543 26332 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:26:12.710408 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:12.700802 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 108693us
W20260709 12:26:12.713647 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 117333us
I20260709 12:26:12.714486 18769 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:12.723875 18773 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:12.732833 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.664752 26245 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:26:12.737684 18772 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 12:26:12.739374 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:12.749146 26289 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.004s
I20260709 12:26:12.749955 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.750876 18768 raft_consensus.cc:2368] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18.
I20260709 12:26:12.751957 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.752720 18768 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:12.734561 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:12.717253 26310 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:12.746840 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:12.755905 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.704617 26272 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:12.758738 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:12.760833 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.816634 18773 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:12.816995 18766 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 12:26:12.817541 18766 pending_rounds.cc:85] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 9
I20260709 12:26:12.817821 18766 pending_rounds.cc:107] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:26:12.760072 26025 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:12.833982 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 87236us
I20260709 12:26:12.836334 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:12.818113 18766 raft_consensus.cc:2889] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:12.713969 26312 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:12.820463 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 85996.9us
I20260709 12:26:12.847872 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:12.750059 26306 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.858372 26011 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:12.863927 26011 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.756532 26251 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.762849 26272 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:12.892361 18771 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:12.858165 26253 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:12.872936 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:12.869715 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:12.857864 18914 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:12.838250 18768 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:12.858525 26282 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:12.852275 26345 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.866153 26025 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:12.920192 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50635.9us
I20260709 12:26:12.921198 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:12.933842 18770 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:12.935496 18770 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:12.944777 18770 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:26:12.945416 26317 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:12.946079 26317 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:12.867559 26312 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.918126 26308 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:26:12.967876 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46775.6us
I20260709 12:26:12.972898 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:12.822196 25863 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.889977 26251 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.977556 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:12.990566 26238 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:12.992115 25859 consensus_meta.cc:287] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.758s	user 0.016s	sys 0.004s
I20260709 12:26:12.992638 25859 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.993784 18764 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:12.975623 26334 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 12:26:12.963781 26233 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:12.963516 26248 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:12.964025 26229 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:12.947022 26282 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:12.987123 26345 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:12.981163 26346 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:26:13.006222 26277 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.839s	user 0.006s	sys 0.010s
I20260709 12:26:13.001178 26139 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.051276 18764 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:13.026804 25849 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:13.043365 26318 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
W20260709 12:26:13.028952 26336 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 12:26:13.085750 26311 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:12.970922 26310 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.046427 26346 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:13.084275 25849 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.031714 26248 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:12.987805 26272 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.053416 26271 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:13.030328 26233 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.030676 26229 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.057580 26341 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:13.197022 26339 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.468s	user 0.001s	sys 0.000s
I20260709 12:26:13.087253 26139 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:13.249328 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 271896us
W20260709 12:26:13.222440 26266 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.922s	user 0.014s	sys 0.008s
W20260709 12:26:13.257409 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:13.251204 18848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.022s	sys 0.007s
I20260709 12:26:13.257082 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:13.258652 18848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.024s	sys 0.007s
I20260709 12:26:13.054229 26277 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.217289 26011 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.223320 26346 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:13.230564 25859 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.246743 25881 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.262055 26139 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.264293 26358 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:13.262343 26306 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:13.277384 26352 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:26:13.278227 26312 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.050062 26317 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.280411 26233 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.045094 26025 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:13.281234 26349 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:26:13.282208 26347 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:26:13.283751 26229 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:13.288530 26238 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:13.289115 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:13.308967 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 472710us
I20260709 12:26:13.314790 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:13.294983 26289 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:13.224699 26311 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.303282 18845 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:13.282205 26282 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:13.257710 25987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.010s	sys 0.019s
I20260709 12:26:13.300714 26358 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.259382 26341 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.263327 26266 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.294361 25881 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:13.344175 25987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.011s	sys 0.019s
I20260709 12:26:13.355471 26251 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.363582 18841 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
W20260709 12:26:13.373811 26360 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:26:13.322670 19456 leader_election.cc:400] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18.
I20260709 12:26:13.344743 26289 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.378321 18921 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:26:13.390502 18845 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:13.392887 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:13.399471 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 89681.2us
I20260709 12:26:13.405377 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:13.376633 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.400346 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.400717 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:13.380725 26225 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.000s
I20260709 12:26:13.353075 26358 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.431849 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:13.440246 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.441354 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.442224 19492 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:13.443902 26359 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:13.444593 26359 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:13.448168 26368 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:26:13.449275 26248 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:13.438946 26306 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.450685 25881 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.451027 26277 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.427248 26251 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:13.451973 26251 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.453547 26289 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.459050 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.458222 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:13.461843 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:13.464174 19483 raft_consensus.cc:2368] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24.
I20260709 12:26:13.466974 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:13.465322 26367 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:26:13.455920 26266 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.454320 26251 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:13.485203 18737 leader_election.cc:400] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24.
I20260709 12:26:13.489985 18737 leader_election.cc:403] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:26:13.456166 25849 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.450256 26306 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.426651 26225 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.472043 26335 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:13.527257 26139 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.529707 26311 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.471308 26365 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:13.548470 18917 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
W20260709 12:26:13.551748 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 74836.9us
I20260709 12:26:13.533749 26335 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:13.561847 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.536978 26366 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:13.578028 26302 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.585234 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.587733 18916 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:13.595039 26359 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:13.553018 26139 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24.
I20260709 12:26:13.600704 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 3152) took 1456 ms. Trace:
W20260709 12:26:13.601298 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.601298 18845 rpcz_store.cc:276] 0709 12:26:12.144615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.160004 (+ 15389us) service_pool.cc:224] Handling call
0709 12:26:13.600456 (+1440452us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003bd154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:13.600626 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2596619008}
I20260709 12:26:13.628340 18916 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:26:13.567553 26335 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:13.571023 26366 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.677034 26346 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.688328 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3249) took 1071 ms. Trace:
I20260709 12:26:13.688848 18847 rpcz_store.cc:276] 0709 12:26:12.616726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.616886 (+   160us) service_pool.cc:224] Handling call
0709 12:26:12.617260 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.648195 (+ 30935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.648228 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.648271 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:12.648301 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.688003 (+1039702us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b5400195354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:13.688059 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.688224 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70616320}
I20260709 12:26:13.690800 26306 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.694371 26273 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:13.695120 26273 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.697044 26273 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.702527 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.704816 26341 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.705942 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.706585 26225 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.712715 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.713987 19491 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:13.715898 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:13.725517 25863 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:13.726727 25863 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.727427 26272 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:13.729104 25863 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.684464 26358 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.717857 26335 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.743944 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.746155 26165 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.746762 26165 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.749073 26165 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.742034 26366 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:13.760715 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2747) took 1149 ms. Trace:
I20260709 12:26:13.761209 18772 rpcz_store.cc:276] 0709 12:26:12.617730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.617859 (+   129us) service_pool.cc:224] Handling call
0709 12:26:13.760456 (+1142597us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002120d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:13.760625 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272771968}
I20260709 12:26:13.762799 18769 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:13.763209 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:13.763836 19492 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:13.764853 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3290) took 1090 ms. Trace:
I20260709 12:26:13.765275 18769 rpcz_store.cc:276] 0709 12:26:12.674568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.738894 (+ 64326us) service_pool.cc:224] Handling call
0709 12:26:13.762591 (+1023697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.763249 (+   658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.764627 (+  1378us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002120d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:13.764786 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312570240}
I20260709 12:26:13.761544 26335 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.768496 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1323) took 1025 ms. Trace:
I20260709 12:26:13.769080 18768 rpcz_store.cc:276] 0709 12:26:12.742805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.901653 (+158848us) service_pool.cc:224] Handling call
0709 12:26:13.767476 (+865823us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:26:13.767724 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.767957 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.767987 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:13.768216 (+   229us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:13.768258 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.768316 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.768432 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9080576}
I20260709 12:26:13.775672 26266 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:13.776396 26165 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.776458 26266 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.777200 26165 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.778666 26277 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:13.775811 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:13.779425 19491 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:13.779307 26277 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.778155 26289 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.783653 26289 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.786037 26289 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.781073 26165 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:13.781185 26344 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.883s	user 0.002s	sys 0.000s
I20260709 12:26:13.780437 25881 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:13.791764 25881 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.794740 25881 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.788930 26245 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:13.796582 26266 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.797235 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 1328) took 1053 ms. Trace:
I20260709 12:26:13.797751 18764 rpcz_store.cc:276] 0709 12:26:12.744126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.847422 (+103296us) service_pool.cc:224] Handling call
0709 12:26:13.797033 (+949611us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54001c2354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:13.797164 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313031424}
I20260709 12:26:13.799460 19492 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:13.802850 26346 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:13.803941 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.804251 19491 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:13.790198 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:13.788229 26277 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.809273 26266 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:13.794028 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3250) took 1176 ms. Trace:
I20260709 12:26:13.810261 18840 rpcz_store.cc:276] 0709 12:26:12.617232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.617378 (+   146us) service_pool.cc:224] Handling call
0709 12:26:13.792597 (+1175219us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b54000ad320. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8ee18 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6
0709 12:26:13.793811 (+  1214us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54003be054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:13.793959 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980928512}
I20260709 12:26:13.816421 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:13.819061 19492 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:13.820444 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.821309 18915 raft_consensus.cc:2410] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 25 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:26:13.821221 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:13.808336 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:13.827898 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.828974 18918 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:13.829474 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.830103 19486 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:13.831193 26314 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.831753 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.832424 26314 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.827361 26228 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:13.826591 26223 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:13.838326 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.839717 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:13.840255 26357 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.638s	user 0.003s	sys 0.000s
I20260709 12:26:13.840780 18917 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:13.841377 26141 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:13.842689 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1261) took 1085 ms. Trace:
I20260709 12:26:13.839020 26223 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.845727 26223 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.842584 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:13.846887 18919 raft_consensus.cc:2368] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25.
I20260709 12:26:13.846619 26306 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:13.848348 26306 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:13.848812 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:13.848994 26306 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:13.849504 18922 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:13.838055 26228 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.851891 26228 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.810293 26271 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:13.885257 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57988.9us
W20260709 12:26:13.886617 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63769.8us
I20260709 12:26:13.862012 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.862516 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.891745 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.846683 26025 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:13.899914 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:13.895658 18922 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:13.860190 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.854588 26271 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:13.897856 18919 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:13.853864 25859 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:13.910065 25894 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:13.910712 25849 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:13.911001 25894 consensus_queue.cc:1243] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:26:13.911209 25849 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:13.911648 25894 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:13.912040 25894 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:13.912281 25849 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.913323 26345 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.913636 25849 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:13.913821 26345 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.914893 26359 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.915400 26359 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.916252 26345 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.912920 25894 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.850046 26306 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.919112 25894 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:13.923202 26277 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:13.926076 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:13.927138 26289 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:13.927294 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:13.927575 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:13.927636 26289 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:13.928213 18768 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
W20260709 12:26:13.928610 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 120385us
I20260709 12:26:13.928244 26289 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:13.929119 25881 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:13.929432 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:13.930789 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:13.934620 26223 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:13.935295 26223 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:13.929626 25881 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.917428 26359 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:13.943235 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:13.937578 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:13.927739 18814 leader_election.cc:400] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25.
I20260709 12:26:13.843182 19490 rpcz_store.cc:276] 0709 12:26:12.757443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.757652 (+   209us) service_pool.cc:224] Handling call
0709 12:26:12.757899 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:12.890977 (+133078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.891010 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:12.891513 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:26:12.999956 (+108443us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:13.000019 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.000143 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.839391 (+839248us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:13.842304 (+  2913us) raft_consensus.cc:1685] finished
0709 12:26:13.842328 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.842596 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116244,"raft.queue_time_us":148067,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5426,"spinlock_wait_cycles":16414592,"thread_start_us":52899,"threads_started":1,"wal-append.queue_time_us":135548}
I20260709 12:26:13.939621 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:13.958503 18814 leader_election.cc:403] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:26:13.939236 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:13.895483 26233 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:26:13.938133 26289 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:13.961299 26371 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:13.961982 26371 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.893740 26346 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:13.963241 26289 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:13.963336 26346 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:13.926090 26228 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:26:13.965657 26346 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:13.894959 26272 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:26:13.957923 25881 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:13.968354 18768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
W20260709 12:26:13.968537 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 68734.5us
I20260709 12:26:13.969095 18768 raft_consensus.cc:606] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:13.938264 25859 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.969622 18768 raft_consensus.cc:614] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:13.972718 18913 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 14. Current term is 15. Ops: []
W20260709 12:26:13.973225 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45630.6us
I20260709 12:26:13.976867 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:13.972352 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:13.978080 26165 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25.
I20260709 12:26:13.854588 26139 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 12:26:13.986410 19456 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:13.989768 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:13.938236 26312 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.985049 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.994586 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:13.998111 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.957020 26332 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.995051 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:13.971777 26341 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:14.009938 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:13.979095 26236 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:13.993238 26289 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:13.939136 26238 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.062s
W20260709 12:26:14.014595 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45678.3us
I20260709 12:26:13.995141 26233 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:14.019399 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:14.029637 18841 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:14.020569 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.029513 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.030596 18840 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:14.031247 18842 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:26:14.036895 18843 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:26:14.028262 26238 consensus_queue.cc:1243] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 23.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:26:13.979115 25859 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.002802 25834 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:13.985271 26266 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:26:14.063445 18913 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:14.007416 26333 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:14.070986 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54826.9us
I20260709 12:26:14.071892 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.047699 26371 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:14.078547 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.080439 18841 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:14.007743 26312 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.010673 26332 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.082472 26333 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.082471 25834 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:14.088948 25859 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:14.089074 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:14.071194 26245 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:14.065316 26228 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:14.103735 26228 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.079726 26139 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:14.081724 26252 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:14.109754 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:26:14.110030 26252 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:14.110421 26252 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:14.110924 26228 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:14.111492 26252 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.112893 26252 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:14.113032 26333 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:14.094034 26018 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:26:14.123942 25834 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.116688 26289 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:14.126773 26289 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.116909 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.128618 18919 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:14.107460 25987 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.129439 25987 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.131892 25987 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:14.109167 26233 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:14.120132 26306 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:14.141654 26306 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:14.109232 26245 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.142794 26306 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.148643 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:14.196251 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.199414 26332 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:14.147411 26312 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:14.203222 26245 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:14.240769 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 147171us
W20260709 12:26:14.241672 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 272175us
I20260709 12:26:14.246413 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:14.247779 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 310270us
I20260709 12:26:14.248812 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.249307 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.257663 26245 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:14.258296 26245 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:14.259559 26245 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.260450 26400 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:14.260980 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.261808 26400 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:14.262291 26396 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:14.263432 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.264945 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:14.242851 26228 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:14.295156 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.285638 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.281629 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.277971 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.283383 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:14.292670 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.302659 26289 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:14.302721 26266 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:14.303500 26266 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:14.304569 26266 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.267895 26271 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.309080 18915 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:14.309442 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:14.270591 26388 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.182s	user 0.003s	sys 0.002s
I20260709 12:26:14.208200 26233 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.311750 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.312325 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.337559 18768 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:26:14.337723 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.314049 26271 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:14.269692 26396 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:14.285640 26402 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:14.322316 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.323117 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.322058 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.348906 18765 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:14.266274 26404 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:14.351006 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.331670 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.335158 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.338604 18772 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 12:26:14.333845 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:14.315342 26394 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:26:14.341570 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.342795 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:14.375257 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.375766 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:14.376389 18768 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:14.377619 26391 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.296s	user 0.000s	sys 0.011s
I20260709 12:26:14.321568 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.268530 26312 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:26:14.324306 25987 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:14.349973 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:14.387179 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.387354 18764 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:14.296581 26223 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:26:14.332056 25945 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:14.399729 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.402352 18845 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:26:14.353981 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.353988 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.355867 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.404351 18770 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:14.404663 18765 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:14.356210 18772 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:14.356894 26025 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.356642 26404 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.426604 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:14.359232 26277 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:14.361188 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:14.429884 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68778.9us
I20260709 12:26:14.430357 18764 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:14.430861 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.361395 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.363059 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.432971 18841 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:14.367437 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.372709 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.379289 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.436137 18847 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:14.380618 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:14.315747 26139 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:26:14.300127 26228 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.347455 26402 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.348728 25834 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.334802 25859 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:14.423512 26165 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:14.337265 26332 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.438228 18839 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:14.436057 18773 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
W20260709 12:26:14.438254 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57751us
I20260709 12:26:14.471005 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:14.428687 26406 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:26:14.440200 26366 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:14.440933 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.449378 18768 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:14.429142 26277 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:14.475883 18773 pending_rounds.cc:85] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 16
I20260709 12:26:14.479629 18773 pending_rounds.cc:107] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 12:26:14.480062 18773 raft_consensus.cc:2889] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:14.483289 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:14.446847 26282 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:14.446787 26402 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:14.491966 18844 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: [18.9-21.10]
I20260709 12:26:14.434937 26025 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:14.502573 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.476568 26271 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.514369 18917 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:14.506791 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.473639 26395 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:14.489600 25863 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:14.489317 26282 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:14.529613 26407 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:26:14.530583 26228 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:14.531618 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.532446 18917 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:14.532708 18846 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 12:26:14.533298 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:14.533838 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:14.543404 26403 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:26:14.558789 18839 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:14.553826 26025 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:14.471902 26165 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.504225 26273 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:14.467258 25859 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:14.512181 25881 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.002s
I20260709 12:26:14.519892 26245 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:14.477869 26332 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.510176 26335 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:14.547726 26277 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.507933 25894 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:26:14.565722 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:14.600965 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.567493 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:14.577056 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:14.467003 25834 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.604497 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:14.582705 18845 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:14.587294 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.595065 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.595726 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:14.596562 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:14.522202 26341 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:14.599023 25881 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.597507 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:14.632951 26165 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:14.597623 18768 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:26:14.633656 25881 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:14.634389 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.635089 25863 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:14.635798 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:14.608803 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:14.602051 19483 raft_consensus.cc:606] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.637311 19483 raft_consensus.cc:614] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:14.637545 26311 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:14.555477 26282 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:14.640378 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.640672 26277 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:14.640934 26228 consensus_queue.cc:1175] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 17 status { last_received { term: 16 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:14.642211 18770 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:14.642444 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.644729 26311 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:14.643275 19492 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:26:14.648716 25849 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.735s	user 0.006s	sys 0.006s
I20260709 12:26:14.649045 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:14.649474 18769 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:14.649794 18918 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.525918 26395 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.597829 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.619596 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:14.523988 26271 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.653676 18839 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:14.638211 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:14.609752 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:14.659723 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.666597 18770 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
W20260709 12:26:14.667618 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63190.6us
I20260709 12:26:14.667765 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.668309 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.668881 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:14.670994 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.671332 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:14.670445 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.676081 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.677817 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.678746 18768 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:14.679847 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:14.654958 26408 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:26:14.609004 26306 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:14.628268 25859 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:14.601603 26400 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:14.738958 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70208.5us
I20260709 12:26:14.741382 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.754981 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.766335 18768 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
W20260709 12:26:14.741765 26406 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:26:14.687528 26371 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:14.737702 26273 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:14.603883 26245 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:14.754369 26403 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:26:14.652035 26266 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:26:14.655654 26341 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.768013 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:14.752606 25863 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.749150 26223 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:14.744102 25987 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:14.787067 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.789490 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.790206 18768 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:14.793100 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:14.809433 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.810485 18768 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
W20260709 12:26:14.803992 26411 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:26:14.818833 26266 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:14.819486 26266 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:14.820567 26266 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.822070 26266 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:14.787732 26404 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:14.832332 26277 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:14.833214 26277 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.835865 26277 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:14.791466 26273 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:14.791507 26332 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:14.774179 26400 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.800450 25894 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:14.794742 26223 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:14.872610 18847 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:14.883896 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:14.885346 18768 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 25 because replica has last-logged OpId of term: 22 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 9.
I20260709 12:26:14.890846 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:14.891922 18768 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 12:26:14.788859 25863 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:14.800370 26371 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:26:14.897886 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:14.900102 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 218892us
I20260709 12:26:14.929724 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.873250 26272 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:26:14.916438 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 242243us
I20260709 12:26:14.932910 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:14.954519 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.965270 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:14.965644 18919 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:26:14.895108 25987 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:14.921141 26395 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:14.940718 26404 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:14.978909 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:14.979070 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:14.984053 18771 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:14.985602 18841 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 26 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:26:14.943427 26271 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:14.968462 26346 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:15.031383 18918 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:14.976857 25894 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:14.959900 26141 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 12:26:14.978364 26404 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:15.150007 26423 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 12:26:15.151239 18873 heartbeater.cc:646] Failed to heartbeat to 127.17.40.62:43633 (4 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.40.62:43633 timed out after 15.000s (SENT)
I20260709 12:26:15.152498 26341 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:15.155224 26427 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:26:14.971458 26233 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.128s
I20260709 12:26:14.981743 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:15.144068 26422 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:26:15.053609 26431 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:15.166918 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 185285us
I20260709 12:26:15.055442 26245 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:14.986531 26273 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.161s
W20260709 12:26:15.163884 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.960662 26223 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:15.174374 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:15.147742 26404 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:15.176870 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.178845 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56838 (request call id 11) took 1091 ms. Trace:
I20260709 12:26:15.166612 26371 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.193181 19483 rpcz_store.cc:276] 0709 12:26:14.100176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.105136 (+  4960us) service_pool.cc:224] Handling call
0709 12:26:15.178522 (+1073386us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54006ff254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af85853 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:15.178713 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130688384}
W20260709 12:26:15.199635 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:15.200830 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 223318us
I20260709 12:26:15.205142 26266 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.205783 26266 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.183418 25945 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:15.211536 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 1334) took 1272 ms. Trace:
I20260709 12:26:15.212175 18769 rpcz_store.cc:276] 0709 12:26:13.939155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.939279 (+   124us) service_pool.cc:224] Handling call
0709 12:26:15.211278 (+1271999us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540002e254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:15.211441 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588226944}
I20260709 12:26:15.185806 26400 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:15.173810 26277 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:26:15.240273 26266 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:15.241144 26266 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.241802 26266 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.217181 26332 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:26:15.235782 26397 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.034s	user 0.006s	sys 0.000s
I20260709 12:26:15.180284 26431 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:15.244839 26393 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.163s	user 0.005s	sys 0.007s
W20260709 12:26:15.252051 26392 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.207s	user 0.012s	sys 0.014s
I20260709 12:26:15.203020 26371 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:15.273200 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70656.7us
W20260709 12:26:15.278074 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 299229us
I20260709 12:26:15.279855 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.281615 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:15.282284 18769 raft_consensus.cc:606] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:15.282712 18769 raft_consensus.cc:614] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:15.275379 25863 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:15.271394 26441 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:15.271744 26304 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:26:15.300073 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:15.286998 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:15.299669 18772 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:26:15.305717 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:15.312244 18843 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:26:15.310211 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.287649 25849 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.318773 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.319466 18841 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:15.322093 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:15.325238 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.328542 18765 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:26:15.331015 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.334306 26371 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:15.339545 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.340189 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.338466 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3301) took 1356 ms. Trace:
I20260709 12:26:15.345485 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:15.351013 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45386.8us
I20260709 12:26:15.352757 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:15.343055 18920 rpcz_store.cc:276] 0709 12:26:13.981700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.981930 (+   230us) service_pool.cc:224] Handling call
0709 12:26:13.982558 (+   628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:13.993634 (+ 11076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.993667 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:13.996751 (+  3084us) log.cc:844] Serialized 26 byte log entry
0709 12:26:14.033577 (+ 36826us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:14.033625 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.033702 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:14.973276 (+939574us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:15.338107 (+364831us) raft_consensus.cc:1685] finished
0709 12:26:15.338135 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:15.338379 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14413,"raft.queue_time_us":11721,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6510,"spinlock_wait_cycles":5556992,"thread_start_us":21835,"threads_started":1,"wal-append.queue_time_us":143255}
I20260709 12:26:15.344096 25849 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.356572 25849 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:15.358853 26449 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:15.359108 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:15.350819 26446 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:15.360256 26304 raft_consensus.cc:2764] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:26:15.361025 26304 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.361505 26304 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.361793 26444 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.362464 26444 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.364372 26304 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:15.366714 26282 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.728s	user 0.013s	sys 0.001s
I20260709 12:26:15.366611 26304 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:15.316001 26277 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:15.341913 26312 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:26:15.350724 26433 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.145s	user 0.003s	sys 0.000s
I20260709 12:26:15.381650 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.350658 26413 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:15.367313 26282 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.314257 26441 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.377300 26449 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:15.383074 26452 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:15.388537 26223 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:15.386199 26437 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:15.412977 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.413990 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.391830 26266 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.417171 18845 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:15.415318 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.420550 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.400628 26312 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.422560 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.425230 18840 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:15.404803 26271 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:15.432111 26271 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.437724 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:15.438501 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:15.438671 26233 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:15.439239 26233 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.439656 26233 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:15.440258 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:15.440675 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:15.441718 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:15.442636 26273 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:15.442999 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:15.443274 26273 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.443706 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.443938 26273 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:15.440297 18918 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:15.443732 18916 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
W20260709 12:26:15.449748 26438 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:26:15.451205 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3318) took 1100 ms. Trace:
I20260709 12:26:15.451644 18764 rpcz_store.cc:276] 0709 12:26:14.350991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.431317 (+ 80326us) service_pool.cc:224] Handling call
0709 12:26:14.431742 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:14.662307 (+230565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:14.662340 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:14.662857 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:26:14.922891 (+260034us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:14.954623 (+ 31732us) log.cc:844] Serialized 14 byte log entry
0709 12:26:15.288043 (+333420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:15.288156 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:15.335908 (+ 47752us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:15.450786 (+114878us) raft_consensus.cc:1685] finished
0709 12:26:15.450912 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:15.451106 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":333095,"prepare.queue_time_us":66190,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":499892,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":1170,"spinlock_wait_cycles":14190208,"thread_start_us":401879,"threads_started":2,"wal-append.queue_time_us":396175}
I20260709 12:26:15.454839 26444 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:15.426673 26436 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:26:15.455673 26449 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.457055 26441 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.457646 26233 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.458170 26271 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:15.406599 26413 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.464035 26282 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.465459 26413 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:15.466691 25894 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:15.467406 25894 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:15.468269 26233 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:15.468498 25894 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.471303 26332 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.472030 26332 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:15.445474 26312 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:15.490069 26457 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:26:15.495967 26312 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:15.498307 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50771us
W20260709 12:26:15.499158 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52236.5us
W20260709 12:26:15.500569 18771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3301) took 1180 ms (client timeout 1503 ms). Trace:
I20260709 12:26:15.500938 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:15.501036 18771 rpcz_store.cc:269] 0709 12:26:14.320430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.320553 (+   123us) service_pool.cc:224] Handling call
0709 12:26:15.500358 (+1179805us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54001793d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:15.500500 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400611584}
I20260709 12:26:15.501829 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.502583 18840 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
W20260709 12:26:15.503065 26402 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.987s	user 0.016s	sys 0.000s
I20260709 12:26:15.503587 26402 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.504137 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.504294 26266 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:15.504745 18767 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:15.505010 26223 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:15.505492 26223 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.505838 18769 raft_consensus.cc:606] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.454723 26431 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.506297 18769 raft_consensus.cc:614] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:15.506947 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:15.507611 26233 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:15.508145 26233 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.505867 26223 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:15.510892 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:15.511633 18922 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:15.512725 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:15.514070 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:15.514780 18915 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:15.516199 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.517432 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.524204 26431 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:15.524852 26431 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.525771 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.490231 25834 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.527179 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:15.527839 18918 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:26:15.507579 18847 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:15.534050 19490 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:15.536507 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.538636 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:15.539408 18918 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:15.534813 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:15.537473 19490 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:26:15.546345 18847 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:15.555155 19485 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:15.589638 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.556363 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.555325 26233 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:15.582782 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3317) took 1233 ms. Trace:
I20260709 12:26:15.549216 19458 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:15.547988 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
W20260709 12:26:15.594938 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45827us
I20260709 12:26:15.595084 18769 raft_consensus.cc:606] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.596201 18769 raft_consensus.cc:614] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:15.596189 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:15.586988 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.575564 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.591306 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:15.594352 18767 rpcz_store.cc:276] 0709 12:26:14.349277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.428202 (+ 78925us) service_pool.cc:224] Handling call
0709 12:26:14.428573 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:15.505294 (+1076721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:15.582503 (+ 77209us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:15.582714 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474577152}
I20260709 12:26:15.548132 26452 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:15.597982 19488 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
I20260709 12:26:15.608064 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.588421 26454 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:15.611754 26454 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:15.612237 26454 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:15.614475 19488 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:15.555335 26428 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:15.628006 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.604409 26317 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:15.610055 26282 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:15.609258 26272 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:15.639325 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.571455 26404 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.656322 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.627480 26402 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.688534 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.651058 26317 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.673225 26266 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:15.686221 26312 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:15.685784 26272 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:15.699023 26317 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:15.713471 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:15.731732 26458 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 12:26:15.737790 26282 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.775352 26282 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:15.776583 26271 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.777249 26271 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.706759 26312 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:15.778539 26371 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.778796 26312 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:15.779218 26371 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.780789 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:15.781570 26371 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:15.781863 18915 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:15.741519 26317 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.747223 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2777) took 1005 ms. Trace:
I20260709 12:26:15.783631 18768 rpcz_store.cc:276] 0709 12:26:14.742186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.943949 (+201763us) service_pool.cc:224] Handling call
0709 12:26:14.979650 (+ 35701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:14.979870 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:26:15.217318 (+237448us) log.cc:844] Serialized 14 byte log entry
0709 12:26:15.746658 (+529340us) log.cc:844] Serialized 14 byte log entry
0709 12:26:15.746876 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:15.746919 (+    43us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:15.746967 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:15.747044 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:15.747159 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":501113,"prepare.queue_time_us":181561,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":473189,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":195,"thread_start_us":163369,"threads_started":2,"wal-append.queue_time_us":160453}
W20260709 12:26:15.752558 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 434730us
I20260709 12:26:15.754633 26409 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.756181 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:15.757191 26272 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.787814 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:15.757761 25859 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.759387 26404 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:15.759479 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2779) took 1016 ms. Trace:
I20260709 12:26:15.760216 26139 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.763877 26223 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.765060 26346 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:26:15.766801 26397 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:26:15.769179 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.696099 26447 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 12:26:15.714088 26431 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.771471 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:15.772778 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.772969 26332 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.781183 26454 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.746031 26414 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.836807 26414 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.838057 26454 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.839178 26414 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.790316 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:15.841197 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:15.794500 18768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:15.842250 18768 raft_consensus.cc:606] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.793787 26335 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.796697 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:15.796128 18770 rpcz_store.cc:276] 0709 12:26:14.742782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:15.185437 (+442655us) service_pool.cc:224] Handling call
0709 12:26:15.185853 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:15.314987 (+129134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:15.315021 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:15.341128 (+ 26107us) log.cc:844] Serialized 26 byte log entry
0709 12:26:15.447166 (+106038us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:15.572382 (+125216us) log.cc:844] Serialized 14 byte log entry
0709 12:26:15.759131 (+186749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:15.759212 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:15.759260 (+    48us) raft_consensus.cc:1685] finished
0709 12:26:15.759278 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:15.759416 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":709909,"prepare.queue_time_us":29984,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":316452,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":14346,"thread_start_us":89832,"threads_started":1,"wal-append.queue_time_us":227662}
I20260709 12:26:15.816810 19483 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:26:15.821800 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52755.4us
W20260709 12:26:15.825089 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:15.826122 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53455.3us
I20260709 12:26:15.795728 26236 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:15.828338 26415 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:15.828379 26341 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:15.830637 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2778) took 1088 ms. Trace:
I20260709 12:26:15.842672 18768 raft_consensus.cc:614] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:15.836015 26332 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:15.894532 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:15.849066 19490 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:15.844960 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:15.794020 26409 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.843096 19488 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
W20260709 12:26:15.892307 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 95732.1us
I20260709 12:26:15.890713 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.896512 18841 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:15.897392 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.891530 18766 rpcz_store.cc:276] 0709 12:26:14.742485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.954514 (+212029us) service_pool.cc:224] Handling call
0709 12:26:14.954901 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:15.288391 (+333490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:15.288425 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:15.504158 (+215733us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b2c00057528. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:26:15.504621 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:26:15.694264 (+189643us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:15.694307 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:15.694376 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:15.830282 (+135906us) raft_consensus.cc:1685] finished
0709 12:26:15.830303 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:15.830554 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":333064,"raft.queue_time_us":340861,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10822,"spinlock_wait_cycles":5044608,"thread_start_us":189231,"threads_started":1,"wal-append.queue_time_us":318612}
I20260709 12:26:15.819341 26346 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:15.905272 26425 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:15.905377 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.905885 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:15.819602 26139 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.907853 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:15.904716 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:15.909349 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:15.812096 26395 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:26:15.894263 26415 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.915441 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:15.922250 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:15.825861 26311 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:15.916451 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:15.914942 18842 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:15.889290 26236 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.941425 18841 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:15.927374 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.898211 26414 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:15.945062 18845 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:15.930838 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:15.897243 25863 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.807708 25859 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.901296 26335 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.889290 26273 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.900708 26429 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:15.918527 26371 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:15.966164 19490 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:15.931994 26415 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:15.944221 26236 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:15.929252 26404 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:15.929320 26341 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:15.974972 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:15.952096 26437 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:15.972105 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.950332 26428 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.978246 18767 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:15.947116 26417 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:15.979732 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:15.946751 25863 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.991266 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:15.991617 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.992050 18769 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:15.980966 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:15.978266 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:15.994340 18842 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:15.963835 26317 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:15.994493 18773 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:15.966172 26429 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.961192 26413 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:15.997107 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:15.993683 18765 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
W20260709 12:26:15.997016 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 80626.7us
I20260709 12:26:16.001588 25863 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:16.004776 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:16.005498 18846 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:16.005614 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:16.008421 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:16.010735 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:16.013703 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:16.020668 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:16.032588 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.972893 25945 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:26:15.975924 26444 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:26:16.043675 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:16.044158 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:15.996734 26271 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:16.019517 26317 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:16.003976 26437 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:16.046545 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:16.012017 25894 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:16.053009 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:15.987788 26404 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:15.987591 26341 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:16.049045 26468 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:26:16.086748 26420 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:16.088438 26416 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:16.051716 26141 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:16.089437 26473 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:16.090338 25859 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.071779 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:16.091630 18914 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:16.092298 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 161530us
I20260709 12:26:16.034119 18773 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:16.085301 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:16.035043 26395 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:16.093910 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:16.094527 26452 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:16.094779 25945 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:16.095072 26452 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:16.095630 26452 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:16.002903 26282 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.121140 18914 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:16.101370 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:15.984284 26346 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:16.147370 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46087.4us
I20260709 12:26:16.053253 26447 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:16.137724 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:16.147845 18764 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:16.148144 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:16.055222 26266 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:16.153048 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:16.179627 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:16.138914 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:16.154762 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:16.181541 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:16.184579 18764 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:16.186120 18764 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:16.056862 25894 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:16.098273 26233 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:16.198525 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:16.030485 25987 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:26:16.197269 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:16.200567 18771 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:16.202096 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:16.206321 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 149693us
I20260709 12:26:16.207242 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:16.135192 26139 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:16.147287 26223 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:16.181434 26447 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.183557 26371 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:16.146709 26289 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:16.193864 26431 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:16.263554 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 231555us
I20260709 12:26:16.193303 26272 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:16.199407 25894 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:16.176617 26477 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.130s
I20260709 12:26:16.297821 19488 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:26:15.997586 26417 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.087407 26420 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:15.994072 26428 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:16.289896 26461 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:26:16.319094 26471 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:26:16.271476 26289 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.333518 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:16.324857 26312 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 12:26:16.326331 26341 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.250038 26476 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.131s
I20260709 12:26:16.303300 26335 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:16.271456 26409 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:16.291229 26472 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
W20260709 12:26:16.292071 26474 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:26:16.263700 26431 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:16.331988 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:16.340087 26431 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:16.340307 26420 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:16.340766 26477 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:16.340965 18769 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:16.341315 26477 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:16.341799 26477 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:16.320437 26428 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:16.336021 26312 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.346972 26404 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.348984 26429 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:16.255867 26266 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:16.289337 26434 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:16.389770 18916 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:16.266125 26400 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:16.261464 26447 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:16.263165 26371 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:16.289729 26272 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:16.412135 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:16.412636 18919 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:26:16.413389 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:16.413790 18771 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
W20260709 12:26:16.425177 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 70963.1us
I20260709 12:26:16.427913 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:16.267382 26446 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.148s
W20260709 12:26:16.435187 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 248231us
I20260709 12:26:16.406438 26434 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:16.250402 26437 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.453204 18919 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:16.467336 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:16.415562 26371 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:16.407330 26400 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:16.472486 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:16.483268 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 243207us
W20260709 12:26:16.486320 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 439891us
I20260709 12:26:16.489409 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:16.489725 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:16.434458 26312 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.460175 26434 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:16.444491 26025 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:26:16.505406 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:16.485548 26409 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.499272 26233 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:16.491220 19458 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:16.498891 26308 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:26:16.522377 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 318747us
I20260709 12:26:16.525662 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:16.552124 26236 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.002s
I20260709 12:26:16.574313 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:16.583791 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58206.8us
I20260709 12:26:16.585609 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:16.520251 26233 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:16.592065 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 149781us
I20260709 12:26:16.570711 26485 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:16.573194 26289 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.596869 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:16.600793 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:16.522607 26409 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.528626 26452 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:16.732317 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 133204us
W20260709 12:26:16.737233 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 140461us
I20260709 12:26:16.737860 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:16.742978 26431 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:16.743765 26483 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:26:16.591742 26266 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 12:26:16.745005 26493 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:16.745906 26493 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:16.739810 26289 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:26:16.748296 25894 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.739810 26485 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:16.749894 26485 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.752476 26452 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.760813 18915 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:16.524847 26272 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.774684 26484 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:16.777266 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:16.779295 26477 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.780979 18916 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:16.612092 26429 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:16.797814 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:16.799008 19492 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:16.805397 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:16.581053 26236 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.814786 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:16.832775 19491 raft_consensus.cc:2368] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:26:16.814833 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:16.604473 26473 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:16.815363 26415 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.835s	user 0.014s	sys 0.000s
I20260709 12:26:16.745580 26431 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:16.864334 18770 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: [24.11-24.11]
I20260709 12:26:16.831923 26335 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.833563 26477 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:16.586658 26312 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:16.849853 26289 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.588148 26417 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:16.793264 25894 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:16.908937 26487 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:16.897615 26335 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.911288 26487 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.908958 26289 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.912796 26335 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:16.913897 26487 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.919433 26273 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:16.919489 26488 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:16.920675 26488 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.926604 18812 leader_election.cc:400] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:26:16.927095 18812 leader_election.cc:403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:26:16.913930 26289 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:16.923128 26502 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.870759 26415 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.933624 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:16.936843 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:16.937659 19491 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:16.930889 26332 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:16.946849 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:16.947777 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:16.922947 26434 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:16.935927 26489 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:16.951574 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:16.955641 26346 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:16.959087 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:16.953377 18812 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.805s (SENT) [suppressed 9 similar messages]
I20260709 12:26:16.970690 26273 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:16.972035 26490 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:16.974988 26409 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.950140 26477 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:16.976296 26477 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.976843 26477 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:16.957901 26480 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.022s
I20260709 12:26:16.980224 26473 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:16.980695 26473 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:16.981606 26473 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.983234 26473 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:16.937935 26502 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:16.989713 26502 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:16.993690 26236 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:16.945344 26332 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:16.932750 25894 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:26:16.958504 26487 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:26:16.999904 26488 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:17.015411 26504 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:26:17.016567 26500 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:26:17.025873 26489 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:26:17.039760 18844 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:26:17.043598 26480 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.044543 26480 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.045636 26228 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:17.046344 26228 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:17.048158 26480 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.047526 26228 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.049824 26228 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:17.058626 26434 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.068210 26415 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.078281 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:17.080269 18843 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:17.086864 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.087431 26489 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:17.088013 26489 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.020423 26488 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:17.091531 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.091720 26488 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.092787 18846 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: [22.13-24.14]
I20260709 12:26:17.093910 26488 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.097970 26415 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.098582 26415 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:17.099638 26371 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.001s
I20260709 12:26:17.100106 26371 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.101115 26415 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.101224 18920 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:17.107944 18843 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:26:17.108271 26371 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.109264 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.110528 26306 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.111124 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:17.111191 26306 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.113096 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:17.113547 26306 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.114779 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:17.115077 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:17.114109 26306 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.116362 18765 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:17.118660 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.118842 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:17.119416 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:17.119906 18768 raft_consensus.cc:2368] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:26:17.121443 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:17.116086 26306 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.122216 18773 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:17.124706 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:17.127621 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.131237 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:17.134162 18768 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:17.132319 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:17.090257 26489 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.135987 18765 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:17.138492 18839 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:17.138917 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:17.139186 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.138931 18846 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:17.142329 18847 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:26:17.072611 26447 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.647s	user 0.013s	sys 0.000s
I20260709 12:26:17.147398 18886 leader_election.cc:400] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:26:17.151573 18886 leader_election.cc:403] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:17.161423 18773 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:17.164553 18771 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:26:17.164791 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:17.165685 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:17.179168 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:17.178628 18768 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:17.188207 26306 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.188319 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3325) took 1212 ms. Trace:
I20260709 12:26:17.188956 18770 rpcz_store.cc:276] 0709 12:26:15.976451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:15.976588 (+   137us) service_pool.cc:224] Handling call
0709 12:26:15.996181 (+ 19593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:16.882991 (+886810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:17.187902 (+304911us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54002107d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:17.188228 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995642752}
I20260709 12:26:17.116609 26400 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.192729 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.193529 26400 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:17.194952 19487 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:26:17.193473 19486 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:17.197690 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.138219 26446 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.137069 26444 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:17.140874 26488 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.149863 26437 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:17.205806 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 252466us
I20260709 12:26:17.140712 26371 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:17.210917 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.209102 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.164170 26502 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:17.202782 18765 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:26:17.176384 26346 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:26:17.211813 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:17.219691 26454 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:17.220372 26454 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:17.170225 26473 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:26:17.174475 26447 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.215152 26488 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.213064 26446 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.240703 26446 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.244489 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:17.245257 18845 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:17.249521 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.250542 18844 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:26:17.221622 26454 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.254992 26489 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.259347 18841 raft_consensus.cc:2368] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:26:17.259946 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.260846 18847 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:17.261323 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:17.216390 26444 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.214079 26437 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.259821 26489 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.295523 18919 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:17.310535 26434 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.326108 18845 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 25 because replica has last-logged OpId of term: 24 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 10.
I20260709 12:26:17.322949 26490 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:17.340479 26488 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.341827 26487 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:17.338320 26434 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.386250 26437 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.390802 26444 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.420689 18916 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:26:17.432909 26511 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:26:17.433810 26513 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:17.420543 26490 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.412806 26447 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.420326 26473 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:17.446520 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.444005 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:17.447252 18922 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:17.382179 26487 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.446060 26489 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.458264 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:17.460155 26434 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.460500 26487 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.462339 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.462797 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.464542 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.465178 18917 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:17.466539 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:17.468706 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.469292 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.450690 26477 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.471992 18922 raft_consensus.cc:2368] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:26:17.475703 26477 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.462414 26346 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:26:17.450284 26473 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.451152 26490 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.507102 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:17.508137 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:17.482632 18917 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:17.508562 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.509768 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:17.485594 26282 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.514133 26473 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:17.514026 26489 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:17.516743 26489 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:17.517179 26489 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:17.517549 26489 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:17.518582 26487 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:17.520898 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:17.538534 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3330) took 1505 ms. Trace:
I20260709 12:26:17.497223 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.501519 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.504825 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.539525 18913 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:17.539803 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:17.557888 26425 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:17.558348 26425 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.561741 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.550575 26346 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.562520 18847 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:26:17.562724 26346 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.563089 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.563522 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:17.564288 18847 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 16: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:17.564720 18848 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:17.539914 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:17.561127 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:17.566337 18839 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:17.539382 18918 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:17.560039 18840 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: []
W20260709 12:26:17.543695 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 1.04727e+06us
I20260709 12:26:17.560421 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.568940 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.569727 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:17.561861 26425 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:17.558934 18843 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:17.559742 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:17.539096 18915 rpcz_store.cc:276] 0709 12:26:16.033019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:16.033423 (+   404us) service_pool.cc:224] Handling call
0709 12:26:16.033756 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:16.761466 (+727710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:17.538240 (+776774us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:17.538464 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671407488}
I20260709 12:26:17.567916 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.552217 18887 leader_election.cc:400] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:26:17.553130 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:17.552384 26434 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.552495 26447 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.578585 26434 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.578974 26447 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.579082 26332 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.580463 26332 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:17.581030 26434 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.578105 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:17.552599 26487 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.581657 26447 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.589815 26449 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:26:17.590205 26479 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:17.551792 26233 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.590513 26480 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 24.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:17.570852 26452 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:17.542928 26476 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:17.588095 26473 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:26:17.596489 26487 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.543977 26223 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:17.549193 26490 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.603433 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.682108 18922 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:17.683203 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.604274 18917 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:17.684381 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.607127 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:17.607982 18841 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:17.609648 18839 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:17.610214 26272 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.610853 26477 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:17.311829 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.617110 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:17.619494 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:17.620882 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.623996 19492 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:17.625303 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.627882 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.628727 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.626852 26489 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.630585 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:17.631716 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.711755 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:17.712308 18840 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:17.712617 18916 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 16: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:17.632720 19487 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:17.632776 18844 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
W20260709 12:26:17.634531 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:17.637539 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.638186 19483 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:17.638270 26228 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.714850 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:17.715649 18915 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:26:17.716126 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 99138.1us
I20260709 12:26:17.570648 26346 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.656985 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.657924 26398 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:17.666801 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:17.589092 26434 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:17.680492 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.694437 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.688016 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:26:17.744427 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77723.8us
W20260709 12:26:17.703122 18666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 292) took 16921 ms (client timeout 15000 ms). Trace:
I20260709 12:26:17.704262 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.717301 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:17.717559 18773 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:17.746883 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:17.747539 18773 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:17.715653 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 96231.3us
I20260709 12:26:17.749420 18814 leader_election.cc:400] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 15 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16.
I20260709 12:26:17.718230 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:17.718974 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:17.671097 26335 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:17.663883 26395 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.727895 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.670944 26476 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.665580 26400 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.739959 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.664760 26452 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:17.662601 26233 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.766582 18771 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:17.800694 18771 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:17.801379 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:17.671533 26304 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:17.671618 26415 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:17.681366 26492 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.769753 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:17.751999 18814 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:17.781541 26306 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:17.779516 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62306.9us
I20260709 12:26:17.680860 26139 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:17.818989 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:17.780454 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 92544us
W20260709 12:26:17.795038 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 138022us
I20260709 12:26:17.765506 18773 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:17.740047 26223 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.833736 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:17.831624 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:17.732575 25859 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:17.740947 26437 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:17.794796 19489 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:17.793551 26493 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:26:17.753839 18666 rpcz_store.cc:269] 0709 12:26:00.758852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:07.901993 (+7143141us) service_pool.cc:224] Handling call
0709 12:26:08.496235 (+594242us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef5090 00007f335af93f3a 00007f3360d49e9c 00007f3360e4804e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc 00007f335f308392 00007f33592c648c 00007f33592c58c6
0709 12:26:17.680360 (+9184125us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:12.354590 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:12.355372 (+   782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:12.355432 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:26:12.355457 (+    25us) tablet.cc:662] Decoding operations
0709 12:26:12.606194 (+250737us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:12.606312 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:12.606340 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:26:12.608048 (+  1708us) tablet.cc:701] Row locks acquired
0709 12:26:12.608114 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:26:12.608300 (+   186us) write_op.cc:270] Start()
0709 12:26:12.608480 (+   180us) write_op.cc:276] Timestamp: P: 1783599972608226 usec, L: 0
0709 12:26:12.608500 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:26:12.692379 (+ 83879us) log.cc:844] Serialized 7759 byte log entry
0709 12:26:13.645464 (+953085us) op_driver.cc:464] REPLICATION: finished
0709 12:26:13.715939 (+ 70475us) write_op.cc:301] APPLY: starting
0709 12:26:13.716066 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:14.273816 (+557750us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:14.273933 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:15.461525 (+1187592us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b1800271300. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335acca0ec 00007f335ad16c0a 00007f335ad164f7 00007f335ad16490 00007f335accdf48 00007f335e9e21bb 00007f335ea295d4 00007f335e8d58da 00007f335e8d83cb
0709 12:26:16.325794 (+864269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:16.326264 (+   470us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:26:16.326337 (+    73us) write_op.cc:312] APPLY: finished
0709 12:26:16.351100 (+ 24763us) log.cc:844] Serialized 180 byte log entry
0709 12:26:16.510107 (+159007us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:16.517893 (+  7786us) write_op.cc:454] Released schema lock
0709 12:26:16.517959 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:16.518480 (+   521us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:16.518518 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46234,"reported_tablets":50,"spinlock_wait_cycles":585245440,"child_traces":[["op",{"apply.queue_time_us":70102,"apply.run_cpu_time_us":72061,"apply.run_wall_time_us":2802495,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87847,"num_ops":20,"prepare.queue_time_us":133711,"prepare.run_cpu_time_us":30109,"prepare.run_wall_time_us":671683,"raft.queue_time_us":183358,"raft.run_cpu_time_us":17555,"raft.run_wall_time_us":38718,"replication_time_us":1034748,"spinlock_wait_cycles":37839104,"thread_start_us":622957,"threads_started":5,"wal-append.queue_time_us":623982,"wal-append.run_cpu_time_us":48597,"wal-append.run_wall_time_us":2651489}]]}
I20260709 12:26:17.801599 18771 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.711347 26272 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:17.816179 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70615.9us
I20260709 12:26:17.867906 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:17.817075 18767 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:17.779330 18915 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:17.772150 26335 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:17.833748 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 81815.5us
I20260709 12:26:17.789752 25894 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:17.853513 18771 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:17.694098 26496 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.097s
I20260709 12:26:17.739781 26228 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.865001 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:17.780351 25945 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:26:17.802139 26452 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:17.882352 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:17.781162 26398 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.787359 26434 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:17.894797 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 223364us
I20260709 12:26:17.897521 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:17.789956 26395 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:17.902262 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:17.851337 26449 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:17.829003 26236 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:26:17.865489 26437 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.881132 26490 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:17.946225 18771 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:26:17.961854 26487 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.964506 26233 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.966759 26434 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.966905 26306 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:17.967495 26306 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.968734 26398 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.864835 26223 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.970559 26228 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.972122 26223 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.872454 25859 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.973382 26489 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.880600 26473 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:17.974255 26473 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:17.975001 25859 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.880332 26346 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 12:26:17.975328 26473 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.976379 26346 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:17.976768 26346 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:17.977607 26346 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.813416 26304 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.980623 26304 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.981271 19485 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:17.834903 26492 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.985576 26492 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:17.884620 26493 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:17.986850 26493 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.829664 26415 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:17.939910 26455 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:17.847005 26480 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:26:17.941202 26449 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:17.941788 26526 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:17.814306 26400 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:17.941959 26437 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:17.972187 26272 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.995193 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.939549 26496 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:17.996896 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:17.997948 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68635.9us
W20260709 12:26:18.003995 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:17.853088 26139 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.019320 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:17.905048 25863 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:17.911377 25894 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:18.014942 26455 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:18.049808 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.050817 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:17.969707 26306 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:18.096889 25834 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:18.104843 26446 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:18.105743 26446 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:18.066036 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.063468 18922 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:18.079843 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.080880 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.117561 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.118294 26228 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:18.118515 26489 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:18.118858 26223 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:18.120289 26489 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:18.118597 26488 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:26:17.947281 26490 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:18.121196 26490 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:18.121321 26488 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:18.121769 26488 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:18.122736 26488 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.124101 26488 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:18.125941 26449 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.061524 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:17.985670 26395 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:17.939586 26527 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:17.905635 26282 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.147s
I20260709 12:26:18.090893 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.092717 18769 raft_consensus.cc:606] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.149343 18769 raft_consensus.cc:614] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:18.044785 18840 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:26:18.052596 26346 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:18.062597 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.056325 26335 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:18.049734 26486 consensus_queue.cc:1175] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e2529a8cff04207bb1b07c108e16983" responder_term: 20 status { last_received { term: 20 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 20 index: 12 } }
I20260709 12:26:18.190858 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.135150 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.144083 26139 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:18.163599 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 219726us
I20260709 12:26:18.189105 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:18.195026 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60014.9us
I20260709 12:26:18.232458 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.236032 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.236968 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.238130 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:18.240957 19483 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:18.242784 18839 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:18.086896 26496 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.243718 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.256012 18922 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:18.256736 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:18.256950 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 368747us
I20260709 12:26:18.214267 26223 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:18.213948 26477 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:18.264372 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 445465us
I20260709 12:26:18.190678 26480 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:18.264901 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.267145 18842 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:18.126366 26446 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.268715 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.261529 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.225699 26400 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:18.275465 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:18.241638 26524 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.283457 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.224464 26271 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:26:18.305334 26524 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.272939 26223 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:18.267030 26311 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:18.292019 26530 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:26:18.290373 26395 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:18.272536 26527 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 12:26:18.332307 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.278137 26492 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:26:18.291234 26528 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:26:18.335291 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59951.7us
I20260709 12:26:18.338960 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.283588 26477 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.315799 26223 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:18.313776 26446 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:18.286993 26480 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:18.465479 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 130728us
I20260709 12:26:18.466339 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:18.468107 26545 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:18.468591 26545 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:18.468950 26545 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:18.469343 18772 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:26:18.469790 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 130955us
I20260709 12:26:18.470709 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.470948 26454 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:18.469944 26527 consensus_queue.cc:1243] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 21.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:26:18.473330 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.488610 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.473666 18768 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:18.491088 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:18.492895 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.479475 26404 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.480069 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.483788 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.476563 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:18.495289 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.496054 18773 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:18.497092 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.499979 18768 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: [18.14-20.15]
I20260709 12:26:18.498347 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.471414 26454 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:18.349289 25894 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:18.333328 26529 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:18.284650 26455 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.612468 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.335093 26400 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.175s
I20260709 12:26:18.620554 25894 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.607473 26404 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.625326 26404 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:18.628600 26531 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:26:18.626086 26404 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:18.485949 26415 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:18.663759 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.663970 18886 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:18.639926 26549 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.678491 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:18.508047 26398 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:26:18.666079 26425 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.077s	user 0.013s	sys 0.002s
W20260709 12:26:18.662766 26332 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.082s	user 0.016s	sys 0.000s
I20260709 12:26:18.682296 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:18.712899 18919 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
W20260709 12:26:18.736876 26533 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.401s	user 0.000s	sys 0.000s
W20260709 12:26:18.679919 26488 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.555s	user 0.014s	sys 0.000s
I20260709 12:26:18.695374 26455 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:18.751075 26496 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:18.751991 26332 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:18.752597 26332 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:18.753103 26332 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:18.755843 26524 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:18.757146 26477 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:18.763031 26535 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
I20260709 12:26:18.633069 26493 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:18.703881 26525 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.516s	user 0.001s	sys 0.000s
I20260709 12:26:18.707396 26473 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:18.744647 26452 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.855s	user 0.012s	sys 0.000s
I20260709 12:26:18.679608 26404 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.680751 26434 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:18.790376 26434 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.791875 26480 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:18.711509 26425 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.793982 26434 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:18.795090 26425 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:18.743203 26454 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:18.797196 26547 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:26:18.617399 26523 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.160s
I20260709 12:26:18.798228 26454 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:18.799314 26559 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 12:26:18.704674 26549 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.778309 26493 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.804430 26549 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:18.805961 26493 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:18.810838 26476 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:18.781700 26452 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:18.815562 26542 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
W20260709 12:26:18.817359 26490 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.005s
I20260709 12:26:18.817620 26452 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:18.817864 26490 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:18.820924 26490 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:18.819001 26346 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
W20260709 12:26:18.822086 26437 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.002s
I20260709 12:26:18.825479 26404 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:18.825958 26335 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:18.824419 26437 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.829514 26437 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:18.822253 26545 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:18.832590 26545 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:18.868745 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 387121us
I20260709 12:26:18.872730 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.879845 18670 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 14 to 17, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 17 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:18.884104 18670 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 14 to 17, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 17 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:18.889309 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.892900 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:18.894906 18764 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.060s	sys 0.092s
W20260709 12:26:18.895434 18764 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.060s	sys 0.092s
I20260709 12:26:18.897432 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3349) took 1182 ms. Trace:
I20260709 12:26:18.897902 18764 rpcz_store.cc:276] 0709 12:26:17.715234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.716874 (+  1640us) service_pool.cc:224] Handling call
0709 12:26:17.778314 (+ 61440us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:26:17.987473 (+209159us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b18003995e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335ab334bc 00007f3357e8148b 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af83bfb 00007f335af8e64b
0709 12:26:17.987634 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.987661 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:26:17.988482 (+   821us) log.cc:844] Serialized 78 byte log entry
0709 12:26:18.250884 (+262402us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:18.896016 (+645132us) log.cc:844] Serialized 14 byte log entry
0709 12:26:18.896552 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.896726 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:18.896826 (+   100us) raft_consensus.cc:1685] finished
0709 12:26:18.896976 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:18.897305 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13641,"prepare.queue_time_us":65520,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":85048,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6256,"spinlock_wait_cycles":15702912,"thread_start_us":966729,"threads_started":3,"wal-append.queue_time_us":344876}
I20260709 12:26:18.902205 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.903543 18764 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:18.903226 18670 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:18.905053 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:18.907361 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:18.908849 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.909330 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:18.668856 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 202927us
I20260709 12:26:18.910957 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.915042 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.915681 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3319) took 1033 ms. Trace:
I20260709 12:26:18.916846 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:18.917629 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3318) took 1068 ms. Trace:
I20260709 12:26:18.917862 18772 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:18.919350 18766 raft_consensus.cc:2410] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:26:18.918061 18847 rpcz_store.cc:276] 0709 12:26:17.849585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.849778 (+   193us) service_pool.cc:224] Handling call
0709 12:26:17.850343 (+   565us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:17.865447 (+ 15104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.865500 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:17.866355 (+   855us) log.cc:844] Serialized 52 byte log entry
0709 12:26:18.026651 (+160296us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:18.031156 (+  4505us) log.cc:844] Serialized 14 byte log entry
0709 12:26:18.031817 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.032145 (+   328us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:18.917090 (+884945us) raft_consensus.cc:1685] finished
0709 12:26:18.917129 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:18.917422 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53345,"prepare.queue_time_us":121079,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":15931,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":12389,"thread_start_us":102695,"threads_started":2,"wal-append.queue_time_us":400384}
I20260709 12:26:18.926307 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:18.931756 18773 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:18.933296 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
W20260709 12:26:18.929242 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 246932us
I20260709 12:26:18.934800 18766 raft_consensus.cc:606] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.929179 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:18.941883 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.916110 18844 rpcz_store.cc:276] 0709 12:26:17.882538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.882729 (+   191us) service_pool.cc:224] Handling call
0709 12:26:17.883194 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:18.033258 (+150064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:18.033292 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:18.033891 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.039632 (+  5741us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:18.039675 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.039752 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:18.814920 (+775168us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:18.915005 (+100085us) raft_consensus.cc:1685] finished
0709 12:26:18.915045 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:18.915442 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6779,"raft.queue_time_us":19037,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":26348,"spinlock_wait_cycles":15914880,"thread_start_us":148069,"threads_started":2,"wal-append.queue_time_us":402420}
W20260709 12:26:18.943815 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.944693 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.945127 18767 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:26:18.951149 18914 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:18.952219 18915 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: [23.12-25.13]
I20260709 12:26:18.953083 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.954135 18917 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:18.955709 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.955564 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.957652 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.959087 18913 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:18.964968 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.951154 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3351) took 1320 ms. Trace:
I20260709 12:26:18.971473 18920 rpcz_store.cc:276] 0709 12:26:17.630626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.631277 (+   651us) service_pool.cc:224] Handling call
0709 12:26:17.631646 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:17.632087 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.632129 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:17.663695 (+ 31566us) log.cc:844] Serialized 26 byte log entry
0709 12:26:17.895727 (+232032us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:17.895794 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:17.895899 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:18.950436 (+1054537us) raft_consensus.cc:1685] finished
0709 12:26:18.950501 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:18.950865 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3048,"raft.queue_time_us":4313,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":4360,"thread_start_us":128291,"threads_started":1,"wal-append.queue_time_us":360852}
I20260709 12:26:18.956873 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:18.978153 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:18.978467 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.979271 19491 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:18.979513 18913 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
W20260709 12:26:18.974360 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.984683 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.988359 25859 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:18.988909 25859 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:18.989976 18766 raft_consensus.cc:606] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:18.990518 25863 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:18.991343 25863 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:18.994855 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:18.995982 18922 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:18.996591 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1278) took 1216 ms. Trace:
I20260709 12:26:18.997658 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:18.952924 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:19.002755 18773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:19.003746 18773 raft_consensus.cc:606] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:19.005837 25945 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.006441 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:19.006955 25945 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.009531 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3359) took 1015 ms. Trace:
I20260709 12:26:18.997167 19484 rpcz_store.cc:276] 0709 12:26:17.780328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.781853 (+  1525us) service_pool.cc:224] Handling call
0709 12:26:17.799958 (+ 18105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:17.989420 (+189462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.989467 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:17.990019 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.318719 (+328700us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:18.318759 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.995636 (+676877us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400562a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:18.995725 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:18.995847 (+   122us) raft_consensus.cc:1685] finished
0709 12:26:18.995865 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:18.996309 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19091,"raft.queue_time_us":1918,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":45861,"spinlock_wait_cycles":434655488,"thread_start_us":328190,"threads_started":1,"wal-append.queue_time_us":470652}
I20260709 12:26:19.010361 25945 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:19.011492 25945 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:19.012840 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:19.013965 25834 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:18.966248 19490 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:19.041337 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:19.010062 18917 rpcz_store.cc:276] 0709 12:26:17.994355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.995856 (+  1501us) service_pool.cc:224] Handling call
0709 12:26:19.009215 (+1013359us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540027c9d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:19.009449 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972621056}
I20260709 12:26:19.015682 26404 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:19.015730 26446 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:26:19.044695 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60514us
I20260709 12:26:19.049151 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:19.049633 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:19.059332 26452 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.060454 26452 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.063419 26528 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:19.064420 26400 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:19.065198 26400 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.067075 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:19.069003 26529 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:19.050554 26526 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:26:19.078709 26488 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:18.906114 18670 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 12 to 16, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 16 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:19.086544 26346 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:19.094596 26434 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:19.095862 26437 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.096673 26437 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.105333 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:19.106331 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62747.9us
I20260709 12:26:19.108320 26530 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:19.108836 26530 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:19.109210 26530 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:19.110817 18764 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:19.110841 25863 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.111838 25834 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.117692 26490 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.118537 26490 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.119239 25834 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:19.121219 26490 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:19.124101 25863 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:19.130570 26415 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:19.132587 26527 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:19.134334 26527 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:19.134841 26527 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:19.136122 26527 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.137980 26527 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:19.138365 26306 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:19.138867 26306 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:19.139854 26425 raft_consensus.cc:993] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:26:19.140486 26425 raft_consensus.cc:1081] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
W20260709 12:26:19.141062 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74254.3us
I20260709 12:26:19.139966 26306 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.146124 19485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:26:19.142354 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:19.142844 26446 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:19.149271 19485 raft_consensus.cc:606] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:19.144696 26400 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.168133 18921 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:19.160531 26446 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:19.184917 26228 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:19.185527 26228 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:19.186025 26228 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:19.186789 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:19.188180 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.188925 26452 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:19.185137 25894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.009s	sys 0.033s
W20260709 12:26:19.185014 18771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.000s	sys 0.012s
W20260709 12:26:19.199821 25894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.033s
W20260709 12:26:19.200547 18771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.001s	sys 0.012s
W20260709 12:26:19.200726 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 308131us
I20260709 12:26:19.206790 26570 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.207682 26570 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.210707 26479 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:19.211658 26479 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.215255 26311 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:19.216380 26311 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.218835 26400 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:19.219655 26400 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.222070 26400 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.192581 26437 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.227451 26446 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.228902 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:19.230522 18921 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:19.235508 26566 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:19.236435 26566 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.240499 26306 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:19.243095 26493 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:19.243939 26493 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.234058 18670 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 16 to 18, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 18 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.249018 18670 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:19.254590 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 54528.3us
I20260709 12:26:19.257934 26236 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.258725 26236 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.260739 19486 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:19.265836 26236 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:19.275787 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76270.8us
I20260709 12:26:19.275947 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:19.276770 19489 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:19.277657 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:19.278203 26452 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:19.281560 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:19.230237 26570 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:19.280076 26452 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:19.296950 26449 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:19.299692 26272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.003s	sys 0.020s
W20260709 12:26:19.298324 18811 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.004s	sys 0.004s
I20260709 12:26:19.306350 26554 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.307121 26554 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.307698 26311 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:19.311228 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.312458 26563 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:19.312855 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.313843 18842 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:19.314694 26554 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:19.310315 26479 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.307034 26570 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:19.316828 26139 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.317651 26139 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.319476 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:19.319941 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 118253us
I20260709 12:26:19.320313 18921 raft_consensus.cc:2368] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23.
I20260709 12:26:19.291913 26493 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.323017 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:19.324990 18811 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.005s	sys 0.004s
I20260709 12:26:19.313061 26563 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:19.321290 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:19.303303 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:19.332655 26570 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.334141 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.335300 18839 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:19.335752 26570 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.321223 26139 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.303052 26452 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:19.331466 26563 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:19.346325 26566 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.355595 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:19.354996 18670 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 13 to 15, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 15 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.357177 18670 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:19.301558 25859 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:19.363560 26223 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.885s	user 0.014s	sys 0.007s
W20260709 12:26:19.331936 18888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.007s	sys 0.002s
I20260709 12:26:19.365253 26569 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.366665 25945 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:19.367666 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:19.369976 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:19.370249 18846 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:26:19.370862 26562 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:19.340183 26272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.004s	sys 0.020s
I20260709 12:26:19.339250 26311 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:19.303144 26449 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.366778 26437 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:19.343458 18765 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.000s	sys 0.011s
W20260709 12:26:19.378755 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51206.8us
W20260709 12:26:19.380158 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.381652 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:19.383916 18917 raft_consensus.cc:1217] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Deduplicated request from leader. Original: 14.7->[16.8-22.11]   Dedup: 18.9->[20.10-22.11]
I20260709 12:26:19.383916 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:19.421824 18917 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [16.8-22.11]
W20260709 12:26:19.384810 26332 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.631s	user 0.007s	sys 0.014s
I20260709 12:26:19.384948 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:19.385070 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.386538 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.388134 26228 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.395327 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.397377 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.404224 26566 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:19.405309 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51152.6us
W20260709 12:26:19.427250 18765 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.000s	sys 0.012s
W20260709 12:26:19.415114 18888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.008s	sys 0.002s
W20260709 12:26:19.406354 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 135638us
I20260709 12:26:19.420898 26449 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.432080 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.434674 18841 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:19.463804 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.469635 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:19.479770 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:19.483282 18843 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:19.417670 26223 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.470556 26139 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:19.486034 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.422926 26530 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.431744 26332 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.431885 26311 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.424285 26569 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.520614 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:19.514909 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44635.6us
I20260709 12:26:19.499961 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:19.502887 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.499080 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:19.495163 18846 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:19.539553 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:19.523758 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.542124 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2797) took 1048 ms. Trace:
I20260709 12:26:19.467430 25945 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.549799 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.465095 26562 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.515224 26564 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.562448 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:19.544551 18771 rpcz_store.cc:276] 0709 12:26:18.474501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.474664 (+   163us) service_pool.cc:224] Handling call
0709 12:26:18.475088 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:19.201222 (+726134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:19.201290 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:19.202196 (+   906us) log.cc:844] Serialized 26 byte log entry
0709 12:26:19.434156 (+231960us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:19.434226 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:19.470347 (+ 36121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.522206 (+ 51859us) raft_consensus.cc:1685] finished
0709 12:26:19.522229 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.522735 (+   506us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6389,"raft.queue_time_us":136072,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":48440,"thread_start_us":946773,"threads_started":2,"wal-append.queue_time_us":285093}
I20260709 12:26:19.561546 18842 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:19.483873 26437 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.565596 18841 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:19.570413 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:19.575495 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51150.3us
I20260709 12:26:19.576052 26139 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:19.576570 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:19.584899 26455 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:19.586241 26564 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.588587 18917 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:19.590868 26490 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:19.589015 26564 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:19.591876 26223 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.597532 26569 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:19.598989 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:19.600157 26332 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.600984 26332 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:19.601425 26332 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.601869 26332 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:19.606563 18840 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:19.607232 18847 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:19.608769 26530 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.612990 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.614140 18844 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 15.
I20260709 12:26:19.615132 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.615840 18844 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:19.608771 25945 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.616750 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:19.591555 26490 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.508878 26566 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.518332 26563 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.569566 26489 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:26:19.645195 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:19.647763 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 92541.7us
I20260709 12:26:19.632723 18847 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:19.489954 26415 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.130s
I20260709 12:26:19.586285 26455 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:19.647912 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:19.665750 26425 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:19.651847 25945 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.671108 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:19.675343 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:19.647423 26489 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:19.663213 26455 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:19.677959 26272 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:19.684141 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 107714us
I20260709 12:26:19.684394 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:19.652968 26400 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.680565 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:19.704931 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:19.705966 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:19.670610 26530 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:26:19.710947 18913 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:19.688854 26272 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.685417 26489 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:19.680979 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:19.689185 26228 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:19.717731 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:19.712177 18670 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 11 to 13, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 13 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:19.726171 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:19.727056 19486 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:19.731065 26562 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.732474 26549 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:19.734735 26455 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.735392 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:19.736563 26529 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:19.736467 26455 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:19.748448 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:19.752434 19484 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:19.710738 26346 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:19.740309 26306 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:26:19.739620 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82721.7us
I20260709 12:26:19.758818 18848 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:19.716151 26272 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:19.700783 26452 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.737713 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:19.759791 18764 raft_consensus.cc:606] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:19.765391 18764 raft_consensus.cc:614] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:19.773247 26563 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.765744 26425 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:19.775175 26425 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:19.783286 18843 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:19.785403 26437 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:19.787127 26577 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:26:19.793910 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:19.796303 19486 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:19.770097 26446 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:19.815315 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 131177us
W20260709 12:26:19.821373 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.825299 26306 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:19.825816 26564 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:19.826265 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:19.827350 26311 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:19.827548 26400 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:19.828657 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:19.778944 26425 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:19.831120 26346 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:19.831658 26346 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:19.832038 26346 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:19.836278 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3321) took 1601 ms. Trace:
I20260709 12:26:19.836787 18840 rpcz_store.cc:276] 0709 12:26:18.235054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.236781 (+  1727us) service_pool.cc:224] Handling call
0709 12:26:18.237049 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:19.607205 (+1370156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:19.835936 (+228731us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400071054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:19.836199 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3008278272}
I20260709 12:26:19.839161 26490 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:19.843206 26236 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.844074 26528 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:19.843977 26236 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.844671 26528 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:19.828861 26563 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:19.849238 26236 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:19.766100 25945 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:19.856343 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 203120us
I20260709 12:26:19.853061 26566 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:19.765911 26335 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.178s
W20260709 12:26:19.869360 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 150525us
W20260709 12:26:19.877914 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.861253 26523 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:19.871079 18670 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 12 to 18, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 18 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:19.914280 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 176731us
I20260709 12:26:19.914955 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:19.931844 19490 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:19.868276 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:19.922611 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.863744 26479 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:19.935870 19484 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:19.845930 26528 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.859431 26446 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.931219 26523 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:19.951234 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.937170 26490 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.936770 25945 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:19.965101 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 206521us
I20260709 12:26:19.943080 26479 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:19.969803 26585 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:19.935089 26449 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:19.966693 18670 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 12 to 19, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 19 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.955976 26523 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:19.967991 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 226682us
I20260709 12:26:19.980371 26282 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:19.980594 26592 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.981103 26282 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.981361 26592 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:19.982888 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf32cd3655eb4943abc0cdbf54a32206 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1e2529a8cff04207bb1b07c108e16983 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:19.971697 26479 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:19.964313 26404 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.987417 26404 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:19.988511 26528 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:19.989826 26404 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:19.990583 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 167382us
I20260709 12:26:19.992936 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:19.995173 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1361) took 2234 ms. Trace:
I20260709 12:26:19.995636 18765 rpcz_store.cc:276] 0709 12:26:17.760511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.777565 (+ 17054us) service_pool.cc:224] Handling call
0709 12:26:17.777854 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:18.144870 (+367016us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:26:19.509205 (+1364335us) log.cc:844] Serialized 14 byte log entry
0709 12:26:19.717225 (+208020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:19.725984 (+  8759us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:19.726057 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:19.994833 (+268776us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54001d5e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:19.994880 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.995084 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161755,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":2636,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":34210,"spinlock_wait_cycles":843464448,"thread_start_us":1412904,"threads_started":2,"wal-append.queue_time_us":181951}
I20260709 12:26:20.000051 26449 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.000334 19490 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:20.001526 26446 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:19.998013 26479 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.003669 26489 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.006117 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:20.009253 25859 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:20.010773 18839 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:20.011128 26479 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.012598 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:20.014991 26395 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:20.015671 26395 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:20.008805 26425 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.022698 18739 leader_election.cc:400] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23.
I20260709 12:26:20.027060 18739 leader_election.cc:403] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:26:20.009274 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:20.006117 26489 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.027081 26395 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:20.033044 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 67113.5us
I20260709 12:26:20.034766 26415 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:20.034862 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.035151 18670 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:20.038618 26306 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:20.036391 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:19.977922 26490 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.041270 26594 raft_consensus.cc:993] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:26:20.041757 26490 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:20.042927 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.013s	sys 0.021s
W20260709 12:26:20.043298 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.021s
W20260709 12:26:20.043594 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 610891us
I20260709 12:26:20.044338 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:20.045270 26489 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:20.045867 26489 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:20.046950 26489 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.051595 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.052460 18920 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:20.053570 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.054287 18918 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:20.054769 26452 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:20.054926 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62103.2us
I20260709 12:26:20.055503 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.056246 18913 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:20.057623 18917 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:20.058566 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.058769 26527 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:20.059638 26585 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:20.062704 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:20.062835 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.065932 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.066195 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.067683 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.070529 26566 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.070750 26452 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:20.071158 26566 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.037292 18670 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 17 to 18, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 18 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.058211 26564 raft_consensus.cc:1081] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:26:20.077237 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.082916 18921 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:20.083329 19490 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:20.078676 26592 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:20.085282 26332 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.086974 18917 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:20.088104 26332 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:20.089334 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:20.089939 26346 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.090868 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:20.092523 26346 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:20.092746 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.093675 18920 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:20.095026 26589 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.230s	user 0.003s	sys 0.000s
I20260709 12:26:20.097429 26566 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:20.096823 18670 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 13 to 18, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 18 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:20.098363 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.103533 18670 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 9 to 12, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 12 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:20.101881 26523 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.108001 19491 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:20.110105 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:20.113364 26282 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.120725 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.122350 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:20.122174 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63703.2us
I20260709 12:26:20.126082 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:20.128947 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:20.129595 18921 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:20.131224 19485 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:26:20.122854 26272 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.134238 18918 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:20.135380 26272 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:20.135696 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.135797 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.136042 26346 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:20.135442 18916 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:26:20.103063 26415 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23.
I20260709 12:26:20.116079 26523 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:20.145503 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.145144 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:20.150604 18922 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:20.145064 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 138550us
I20260709 12:26:20.157632 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:20.159013 18916 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:20.157735 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.160148 18773 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:20.176537 26592 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:20.170660 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:20.170614 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.180400 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:20.184653 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.206832 18771 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:20.203717 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.208709 18913 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:20.216070 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:20.210350 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51582.6us
I20260709 12:26:20.221071 26415 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.221442 26604 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:20.222010 26604 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.221782 26415 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.222453 26604 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:20.224180 26415 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.189639 26528 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:26:20.200076 26306 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:20.232841 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:20.235953 18764 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
W20260709 12:26:20.241743 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 88265.7us
I20260709 12:26:20.244769 18916 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:20.239877 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:20.246925 26425 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.247597 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:20.254683 26591 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:26:20.255738 26335 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:20.256546 26346 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:20.256762 26335 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:20.256971 26346 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:20.257272 26335 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:20.256026 26490 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:26:20.258116 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:20.262204 19491 raft_consensus.cc:2368] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27.
I20260709 12:26:20.262326 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:20.262785 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.265094 18769 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:20.265340 26271 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.264065 26415 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:20.266953 26415 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.264608 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.260275 26395 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:20.269639 26395 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.270344 26415 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.272467 26395 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.273095 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:20.242863 26306 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.281239 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:20.282492 18922 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:20.282812 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.283888 26527 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:20.286599 18920 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
W20260709 12:26:20.287796 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.289039 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:20.290565 18921 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:20.268261 26585 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:20.258276 26335 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.292519 18737 leader_election.cc:400] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27.
I20260709 12:26:20.295553 18737 leader_election.cc:403] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:26:20.274780 26490 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:20.266065 26271 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.289882 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.300074 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.300491 18769 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:20.296299 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.298758 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.301928 18771 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:26:20.285001 26528 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:20.304564 26528 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.304889 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.305729 18772 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 11. (term mismatch)
I20260709 12:26:20.306109 18772 pending_rounds.cc:85] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 10
I20260709 12:26:20.306348 18772 pending_rounds.cc:107] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 22.11
I20260709 12:26:20.306716 18772 raft_consensus.cc:2889] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:20.306936 26528 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.307564 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.307618 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.306249 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.282526 26425 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:20.258111 26346 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 19.18, Last appended by leader: 18, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.311549 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.311645 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.312515 18771 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:20.312505 18915 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:20.313205 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54314.8us
I20260709 12:26:20.313926 26528 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:20.320986 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.321762 18769 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:26:20.312608 18764 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:20.326097 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:20.327123 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.327405 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.329034 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.331187 26594 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.331489 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.332297 18773 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:20.336031 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:20.336977 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.298918 18921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:57874
I20260709 12:26:20.338162 18921 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:20.293373 26527 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:26:20.351922 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.338586 18921 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:20.339630 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.339803 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.348770 26490 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.353574 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.354738 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:20.352576 18764 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:20.355594 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.357630 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.358201 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.331796 26594 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.373358 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.376147 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.374967 18773 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:20.351568 26335 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:20.379846 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.390264 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.396107 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.408066 18841 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [18.9-22.11]
I20260709 12:26:20.410578 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.411173 18766 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:20.411366 18773 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:20.408149 26452 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:26:20.423403 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50302.3us
W20260709 12:26:20.423676 26599 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
I20260709 12:26:20.424598 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.425774 26446 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:20.427161 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.427342 18768 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:20.428531 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:20.429862 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:20.430251 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.431945 26415 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:20.432461 26415 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:20.433248 18771 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:26:20.436214 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.434587 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.437116 18772 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:20.332592 26425 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.440637 26528 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27.
I20260709 12:26:20.440958 26527 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:20.434142 18771 pending_rounds.cc:85] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 11
I20260709 12:26:20.346514 26585 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 12:26:20.453507 18771 pending_rounds.cc:107] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:26:20.453922 18771 raft_consensus.cc:2889] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:20.442080 26446 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:20.458797 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.409119 26346 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:20.474548 18764 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:20.476675 18770 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:20.489248 18841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:20.490264 18841 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:20.490821 18841 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:20.495820 26594 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:20.508550 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80079.8us
I20260709 12:26:20.509887 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:20.473886 25859 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:20.463142 26446 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:20.521795 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.433516 26415 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.523047 18921 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.528700 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.530894 18919 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:20.531055 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:20.540933 18921 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.544270 26271 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:20.551329 18843 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:20.551761 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:20.551326 18840 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:20.552589 18842 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:20.526727 26446 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:20.554047 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:20.558059 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.520923 25859 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:20.556692 26311 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:26:20.596926 26452 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:26:20.597479 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47165.7us
I20260709 12:26:20.606281 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:20.576689 18765 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:20.609859 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.608808 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.608666 18770 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:20.617231 18772 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:20.625901 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:20.630133 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:20.631088 18919 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:20.630060 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.631623 26425 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.632069 26404 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:20.632591 26404 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:20.632998 26404 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:20.634505 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 124744us
I20260709 12:26:20.635466 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:20.638669 26585 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:20.622249 26415 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:20.641885 18921 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:20.602028 26604 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.643842 26601 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:20.632098 18764 raft_consensus.cc:2376] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21. Re-sending same reply.
I20260709 12:26:20.645022 26601 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:20.645414 26601 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:20.645609 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:20.646957 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:20.653317 18914 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:20.566422 26489 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:20.661345 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:20.610702 26452 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:20.662320 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.666829 26404 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.647176 26400 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:26:20.670154 25859 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.671156 26400 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:20.671563 26400 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:20.671922 25859 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:20.672504 26400 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.647465 26604 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.673856 26400 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:20.693845 26585 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:20.694526 26585 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:20.694453 26616 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:20.670087 26404 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.674261 26452 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:20.664021 26489 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:20.706977 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.695363 26395 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.711512 26404 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:20.701655 26616 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.646384 26601 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.695705 26594 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:20.740957 26594 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.711179 26585 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.731782 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.767217 18773 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:20.740212 26601 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:20.751315 26489 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.752599 26404 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:20.729152 26395 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:20.720278 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.761541 18921 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 15. Current term is 16. Ops: []
W20260709 12:26:20.768863 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 143083us
I20260709 12:26:20.774734 18841 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.731014 26616 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:20.795248 18841 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.780435 26425 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:20.818733 26306 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.827108 26395 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.830852 26404 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.787680 26534 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:20.793622 26523 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:26:20.836843 26534 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:20.838285 18844 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:20.830907 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:20.846196 19485 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:26:20.848798 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.783697 26527 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:20.850420 18920 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
W20260709 12:26:20.854187 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 218828us
I20260709 12:26:20.846812 19485 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:20.862599 18920 pending_rounds.cc:85] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 14
I20260709 12:26:20.862938 18920 pending_rounds.cc:107] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:26:20.863190 18920 raft_consensus.cc:2889] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:20.862330 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.868310 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:20.871009 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 78635.1us
I20260709 12:26:20.797197 26585 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:20.871376 19485 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.880589 19485 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:20.884047 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.877705 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:20.880915 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:20.887542 19486 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:26:20.866075 26489 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:20.885079 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:20.891460 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:20.903370 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.849956 26425 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:20.947000 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43680.6us
I20260709 12:26:20.948975 26455 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:20.953263 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 154738us
W20260709 12:26:20.949648 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58285.5us
I20260709 12:26:20.873555 26527 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:20.900476 26395 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:20.903709 26617 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:20.895923 26604 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:26:20.876645 26446 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:20.988615 26446 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:20.949769 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:20.990754 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:20.991678 26566 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:20.992061 26566 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:20.992339 26346 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:20.992442 26566 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:20.967892 26455 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:20.994784 26455 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:20.998787 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.992076 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:20.999989 26272 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:21.000474 26272 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:21.000880 26272 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:20.974723 26527 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:20.965077 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:20.977208 26622 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:20.977780 26415 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:20.980031 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.964601 26490 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:26:20.957757 26335 raft_consensus.cc:2764] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:26:21.006160 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:21.014642 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59278.9us
I20260709 12:26:20.944324 26306 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:26:21.015983 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:21.020279 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:20.979398 26617 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:21.041045 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 168271us
W20260709 12:26:21.052846 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 149566us
I20260709 12:26:21.008999 26622 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:21.062729 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.022272 26603 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:21.068097 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 188370us
I20260709 12:26:21.016081 26490 consensus_queue.cc:1243] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:26:21.073900 18920 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:21.077003 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:21.011152 26624 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:26:21.077852 19486 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:26:21.078660 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:21.048568 26617 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:21.079280 26335 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:21.079502 26452 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.080309 26592 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:21.113806 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.080612 26630 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:21.081267 26528 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:21.076961 26404 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:21.121893 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:21.122592 18764 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:21.086031 26594 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:21.086803 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66617.1us
I20260709 12:26:21.087009 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.128479 18768 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:26:21.087446 26622 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:21.091755 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76296.7us
I20260709 12:26:21.132961 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:21.092890 26425 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:21.073530 26523 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:21.102937 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.136498 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.137123 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.137493 18771 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:26:21.110903 19485 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:21.071471 26603 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:21.115310 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:21.118589 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.119182 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:21.119491 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:21.142515 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58112.2us
I20260709 12:26:21.113075 26604 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:21.146243 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.138304 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:21.138862 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 74251.5us
I20260709 12:26:21.143255 18773 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:21.082259 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:21.153093 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:21.154589 18769 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:21.151131 18770 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 14.
I20260709 12:26:21.146093 26603 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:21.160722 18918 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:21.133281 26404 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.163897 26404 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:21.178587 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:21.113847 26534 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:26:21.183738 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:21.153002 26311 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:26:21.186724 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:21.186342 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:21.192651 18773 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:21.121232 26592 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.158917 26604 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:21.239853 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:21.196324 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77707.6us
I20260709 12:26:21.180732 26628 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:21.247822 26621 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.262s	user 0.004s	sys 0.001s
I20260709 12:26:21.182011 26622 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:21.251001 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 118131us
I20260709 12:26:21.255412 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:21.183753 26523 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:21.240882 26626 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:26:21.271044 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 142948us
I20260709 12:26:21.253547 26604 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:21.294095 26523 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.300765 18764 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
W20260709 12:26:21.341233 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67340.6us
I20260709 12:26:21.363397 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:21.478540 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.487782 19484 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:21.263047 26629 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.378772 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.380234 18767 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:26:21.378425 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:21.486342 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.472023 18766 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:26:21.385363 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:21.378259 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.371513 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.467151 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:21.333050 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52380us
I20260709 12:26:21.364050 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:21.401917 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.486147 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:21.444545 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 322563us
I20260709 12:26:21.377802 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.489775 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.380772 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:21.379253 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.491243 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.532023 18847 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:21.531683 18842 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
W20260709 12:26:21.536935 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50895.7us
I20260709 12:26:21.536795 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:21.537958 18771 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:21.539011 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:21.539084 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 380835us
I20260709 12:26:21.544853 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:21.541579 19489 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:26:21.502853 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 316591us
W20260709 12:26:21.324271 26627 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:21.544446 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:21.532696 18772 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:21.543761 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:21.357311 26616 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.001s
I20260709 12:26:21.549556 26616 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.552577 26616 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:21.548105 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:21.547540 18764 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:21.555680 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:21.531682 18770 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:21.557036 26624 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:21.557183 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:21.557894 26624 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:21.558926 26446 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:21.559535 26446 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:21.559149 26624 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.560492 26446 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.562721 26534 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:21.563364 26534 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:21.565016 18922 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:26:21.567152 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.568361 26631 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:21.568888 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:21.569905 26631 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:21.564421 26534 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.574295 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:21.574663 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:21.576097 26400 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:21.576692 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.577682 26400 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:21.580776 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:21.580896 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:21.582103 26425 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:21.585769 18764 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:21.542587 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:21.587281 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:21.305676 26346 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:21.384287 26601 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.002s
I20260709 12:26:21.258961 26628 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.464847 26272 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.592476 26628 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:21.355696 26592 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:21.327965 26633 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:26:21.593106 26272 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:21.321993 26632 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.595386 18916 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:21.595532 18917 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:21.587180 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:21.596763 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50818.2us
I20260709 12:26:21.287256 26630 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:21.356208 26452 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:21.286969 26637 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:21.599225 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.599671 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:21.302413 26528 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.353228 26395 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:21.603134 18771 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:21.603286 19484 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:21.597565 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:21.611567 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:21.451705 26489 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:21.357184 26306 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:21.629184 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:21.633471 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.635267 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:21.636073 18771 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:21.606565 26271 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:21.652334 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:21.654778 18913 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:26:21.606081 26637 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.654882 18848 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:21.654793 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.655956 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:21.665676 18767 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:21.661203 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.666819 18841 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:21.535713 26455 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.667747 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.668006 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.608415 18764 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.330449 26566 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.612464 26395 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:21.677732 18764 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:21.608829 26640 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:21.675727 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.689788 18769 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:26:21.680656 26311 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.614107 26641 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:26:21.682715 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.608516 26632 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.615222 26528 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.683950 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.669787 26637 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:21.637220 26272 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:21.722278 19485 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:21.686936 18839 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:21.723177 18921 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:21.625386 26630 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:21.679993 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:21.731163 18916 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:21.690217 18843 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:21.691216 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.693641 18847 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:26:21.596256 26629 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.696065 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:21.734982 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:21.735786 26629 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:21.736093 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 98008.5us
I20260709 12:26:21.653743 26271 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.669530 25859 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.736974 26271 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:21.737149 25859 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.701674 18848 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:21.696717 18845 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:21.739365 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:21.739992 18848 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:21.740036 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.668699 26616 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:21.741554 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:21.742439 18843 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:21.742622 18844 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:21.736310 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.743324 18846 raft_consensus.cc:2410] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 26 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:26:21.743762 18841 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:21.745126 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.645725 26489 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:21.693410 26603 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.005s
I20260709 12:26:21.750463 18764 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
W20260709 12:26:21.759100 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 226747us
I20260709 12:26:21.696808 26527 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:21.737916 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 83252.2us
I20260709 12:26:21.688176 26306 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.765601 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:21.774767 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 234240us
I20260709 12:26:21.729306 26272 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:21.786600 18840 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:21.786095 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 135881us
I20260709 12:26:21.790589 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.755185 26534 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:21.695705 26311 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.789435 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:21.765060 26527 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.729949 26604 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.774259 25859 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:21.801273 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.801625 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:21.787629 26272 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:21.757261 26616 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.747664 26643 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:26:21.806473 18846 raft_consensus.cc:2376] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17. Re-sending same reply.
I20260709 12:26:21.823249 18842 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:21.792696 26395 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.829095 26528 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:21.829361 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.829855 26528 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:21.830296 26528 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:21.830718 26528 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:21.831241 26616 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:21.831908 26616 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:21.832419 26616 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:21.833348 26616 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 19.18, Last appended by leader: 18, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.820415 25859 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:26:21.803534 26527 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:21.835806 26489 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:21.836365 26306 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:21.845121 18848 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:21.845343 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.846266 18847 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:21.846630 26489 raft_consensus.cc:2764] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:26:21.847784 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:21.803715 26534 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.829408 26395 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:21.849182 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:21.864279 26617 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.000s
I20260709 12:26:21.865025 26632 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:21.866479 26635 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:21.869319 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.871078 26654 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:21.872897 26654 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:21.836786 26656 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:21.876523 18913 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:21.806349 26655 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 12:26:21.769505 26603 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.886262 18767 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:21.888433 26311 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:21.890897 18840 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:26:21.865146 26617 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.880034 26656 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.884236 26635 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.838083 26630 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 24.11, Last appended by leader: 11, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.885417 26624 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:21.884492 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:21.918203 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127732us
W20260709 12:26:21.939493 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 55098.1us
I20260709 12:26:21.873968 26654 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:21.940973 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:21.941774 18738 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:21.920403 18845 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
W20260709 12:26:21.968659 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.970518 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.900369 26656 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:21.915277 26400 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:21.938362 26655 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:21.978542 26629 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:21.978978 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.979959 26616 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:21.980436 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:21.980494 26616 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:21.984375 26616 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:21.985883 26636 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.986605 26636 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:21.987890 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 250698us
W20260709 12:26:21.992084 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 167566us
I20260709 12:26:21.917452 26455 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:21.943786 26622 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:21.996788 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:21.986016 26616 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:22.006264 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:21.972776 26632 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.919458 25859 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 12:26:21.995843 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:21.976473 26446 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:22.010730 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.061295 18921 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:22.068650 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.070523 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.063136 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:22.015831 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 194893us
I20260709 12:26:22.070923 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.073483 18773 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:22.010329 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.073987 18769 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 25: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:22.078465 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.079636 18921 raft_consensus.cc:2410] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:26:22.081162 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.081488 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.043462 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.051712 26643 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:21.983139 26425 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:22.030032 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:22.088076 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 91362.1us
I20260709 12:26:21.918330 26635 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:22.077785 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82010us
I20260709 12:26:22.002041 26636 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:22.139920 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61525.4us
I20260709 12:26:22.088639 26446 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:22.140661 26668 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:22.141043 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:22.141542 26534 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.141705 26446 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.143836 26668 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:26:22.144556 19457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.585s (SENT) [suppressed 27 similar messages]
I20260709 12:26:22.068281 26622 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:22.147111 26622 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.076179 26677 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:22.150970 18916 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:22.151135 26677 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:22.151917 26677 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.150092 26622 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.157444 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:22.155021 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.058625 26604 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:22.004570 26400 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.061162 26669 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:22.223168 18843 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:22.210769 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:22.526060 18764 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:22.075465 26346 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.077104 26489 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.180233 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:22.165305 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 78070.7us
W20260709 12:26:22.393107 26395 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.516s	user 0.003s	sys 0.011s
I20260709 12:26:22.312893 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:22.467941 26684 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:22.466897 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:22.467350 26673 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.167858 19491 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:22.213847 26603 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.340199 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.211213 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:22.070358 26628 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:22.548745 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 391515us
I20260709 12:26:22.545912 26669 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:22.456641 26527 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.002s
I20260709 12:26:22.167050 26641 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.394s
W20260709 12:26:22.399319 26271 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.001s
I20260709 12:26:22.008867 26655 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.557375 26452 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:26:22.300988 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 293634us
I20260709 12:26:22.575217 26527 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:22.580590 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:22.580717 26678 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:22.581547 26680 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:22.581393 26678 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.582118 26680 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.583950 26691 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.584438 26680 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:22.585194 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:22.582136 26527 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.587836 26306 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:22.588626 26306 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:22.552641 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 408405us
W20260709 12:26:22.352833 26272 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.004s
W20260709 12:26:22.247148 26661 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 12:26:22.248121 26664 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:26:22.554656 18915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.004s	sys 0.016s
I20260709 12:26:22.009533 26654 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.555371 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.192627 26592 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:22.233707 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:22.558496 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 378448us
I20260709 12:26:22.558667 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.303563 26660 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:22.557410 26489 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.612207 19490 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 25: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:22.568095 26684 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:22.559403 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.005s	sys 0.014s
I20260709 12:26:22.353331 26566 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.071817 26632 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.169008 19485 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:26:22.625555 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:22.296218 26617 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.245604 26670 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:22.565760 18917 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:22.605973 26527 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:26:22.627698 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:22.627496 26670 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.628530 26527 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:22.628938 26527 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:22.629050 18844 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:22.629513 26489 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.610237 26660 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:22.561695 26636 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.630677 26636 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.630777 26660 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.631819 26660 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:22.632205 18921 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:22.632954 26636 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:22.565698 18764 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:22.568020 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.634496 26678 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:22.635545 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67571.3us
I20260709 12:26:22.637478 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:22.391363 26666 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:26:22.163095 26635 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.568162 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:22.370957 26657 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.484s	user 0.000s	sys 0.003s
I20260709 12:26:22.639153 26684 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:22.506680 26637 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.002s
I20260709 12:26:22.639743 26630 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:22.640205 26637 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.640581 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:22.586365 26631 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:22.641276 18845 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.641369 26631 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.360373 26676 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.224s
I20260709 12:26:22.643203 26676 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:22.643579 26676 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:22.643842 26631 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.644470 26676 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.645928 26676 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:22.646438 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:22.646716 18920 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:22.646835 26655 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.647069 26617 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:22.630198 26670 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:22.570323 26673 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:22.648572 26604 consensus_queue.cc:1175] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e2529a8cff04207bb1b07c108e16983" responder_term: 19 status { last_received { term: 19 index: 16 } last_committed_idx: 16 last_received_current_leader { term: 19 index: 16 } }
I20260709 12:26:22.649044 26489 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:22.649492 26489 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.649852 26489 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:22.650811 19484 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:26:22.587294 26395 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:22.569331 26628 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.653458 26395 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.655604 26628 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.656054 26395 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.366643 26665 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.218s
I20260709 12:26:22.591988 26271 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.586820 26680 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:22.597332 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:22.457504 26528 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.003s
I20260709 12:26:22.550776 26629 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:26:22.600821 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:22.678093 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:22.679175 18841 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:22.679287 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.601680 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:22.602380 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:22.455384 26656 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.350872 26677 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.556051 26346 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.573122 26669 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:22.614951 26400 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.609812 26634 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:22.616888 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61595.5us
I20260709 12:26:22.614168 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:22.617574 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:22.618583 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.014s
W20260709 12:26:22.619333 26652 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.013s	sys 0.010s
W20260709 12:26:22.702271 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 88182.8us
I20260709 12:26:22.703200 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:22.577819 26452 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:22.192389 26404 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:22.595039 26272 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.640489 26630 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:22.592958 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:22.702804 26652 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.014s	sys 0.010s
I20260709 12:26:22.658447 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:22.659657 18918 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:22.660781 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.663496 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:22.600979 18915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.005s	sys 0.016s
W20260709 12:26:22.715513 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 122643us
I20260709 12:26:22.716313 18913 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:22.723050 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.717154 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:22.726329 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.682281 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:22.686551 18917 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 25: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:22.657270 26665 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:22.735869 18814 leader_election.cc:400] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:22.736443 18814 leader_election.cc:403] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:26:22.698421 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 709757us
I20260709 12:26:22.697907 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:22.629951 26527 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.619390 18919 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:22.715909 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57553.5us
W20260709 12:26:22.730234 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48084.7us
I20260709 12:26:22.738695 18845 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:22.716692 26663 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:22.732316 26346 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:22.732848 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75083.9us
I20260709 12:26:22.744741 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.734094 26670 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:22.698784 26306 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.710778 26636 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:22.742348 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44513.1us
I20260709 12:26:22.695993 26637 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:22.681316 26628 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:26:22.717603 26594 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:22.711727 26452 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:22.686034 26528 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.756050 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:22.680958 26680 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.711535 26673 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.713747 26272 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.703963 26688 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:22.759284 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.709486 26271 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:22.719169 26640 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:22.712137 26404 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:22.715178 26677 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.740192 26400 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:22.735566 26665 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:22.804203 18766 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:22.758847 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:22.763221 26630 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:22.782467 18767 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:22.783404 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3400) took 1170 ms. Trace:
I20260709 12:26:22.785084 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:22.785766 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:22.748620 26455 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:22.762844 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:22.748765 26675 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:22.763559 26594 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.764629 26527 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.781668 26306 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.765086 26617 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:22.805437 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46663.4us
I20260709 12:26:22.763182 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:22.806174 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.800998 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.866741 18768 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:22.867565 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104864us
I20260709 12:26:22.867671 25859 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:26:22.854909 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:22.868521 25859 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:22.867658 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66773.8us
I20260709 12:26:22.796526 26585 raft_consensus.cc:2764] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:26:22.869776 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.858333 18765 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:22.874220 18769 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:22.872313 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:22.875172 18847 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:22.801610 26400 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.877419 26690 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:22.877637 25859 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.800972 26693 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 12:26:22.858083 26635 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:22.871196 26306 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.886039 18765 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:22.798666 26640 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:22.898800 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:22.899251 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:22.899513 18842 raft_consensus.cc:2376] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17. Re-sending same reply.
I20260709 12:26:22.899844 18840 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:22.865332 26594 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:22.893029 18768 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:22.846505 26634 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.876740 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:22.905432 19484 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:22.798527 26689 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.092s
I20260709 12:26:22.904424 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.909608 18768 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:22.858816 18915 rpcz_store.cc:276] 0709 12:26:21.612614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.612742 (+   128us) service_pool.cc:224] Handling call
0709 12:26:21.644473 (+ 31731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:21.987862 (+343389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:21.987896 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:21.988478 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:26:22.718828 (+730350us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:22.718893 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.757555 (+ 38662us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b540027c4d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:22.757626 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:22.757673 (+    47us) raft_consensus.cc:1685] finished
0709 12:26:22.757686 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:22.783347 (+ 25661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":301494,"raft.queue_time_us":312627,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":46160,"spinlock_wait_cycles":104643328,"thread_start_us":729888,"threads_started":1,"wal-append.queue_time_us":666022}
I20260709 12:26:22.889971 26624 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:22.938090 26624 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.938566 26663 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.939297 26663 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.940245 26306 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.942931 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:22.797799 26688 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.946655 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.893754 26665 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.938593 26624 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:22.948330 26665 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:22.948487 26688 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.946213 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.947516 18769 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:22.956557 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:22.956791 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.957492 26690 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:22.957952 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:22.917493 26691 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:22.896004 26635 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.918715 26404 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:22.908665 26395 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:22.921054 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:22.922068 18767 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:22.985584 19485 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:22.902498 26677 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.923446 26528 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.925612 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.926641 18840 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:22.929119 19490 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:22.933923 19489 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:22.934780 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:22.934864 18657 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbadce60e960476289740ec2afd0a5c8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 47b48b5c69f245b79ecb292eff89927f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:22.992087 18657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 86713.1us
I20260709 12:26:22.936487 26656 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:22.937325 26699 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:26:22.997112 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:22.997735 18765 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:22.957674 18769 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:22.958094 26690 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.001864 26629 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:23.003873 26680 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.997002 26677 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.009074 26632 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:22.960621 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 257511us
I20260709 12:26:23.010430 18765 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:23.011183 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.011256 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:23.012101 18840 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:26:22.961133 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 218673us
I20260709 12:26:22.961966 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:22.962600 26641 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:22.890728 26616 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:23.014773 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:23.016734 25859 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:23.017410 25859 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:22.891153 26400 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:22.980556 26635 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:22.974534 18918 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 18. Preceding OpId from leader: term: 20 index: 19. (index mismatch)
I20260709 12:26:22.982787 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:22.987305 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:22.942134 26663 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:22.996361 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.027179 26641 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:23.031950 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.032723 19487 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:23.028596 26641 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.033473 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2854) took 1010 ms. Trace:
I20260709 12:26:23.036659 18772 rpcz_store.cc:276] 0709 12:26:22.023216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.023356 (+   140us) service_pool.cc:224] Handling call
0709 12:26:22.058773 (+ 35417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:22.566882 (+508109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:22.566914 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:22.597224 (+ 30310us) log.cc:844] Serialized 26 byte log entry
0709 12:26:22.626283 (+ 29059us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:22.626333 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.626431 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:23.033236 (+406805us) raft_consensus.cc:1685] finished
0709 12:26:23.033258 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.033412 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9635,"raft.queue_time_us":84380,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":517238,"threads_started":2,"wal-append.queue_time_us":136399}
I20260709 12:26:22.998157 18920 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:23.001981 26690 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:22.959901 26585 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:23.045683 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.988629 26395 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.050679 26395 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.051970 26452 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.022904 26653 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:23.055272 26653 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:23.056475 26653 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.059371 18920 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 18. Current term is 19. Ops: []
W20260709 12:26:23.059901 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 63665us
I20260709 12:26:23.060365 18921 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:23.021565 18765 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:23.023674 26594 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:22.995438 26628 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:23.035015 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.017879 25859 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:23.015578 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:23.084560 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69083.7us
I20260709 12:26:23.085610 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:23.046322 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.048071 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:23.048496 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.087488 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.088119 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.089596 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.089798 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:23.092664 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.094841 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:23.061334 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:23.072101 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:22.914534 26634 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:23.077437 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 207779us
I20260709 12:26:23.037840 26677 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:23.088271 19488 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:23.088645 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:23.107290 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.049012 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:23.100728 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.106741 19491 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:23.047669 26455 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:23.077023 26632 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.070996 26693 raft_consensus.cc:2764] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:26:23.111940 18920 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:23.122591 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.121409 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:23.127501 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.098346 26271 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:23.076509 26616 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.048s
I20260709 12:26:23.128819 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.103186 26585 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:26:23.136232 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.103714 26688 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:23.120433 26306 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:23.103287 26680 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:23.135492 18915 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:23.105993 26663 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.075627 26622 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:26:23.072510 26669 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.131611 25859 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.097544 26640 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.126003 26677 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:23.106122 26660 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:26:23.128544 26490 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:26:23.168416 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 73709.6us
I20260709 12:26:23.101468 26628 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.137445 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.173049 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:23.131784 26689 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:23.181497 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:23.187413 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52447.3us
I20260709 12:26:23.113620 26683 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:23.133912 26452 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:23.197570 18914 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:23.198077 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.177918 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:23.177628 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:23.188263 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:23.199563 18765 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:23.200873 26704 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:23.201551 26704 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:23.202638 26704 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.208233 26679 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:23.208950 26679 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.210632 26648 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:23.211642 26648 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:23.213042 26648 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.215773 26634 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.216563 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:23.217293 18764 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:26:23.218183 18764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:23.218856 18764 raft_consensus.cc:606] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.219256 18764 raft_consensus.cc:614] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:23.220134 26676 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 12:26:23.220947 19486 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:23.223286 26594 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.224078 18764 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:23.170922 26663 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.125299 26632 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:23.228626 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47207.9us
W20260709 12:26:23.177585 26489 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.525s	user 0.015s	sys 0.000s
I20260709 12:26:23.140369 26688 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:23.143308 26306 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:23.235256 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.237675 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.239843 26395 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.248620 18921 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:23.236793 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:23.180562 26617 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:23.187665 26689 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:23.259567 26712 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:26:23.259936 26637 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:23.260043 26634 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.299680 26634 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.247308 26688 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:23.319262 18771 raft_consensus.cc:2368] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:26:23.271922 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2857) took 1229 ms. Trace:
W20260709 12:26:23.320664 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.198582 26680 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:23.236660 26691 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:23.300000 19487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1485e54f9795416785f4baf244599201"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:26:23.326558 19487 raft_consensus.cc:606] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:23.263270 26697 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.500s	user 0.004s	sys 0.000s
I20260709 12:26:23.329051 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:23.271278 26701 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 12:26:23.322005 26637 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:23.332221 26604 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:23.333531 26663 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.332221 26637 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.252049 26306 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:23.320573 18766 rpcz_store.cc:276] 0709 12:26:22.042811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.043036 (+   225us) service_pool.cc:224] Handling call
0709 12:26:23.271679 (+1228643us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:23.271832 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655596928}
I20260709 12:26:23.324291 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:23.261901 26624 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.302280 26634 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.328894 19483 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:26:23.287489 26689 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:23.248768 26489 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.218536 26455 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.349267 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.350014 18845 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:23.351696 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:23.354903 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:23.345400 26603 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:26:23.358667 26395 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.362944 26632 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:23.363348 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:23.364030 18770 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:23.364784 26628 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:23.365746 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.366627 19492 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:23.367990 26669 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.369469 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:23.370211 18773 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:26:23.371374 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:23.372190 18773 raft_consensus.cc:2368] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:26:23.373087 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:23.373343 26679 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:23.373960 18773 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:23.378628 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.379350 18847 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.380685 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.381369 18840 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:23.382786 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:23.385936 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 324670us
I20260709 12:26:23.386005 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:23.354099 26705 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:23.388988 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.381472 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:23.389714 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.379479 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.393674 18766 pending_rounds.cc:85] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 9
I20260709 12:26:23.394018 18766 pending_rounds.cc:107] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 12:26:23.394284 18766 raft_consensus.cc:2889] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:23.335268 26680 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.399380 18839 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:23.404156 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.404539 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.405270 18840 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:23.405167 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.406723 18848 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:23.406821 18840 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:23.408221 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.408366 18846 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:23.372473 26635 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.410494 18773 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 12:26:23.400323 26709 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 12:26:23.431703 18845 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:23.418668 18848 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:23.427438 18843 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:23.417712 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:23.391824 26705 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.437378 18842 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:23.401139 26604 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:23.440793 18765 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:23.454519 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:23.455274 18765 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:23.459928 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.460073 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:23.458626 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:23.414067 26632 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.392539 26679 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:26:23.391353 26628 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.062s
I20260709 12:26:23.503966 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:23.464931 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47317.9us
I20260709 12:26:23.512925 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.520525 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:23.519150 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:23.519340 18845 raft_consensus.cc:2376] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25. Re-sending same reply.
I20260709 12:26:23.521240 18773 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:23.523610 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:23.524194 18765 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:26:23.526196 18847 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:23.453708 26604 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.529353 18886 leader_election.cc:400] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:26:23.532850 18886 leader_election.cc:403] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:23.452729 26705 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:23.538633 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:23.521595 26528 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:23.573459 18773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:23.579728 18773 raft_consensus.cc:606] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:23.580149 18773 raft_consensus.cc:614] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:23.526952 26669 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.536922 26604 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:23.518253 26714 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:23.576282 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:23.541196 26616 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:23.589505 26616 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:23.590605 26616 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.19, Last appended by leader: 19, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.592064 26616 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:23.595670 26700 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.730s	user 0.000s	sys 0.002s
W20260709 12:26:23.598986 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69782.6us
I20260709 12:26:23.599747 25859 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:23.599987 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:23.602064 26642 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:23.602892 26642 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:23.603652 26642 consensus_queue.cc:1243] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:26:23.604952 26566 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:23.605072 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.605504 26566 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:23.523131 26632 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.617646 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.621495 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:23.621850 18765 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:23.622859 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:23.618444 18841 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:23.627785 18770 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:23.638417 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.604735 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:23.583961 26490 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
W20260709 12:26:23.652292 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47736.3us
I20260709 12:26:23.608106 26714 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:23.640144 26665 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.691s	user 0.001s	sys 0.013s
I20260709 12:26:23.628803 26676 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:26:23.691951 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70459.4us
I20260709 12:26:23.656096 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:23.585923 26669 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.682333 26691 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:23.689141 26670 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:23.716522 26676 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:23.698882 18770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:23.746613 18770 raft_consensus.cc:606] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.747259 18770 raft_consensus.cc:614] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:23.715183 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59183.8us
W20260709 12:26:23.735276 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:23.719802 26721 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:26:23.721952 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:23.685130 26714 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:23.742240 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.606334 26566 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.762696 19492 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:23.763352 26566 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.763417 26404 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:23.764242 26404 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:23.687808 26624 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:23.769667 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.727741 26641 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:23.774271 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.774753 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.757793 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:23.715559 26400 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.004s
I20260709 12:26:23.748956 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.775477 18843 raft_consensus.cc:2376] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23. Re-sending same reply.
I20260709 12:26:23.776221 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.702517 26715 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.781937 18848 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:26:23.723946 26691 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.783854 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:23.785320 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.786252 18848 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:23.786115 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.786726 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:23.788679 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.791278 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:23.792181 18845 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:23.789031 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:23.803399 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.805245 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.779881 26641 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:23.788388 26691 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:23.787912 26653 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:26:23.804383 26720 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:26:23.771330 26490 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
I20260709 12:26:23.809659 26455 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:23.825186 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.833506 18770 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:23.812089 26601 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:23.781773 26400 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.808384 26624 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.815315 26641 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:23.810493 26680 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:23.865104 26710 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.539s	user 0.005s	sys 0.000s
I20260709 12:26:23.818522 26628 raft_consensus.cc:2764] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:26:23.854314 26725 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:23.831318 26676 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:23.874650 26728 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:26:23.877465 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:23.880995 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:23.881906 18922 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:23.820835 26617 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:26:23.882644 26640 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:23.883347 18920 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:23.826144 26634 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 12:26:23.884510 26634 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:23.884929 26634 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:23.865099 18767 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:23.859141 26626 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:23.863194 26400 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.800151 26670 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 12:26:23.905366 18841 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:23.907181 19483 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:23.910332 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:23.812621 26452 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
W20260709 12:26:23.935333 26724 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 12:26:23.937024 26716 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:26:23.937829 26635 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.939215 26626 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:23.939671 26626 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:23.940624 26626 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.942035 26626 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:23.818223 26564 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 12:26:23.828357 26690 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:26:23.943243 26564 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:23.943663 26564 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:23.839725 26455 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.944801 26455 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:23.944576 26564 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.946048 26564 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:23.890609 26622 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:26:23.885900 26634 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.982048 26634 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:23.982312 26683 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:23.982735 26683 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:23.983574 26683 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.984946 26683 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:23.958501 26272 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:23.986290 26641 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.986980 26272 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.987596 18913 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:23.989358 26272 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:23.794647 26715 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.990760 26641 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:23.991124 26395 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:23.991721 26715 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:23.992574 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.993657 26719 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:23.994323 26660 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:23.994240 26719 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.994628 26452 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:23.994957 26660 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:23.996670 26719 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:24.000418 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 180358us
I20260709 12:26:23.958866 26632 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.959815 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2869) took 1033 ms. Trace:
W20260709 12:26:23.917917 26688 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.004s
I20260709 12:26:23.962218 26669 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:23.964336 18847 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 21 because replica has last-logged OpId of term: 20 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 18.
I20260709 12:26:23.968916 26673 raft_consensus.cc:993] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:26:24.009708 26673 raft_consensus.cc:1081] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:26:23.918745 26617 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:23.971477 26670 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:23.973465 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:24.013041 26622 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:24.012769 26688 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.013410 18769 raft_consensus.cc:606] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:24.013543 26622 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:24.013849 18769 raft_consensus.cc:614] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:24.013047 26670 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:23.974833 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:24.001475 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:24.015610 18920 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:24.002254 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:24.002348 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.016443 18922 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
W20260709 12:26:24.016546 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.997483 26604 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:23.999596 26689 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.004s
I20260709 12:26:24.016443 18921 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:24.015324 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1518) took 1033 ms. Trace:
I20260709 12:26:24.020722 19484 rpcz_store.cc:276] 0709 12:26:22.982535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.974499 (+991964us) service_pool.cc:224] Handling call
0709 12:26:24.015252 (+ 40753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:24.002205 18768 rpcz_store.cc:276] 0709 12:26:22.926127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.034425 (+108298us) service_pool.cc:224] Handling call
0709 12:26:23.034851 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:23.035266 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:26:23.113484 (+ 78218us) log.cc:844] Serialized 14 byte log entry
0709 12:26:23.452174 (+338690us) log.cc:844] Serialized 14 byte log entry
0709 12:26:23.452497 (+   323us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:23.459920 (+  7423us) log.cc:844] Serialized 26 byte log entry
0709 12:26:23.460088 (+   168us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:23.464657 (+  4569us) log.cc:844] Serialized 14 byte log entry
0709 12:26:23.520214 (+ 55557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.520295 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:23.597407 (+ 77112us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b1800228940. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e557 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:26:23.959550 (+362143us) raft_consensus.cc:1685] finished
0709 12:26:23.959576 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.959741 (+   165us) inbound_call.cc:177] Queueing success response
0709 12:26:23.990845 (+ 31104us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b1800228940. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f335ee5f58f 00007f3357e9e571 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd
Metrics: {"mutex_wait_us":73692,"prepare.queue_time_us":440256,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":110,"raft.queue_time_us":56123,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":1695,"spinlock_wait_cycles":74245248,"thread_start_us":379037,"threads_started":3,"wal-append.queue_time_us":403427}
I20260709 12:26:24.017747 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:24.007905 26455 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:23.978986 26601 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:24.032043 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:24.038743 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.040331 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:23.991735 26395 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:24.046087 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.011317 26630 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:24.053725 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54284us
I20260709 12:26:24.059140 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:24.015280 26688 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:24.065320 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.072852 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:24.074229 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.077013 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.079563 25859 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:24.080343 25859 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.085532 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:24.069314 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:24.071200 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:24.071719 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.089859 18773 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:24.073202 18914 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:24.020206 26715 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.015183 26670 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.026930 26680 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.036536 26663 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:24.103022 18768 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:26:24.103140 18773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:24.008906 26691 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.045161 26272 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:24.104532 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:24.044414 26271 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:24.111399 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:24.068352 26527 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.113008 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:24.101979 26528 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:24.217332 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104451us
I20260709 12:26:24.218761 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:24.220640 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:24.222813 26741 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:24.223394 26741 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:24.224368 26741 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.226267 26527 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.164403 26616 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:24.231251 26616 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.231632 26616 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:24.152634 26272 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.234443 19485 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:24.234802 26272 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.235456 26272 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:24.239122 26739 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:24.240615 18773 raft_consensus.cc:606] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.241220 18773 raft_consensus.cc:614] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:24.012784 26617 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.245142 26617 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.119114 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.119606 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.090353 26632 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:24.097549 26346 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:24.090150 26719 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:24.115365 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2861) took 1212 ms. Trace:
I20260709 12:26:24.248534 26346 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:24.248620 18771 rpcz_store.cc:276] 0709 12:26:22.903347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.925344 (+ 21997us) service_pool.cc:224] Handling call
0709 12:26:24.115173 (+1189829us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54000af0d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:24.115306 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749455744}
I20260709 12:26:24.178886 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1515) took 1229 ms. Trace:
I20260709 12:26:24.249691 26346 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.250123 19486 rpcz_store.cc:276] 0709 12:26:22.933605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.942560 (+  8955us) service_pool.cc:224] Handling call
0709 12:26:24.163150 (+1220590us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400720454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:24.163353 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637256960}
I20260709 12:26:24.180013 18920 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:24.180717 26726 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:26:24.187140 26306 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.004s
I20260709 12:26:24.188987 26404 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.190335 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:24.282364 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 92122.2us
I20260709 12:26:24.283627 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.194653 26622 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.297773 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:24.299561 18920 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:24.202559 26660 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.203995 26455 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.205443 26714 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.111757 26635 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 12:26:24.109488 26715 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.311738 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:24.109858 26663 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.209199 19487 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:26:24.112690 26680 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.064543 26705 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.100052 26630 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.212201 26395 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.108821 26677 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:24.215911 26670 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:24.152230 26688 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:24.036497 26689 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:24.252820 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 338934us
I20260709 12:26:24.268642 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:24.267899 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:24.307852 26404 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:24.230037 26527 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.275321 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:24.339608 18841 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:24.298353 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.298635 18917 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:24.196583 26604 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.303362 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:24.305838 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:24.314661 26725 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:24.308173 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.308285 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.342824 18918 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:24.271883 26726 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:24.319020 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:24.322758 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:24.353545 26713 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:24.354148 26713 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:24.355130 26713 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.358609 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:24.361914 26715 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.362811 26630 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.363317 26527 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:24.363765 26527 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.316555 26663 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:24.341387 18848 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:24.331413 18846 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:24.331310 18920 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:24.301460 26594 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:24.307665 26624 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:24.273680 25859 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.335109 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.336714 18843 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:24.336951 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:24.215992 26271 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.345760 18839 raft_consensus.cc:2368] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22.
I20260709 12:26:24.297312 26306 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.371995 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:24.493357 25859 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:24.493956 25859 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:24.494334 25859 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:24.376480 26680 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.378016 26705 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.379650 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:26:24.493294 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 121390us
I20260709 12:26:24.380092 18764 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 22. Ops: []
I20260709 12:26:24.378940 26603 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.334748 26622 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:24.390134 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.364620 26688 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:24.387208 26714 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.401315 26616 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:24.401911 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.364125 26527 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:24.500731 26603 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:24.440155 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:24.509931 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69885.9us
I20260709 12:26:24.506434 26624 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:24.510756 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:24.511037 26624 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.440568 26726 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.441908 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 1314) took 1095 ms. Trace:
I20260709 12:26:24.515007 19483 rpcz_store.cc:276] 0709 12:26:23.346029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.346193 (+   164us) service_pool.cc:224] Handling call
0709 12:26:24.441715 (+1095522us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b540062b6d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:24.441844 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797781376}
I20260709 12:26:24.492190 26452 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:24.409919 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.337283 26677 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.429021 26489 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.468161 26272 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:24.470126 18845 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:24.477936 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:24.478166 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 143143us
W20260709 12:26:24.484834 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.524626 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.497123 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:24.500546 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 423625us
W20260709 12:26:24.431671 26732 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.552s	user 0.003s	sys 0.003s
I20260709 12:26:24.506709 18765 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:24.526077 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:24.507507 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:24.442101 26689 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.530673 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.532514 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.533070 18920 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:26:24.533483 18920 pending_rounds.cc:85] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 10
I20260709 12:26:24.533716 18920 pending_rounds.cc:107] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:26:24.520617 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:24.533942 18920 raft_consensus.cc:2889] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:24.528000 18844 raft_consensus.cc:2368] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21.
W20260709 12:26:24.517242 26676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.019s	sys 0.015s
I20260709 12:26:24.528661 18919 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:24.534893 25859 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.535696 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:24.536681 19483 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:24.537592 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.538275 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
W20260709 12:26:24.538830 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.539681 18769 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:24.542469 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:24.543270 19483 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:26:24.544428 18846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1485e54f9795416785f4baf244599201"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:45432
I20260709 12:26:24.545140 18846 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.545626 18846 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:24.547367 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.523625 26739 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:24.523450 26335 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:24.548424 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:24.564236 18848 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:24.567418 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:24.505337 26680 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:26:24.549417 18919 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:24.539232 26635 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:24.527443 26714 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:24.551416 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:24.531383 26725 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:24.535868 26676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.019s	sys 0.015s
I20260709 12:26:24.694039 26713 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.555534 18843 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:26:24.722055 19491 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 12:26:24.739399 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.550571 26641 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 12:26:24.740083 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.553248 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.703639 19485 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:24.540313 26489 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:24.546598 26637 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:24.764041 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 210895us
I20260709 12:26:24.765834 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:24.562132 26689 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:24.724900 18846 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:24.712986 26733 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.834s	user 0.005s	sys 0.015s
I20260709 12:26:24.635756 18840 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:24.776088 18773 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 26 index: 12. (index mismatch)
I20260709 12:26:24.786921 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:24.762756 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.795077 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:24.554589 26749 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:24.797827 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:24.700934 26739 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:24.797920 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:24.807483 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:24.798949 18772 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:24.800568 18771 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:24.779914 26683 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:24.812984 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:24.813997 19485 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:24.816175 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:24.819136 18846 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.819525 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:24.774215 19483 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:24.702684 26642 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.097s
I20260709 12:26:24.855854 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:24.856549 18768 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:24.859357 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:24.860072 25859 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.861621 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3399) took 1537 ms. Trace:
I20260709 12:26:24.873045 18766 rpcz_store.cc:276] 0709 12:26:23.324063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.393079 (+ 69016us) service_pool.cc:224] Handling call
0709 12:26:23.393450 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:23.395176 (+  1726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.395207 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:23.396542 (+  1335us) log.cc:844] Serialized 52 byte log entry
0709 12:26:23.715643 (+319101us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:23.715689 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.715769 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:24.430871 (+715102us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:24.861266 (+430395us) raft_consensus.cc:1685] finished
0709 12:26:24.861293 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:24.861552 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2202,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9791,"spinlock_wait_cycles":59739904,"thread_start_us":263302,"threads_started":1,"wal-append.queue_time_us":393243}
I20260709 12:26:24.862418 26753 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:24.775487 26489 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.816257 26523 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
W20260709 12:26:24.889842 26755 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:26:24.890484 26648 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:24.891098 26648 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.863965 26624 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.875805 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:24.864789 26739 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.792418 26660 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:24.870110 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:24.857656 18919 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:24.901317 18846 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:24.877405 18848 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:24.877918 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 1385) took 1242 ms. Trace:
I20260709 12:26:24.726243 26635 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.888072 26306 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:24.888949 26748 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.529s	user 0.000s	sys 0.009s
I20260709 12:26:24.716517 26713 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.916757 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:24.896832 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:24.897876 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:24.741716 26714 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.544849 26452 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:24.903278 18847 rpcz_store.cc:276] 0709 12:26:23.616810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.638070 (+ 21260us) service_pool.cc:224] Handling call
0709 12:26:24.859159 (+1221089us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400071054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:24.859313 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746638208}
I20260709 12:26:24.906044 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:24.909297 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:24.913390 18848 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:24.915405 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:24.923970 19483 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:24.924546 19483 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:24.741219 26688 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.895442 26665 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.923573 18919 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.826997 26594 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.092s
I20260709 12:26:24.930173 18848 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:24.910598 26624 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.915107 26715 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:24.943040 18919 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:24.942572 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3428) took 1675 ms. Trace:
I20260709 12:26:24.944901 18845 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:24.942261 19483 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.951633 18768 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:24.952247 19483 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:24.949898 18921 rpcz_store.cc:276] 0709 12:26:23.267597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.290991 (+ 23394us) service_pool.cc:224] Handling call
0709 12:26:23.291351 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.027434 (+736083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.942275 (+914841us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54000320d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:24.942496 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667115776}
I20260709 12:26:24.935691 26630 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:24.953995 26630 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:24.955179 26630 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.960297 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:24.961149 18773 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:24.930150 26452 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.971122 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:24.948135 18847 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:24.900768 26648 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.871696 26527 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:24.947988 18848 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:24.977718 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:26:24.974545 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 377238us
I20260709 12:26:24.987164 19483 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:24.985682 18846 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:24.952570 26715 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.942646 26665 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:24.966686 26271 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:24.970681 26637 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.996446 18846 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:26:25.006086 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.015625 18773 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:24.986414 26616 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.994704 26680 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.002454 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:25.008332 18848 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:24.968199 26624 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.025000 18737 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:25.032670 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:25.033762 18773 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:25.007087 26715 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:25.034317 26660 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:25.032188 26306 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:25.040515 26660 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.041319 26660 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:25.003954 26635 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.040613 26306 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:25.045552 26306 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:25.051934 26489 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.052902 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1334) took 1199 ms. Trace:
I20260709 12:26:25.053346 19488 rpcz_store.cc:276] 0709 12:26:23.853812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.854023 (+   211us) service_pool.cc:224] Handling call
0709 12:26:23.854503 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:24.023306 (+168803us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:26:24.054261 (+ 30955us) log.cc:844] Serialized 14 byte log entry
0709 12:26:24.317850 (+263589us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:24.323477 (+  5627us) log.cc:844] Serialized 26 byte log entry
0709 12:26:24.323679 (+   202us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:24.323714 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.323785 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:24.888240 (+564455us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:25.036632 (+148392us) raft_consensus.cc:1685] finished
0709 12:26:25.052649 (+ 16017us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.052828 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4875,"prepare.queue_time_us":30665,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":18382,"raft.queue_time_us":38248,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":14764,"spinlock_wait_cycles":29761792,"thread_start_us":374392,"threads_started":2,"wal-append.queue_time_us":234581}
I20260709 12:26:25.056901 26715 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.059371 26624 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.019814 26637 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.059388 26715 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:25.062724 26665 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.063854 18773 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:26:25.065732 26663 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 12:26:25.065829 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:25.066558 18773 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:25.069379 26603 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.003s
I20260709 12:26:24.999660 26452 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:24.998718 26753 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.074023 26753 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.075205 26306 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.076828 26753 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:25.077682 26660 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.078966 18773 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:25.101742 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:25.102456 18773 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:25.103684 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3433) took 1233 ms. Trace:
I20260709 12:26:25.104082 18913 rpcz_store.cc:276] 0709 12:26:23.870334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.870527 (+   193us) service_pool.cc:224] Handling call
0709 12:26:23.870879 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.988071 (+117192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.103436 (+1115365us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540027d8d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:25.103623 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267944704}
I20260709 12:26:25.104692 26660 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:25.091913 26669 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:25.106695 26669 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.108923 26669 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:25.095731 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 1376) took 1692 ms (client timeout 1655 ms). Trace:
I20260709 12:26:25.097805 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1337) took 1186 ms. Trace:
I20260709 12:26:25.110638 19491 rpcz_store.cc:276] 0709 12:26:23.911140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.911595 (+   455us) service_pool.cc:224] Handling call
0709 12:26:23.912054 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:24.724739 (+812685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.097398 (+372659us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54005c0dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:25.097713 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861881728}
I20260709 12:26:25.115628 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.116350 18770 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:25.116698 26306 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:25.116897 26527 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.117277 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.118034 18770 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
W20260709 12:26:25.119063 26670 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.782s	user 0.009s	sys 0.002s
I20260709 12:26:25.120287 26714 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.031733 26680 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.123114 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45480 (request call id 1336) took 1213 ms. Trace:
I20260709 12:26:25.123667 19487 rpcz_store.cc:276] 0709 12:26:23.909883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.910041 (+   158us) service_pool.cc:224] Handling call
0709 12:26:25.122895 (+1212854us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54006c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:25.123045 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676502912}
W20260709 12:26:25.125348 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.125577 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3439) took 1144 ms. Trace:
I20260709 12:26:25.127112 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3405) took 1799 ms. Trace:
I20260709 12:26:25.127519 18765 rpcz_store.cc:276] 0709 12:26:23.327316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.636781 (+309465us) service_pool.cc:224] Handling call
0709 12:26:23.637676 (+   895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.526631 (+888955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.126822 (+600191us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54002a1054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:25.127046 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998115584}
I20260709 12:26:25.128860 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.131304 26713 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:25.135103 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3415) took 1063 ms. Trace:
I20260709 12:26:25.135557 18764 rpcz_store.cc:276] 0709 12:26:24.071929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.097887 (+ 25958us) service_pool.cc:224] Handling call
0709 12:26:24.115996 (+ 18109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.498681 (+382685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.134829 (+636148us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54001d6854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:25.135018 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606882560}
I20260709 12:26:25.136744 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:25.137353 18764 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:26:25.141686 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1841) took 1112 ms. Trace:
I20260709 12:26:25.142151 18922 rpcz_store.cc:276] 0709 12:26:24.028870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.029056 (+   186us) service_pool.cc:224] Handling call
0709 12:26:24.078873 (+ 49817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.504928 (+426055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.504978 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.505045 (+    67us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:24.505106 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.141417 (+636311us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54000f6254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:25.141468 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.141621 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979142528}
I20260709 12:26:25.144258 26311 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:25.144755 26311 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:26:25.148901 26622 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 12:26:25.010082 26677 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.145704 26311 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.160954 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:25.216421 18772 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:25.070055 26603 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.066268 26663 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.162778 26335 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:25.118923 18767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2863) took 2208 ms (client timeout 2198 ms). Trace:
I20260709 12:26:25.125921 18917 rpcz_store.cc:276] 0709 12:26:23.981148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.000606 (+ 19458us) service_pool.cc:224] Handling call
0709 12:26:24.010114 (+  9508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.340834 (+330720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.125325 (+784491us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540027c9d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:25.125517 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663059712}
W20260709 12:26:25.110103 18839 rpcz_store.cc:269] 0709 12:26:23.403746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.403884 (+   138us) service_pool.cc:224] Handling call
0709 12:26:25.095392 (+1691508us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400154ad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:25.095621 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151667456}
I20260709 12:26:25.227177 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.175406 18765 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:25.227072 26640 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 12:26:25.251947 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:25.252373 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.252691 26640 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:25.253175 26640 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:25.253631 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:25.249859 18767 rpcz_store.cc:269] 0709 12:26:22.910626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.986160 (+ 75534us) service_pool.cc:224] Handling call
0709 12:26:25.118661 (+2132501us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54002a1a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:25.118811 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932353408}
I20260709 12:26:25.256682 26603 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.205687 26669 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.258649 19487 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 12:26:25.258723 26669 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.262230 26311 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:25.266953 26404 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:25.267379 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:25.267596 26404 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.269059 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:25.252696 18770 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:25.271274 18771 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 12:26:25.273085 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.273707 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:25.274266 19485 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:25.178467 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.180560 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 298957us
I20260709 12:26:25.254273 18765 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:25.184849 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.190371 18913 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:25.191730 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.191879 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:25.277882 18920 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:25.187847 18773 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:25.206939 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:25.156355 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.213799 18764 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:25.220275 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.123204 26680 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.280690 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.283483 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:25.284397 19491 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:25.282940 18919 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:25.286895 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:25.289585 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82747.4us
I20260709 12:26:25.035446 18769 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
W20260709 12:26:25.291330 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.269812 26404 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:25.281668 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.297501 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.274451 19487 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
W20260709 12:26:25.277864 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 93118.8us
I20260709 12:26:25.301095 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.301687 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.292695 19483 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:25.298728 26765 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:25.298945 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:25.299474 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:25.303423 18764 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
W20260709 12:26:25.299852 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.303639 18840 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:25.305909 18773 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:25.307493 18773 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:25.303151 19488 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:25.311724 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:25.215629 26271 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:25.314807 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:25.315115 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:25.325318 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:25.315204 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:25.323436 19485 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 28: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:25.325501 19483 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:25.251979 26335 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.327817 18764 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:25.329578 18764 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:25.330895 19486 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:25.330984 18764 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:25.323446 26704 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.309981 26624 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.347018 18772 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:25.347990 18767 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 17. Current term is 18. Ops: [16.11-17.12]
W20260709 12:26:25.335541 26743 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.982s	user 0.009s	sys 0.012s
I20260709 12:26:25.335963 26705 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.338376 19491 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:25.342653 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:25.355571 19487 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:25.343864 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:25.283959 26683 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:25.338761 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:25.356812 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.358144 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.359725 19457 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.366997 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:25.337441 26689 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:25.367182 18764 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:25.326786 26669 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.254072 26640 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:25.372313 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59354.3us
I20260709 12:26:25.300513 26642 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.056s
I20260709 12:26:25.373482 18920 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:25.299753 26566 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
W20260709 12:26:25.355620 26759 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:26:25.378582 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.438642 18917 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:25.381631 18765 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:26:25.353545 26404 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.373320 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:25.431515 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48291.7us
I20260709 12:26:25.386719 18772 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:25.464587 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.465665 18772 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:25.345641 26271 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.361990 26594 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:25.400557 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.378113 26683 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.443493 18770 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
W20260709 12:26:25.468058 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 94836.8us
I20260709 12:26:25.469817 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.476960 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.377940 26665 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:25.479724 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:25.377825 26726 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:25.439915 18771 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:25.349603 26704 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.355106 26624 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.367956 26705 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.383320 26489 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:25.597083 26489 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.597909 26489 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:25.593438 18921 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:25.551409 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:25.603374 26617 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:25.603945 26617 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:25.604833 26617 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:25.505574 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.587158 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 248472us
W20260709 12:26:25.553032 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 279152us
W20260709 12:26:25.593976 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114419us
W20260709 12:26:25.609211 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57883.9us
I20260709 12:26:25.523610 26765 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:25.609592 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.382899 26680 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:25.612126 26765 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.613123 26775 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.613209 26648 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:25.610623 26670 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:25.614545 26670 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.613824 26648 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:25.614986 26670 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:25.615265 26648 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:25.615798 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:25.616514 18765 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:25.614717 26774 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.619143 26774 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.621203 26663 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.614707 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.623741 26774 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:25.623848 26663 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:25.620357 18772 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
W20260709 12:26:25.578732 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 287859us
I20260709 12:26:25.497383 26404 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:25.596431 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 159623us
I20260709 12:26:25.385424 26677 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:25.627920 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.610502 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:25.539081 26566 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:25.630725 19484 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:26:25.618567 18765 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:26:25.611063 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:25.657801 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46836.9us
I20260709 12:26:25.659005 18738 leader_election.cc:400] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21.
I20260709 12:26:25.530097 26688 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:25.504012 26630 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.487958 26689 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:26:25.640586 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:25.694042 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53560us
I20260709 12:26:25.536927 26669 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:25.432818 26703 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.245s
W20260709 12:26:25.663122 26763 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:26:25.384128 26714 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.258s
I20260709 12:26:25.676201 26704 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:25.515720 26718 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.146s
I20260709 12:26:25.681329 26705 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.683878 26773 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:26:25.650789 26715 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:25.687785 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58582.2us
I20260709 12:26:25.613812 26775 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.834755 26775 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:25.636406 26683 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:25.566417 26725 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:26:25.567420 26616 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 12:26:25.854105 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:25.860680 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:25.767599 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74488.2us
I20260709 12:26:25.504261 26766 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.185s
I20260709 12:26:25.821002 26742 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:25.826994 26689 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:25.897864 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:25.905382 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:25.906493 18842 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:25.908790 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.914768 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:25.915774 18920 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:25.829867 26704 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.652436 26566 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:25.660686 26680 raft_consensus.cc:2764] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:26:25.824699 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:25.657464 26677 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.817718 26774 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:26:25.954895 18839 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:25.694952 26630 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.832448 26715 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.659616 18738 leader_election.cc:403] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:25.841257 26683 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:25.815655 26594 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:25.923537 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:25.777580 26663 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:25.922123 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:25.969514 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47531.3us
W20260709 12:26:25.970484 19487 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.004s
I20260709 12:26:25.836349 26271 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:25.930979 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:25.970899 19487 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:26:25.941412 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 110929us
I20260709 12:26:25.687005 26691 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:25.947144 18845 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:26:25.895015 26622 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:25.822290 26669 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:25.898701 26742 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.967289 18844 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:25.977705 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 349854us
I20260709 12:26:25.930157 26689 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:25.979362 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:25.976033 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:25.973922 26768 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 12:26:25.963881 26715 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:26.023624 19488 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.000s
W20260709 12:26:26.024682 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46186.4us
W20260709 12:26:26.025347 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45480.8us
I20260709 12:26:26.024495 19488 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:25.974982 26452 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.974637 26683 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.978041 26742 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:25.946373 26642 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:26:25.974836 26622 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:26.027966 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:25.983795 26636 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:25.982714 26680 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21.
I20260709 12:26:25.946655 26704 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.022266 26271 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:26:25.976001 26594 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.028606 26766 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:26.050328 26776 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:26:26.049549 26624 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.074538 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.075440 19487 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:26.074026 26704 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:26.076152 18769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3416) took 2003 ms (client timeout 1720 ms). Trace:
W20260709 12:26:26.085603 18769 rpcz_store.cc:269] 0709 12:26:24.072231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.072405 (+   174us) service_pool.cc:224] Handling call
0709 12:26:26.074340 (+2001935us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540036b5d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:26.076075 (+  1735us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887943424}
I20260709 12:26:26.077668 26677 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.086863 26705 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:26.087360 26705 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:26.078949 26669 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.087790 26648 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.080734 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.088364 26705 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.088939 19485 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:26.089715 26705 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:26.080932 26780 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:26:26.090085 26742 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:26.091449 26769 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.407s	user 0.000s	sys 0.002s
I20260709 12:26:26.092379 26742 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.092579 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:26.093461 26669 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:26.093894 26669 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:26.094286 26669 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:25.980326 26714 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:26.058861 26680 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:24.983922 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.095580 26680 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:26.095844 19487 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:26.096634 26680 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.059166 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2881) took 1182 ms. Trace:
I20260709 12:26:26.098614 26688 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:26.099087 26688 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:26.098555 18768 rpcz_store.cc:276] 0709 12:26:24.877619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.972651 (+ 95032us) service_pool.cc:224] Handling call
0709 12:26:24.991313 (+ 18662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:24.992337 (+  1024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.992384 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:24.997001 (+  4617us) log.cc:844] Serialized 26 byte log entry
0709 12:26:25.371099 (+374098us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:25.371144 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.371983 (+   839us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:26.058907 (+686924us) raft_consensus.cc:1685] finished
0709 12:26:26.058933 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.059097 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1836,"raft.queue_time_us":5089,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"thread_start_us":371265,"threads_started":1,"wal-append.queue_time_us":566347}
I20260709 12:26:26.058880 26630 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.041033 26404 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.044833 26683 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.102756 26683 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.102576 26715 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.024190 26617 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:26:26.103402 26637 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:26.028254 26566 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.104462 26718 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:26.076902 18766 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:26.107828 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.108615 19487 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 16.
I20260709 12:26:26.109964 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:26.080236 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.110947 26677 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:26.111531 26677 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.110869 26689 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.111887 26677 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:26.112962 18773 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:26.114614 26739 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:26:26.115103 26739 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:26.116261 26594 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.116003 26739 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.104972 26715 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.117481 26739 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:26.118706 26691 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:26.118273 26714 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.121007 26775 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:26.121416 26775 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:26.121795 26714 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.044979 26452 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.062940 26622 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.123252 26622 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:26.044185 26616 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.124132 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.124250 26616 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.124951 19484 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:26.125396 26774 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:26.124195 26452 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.048341 26636 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.126612 26636 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:26.126675 26346 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:26.127256 26346 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.129771 26346 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:26.049818 26713 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:26.081794 26670 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.130705 26713 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.132078 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.132970 26713 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.041679 26335 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:26:26.064219 26766 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.051702 26663 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.134848 26637 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:26.135357 26637 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:26.122290 26775 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.136788 26775 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:26.052388 26489 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.138742 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2880) took 1269 ms. Trace:
I20260709 12:26:26.139135 18766 rpcz_store.cc:276] 0709 12:26:24.869457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.875175 (+  5718us) service_pool.cc:224] Handling call
0709 12:26:26.076712 (+1201537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.105673 (+ 28961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.138513 (+ 32840us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540036b5d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:26.138680 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762491264}
I20260709 12:26:26.139868 26489 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.140340 18843 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:26.047410 26782 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:26.141265 26782 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:26.104993 26718 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:26.143388 26718 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 26.12, Last appended by leader: 12, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.144687 26718 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:26.064931 26640 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:26.100039 26688 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.105101 26566 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:26.179337 18844 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:26.134433 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:26.181484 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.125607 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2891) took 1088 ms. Trace:
W20260709 12:26:26.147678 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 171709us
I20260709 12:26:26.183585 18771 rpcz_store.cc:276] 0709 12:26:25.037148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.272090 (+234942us) service_pool.cc:224] Handling call
0709 12:26:25.439731 (+167641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.626655 (+186924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.125438 (+498783us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540029c2d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:26.125551 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384817024}
I20260709 12:26:26.184409 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:26.134606 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:26.185370 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50839.2us
W20260709 12:26:26.154592 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 103490us
W20260709 12:26:26.051285 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 86589.3us
I20260709 12:26:26.197616 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:26.203910 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.205984 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.207002 18913 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:26.049736 26665 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:26.136217 26637 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.210538 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.212067 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.212597 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.219413 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.222926 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.125986 26774 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.231699 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.232885 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.233902 18922 raft_consensus.cc:2368] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21.
I20260709 12:26:26.236029 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.237015 18914 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:26.178993 26648 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.132974 26670 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.228147 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.226779 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.254907 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.254401 18666 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:26.256101 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.238466 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.134523 26766 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.216785 26714 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:26.259680 18913 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:26.221395 26489 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:26:26.228739 26616 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.243562 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.306340 18916 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:26.277169 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:26.309831 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.262964 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.320235 18666 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:26.308951 26773 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.325263 18922 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:26.308887 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.322288 18666 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:26.240455 26617 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:26:26.330510 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:26.332638 19456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.044s	sys 0.044s
W20260709 12:26:26.333021 19456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.044s	sys 0.044s
W20260709 12:26:26.333303 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 707576us
W20260709 12:26:26.331056 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53979us
I20260709 12:26:26.334164 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.323594 26773 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.237766 26788 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:26:26.351718 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 323623us
I20260709 12:26:26.355257 19491 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:26.276400 26713 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:26.299640 26766 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.357975 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.297349 26774 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.305704 26714 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:26.359865 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.328393 18666 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 20, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 20 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:26.333551 26404 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.370463 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:26.372150 18913 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:26:26.375312 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.010s	sys 0.046s
W20260709 12:26:26.385215 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.010s	sys 0.046s
I20260709 12:26:26.385648 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.386545 18913 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:26.378659 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 719808us
I20260709 12:26:26.380098 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.390726 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.289459 26636 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.391695 18844 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:26.384217 18916 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:26.395996 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.396872 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.397647 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:26.401799 18840 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:26.345408 26604 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:26.355697 26715 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:26.414497 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3429) took 1217 ms. Trace:
I20260709 12:26:26.418690 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:26.383535 26452 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:26.419178 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.271061 26665 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.425146 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.438742 18765 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:26:26.439059 18845 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 15.
I20260709 12:26:26.440786 18765 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:26:26.420943 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:26.422122 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:26.423334 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:26.363009 26670 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 12:26:26.384166 26714 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:26.424479 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:26.421015 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.365717 26634 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
W20260709 12:26:26.426198 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46223.6us
I20260709 12:26:26.426614 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.451217 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.425056 26490 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:26:26.417577 26765 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:26.424950 26683 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.418853 26640 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:26:26.430354 26726 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:26.417263 26786 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:26.432957 26782 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:26.433439 26715 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:26.431330 18739 leader_election.cc:400] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21.
I20260709 12:26:26.465940 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.431501 26788 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.435918 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:26.450194 26635 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:26.437063 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:26.444465 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:26.445542 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:26.447111 18768 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:26.425886 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.447558 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:26.480967 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.459468 26765 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.439885 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:26.413149 26774 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:26.451448 18848 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:26.428956 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:26.452993 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:26.504516 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51590.1us
I20260709 12:26:26.382663 26725 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:26:26.430852 26790 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:26.394134 26742 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:26:26.462411 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:26.471105 18918 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:26.471623 18764 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:26.436900 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.411252 26404 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.448149 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.418339 26604 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.512332 18768 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:26.524713 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.524964 18842 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:26.459817 26616 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:26.526563 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45713.1us
W20260709 12:26:26.494935 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55154.3us
I20260709 12:26:26.495281 18917 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 15: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:26.440874 26335 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:26:26.517630 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.502940 26765 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:26.523257 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.551574 18843 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:26:26.520130 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57853us
I20260709 12:26:26.481359 26788 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.513700 26790 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:26.467005 26669 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.513262 26713 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:26.542702 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.555588 18847 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:26.568457 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.569223 18843 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:26.465708 26683 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.570446 18847 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:26:26.572395 18847 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:26:26.573705 26788 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.574224 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:26.575376 26788 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:26.537678 26489 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:26:26.578649 26790 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:26.502775 26774 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:26.575870 26713 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.580235 26774 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:26.580360 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.581557 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.472164 26346 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
W20260709 12:26:26.563825 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.528951 26452 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:26.467511 26726 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.568729 26715 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.545900 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:26.554560 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.581094 18845 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:26.547093 18846 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:26:26.567660 26604 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.586763 26683 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.587105 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.554616 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.477300 26689 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:26:26.593050 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.520795 26777 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:26.513893 26670 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:26.542229 26640 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:26.594235 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:26.607941 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.634629 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:26.469069 26786 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.607100 18766 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
W20260709 12:26:26.629540 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 91414.7us
I20260709 12:26:26.580441 26713 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:26.612246 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 143534us
I20260709 12:26:26.555552 26636 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:26.640445 18919 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:26.598600 26788 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:26.642921 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:26.606027 26782 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:26.595861 26452 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:26.643580 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.534567 26677 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.631598 26594 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:26.659986 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.632279 26777 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:26.665987 18773 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:26.632503 26670 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:26.666517 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:26.641449 26680 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:26.712971 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.670552 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:26.671449 26689 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:26.672964 26677 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.668771 26490 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:26.665755 26452 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:26.674602 26784 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.528s	user 0.003s	sys 0.003s
I20260709 12:26:26.659922 26782 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:26.676069 26718 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.002s
I20260709 12:26:26.415024 18770 rpcz_store.cc:276] 0709 12:26:25.197359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.619093 (+421734us) service_pool.cc:224] Handling call
0709 12:26:25.619478 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.619682 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:26:25.947183 (+327501us) log.cc:844] Serialized 14 byte log entry
0709 12:26:26.388238 (+441055us) log.cc:844] Serialized 14 byte log entry
0709 12:26:26.414099 (+ 25861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:26.414153 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:26.414221 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.414287 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.414435 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34673,"prepare.queue_time_us":455648,"prepare.run_cpu_time_us":195,"prepare.run_wall_time_us":248,"raft.queue_time_us":39962,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9073,"spinlock_wait_cycles":17225088,"thread_start_us":762786,"threads_started":2}
I20260709 12:26:26.677623 26777 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.679899 26635 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:26.757174 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.681435 26786 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.681752 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.686043 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.692725 26669 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.697698 26404 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:26.641839 26807 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.772706 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3430) took 1575 ms. Trace:
I20260709 12:26:26.772356 26807 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.641152 26787 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.773218 18772 rpcz_store.cc:276] 0709 12:26:25.197619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.625827 (+428208us) service_pool.cc:224] Handling call
0709 12:26:25.626206 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:25.626764 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.626801 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:25.631555 (+  4754us) log.cc:844] Serialized 26 byte log entry
0709 12:26:25.959201 (+327646us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:26:25.959246 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.959320 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:26.673761 (+714441us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:26.772345 (+ 98584us) raft_consensus.cc:1685] finished
0709 12:26:26.772371 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.772631 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11977,"spinlock_wait_cycles":353571200,"thread_start_us":279947,"threads_started":1,"wal-append.queue_time_us":484743}
I20260709 12:26:26.673854 26726 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:26.775671 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.669333 26808 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.096s
I20260709 12:26:26.777606 26742 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.778280 26742 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.779513 26688 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:26.745743 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.669185 26788 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:26.750682 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:26.750692 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:26.753098 19488 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:26.701969 26594 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.711041 26704 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:26.765462 18848 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 27 because replica has last-logged OpId of term: 26 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 11.
I20260709 12:26:26.829543 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.759299 18841 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:26:26.830847 18841 pending_rounds.cc:85] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 13
I20260709 12:26:26.831207 18841 pending_rounds.cc:107] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:26:26.757588 26725 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:26.760203 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 166063us
W20260709 12:26:26.741528 26792 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 12:26:26.833277 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:26.765060 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.759128 26490 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:26.774806 26787 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.744125 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:26.746940 26689 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:26.783023 26742 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:26.762181 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 91710.3us
I20260709 12:26:26.823779 19484 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:26.756052 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:26.853534 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 97562.1us
I20260709 12:26:26.837810 26636 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:26:26.758667 26782 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:26.831517 18841 raft_consensus.cc:2889] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:26.832629 26726 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:26.834146 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.723451 26680 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:26.768802 26635 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:26.757409 26617 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.748541 26677 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:26.854826 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.857708 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:26.858058 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:26.765445 18847 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:26.839371 26777 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:26.900193 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:26.846491 26739 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.008s
I20260709 12:26:26.767617 26335 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.082s
I20260709 12:26:26.902722 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:26.867902 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:26.904302 18840 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:26.905308 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:26.905375 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44115.5us
I20260709 12:26:26.905514 18914 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 28 because replica has last-logged OpId of term: 27 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
I20260709 12:26:26.832408 26641 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:26:26.768671 26670 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:26.907476 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49573.6us
I20260709 12:26:26.864307 18845 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:26.907676 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.914067 19487 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 18: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:26:26.903888 26792 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:26:26.865314 19491 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:26.911168 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.838058 26704 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.912621 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.909096 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:26.861865 26786 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:26.856994 26640 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:26.917109 19484 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
W20260709 12:26:26.918177 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82758.1us
I20260709 12:26:26.928990 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:26.863154 26812 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:26:26.864292 26718 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:26.929684 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.864758 26683 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:26.930487 19486 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:26.930608 26683 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.920003 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.850158 26725 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:26.932576 26683 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:26.916188 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 61456.7us
I20260709 12:26:26.937633 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.903689 26677 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.923542 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:26.943979 19487 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:26.902483 26808 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.906677 26680 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:26.922674 18841 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:26:26.912624 26648 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:26.902961 26346 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 12:26:26.993278 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55713.1us
I20260709 12:26:26.994446 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.979739 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.921475 26703 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:26:26.994076 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:26.914760 26691 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:26:26.950004 26677 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:26.909271 26617 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.009012 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:26.924019 26670 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:27.006650 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 79984.6us
I20260709 12:26:27.016191 19484 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:27.007120 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78259.3us
W20260709 12:26:27.013141 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 112565us
I20260709 12:26:27.005854 19487 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:27.007018 26311 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:26:26.972994 26725 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:26.974350 26807 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:27.021654 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:27.036572 18847 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:27.037079 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:27.042799 18841 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:26.982359 26815 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:27.003333 26814 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:27.001264 26663 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:26.910858 26788 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.013626 26812 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:27.038132 26703 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:27.056591 26810 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:27.088949 18770 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:27.051967 18666 catalog_manager.cc:5697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 19, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 19 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:27.045238 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:27.065052 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48146.9us
W20260709 12:26:27.064937 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48487.1us
I20260709 12:26:27.066272 18769 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 12:26:27.067323 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:26.936396 26490 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:26.981699 26774 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.028427 26648 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:26.927503 26714 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:27.073522 26811 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:26:27.085737 26703 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.039223 26776 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:26.937803 26786 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.083868 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:26.981801 26808 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.100159 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:27.131403 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:27.027135 26642 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:26:27.136509 18920 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:27.104563 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.133971 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:27.142953 26783 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.880s	user 0.003s	sys 0.001s
W20260709 12:26:27.144565 26816 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 12:26:27.145823 26790 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 12:26:27.146791 26594 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:27.147706 26812 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.117834 26820 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:26:27.152503 26704 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:27.111742 26818 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.055469 26814 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:27.163587 26814 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.164986 26814 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:27.103149 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:27.166755 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:27.166844 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63791us
I20260709 12:26:27.108777 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:27.005466 26689 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.017616 26680 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.075598 26634 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:27.079850 26641 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:26:27.106789 26775 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.966s	user 0.015s	sys 0.000s
I20260709 12:26:27.185401 18922 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:27.089278 26810 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:27.098352 26807 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:27.187171 26807 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.187683 26807 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:27.097965 26683 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.146328 26790 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.190752 26683 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.192304 26786 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:27.192611 26790 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:27.193223 26786 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:27.193910 26786 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:27.157941 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.617s (SENT) [suppressed 8 similar messages]
I20260709 12:26:27.211885 19483 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:26:27.158690 18771 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
W20260709 12:26:27.069136 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74828.7us
W20260709 12:26:27.168864 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60148.9us
I20260709 12:26:27.216529 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:27.105224 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 111232us
W20260709 12:26:27.167841 26713 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.003s
I20260709 12:26:27.128698 26703 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:27.225256 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:27.228987 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:27.176977 18920 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:27.128727 26648 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:27.180366 19485 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:27.177740 26821 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:27.182616 26634 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.196394 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:27.197361 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:27.197422 26808 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:27.166311 26635 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.086962 26636 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:26:27.155593 26346 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:27.088172 26640 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.200942 26780 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:27.202545 26725 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.204285 26820 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:27.128206 26776 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:27.232861 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:27.238776 26624 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:27.233632 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:27.243955 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:27.249431 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.249758 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:27.178081 26715 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:27.264514 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 67251.1us
W20260709 12:26:27.208606 26765 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260709 12:26:27.178694 26335 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:27.208405 26271 raft_consensus.cc:3055] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:27.273095 18839 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:27.276470 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:27.281136 19490 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:26:27.135566 26806 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 12:26:27.285203 18840 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:27.277369 26691 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:27.306768 19489 raft_consensus.cc:2410] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 23 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:26:27.233640 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:27.277849 26780 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:27.273209 26817 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:27.323263 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 155453us
I20260709 12:26:27.286762 26776 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:27.238145 26713 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.174299 26818 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.325156 18839 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:26:27.270481 26775 consensus_queue.cc:1059] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:26:27.332073 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:27.334975 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:27.335531 18766 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:27.315398 26271 raft_consensus.cc:740] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:27.336005 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:27.336647 18767 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:27.272660 26813 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
W20260709 12:26:27.324407 26688 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.004s
I20260709 12:26:27.361824 18770 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:27.309325 26335 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:27.362639 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:27.364938 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:27.264266 26821 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.328745 26726 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.370713 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:27.284528 26725 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.375427 18847 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:27.375649 18768 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:27.372359 18764 raft_consensus.cc:2376] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23. Re-sending same reply.
W20260709 12:26:27.376149 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50957.5us
I20260709 12:26:27.377828 18769 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:27.366415 26817 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:27.422231 18767 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:27.312757 26765 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.411341 18913 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:27.375869 26335 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:27.571370 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:27.423806 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 58930.9us
I20260709 12:26:27.575053 26594 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:27.370793 26617 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:27.441629 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.444552 18770 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:26:27.581509 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:27.583002 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:27.584168 19486 raft_consensus.cc:2368] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:26:27.448045 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:27.450085 18844 raft_consensus.cc:2376] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23. Re-sending same reply.
I20260709 12:26:27.286545 26820 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.480158 26813 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:27.586700 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:27.586789 26813 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.588109 18839 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:27.589555 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:27.450793 26452 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.683s	user 0.013s	sys 0.000s
W20260709 12:26:27.539224 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 212905us
I20260709 12:26:27.544039 26635 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:27.486486 26780 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.363092 26648 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:27.559851 26831 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 12:26:27.560930 26670 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
W20260709 12:26:27.561213 26840 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:26:27.561506 26616 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.567479 26839 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:26:27.327112 26786 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:27.569065 26798 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.006s	user 0.001s	sys 0.003s
I20260709 12:26:27.537658 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:27.704571 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 167055us
I20260709 12:26:27.705397 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:27.591832 26813 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:27.592422 26311 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:27.682165 26713 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:27.595484 26725 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:27.599514 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:27.612721 26844 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:26:27.615528 26777 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.004s
I20260709 12:26:27.447755 26775 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:27.630725 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3440) took 1187 ms. Trace:
I20260709 12:26:27.486578 26774 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:27.486749 26714 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:27.635169 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3388) took 1116 ms. Trace:
I20260709 12:26:27.599836 26815 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:27.640967 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1326) took 1572 ms. Trace:
I20260709 12:26:27.640229 26817 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:27.642361 26833 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 12:26:27.651530 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:27.651292 18666 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 17, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 17 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:27.652514 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 76352.2us
I20260709 12:26:27.617780 26810 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:27.682940 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.758514 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:27.758956 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.487113 26806 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:27.693218 18839 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:27.701220 19491 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:26:27.634102 26765 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:27.508816 26821 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:27.452060 26688 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.244s
I20260709 12:26:27.593096 26820 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:27.714200 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114785us
I20260709 12:26:27.716750 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:27.532320 26726 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.716763 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:27.804188 18766 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:27.710983 26636 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:27.713371 26346 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:27.718046 26813 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:27.719450 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:27.812057 18769 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:27.719828 26617 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.726778 26825 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.625s	user 0.009s	sys 0.000s
I20260709 12:26:27.729274 26780 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:27.799054 26489 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:27.732728 26805 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.735242 26271 consensus_queue.cc:260] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:27.718230 18670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 282) took 28086 ms (client timeout 15000 ms). Trace:
I20260709 12:26:27.741647 18773 rpcz_store.cc:276] 0709 12:26:26.443714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.444209 (+   495us) service_pool.cc:224] Handling call
0709 12:26:27.630465 (+1186256us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002a0654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:27.630635 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430500736}
I20260709 12:26:27.748375 19488 rpcz_store.cc:276] 0709 12:26:26.068866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.185510 (+116644us) service_pool.cc:224] Handling call
0709 12:26:26.227336 (+ 41826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.824922 (+597586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:27.640551 (+815629us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54005c21d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:27.640865 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208623872}
W20260709 12:26:27.801203 26814 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.636s	user 0.014s	sys 0.006s
I20260709 12:26:27.747561 18848 rpcz_store.cc:276] 0709 12:26:26.519104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.519303 (+   199us) service_pool.cc:224] Handling call
0709 12:26:27.634855 (+1115552us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540041afd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:27.635079 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368468736}
I20260709 12:26:27.751600 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3406) took 1343 ms. Trace:
I20260709 12:26:27.683646 26808 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 12:26:27.682367 26452 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.837347 26663 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.837930 26663 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:27.653775 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.754875 18666 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:27.760107 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 108671us
I20260709 12:26:27.740971 26775 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:27.777248 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.741401 26773 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:27.799389 18887 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.032s	sys 0.034s
W20260709 12:26:27.851792 18887 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.032s	sys 0.034s
W20260709 12:26:27.852244 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 694291us
I20260709 12:26:27.749550 26815 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.706514 26616 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.798291 26714 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.802078 26806 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:27.825500 18919 rpcz_store.cc:276] 0709 12:26:26.408778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.936410 (+527632us) service_pool.cc:224] Handling call
0709 12:26:26.943185 (+  6775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:27.022713 (+ 79528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:27.022764 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:27.023419 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 12:26:27.274792 (+251373us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:27.274837 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:27.274920 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:27.751288 (+476368us) raft_consensus.cc:1685] finished
0709 12:26:27.751318 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:27.751504 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92958,"raft.queue_time_us":92358,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":15452,"thread_start_us":250981,"threads_started":1,"wal-append.queue_time_us":310411}
I20260709 12:26:27.835105 26271 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:27.865442 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:27.836700 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3397) took 1622 ms. Trace:
I20260709 12:26:27.880231 18769 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:26:27.879000 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:27.837219 19487 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:27.840718 18843 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:27.837963 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:27.882863 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:27.848618 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:27.847903 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:27.841724 18666 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 20, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 20 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:27.881456 19488 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:27.883734 19489 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:27.864719 18848 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:26:27.836107 26490 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.885104 26490 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.885005 18666 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:27.823679 26810 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:27.887607 18666 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 22, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 22 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:27.891372 18917 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:27.881703 18914 rpcz_store.cc:276] 0709 12:26:26.214297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.243222 (+ 28925us) service_pool.cc:224] Handling call
0709 12:26:27.836427 (+1593205us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:27.836607 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379250432}
I20260709 12:26:27.893234 19488 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:27.895293 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:27.895788 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 47986.3us
I20260709 12:26:27.896306 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:27.889690 18666 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:27.847318 26807 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.659s	user 0.014s	sys 0.000s
I20260709 12:26:27.897611 18666 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 21 to 24, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:27.897226 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:27.900713 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:27.905369 18666 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 21, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 21 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:27.860484 26663 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:27.909049 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.910579 18666 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:27.838691 26636 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:27.839960 26818 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:27.838779 26346 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:27.839326 26452 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:27.863637 26815 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:27.913810 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:27.865022 26773 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.823261 26617 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:27.914165 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:27.918642 18666 catalog_manager.cc:5697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 12 to 17, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 17 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:27.951578 18666 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:27.953275 18666 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.915704 26851 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:27.958899 26849 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.958902 26851 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:27.917671 26836 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:26:27.939970 26806 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:27.891225 26640 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:27.901777 26680 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:27.914518 26830 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:28.098526 19488 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [22.17-22.17]
W20260709 12:26:27.923791 26782 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.034s	user 0.010s	sys 0.005s
W20260709 12:26:27.823957 18670 rpcz_store.cc:269] 0709 12:25:59.631994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.632396 (+   402us) service_pool.cc:224] Handling call
0709 12:26:27.718113 (+28085717us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:20.818538 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:20.819276 (+   738us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:20.819333 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:26:20.819371 (+    38us) tablet.cc:662] Decoding operations
0709 12:26:20.821078 (+  1707us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:20.821210 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:20.821240 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:26:20.892565 (+ 71325us) tablet.cc:701] Row locks acquired
0709 12:26:20.911560 (+ 18995us) write_op.cc:260] PREPARE: finished
0709 12:26:20.968701 (+ 57141us) write_op.cc:270] Start()
0709 12:26:20.996446 (+ 27745us) write_op.cc:276] Timestamp: P: 1783599980951634 usec, L: 0
0709 12:26:20.996499 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:26:20.997352 (+   853us) log.cc:844] Serialized 5824 byte log entry
0709 12:26:21.734986 (+737634us) op_driver.cc:464] REPLICATION: finished
0709 12:26:22.368319 (+633333us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335e9c1ef0
0709 12:26:22.615047 (+246728us) write_op.cc:301] APPLY: starting
0709 12:26:22.615165 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:23.531548 (+916383us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:23.541435 (+  9887us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:24.206761 (+665326us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:24.207123 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:26:24.207191 (+    68us) write_op.cc:312] APPLY: finished
0709 12:26:24.207632 (+   441us) log.cc:844] Serialized 139 byte log entry
0709 12:26:24.324696 (+117064us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:24.324944 (+   248us) write_op.cc:454] Released schema lock
0709 12:26:24.325056 (+   112us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:24.325786 (+   730us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:24.325839 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62446,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":879736,"apply.run_cpu_time_us":59533,"apply.run_wall_time_us":1710695,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66917,"num_ops":15,"prepare.queue_time_us":338026,"prepare.run_cpu_time_us":24463,"prepare.run_wall_time_us":310152,"raft.queue_time_us":140070,"raft.run_cpu_time_us":24795,"raft.run_wall_time_us":980898,"replication_time_us":738256,"spinlock_wait_cycles":17918336,"thread_start_us":1480913,"threads_started":5,"wal-append.queue_time_us":308454,"wal-append.run_cpu_time_us":29629,"wal-append.run_wall_time_us":2563014}]]}
I20260709 12:26:27.972527 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:27.838366 26335 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:27.979837 26855 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:26:27.831782 26805 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:27.943280 26677 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.905s	user 0.009s	sys 0.006s
I20260709 12:26:27.959770 26850 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:28.058044 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 1417) took 1637 ms. Trace:
I20260709 12:26:28.058039 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3488) took 1342 ms. Trace:
W20260709 12:26:28.059333 18920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3473) took 1753 ms (client timeout 2221 ms). Trace:
I20260709 12:26:28.112792 18771 rpcz_store.cc:276] 0709 12:26:26.420581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.420701 (+   120us) service_pool.cc:224] Handling call
0709 12:26:27.980765 (+1560064us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54001d5e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:28.057990 (+ 77225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648894848}
I20260709 12:26:28.113478 18922 rpcz_store.cc:276] 0709 12:26:26.716222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.740037 (+ 23815us) service_pool.cc:224] Handling call
0709 12:26:27.973900 (+1233863us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54002b48d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:28.057953 (+ 84053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800196864}
W20260709 12:26:28.113619 18920 rpcz_store.cc:269] 0709 12:26:26.306437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.517272 (+210835us) service_pool.cc:224] Handling call
0709 12:26:27.977894 (+1460622us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400336154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:28.059249 (+ 81355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363135744}
W20260709 12:26:28.060655 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 1.39419e+06us
I20260709 12:26:27.959455 26636 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:28.061561 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 105033us
I20260709 12:26:27.969455 26346 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.062775 18666 catalog_manager.cc:5697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 15 to 25. New cstate: current_term: 25 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.897009 26714 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.089013 18886 leader_election.cc:400] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
I20260709 12:26:28.112581 26490 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:27.954334 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.102763 18917 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:28.106545 26863 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:28.099414 26640 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.091003 26688 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:28.090592 26851 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:28.048578 26665 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.101990 26637 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:28.135578 18886 leader_election.cc:403] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.109679 26782 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.136577 26827 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 12:26:28.136690 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:28.137704 26858 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:26:28.112633 26850 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:27.947273 26777 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:28.143306 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47391.8us
I20260709 12:26:28.148847 26616 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.144290 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.144634 18666 catalog_manager.cc:5697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:28.064766 26849 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.123916 26787 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:28.160667 26808 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:28.160784 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 72044.8us
I20260709 12:26:28.143982 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:28.115911 26677 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.167418 18922 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:28.193779 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.167222 26490 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18.
W20260709 12:26:28.159281 18739 connection.cc:256] RPC call timeout handler was delayed by -1.4374594409996462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 12:26:28.178926 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:28.183367 18666 catalog_manager.cc:5697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 18, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 18 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:28.195441 18666 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 19 to 25, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 25 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:28.191090 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:28.185050 26819 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:28.185951 18764 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:26:27.992466 26773 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.188493 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:28.197924 19489 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:27.915304 26807 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:28.198915 18739 connection.cc:256] RPC call timeout handler was delayed by -1.048659440999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 12:26:28.199311 18739 connection.cc:256] RPC call timeout handler was delayed by -1.0252594409998892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 12:26:28.201486 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:28.201988 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.202495 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:28.203125 19488 raft_consensus.cc:1240] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
W20260709 12:26:28.192363 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48459us
I20260709 12:26:28.204653 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:28.205245 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.171123 26726 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.206496 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:28.209146 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.210027 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.211846 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:28.212468 18772 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: [24.11-26.12]
I20260709 12:26:28.196596 18666 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 9 to 17, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 17 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.213518 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:28.213907 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:28.214495 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.214737 18765 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:28.215654 19484 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:26:28.215909 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.160949 26688 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.176067 26850 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:28.218554 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:28.231992 18767 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:26:28.185413 26634 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.225991 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.235786 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.147290 26863 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.233253 18666 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 24, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 24 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:28.238018 18765 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:28.239261 26803 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.592s	user 0.002s	sys 0.021s
I20260709 12:26:28.240574 26688 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:28.241557 26688 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:28.241906 26864 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:26:28.213724 26718 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:28.251096 18922 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:28.206630 26616 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:28.208305 26786 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.240700 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3471) took 1986 ms. Trace:
I20260709 12:26:28.238430 18666 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 20 to 21, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 21 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:28.264010 18921 rpcz_store.cc:276] 0709 12:26:26.253904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.294301 (+ 40397us) service_pool.cc:224] Handling call
0709 12:26:26.316284 (+ 21983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.318187 (+  1903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.318235 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:26.331353 (+ 13118us) log.cc:844] Serialized 26 byte log entry
0709 12:26:26.512783 (+181430us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:26.512851 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.512969 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:27.955338 (+1442369us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:28.240390 (+285052us) raft_consensus.cc:1685] finished
0709 12:26:28.240414 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.240632 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1304,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":7591,"spinlock_wait_cycles":22330240,"thread_start_us":123453,"threads_started":1,"wal-append.queue_time_us":200884}
I20260709 12:26:28.285769 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.242045 26688 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:28.264987 18666 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 11 to 18, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 18 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.167960 26665 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.218564 26813 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:28.344893 18772 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 26: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:28.349258 18666 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 15 to 24, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.219282 26781 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:28.361771 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:28.363445 18666 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 10 to 23, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 23 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:28.370261 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:28.376523 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 171938us
I20260709 12:26:28.378026 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.385851 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:28.198181 26765 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 12:26:28.187067 26777 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.403718 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.344398 26616 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:28.400035 26703 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.134s	user 0.023s	sys 0.005s
I20260709 12:26:28.361755 26688 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:28.393198 26663 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.214912 26862 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.201s
I20260709 12:26:28.198421 26808 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.359916 26786 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:28.480050 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:28.516160 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.380748 18666 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 20, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 20 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:28.473667 26616 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:28.489717 18917 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:28.214846 26819 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:28.476246 26271 consensus_meta.cc:287] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.581s	user 0.014s	sys 0.005s
I20260709 12:26:28.465677 26452 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.518716 18666 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 19 to 20, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 20 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:28.530851 18666 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 20, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 20 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.482685 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:28.523278 26780 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.006s
I20260709 12:26:28.520164 26805 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.536938 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.538705 18771 raft_consensus.cc:2368] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:28.533274 18666 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 21 to 22, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 22 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:28.546561 26714 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.547251 26773 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:28.548529 26786 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.550511 26808 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.551574 26683 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:28.537650 18921 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:28.554301 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3447) took 1177 ms. Trace:
I20260709 12:26:28.557402 18767 rpcz_store.cc:276] 0709 12:26:27.376948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.536770 (+159822us) service_pool.cc:224] Handling call
0709 12:26:27.537153 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:28.232448 (+695295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.553905 (+321457us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54001ca2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:28.554214 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597534080}
W20260709 12:26:28.476533 26810 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.015s
I20260709 12:26:28.469290 26335 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:28.565657 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.527436 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.487799 26703 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.564256 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.565091 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.570096 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3396) took 2026 ms. Trace:
I20260709 12:26:28.570453 18767 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:28.528916 26857 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.494217 26663 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.570590 18842 rpcz_store.cc:276] 0709 12:26:26.543743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.543887 (+   144us) service_pool.cc:224] Handling call
0709 12:26:26.544322 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.544766 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.544809 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:26.554692 (+  9883us) log.cc:844] Serialized 26 byte log entry
0709 12:26:28.139243 (+1584551us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b180033e680. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:26:28.204190 (+ 64947us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:28.204230 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.204336 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:28.553286 (+348950us) raft_consensus.cc:1685] finished
0709 12:26:28.553306 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.570020 (+ 16714us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3921,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":38100352,"thread_start_us":64759,"threads_started":1,"wal-append.queue_time_us":1907341}
I20260709 12:26:28.588264 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3486) took 1900 ms. Trace:
I20260709 12:26:28.588799 18921 rpcz_store.cc:276] 0709 12:26:26.688250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.587288 (+1899038us) service_pool.cc:224] Handling call
0709 12:26:28.587703 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.587946 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.587968 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.588005 (+    37us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:28.588035 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.588084 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.588201 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:28.537925 26677 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.591382 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1881) took 1888 ms. Trace:
I20260709 12:26:28.600219 19483 raft_consensus.cc:2368] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24.
I20260709 12:26:28.599450 18921 rpcz_store.cc:276] 0709 12:26:26.702877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.590034 (+1887157us) service_pool.cc:224] Handling call
0709 12:26:28.590686 (+   652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.590910 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.590948 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.591008 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:28.591053 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.591139 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.591310 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:28.568142 26640 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:28.604882 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3487) took 1892 ms. Trace:
I20260709 12:26:28.606132 18921 rpcz_store.cc:276] 0709 12:26:26.711946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.601435 (+1889489us) service_pool.cc:224] Handling call
0709 12:26:28.601887 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.602147 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.602189 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.602254 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:28.602302 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.602381 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.603993 (+  1612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:28.570178 26624 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:28.570835 26879 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.611385 19489 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:26:28.598088 26866 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 12:26:28.539435 26452 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.592468 26813 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:28.604441 26782 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.645951 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:28.594841 26857 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.625248 26807 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.651124 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:28.659960 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:28.661562 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 73471.9us
I20260709 12:26:28.645021 26765 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.645533 26640 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.666005 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.668610 26665 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.669217 26874 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:28.670363 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:28.671343 26452 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.672554 26566 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:28.674944 26807 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:26:28.675254 26877 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:26:28.675894 26868 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:26:28.653702 26677 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:28.625129 26624 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.653426 26849 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.690889 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:28.710896 18772 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:28.664333 26776 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.324s	user 0.015s	sys 0.000s
I20260709 12:26:28.690349 26566 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:28.822592 26648 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.823248 26566 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.825302 26566 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:28.689181 26812 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.686679 26817 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.681048 26863 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:28.839319 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3299) took 1348 ms. Trace:
I20260709 12:26:28.843390 26881 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:28.844743 26881 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.839931 18841 rpcz_store.cc:276] 0709 12:26:27.490916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.739645 (+248729us) service_pool.cc:224] Handling call
0709 12:26:27.740031 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:27.740430 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:27.740466 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:27.741081 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:26:28.110981 (+369900us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:28.111035 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.111690 (+   655us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:28.839052 (+727362us) raft_consensus.cc:1685] finished
0709 12:26:28.839074 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.839239 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1417,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4986,"thread_start_us":369425,"threads_started":1,"wal-append.queue_time_us":423345}
I20260709 12:26:28.776165 26777 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:28.646888 26879 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.826228 26617 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.775982 26807 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:28.864171 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 195710us
I20260709 12:26:28.875620 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.687031 26640 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.837788 26780 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.680755 26765 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:28.852862 26815 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.863s	user 0.012s	sys 0.001s
I20260709 12:26:28.841475 26849 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.839157 26665 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.888216 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:28.888667 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:28.876381 18769 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
W20260709 12:26:28.890220 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.895619 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:28.693560 26874 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.903506 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:28.904901 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.905579 18769 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:28.823309 26648 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:28.912545 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 234274us
I20260709 12:26:28.813457 26776 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.917405 18772 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:28.877832 26863 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:28.877593 26346 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:28.875140 26810 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:28.841054 26812 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.930287 18772 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:26:28.931434 26889 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:28.932569 26889 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:28.927245 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:28.905047 26815 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.849124 26817 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.827232 26813 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.941648 18918 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
W20260709 12:26:28.920231 26872 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:26:28.912894 26703 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:28.956422 26718 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.709s	user 0.006s	sys 0.006s
I20260709 12:26:28.957165 26718 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:28.963588 26888 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:28.908067 26780 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.967976 26335 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:28.968827 26335 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:28.972500 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1550) took 1214 ms. Trace:
I20260709 12:26:28.973089 19483 rpcz_store.cc:276] 0709 12:26:27.758070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.758217 (+   147us) service_pool.cc:224] Handling call
0709 12:26:28.972218 (+1214001us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b540051cf54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:28.972421 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933566720}
I20260709 12:26:28.975716 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:28.961081 26776 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:28.924387 26677 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:28.981334 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:28.966161 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.964751 26888 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.995536 18922 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:28.911134 26849 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.911366 26665 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.982211 26648 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.972136 26663 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.008942 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:28.971194 26883 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:28.942857 26863 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.994221 26875 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:28.939023 26810 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.022730 18922 raft_consensus.cc:2410] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:26:28.945837 26346 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.996614 26703 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.024573 19486 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
W20260709 12:26:29.015144 26850 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.757s	user 0.015s	sys 0.000s
W20260709 12:26:29.031900 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.013s	sys 0.045s
I20260709 12:26:29.033452 19489 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:26:28.977447 26616 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:29.038744 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.013s	sys 0.045s
I20260709 12:26:29.044677 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.045300 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.045429 19483 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:29.001181 26677 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.027392 26780 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.027302 26875 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:29.060704 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.064391 18769 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
W20260709 12:26:29.065804 18887 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.720s (SENT)
I20260709 12:26:29.068346 26863 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.027001 26883 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.070320 26665 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:28.987290 26807 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.042016 26634 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.073845 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1412) took 1227 ms. Trace:
I20260709 12:26:29.077371 18848 rpcz_store.cc:276] 0709 12:26:27.846693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.846882 (+   189us) service_pool.cc:224] Handling call
0709 12:26:27.847327 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:27.884696 (+ 37369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.073593 (+1188897us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5400326ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:29.073781 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38864256}
W20260709 12:26:29.074853 18844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3406) took 1841 ms (client timeout 1720 ms). Trace:
W20260709 12:26:29.078962 18844 rpcz_store.cc:269] 0709 12:26:27.233228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.233303 (+    75us) service_pool.cc:224] Handling call
0709 12:26:29.074638 (+1841335us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000f0fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.074775 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373443840}
I20260709 12:26:29.048353 26808 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:29.084430 19492 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:26:29.047466 26703 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:28.988765 26335 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.063717 26490 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:29.072681 26875 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:29.048375 26850 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.076349 26624 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.112896 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.121532 18769 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:29.116869 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3483) took 2533 ms. Trace:
I20260709 12:26:29.115767 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1882) took 1908 ms. Trace:
I20260709 12:26:29.085364 26881 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:29.126479 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75361.6us
I20260709 12:26:29.107792 26640 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.122536 18916 rpcz_store.cc:276] 0709 12:26:26.583190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.100714 (+517524us) service_pool.cc:224] Handling call
0709 12:26:27.101076 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:27.103852 (+  2776us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:26:28.138023 (+1034171us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b180045b9e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:26:28.174065 (+ 36042us) log.cc:844] Serialized 14 byte log entry
0709 12:26:28.560657 (+386592us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:28.565919 (+  5262us) log.cc:844] Serialized 26 byte log entry
0709 12:26:28.566088 (+   169us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:28.566123 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.566192 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.100033 (+533841us) raft_consensus.cc:1685] finished
0709 12:26:29.116581 (+ 16548us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.116780 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38641,"prepare.queue_time_us":1119026,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2234,"raft.queue_time_us":171203,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":26142,"spinlock_wait_cycles":3379456,"thread_start_us":366733,"threads_started":3,"wal-append.queue_time_us":349798}
I20260709 12:26:29.131047 19483 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:29.114140 26883 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.132288 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.086365 26634 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:29.127456 26893 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260709 12:26:29.126900 18921 rpcz_store.cc:276] 0709 12:26:27.207091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.622095 (+1415004us) service_pool.cc:224] Handling call
0709 12:26:28.622965 (+   870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.623437 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:26:28.643505 (+ 20068us) log.cc:844] Serialized 14 byte log entry
0709 12:26:29.115410 (+471905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.115465 (+    55us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:29.115507 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.115581 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.115707 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6,"prepare.queue_time_us":19466,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2952,"raft.queue_time_us":266,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5034,"spinlock_wait_cycles":1802112,"thread_start_us":470160,"threads_started":1}
I20260709 12:26:29.124010 26812 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.090806 26808 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.139155 18916 raft_consensus.cc:2410] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:26:29.138029 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:29.142575 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.144168 19488 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:29.138610 26624 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:29.134968 26879 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.147132 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:29.122074 26490 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.134037 26335 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:29.138037 26830 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.035s	user 0.013s	sys 0.003s
I20260709 12:26:29.136948 26881 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:29.157234 26808 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.138648 26815 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.146854 26817 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.172820 26850 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:29.173588 26637 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.006s	user 0.011s	sys 0.002s
I20260709 12:26:29.174443 26774 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.174727 26634 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.175034 26774 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.175868 26616 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.176504 26874 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.177991 26774 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.159994 26624 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.171134 26677 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:29.167677 26851 consensus_meta.cc:287] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.007s	user 0.001s	sys 0.017s
I20260709 12:26:29.186726 26857 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.187175 26851 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.187911 26819 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.164040 26849 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.181689 26881 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.145324 26899 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.191593 26899 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.193445 26775 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.170555 26888 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.183187 26889 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.183251 26820 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:29.195523 26820 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:29.196540 26820 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.197629 26820 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:29.185679 26703 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.184676 26821 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:26:29.202641 26892 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.331s	user 0.001s	sys 0.002s
I20260709 12:26:29.202793 26822 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:29.202976 26821 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:29.203390 26822 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:29.203953 26875 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.204613 26822 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.169363 26810 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.190310 26851 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:29.207053 26869 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.796s	user 0.008s	sys 0.000s
I20260709 12:26:29.207664 26875 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.208879 26821 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.211723 26821 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:29.210331 26822 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:29.170212 26830 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:29.263515 18772 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
W20260709 12:26:29.265698 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.154071 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.269831 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.271648 18915 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:29.272477 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.273783 18921 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:29.275597 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:29.275933 18913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3479) took 2908 ms (client timeout 2904 ms). Trace:
W20260709 12:26:29.276535 18913 rpcz_store.cc:269] 0709 12:26:26.367508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.681464 (+313956us) service_pool.cc:224] Handling call
0709 12:26:29.275400 (+2593936us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54000348d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.275687 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480044288}
W20260709 12:26:29.277486 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.262835 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.279583 18769 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 15.
W20260709 12:26:29.279794 18768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 1429) took 1947 ms (client timeout 1843 ms). Trace:
W20260709 12:26:29.280388 18768 rpcz_store.cc:269] 0709 12:26:27.331897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.332069 (+   172us) service_pool.cc:224] Handling call
0709 12:26:29.279208 (+1947139us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b540017a7d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.279479 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91794304}
I20260709 12:26:29.278690 18922 raft_consensus.cc:2410] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:26:29.282918 18767 raft_consensus.cc:1240] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
W20260709 12:26:29.265400 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 124953us
I20260709 12:26:29.184667 26490 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:29.169979 26688 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.670s	user 0.014s	sys 0.000s
I20260709 12:26:29.321346 26688 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.277536 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.309926 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2910) took 1096 ms. Trace:
I20260709 12:26:29.298987 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2909) took 1085 ms. Trace:
I20260709 12:26:29.299189 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:29.300479 18915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3388) took 3097 ms (client timeout 2585 ms). Trace:
I20260709 12:26:29.300813 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.301285 19484 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:29.302906 26851 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:29.324270 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2903) took 1113 ms. Trace:
I20260709 12:26:29.303570 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1880) took 2618 ms. Trace:
I20260709 12:26:29.305110 19486 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:29.303609 26346 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.306802 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:29.307269 26765 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.310810 26782 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:29.292316 18769 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:29.311334 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.312861 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.314296 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.316227 26718 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.297540 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:29.325513 18915 rpcz_store.cc:269] 0709 12:26:26.203147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.203548 (+   401us) service_pool.cc:224] Handling call
0709 12:26:29.300199 (+3096651us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b54000f6c54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.300404 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7052100992}
I20260709 12:26:29.327957 18918 rpcz_store.cc:276] 0709 12:26:26.685034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.166051 (+481017us) service_pool.cc:224] Handling call
0709 12:26:27.168695 (+  2644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.942288 (+1773593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.302853 (+360565us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54000f6254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:29.303290 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4076844928}
I20260709 12:26:29.327136 18771 rpcz_store.cc:276] 0709 12:26:28.210877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.211536 (+   659us) service_pool.cc:224] Handling call
0709 12:26:29.323720 (+1112184us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54002a1a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.324011 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736622848}
I20260709 12:26:29.324987 18765 rpcz_store.cc:276] 0709 12:26:28.213069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.215654 (+  2585us) service_pool.cc:224] Handling call
0709 12:26:29.298408 (+1082754us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.298766 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48676224}
I20260709 12:26:29.348143 18917 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:29.291923 26624 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.348415 26718 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.352703 18914 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:29.327297 26851 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:29.356982 18847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3405) took 2123 ms (client timeout 2365 ms). Trace:
W20260709 12:26:29.357642 18847 rpcz_store.cc:269] 0709 12:26:27.232861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.233330 (+   469us) service_pool.cc:224] Handling call
0709 12:26:29.339243 (+2105913us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b5400071054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.356658 (+ 17415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121611392}
I20260709 12:26:29.358691 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1887) took 1677 ms. Trace:
I20260709 12:26:29.359534 18918 rpcz_store.cc:276] 0709 12:26:27.681016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.357361 (+1676345us) service_pool.cc:224] Handling call
0709 12:26:29.357864 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.358269 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.358295 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.358358 (+    63us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:29.358426 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.358492 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.358597 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.358207 18915 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:26:29.361860 18915 pending_rounds.cc:85] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 13
I20260709 12:26:29.362272 18920 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 29 because replica has last-logged OpId of term: 27 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
I20260709 12:26:29.352878 26819 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.362322 18915 pending_rounds.cc:107] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:26:29.362987 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3400) took 2815 ms. Trace:
I20260709 12:26:29.363523 26819 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.364355 18843 rpcz_store.cc:276] 0709 12:26:26.548034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.569908 (+ 21874us) service_pool.cc:224] Handling call
0709 12:26:26.570221 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:27.882973 (+1312752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.362256 (+1479283us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400124b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:29.362693 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2921442048}
I20260709 12:26:29.365993 18915 raft_consensus.cc:2889] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.366796 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3485) took 2678 ms. Trace:
I20260709 12:26:29.365108 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3491) took 1557 ms. Trace:
I20260709 12:26:29.369616 18917 rpcz_store.cc:276] 0709 12:26:26.687919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.585968 (+1898049us) service_pool.cc:224] Handling call
0709 12:26:28.592634 (+  6666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.351108 (+758474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.366340 (+ 15232us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b5400353ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:29.366697 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683236736}
I20260709 12:26:29.378895 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.381492 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1883) took 2174 ms. Trace:
I20260709 12:26:29.382644 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1331) took 2211 ms. Trace:
I20260709 12:26:29.388315 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45480 (request call id 1354) took 2367 ms. Trace:
I20260709 12:26:29.387995 26688 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:29.373862 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:29.390331 19484 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:29.389685 18915 rpcz_store.cc:276] 0709 12:26:27.208996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.356632 (+2147636us) service_pool.cc:224] Handling call
0709 12:26:29.357349 (+   717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.370467 (+ 13118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.381347 (+ 10880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.398818 26677 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.399333 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.384019 18918 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260709 12:26:29.391830 26624 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:29.387089 26718 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.402462 26624 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.403932 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:29.399827 26677 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.387960 19487 rpcz_store.cc:276] 0709 12:26:27.170578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.170760 (+   182us) service_pool.cc:224] Handling call
0709 12:26:27.171110 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:27.882682 (+711572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.381843 (+1499161us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400720454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:29.382308 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531442048}
I20260709 12:26:29.407657 26718 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:29.408526 26677 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.410156 26624 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.410851 18918 pending_rounds.cc:85] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 15
I20260709 12:26:29.411259 18918 pending_rounds.cc:107] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 12:26:29.411582 18918 raft_consensus.cc:2889] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.412614 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1888) took 1669 ms. Trace:
I20260709 12:26:29.413241 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.415069 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.416662 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.417004 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3446) took 2048 ms. Trace:
I20260709 12:26:29.358340 26851 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.431983 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.324858 18766 rpcz_store.cc:276] 0709 12:26:28.215160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.247674 (+ 32514us) service_pool.cc:224] Handling call
0709 12:26:28.248120 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:28.248539 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.248580 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:28.249207 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 12:26:28.399139 (+149932us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:28.872660 (+473521us) log.cc:844] Serialized 14 byte log entry
0709 12:26:29.308761 (+436101us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b540012d520. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af06733 00007f335af8bdbf 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c
0709 12:26:29.308867 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.309063 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.309180 (+   117us) raft_consensus.cc:1685] finished
0709 12:26:29.309338 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.309644 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12044,"prepare.queue_time_us":524513,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":13469,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":102351,"spinlock_wait_cycles":25042304,"thread_start_us":543527,"threads_started":2,"wal-append.queue_time_us":287951}
I20260709 12:26:29.443970 26851 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:29.445117 26851 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.448071 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:29.448203 26404 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:29.448969 18913 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:29.449358 26404 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.417464 18764 rpcz_store.cc:276] 0709 12:26:27.368447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.536765 (+168318us) service_pool.cc:224] Handling call
0709 12:26:27.537129 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:28.197433 (+660304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.409978 (+1212545us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54001d5954. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:29.410406 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481443200}
I20260709 12:26:29.452263 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1890) took 1339 ms. Trace:
I20260709 12:26:29.452505 26851 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.453225 26830 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:29.453706 19489 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:29.454077 26881 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.455792 18843 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:29.456501 26830 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:29.457044 26830 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:29.455883 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1885) took 1778 ms. Trace:
I20260709 12:26:29.413079 18918 rpcz_store.cc:276] 0709 12:26:27.743298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.382349 (+1639051us) service_pool.cc:224] Handling call
0709 12:26:29.383122 (+   773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.412280 (+ 29158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.412548 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.452883 18913 rpcz_store.cc:276] 0709 12:26:28.112861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.450719 (+1337858us) service_pool.cc:224] Handling call
0709 12:26:29.451284 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.451782 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.451814 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.451891 (+    77us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:29.451947 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.452042 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.452187 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.388927 19491 rpcz_store.cc:276] 0709 12:26:27.021119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.021343 (+   224us) service_pool.cc:224] Handling call
0709 12:26:29.387733 (+2366390us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b5400555fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.388071 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520524672}
I20260709 12:26:29.462801 26830 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.464766 26830 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:29.457369 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1886) took 1779 ms. Trace:
I20260709 12:26:29.465356 18916 rpcz_store.cc:276] 0709 12:26:27.678277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.374869 (+1696592us) service_pool.cc:224] Handling call
0709 12:26:29.456527 (+ 81658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.456934 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.456968 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.457050 (+    82us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:29.457134 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.457194 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.457301 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.467988 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3411) took 1320 ms. Trace:
I20260709 12:26:29.467818 18917 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 12:26:29.471276 18917 pending_rounds.cc:85] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 15
I20260709 12:26:29.471903 18917 pending_rounds.cc:107] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:26:29.472296 18917 raft_consensus.cc:2889] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.458040 18921 rpcz_store.cc:276] 0709 12:26:27.677837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.368542 (+1690705us) service_pool.cc:224] Handling call
0709 12:26:29.454626 (+ 86084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.455417 (+   791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.455451 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.455550 (+    99us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:29.455581 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.455649 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.455789 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.470504 18737 leader_election.cc:400] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24.
I20260709 12:26:29.474738 18737 leader_election.cc:403] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:26:29.474339 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3497) took 1648 ms. Trace:
I20260709 12:26:29.369968 18920 rpcz_store.cc:276] 0709 12:26:27.807791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.363423 (+1555632us) service_pool.cc:224] Handling call
0709 12:26:29.364091 (+   668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.364589 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.364633 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.364707 (+    74us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:29.364744 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.364819 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.364963 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.476357 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.477396 18917 rpcz_store.cc:276] 0709 12:26:27.825933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.375307 (+1549374us) service_pool.cc:224] Handling call
0709 12:26:29.467268 (+ 91961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.473119 (+  5851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.473979 (+   860us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b54003539d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.474237 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210031872}
I20260709 12:26:29.479625 18915 rpcz_store.cc:276] 0709 12:26:28.147949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.460576 (+1312627us) service_pool.cc:224] Handling call
0709 12:26:29.461095 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.467582 (+  6487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.467608 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.467673 (+    65us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:29.467703 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.467762 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.467902 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.484225 19484 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:29.488489 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.458220 26819 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.486681 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.489497 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.493470 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.487105 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:29.496456 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.505153 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.491293 26851 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:29.508702 18914 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:26:29.509315 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 58938.8us
I20260709 12:26:29.512158 26820 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:29.512872 26820 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:29.513446 26820 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:29.515774 26404 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.516652 18737 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:29.517980 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:29.519358 26404 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:29.519567 26843 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:29.521701 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:29.522904 26819 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:29.523499 18921 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:29.523687 26819 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:29.524362 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3415) took 1369 ms. Trace:
I20260709 12:26:29.524968 18921 rpcz_store.cc:276] 0709 12:26:28.154884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.503291 (+1348407us) service_pool.cc:224] Handling call
0709 12:26:29.522933 (+ 19642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.523941 (+  1008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.524256 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.525393 26819 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.526058 26899 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.534801 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.536718 19489 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:26:29.543494 19483 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:29.546635 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.544461 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:29.550806 18917 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:29.552421 18920 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 12:26:29.521960 26843 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:26:29.554522 18922 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:29.552973 18920 pending_rounds.cc:85] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 16
I20260709 12:26:29.556842 18920 pending_rounds.cc:107] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 12:26:29.557238 18920 raft_consensus.cc:2889] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.570623 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:29.572439 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 115004us
I20260709 12:26:29.573930 26718 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:29.545825 26624 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.547853 26881 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:29.566200 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:29.563010 26822 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:29.590739 18916 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:29.592022 18915 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:26:29.593021 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.595670 18915 pending_rounds.cc:85] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 11
I20260709 12:26:29.598605 18915 pending_rounds.cc:107] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:26:29.598984 18915 raft_consensus.cc:2889] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.602902 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:29.592147 26822 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:29.601687 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:29.609066 26630 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:29.609995 26630 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.607174 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1892) took 1351 ms. Trace:
I20260709 12:26:29.619180 18920 rpcz_store.cc:276] 0709 12:26:28.256027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.478234 (+1222207us) service_pool.cc:224] Handling call
0709 12:26:29.495406 (+ 17172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.603858 (+108452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.607073 (+  3215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:29.607534 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45365.4us
I20260709 12:26:29.620765 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:29.633411 18919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57874 (request call id 1889) took 1782 ms (client timeout 2104 ms). Trace:
W20260709 12:26:29.633970 18919 rpcz_store.cc:269] 0709 12:26:27.851133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.214155 (+363022us) service_pool.cc:224] Handling call
0709 12:26:29.632928 (+1418773us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400334354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.633199 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3021814144}
I20260709 12:26:29.634570 26624 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.635823 18919 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:29.637916 26624 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.642956 18918 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:29.616027 26822 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:29.648165 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 67271us
I20260709 12:26:29.606947 26899 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:26:29.657558 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3418) took 1499 ms. Trace:
I20260709 12:26:29.644835 18917 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:29.662364 26843 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:29.662916 26677 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.666384 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:29.667294 26630 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.675552 18913 rpcz_store.cc:276] 0709 12:26:28.158085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.492330 (+1334245us) service_pool.cc:224] Handling call
0709 12:26:29.515050 (+ 22720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:29.515421 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.515456 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:29.516195 (+   739us) log.cc:844] Serialized 26 byte log entry
0709 12:26:29.597056 (+ 80861us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:29.597108 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.597181 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.657220 (+ 60039us) raft_consensus.cc:1685] finished
0709 12:26:29.657252 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.657445 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":80045,"threads_started":1,"wal-append.queue_time_us":137992}
I20260709 12:26:29.670845 26821 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:29.647682 26636 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:26:29.667526 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 178333us
I20260709 12:26:29.691663 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3412) took 1541 ms. Trace:
I20260709 12:26:29.692142 18918 rpcz_store.cc:276] 0709 12:26:28.150580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.466465 (+1315885us) service_pool.cc:224] Handling call
0709 12:26:29.642716 (+176251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.654964 (+ 12248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.690090 (+ 35126us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400334350. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:29.691598 (+  1508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403999488}
I20260709 12:26:29.695061 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:29.624420 26806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.015s	sys 0.016s
I20260709 12:26:29.701694 19491 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:29.701987 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:29.705466 26703 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:29.707460 19489 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:29.691395 26636 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.708523 26636 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:29.708314 26703 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:29.709309 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.711335 26677 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:29.715111 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 170475us
I20260709 12:26:29.721159 26807 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:29.721827 26807 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:29.722287 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3410) took 1860 ms. Trace:
W20260709 12:26:29.716969 26806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.017s	sys 0.016s
I20260709 12:26:29.738739 26782 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:29.742437 26908 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.121s	user 0.002s	sys 0.001s
I20260709 12:26:29.722831 18840 rpcz_store.cc:276] 0709 12:26:27.861565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.862487 (+   922us) service_pool.cc:224] Handling call
0709 12:26:27.862856 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:27.863211 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:27.863242 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:27.880928 (+ 17686us) log.cc:844] Serialized 26 byte log entry
0709 12:26:29.286506 (+1405578us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b180043dc20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:26:29.593228 (+306722us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:29.593298 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.600086 (+  6788us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.721675 (+121589us) raft_consensus.cc:1685] finished
0709 12:26:29.721695 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.722049 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3924,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":15165,"spinlock_wait_cycles":5858688,"thread_start_us":259420,"threads_started":1,"wal-append.queue_time_us":1718151}
I20260709 12:26:29.716799 26843 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.751605 26677 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:29.718963 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:29.752969 26843 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:29.753656 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 99968us
I20260709 12:26:29.756596 26718 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:29.757211 18916 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
W20260709 12:26:29.757682 26906 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.143s	user 0.004s	sys 0.000s
W20260709 12:26:29.726326 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60210.3us
I20260709 12:26:29.761209 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:29.724958 26807 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:29.756587 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:29.766044 26624 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:29.766708 26624 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.767267 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:29.767266 26624 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:29.767522 26630 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:29.769454 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:29.774446 26718 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:29.776062 26718 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.19, Last appended by leader: 19, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.780718 26335 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:29.781270 26335 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.781687 26335 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:29.783260 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.739636 26782 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.789945 18922 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
W20260709 12:26:29.793340 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:29.795282 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 93508.6us
W20260709 12:26:29.798857 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.809661 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.824805 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.803089 26821 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:26:29.835228 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:29.836187 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 100518us
I20260709 12:26:29.840555 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:29.841907 19484 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:26:29.846030 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.851290 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.852006 18922 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:29.834056 26899 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:29.852972 19491 raft_consensus.cc:2410] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:26:29.848321 19489 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:29.862061 26813 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:29.862334 26851 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24.
I20260709 12:26:29.862778 26813 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.863282 26813 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:29.863726 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:29.864781 18771 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:29.867687 18767 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:29.857734 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:29.873808 26782 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.880230 18764 raft_consensus.cc:2410] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:26:29.880659 26822 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.884019 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.884936 18773 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:29.886024 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.886868 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.839325 26677 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:26:29.888621 18919 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:29.892652 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.855803 26899 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.897712 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.898774 18768 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:26:29.900193 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.902346 18772 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:29.903690 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.905100 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.906001 18772 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:29.901598 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.909646 18765 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:29.906759 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.850255 26843 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 12:26:29.879143 26636 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.906140 26624 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:29.917743 18769 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:29.918958 26851 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:29.919432 26851 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:29.919631 18769 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 27 index: 12. (index mismatch)
I20260709 12:26:29.920367 26624 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:29.920446 26851 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.921541 26346 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:29.908743 26899 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:29.922866 26641 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:29.923317 18770 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 12:26:29.923867 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:29.974088 18767 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:29.918111 26843 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:29.975418 26843 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:29.976861 26843 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:29.979044 26843 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:29.932822 18769 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:26:29.877110 26807 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:29.984568 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 59698.5us
I20260709 12:26:29.991194 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.003000 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.004069 18764 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:30.001194 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.004817 18769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:30.015664 18769 raft_consensus.cc:606] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.016297 18769 raft_consensus.cc:614] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:30.019783 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.999738 26851 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:30.018680 18768 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
W20260709 12:26:30.036618 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:30.037117 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 193856us
W20260709 12:26:30.043663 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.010146 26335 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:30.055740 26636 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:30.071427 26822 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:30.074525 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.077378 26808 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:30.078450 26782 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:30.078883 26782 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:30.079458 18768 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:26:30.079990 26782 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.081218 26782 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:30.085017 18764 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:26:30.085523 18764 pending_rounds.cc:85] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 16
I20260709 12:26:30.085763 18764 pending_rounds.cc:107] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:26:30.085999 18764 raft_consensus.cc:2889] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:30.086952 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:30.087671 18772 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:30.088297 26688 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:30.088846 26688 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:30.096256 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.096233 18770 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:30.097481 18765 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:30.102383 18771 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:30.127590 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.042335 26641 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.038710 26346 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.072s
I20260709 12:26:30.136694 26782 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:30.090154 26688 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:30.147337 26820 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.633s	user 0.016s	sys 0.003s
I20260709 12:26:30.154040 18771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:30.164363 26807 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:30.167392 26641 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:30.170691 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120337us
I20260709 12:26:30.172029 18739 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.157306 26820 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:30.155344 18771 raft_consensus.cc:606] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.183916 18771 raft_consensus.cc:614] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:30.185426 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 480684us
I20260709 12:26:30.200969 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.169951 26813 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:30.196128 26782 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:30.197506 26688 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:30.218175 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.220983 18771 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
W20260709 12:26:30.222048 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.217525 26881 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:26:30.218676 19487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.018s	sys 0.044s
W20260709 12:26:30.233690 19487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.018s	sys 0.044s
W20260709 12:26:30.234311 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 454201us
I20260709 12:26:30.229061 26851 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:30.221693 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 452362us
I20260709 12:26:30.226485 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:30.233345 26624 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:30.261041 18770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:30.262089 18770 raft_consensus.cc:606] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.262676 18770 raft_consensus.cc:614] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:30.242161 26335 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:30.265080 26624 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:30.269230 26820 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:30.291569 18771 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:26:30.298065 26813 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:30.298626 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:30.299429 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 73194.2us
I20260709 12:26:30.299739 18767 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 29 because replica has last-logged OpId of term: 27 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
I20260709 12:26:30.299928 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.300554 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.301034 19458 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.301182 26915 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:30.276772 26819 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:30.302848 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.303310 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.315526 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.310535 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:30.310073 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.302361 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.321149 18768 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:30.321202 18765 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:30.324712 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.327463 18772 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
W20260709 12:26:30.327719 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 334013us
I20260709 12:26:30.306881 26830 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:30.307358 26875 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:30.338241 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:30.313845 26677 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:30.339040 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:30.283958 26881 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:26:30.342631 18772 raft_consensus.cc:606] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.337913 18764 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:30.320123 26819 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:30.343715 18767 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:26:30.345876 18772 raft_consensus.cc:614] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:30.334627 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.345831 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3431) took 1411 ms. Trace:
I20260709 12:26:30.336934 26830 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.339812 26875 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:30.363567 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61324.4us
I20260709 12:26:30.363683 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:30.364305 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.349553 18921 rpcz_store.cc:276] 0709 12:26:28.933994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.564780 (+630786us) service_pool.cc:224] Handling call
0709 12:26:29.599048 (+ 34268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.717135 (+118087us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:26:30.199935 (+482800us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.345461 (+145526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:30.345526 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:30.345566 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.345619 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.345766 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":486181,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2930,"raft.queue_time_us":7753,"thread_start_us":527671,"threads_started":2}
I20260709 12:26:30.351887 26819 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:30.370352 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53996.9us
I20260709 12:26:30.353688 26821 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:30.371803 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.372771 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:30.376875 19488 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:30.361866 26813 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:30.378320 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.363153 26830 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:30.363780 26875 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:30.386942 19489 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:30.387341 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:30.388072 19484 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:30.389457 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:30.390275 19490 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:30.392969 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.396798 26881 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:30.397500 26881 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:30.400552 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:30.371174 26624 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.402863 26624 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:30.383018 26926 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:30.406893 26926 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.407299 26926 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:30.406029 26843 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:26:30.414429 19486 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:30.416354 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.383967 26813 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:30.420275 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.417375 18764 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:30.423121 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:30.424665 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 286754us
W20260709 12:26:30.444274 26927 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.003s
W20260709 12:26:30.455875 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44954.6us
I20260709 12:26:30.460485 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:30.464448 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:30.465525 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.466244 18767 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:30.431756 26813 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:30.468735 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:30.474455 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 83017.5us
I20260709 12:26:30.477536 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:30.478809 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:30.479552 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 83978.4us
W20260709 12:26:30.480798 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.479571 18916 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:30.482262 19488 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
I20260709 12:26:30.488057 19490 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:30.493722 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:30.502811 26923 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:30.502938 26928 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:30.503801 26923 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:30.504580 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.504963 26923 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:30.505591 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.505685 26635 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:30.507198 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.508013 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.509016 26635 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:26:30.509181 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.509452 26635 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.509866 26635 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:30.510138 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.511247 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:30.511905 18847 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:30.514976 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:30.515725 18846 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:30.519052 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.519413 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.520627 18918 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
W20260709 12:26:30.521955 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:30.487411 26924 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:26:30.481814 26821 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:30.519982 18841 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:30.426785 26920 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.170s
I20260709 12:26:30.538149 19484 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:30.541950 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:30.543916 18767 raft_consensus.cc:606] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:30.544366 18767 raft_consensus.cc:614] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:30.461596 26899 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:30.546478 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.535118 26821 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.547135 26821 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:30.547259 26630 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:30.547843 26630 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:30.548288 26630 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:30.551450 18840 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:30.551352 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:30.552373 18845 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:30.554430 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.555223 18848 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 17.
I20260709 12:26:30.556021 18766 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:30.538969 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.533751 26688 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:30.559617 26688 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:30.563905 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.563167 26875 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:30.566771 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 84769.6us
I20260709 12:26:30.568522 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.569984 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.571045 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:30.572045 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:30.576017 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:30.588822 18922 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:30.583930 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.596740 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.596753 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:30.600764 18847 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:26:30.602428 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.562285 26688 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:30.609632 18846 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 26 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 12:26:30.598305 26843 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:30.614600 18848 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
W20260709 12:26:30.619709 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.488296 26881 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.613425 26915 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:30.616441 26843 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.668668 18772 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
W20260709 12:26:30.670850 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48382.9us
I20260709 12:26:30.632884 26808 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:30.669236 26807 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:26:30.674734 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.685292 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:30.631942 26851 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:26:30.693740 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.666195 26875 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:30.673955 26843 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:30.672312 26635 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.735697 26819 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:30.740602 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:30.746598 26404 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:30.697674 26688 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:30.775817 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 78823.8us
W20260709 12:26:30.753196 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.753291 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:30.792589 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 114242us
I20260709 12:26:30.806639 18772 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:30.808405 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:30.776604 26346 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:26:30.776809 26404 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:30.802686 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49665.5us
I20260709 12:26:30.681289 26915 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:30.817620 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 246691us
I20260709 12:26:30.819108 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.809567 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.828528 18844 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 28: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:30.834443 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:30.835245 18764 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:30.794610 26808 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:30.824203 26820 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:30.880196 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.823115 26404 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:30.791352 26688 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:30.891670 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:30.892485 18764 raft_consensus.cc:3060] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:26:30.837437 26346 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:30.888229 26925 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.919660 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:30.903815 26938 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 12:26:30.916514 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.899386 26820 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:30.903779 26943 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:30.912832 26335 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:26:30.923179 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 93762.8us
I20260709 12:26:30.929508 18766 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:30.889240 26813 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:30.928860 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 109865us
I20260709 12:26:30.914529 26953 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:26:30.945643 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52575.2us
W20260709 12:26:30.951334 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:30.953344 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52903.8us
I20260709 12:26:30.956204 18916 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:30.936460 26943 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:30.922945 26821 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.954077 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:30.914197 26688 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:30.969700 26940 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 12:26:30.970486 26936 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:26:30.971305 26956 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.971972 26956 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.973101 26819 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:30.950081 26925 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:30.943748 26953 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:30.991958 18812 leader_election.cc:400] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:30.952279 26335 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:30.983614 18764 raft_consensus.cc:2468] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:30.999109 18844 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:31.001543 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:30.974869 26945 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.005s
I20260709 12:26:31.002533 18846 raft_consensus.cc:2393] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:31.017673 26335 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.018698 26635 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:31.002861 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.968904 26920 raft_consensus.cc:2764] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:26:31.004657 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.019908 18848 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:31.006223 26820 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.022231 26925 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:31.022585 26960 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 12:26:31.007543 26915 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:30.976362 26949 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:26:30.976027 26821 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:31.025213 26926 consensus_meta.cc:287] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.617s	user 0.004s	sys 0.008s
I20260709 12:26:31.025987 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:30.980218 26808 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.977895 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:31.011385 26957 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:26:31.013262 26943 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:30.992930 26346 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.000100 26953 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:30.974937 26937 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:26:30.974815 26941 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:31.013903 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 173906us
I20260709 12:26:31.025765 26926 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:31.037314 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 108567us
W20260709 12:26:31.000141 26830 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.007s
I20260709 12:26:30.974368 26956 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.051787 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:31.010000 26630 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:31.045959 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:31.048159 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.048311 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:30.975759 26954 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:31.055470 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:31.056195 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.035276 26899 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.073254 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:31.074100 18769 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:31.075803 18841 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:26:31.076153 18766 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:26:31.079864 19490 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:31.036791 26843 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:31.081355 18845 raft_consensus.cc:3055] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:26:31.099277 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 121509us
I20260709 12:26:31.085536 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:31.095238 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 43608.1us
I20260709 12:26:31.097116 18847 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:31.100962 18764 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:31.101297 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:31.102471 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:31.103273 18766 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:31.106135 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.098762 18845 raft_consensus.cc:740] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:31.108336 18842 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 24: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:31.062000 26960 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:31.111249 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:31.112761 18772 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:31.112385 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.114813 18921 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:31.116137 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:31.131090 26947 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260709 12:26:31.131892 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 165134us
I20260709 12:26:31.133311 26962 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:31.133917 26962 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.133680 26972 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:26:31.134361 26962 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:31.136276 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:31.140944 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:31.142999 18917 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:31.156154 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:31.108117 26819 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:31.062211 26830 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.162609 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:31.154127 18887 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.617s (SENT)
I20260709 12:26:31.057747 26943 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:31.185024 26959 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:26:31.185937 26946 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
I20260709 12:26:31.187743 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:31.194217 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:31.195676 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:31.200167 18770 raft_consensus.cc:2393] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:31.131120 26843 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.205741 18767 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:31.208205 18772 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:31.219290 18764 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
I20260709 12:26:31.144948 26851 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:31.219637 18886 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.598s (SENT)
I20260709 12:26:31.113003 26821 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.092s
I20260709 12:26:31.223297 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:31.171116 26819 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:31.195371 18845 consensus_queue.cc:260] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:31.225535 26937 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:26:31.084638 26941 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.198841 26972 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:26:31.242596 26881 consensus_queue.cc:1059] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:31.221879 26813 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:31.236876 26819 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:31.276489 26808 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:31.260268 26718 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:26:31.284211 26808 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:31.283860 26624 consensus_queue.cc:1175] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "43b520eabb65493abe84f4cf06806cba" responder_term: 19 status { last_received { term: 18 index: 12 } last_committed_idx: 12 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:31.285647 26808 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.286345 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:31.287524 26821 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:31.287739 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 94227.5us
I20260709 12:26:31.287097 26808 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:31.276301 26688 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:31.296133 26830 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.257375 26851 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:31.300832 26851 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.303583 26926 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.303954 26941 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:31.280611 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 140286us
W20260709 12:26:31.305827 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.306288 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.250602 26964 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.307370 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:31.315747 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.293933 26843 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:31.321209 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 134023us
W20260709 12:26:31.326232 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 139402us
I20260709 12:26:31.328737 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.338120 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:31.335546 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:31.348630 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 160075us
W20260709 12:26:31.349472 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.336757 26956 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:31.363183 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.294104 26962 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:31.365566 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75135.4us
I20260709 12:26:31.367645 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.367792 18769 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:31.370319 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.375164 18918 raft_consensus.cc:2368] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22.
I20260709 12:26:31.320278 26964 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.383527 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.385695 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:31.376292 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:31.387579 18920 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:31.380270 26930 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:26:31.389653 26979 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:26:31.394280 18845 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:31.397596 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.365103 26956 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:31.358538 26959 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
W20260709 12:26:31.428064 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 85383.7us
I20260709 12:26:31.430112 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:31.429962 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:31.426041 26404 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.008s
I20260709 12:26:31.417702 26956 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:31.446857 26941 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:31.448578 26819 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:31.450018 26959 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:26:31.440114 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77014.9us
I20260709 12:26:31.485469 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:31.455724 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 73690.6us
W20260709 12:26:31.462373 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 76822.8us
I20260709 12:26:31.460846 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:31.488058 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.488790 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 70871us
W20260709 12:26:31.489569 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.450047 26677 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:31.487545 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:31.496269 26915 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:31.512457 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:31.513387 18921 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:31.514137 26630 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.514940 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:31.505571 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.533475 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:31.505028 26980 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 12:26:31.541224 26928 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.485076 26941 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.489387 26718 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:31.490873 26851 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.489558 26959 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:31.559105 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:31.562770 18919 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:31.541821 26928 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:31.486198 26404 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:31.542701 26962 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:31.570437 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 117440us
I20260709 12:26:31.576915 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.579623 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:31.556945 26941 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:31.590997 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:31.592674 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:31.597951 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110556us
I20260709 12:26:31.601343 18739 leader_election.cc:400] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22.
I20260709 12:26:31.601949 18739 leader_election.cc:403] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:31.603179 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:31.569785 26930 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.572456 26677 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:31.634614 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:31.633848 26946 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:26:31.605955 26968 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:31.695814 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 103648us
I20260709 12:26:31.636508 26843 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:31.636039 26875 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:31.562372 26851 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:31.703284 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 105766us
W20260709 12:26:31.702927 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 58768.2us
I20260709 12:26:31.733765 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:31.711251 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 120456us
I20260709 12:26:31.706444 26875 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.602830 26820 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
W20260709 12:26:31.742957 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 108545us
I20260709 12:26:31.662084 26930 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:31.707530 26808 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:31.709585 26961 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22.
I20260709 12:26:31.745126 26843 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:26:31.744020 26953 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.001s
W20260709 12:26:31.799528 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57493.1us
I20260709 12:26:31.801158 26953 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:31.811430 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58798us
I20260709 12:26:31.812944 26404 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.813141 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.814412 19456 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:31.814958 26967 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.003s
I20260709 12:26:31.815485 26960 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:31.816102 26960 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:31.817103 26960 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.819125 26928 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.819696 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:31.819832 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:31.821007 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71244.4us
I20260709 12:26:31.824292 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:31.826253 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:31.825102 26881 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:31.839648 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 95746.7us
W20260709 12:26:31.887499 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61316.5us
I20260709 12:26:31.890367 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:31.865422 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:31.745270 26875 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:31.751382 26808 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:31.896044 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 71830.8us
W20260709 12:26:31.898012 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 70068.9us
I20260709 12:26:31.895473 26819 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:31.839124 26703 raft_consensus.cc:2764] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
W20260709 12:26:31.900012 26991 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.210s	user 0.003s	sys 0.002s
W20260709 12:26:31.907770 26992 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:26:31.910681 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.911217 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.912499 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.916595 18919 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:31.917325 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:31.918231 18916 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:31.913198 18842 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:31.821026 26688 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:31.950115 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.897842 26881 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:31.894377 26821 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:31.898691 26961 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.889963 26962 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:31.956370 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.957463 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:31.972783 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.972875 18847 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:31.899544 26808 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:31.958128 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:31.963449 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:31.968106 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.968344 26677 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:26:31.977936 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.980242 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:31.988229 18841 raft_consensus.cc:2410] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:26:31.950143 26688 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:31.711721 26959 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:31.975220 26819 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:32.005810 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 183479us
I20260709 12:26:31.981925 26961 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.028477 26819 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.013123 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.030642 27000 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:32.030964 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.032254 27000 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:32.023262 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:32.034776 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 71477.9us
W20260709 12:26:32.035094 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.036574 26987 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:32.037020 26987 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.037369 26987 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:32.003953 27002 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.039089 27002 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:32.034804 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.041198 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.041510 27002 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:32.005384 26881 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.019568 26346 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:32.043138 26346 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:32.043769 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.044751 18843 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:32.045979 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.046809 18920 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:32.046864 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.044052 26346 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.048336 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.006271 27003 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:32.049578 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:32.049325 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.050544 18922 raft_consensus.cc:2368] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:26:32.051844 26959 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:32.051959 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.048563 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.046070 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.056466 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:32.011646 18840 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:32.076647 18847 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:32.049281 18839 raft_consensus.cc:2410] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 12:26:32.027783 26943 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.001s
I20260709 12:26:32.091022 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.091786 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.094081 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.095355 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.096503 19489 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 24: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:32.094215 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.098989 19490 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:32.099031 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.100039 18769 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:32.102089 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.102813 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.014518 26688 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:32.115840 18766 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:32.048605 26346 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:32.101663 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:32.049217 27003 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:32.128777 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.136045 18920 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
W20260709 12:26:32.107182 26718 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
W20260709 12:26:32.094310 26956 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.000s
I20260709 12:26:32.145079 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.148032 18814 leader_election.cc:400] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
I20260709 12:26:32.148494 18814 leader_election.cc:403] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:26:32.127099 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.144636 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.128002 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.153326 18767 raft_consensus.cc:2410] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:26:32.123566 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:31.986793 26964 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.007261 26953 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:32.124475 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 69220.3us
I20260709 12:26:32.098484 26677 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:32.147275 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:32.160248 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.316s (SENT) [suppressed 46 similar messages]
I20260709 12:26:32.176877 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.183733 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.185582 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.186599 26915 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:32.187150 26915 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.187642 26915 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:32.188040 26635 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.188858 26635 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.167809 26928 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:32.190857 26969 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:32.150597 26980 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:32.192131 26980 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.192526 26980 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:32.152211 26718 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:32.201261 19484 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 18. Preceding OpId from leader: term: 22 index: 20. (index mismatch)
I20260709 12:26:32.202445 18848 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:32.203014 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.143863 27003 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:32.204152 19490 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:32.175371 26819 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.115545 26962 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:32.207839 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 317562us
I20260709 12:26:32.208706 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:32.209415 26962 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.210039 26962 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:32.158771 26956 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.212468 26956 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.203524 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.220075 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:32.222222 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53881.5us
I20260709 12:26:32.150455 26972 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:32.140030 27008 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:32.231542 18840 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
W20260709 12:26:32.236632 26990 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.541s	user 0.000s	sys 0.002s
I20260709 12:26:32.246526 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.264907 18914 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:32.266942 26677 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:32.180123 26961 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.278376 26930 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:32.248059 26972 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.281623 26972 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.270293 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:32.232112 26941 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.546s	user 0.003s	sys 0.007s
I20260709 12:26:32.286125 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.250718 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:32.289234 18842 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:32.288578 19484 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 12:26:32.294160 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 264128us
W20260709 12:26:32.294340 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44798.2us
I20260709 12:26:32.295480 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:32.276171 27009 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:32.229017 26956 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 12:26:32.311193 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:32.284907 26959 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.317691 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:32.296128 26961 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.296906 26630 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.307134 26843 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:32.315512 26972 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:32.337927 26843 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:32.338018 26972 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:32.338699 26972 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:32.341791 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54372.9us
I20260709 12:26:32.342561 26959 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.343683 26851 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:32.345394 26996 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.458s	user 0.003s	sys 0.001s
I20260709 12:26:32.275758 26980 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.349931 26980 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.313613 26624 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.355252 26624 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.356807 26635 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.335397 26813 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:32.363984 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.364214 26813 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:32.364565 18848 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:32.364961 18840 raft_consensus.cc:2368] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28.
I20260709 12:26:32.335969 26630 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.366678 26635 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.367393 26635 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.370776 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.370858 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.373904 26635 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.361322 18913 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:32.369851 26630 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.370620 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:32.375593 18915 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:32.370366 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.379498 18919 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:32.380869 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:32.382184 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:32.384887 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.387578 26688 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.388341 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.388935 18916 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:32.390329 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.391191 18919 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:32.365612 26813 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.392765 26813 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:32.392611 27003 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.393901 18922 raft_consensus.cc:1240] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:32.295465 26941 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.395291 19491 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:26:32.345394 26959 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.396358 26941 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:32.357933 26624 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.334118 26961 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.261024 27008 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.399838 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.400316 27008 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.401021 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.401547 26808 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.404107 26808 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.405938 27003 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.274447 26987 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.308413 26677 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.406418 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:32.430202 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.437783 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56998.4us
I20260709 12:26:32.459547 18915 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:26:32.449533 18842 raft_consensus.cc:1217] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Deduplicated request from leader. Original: 22.15->[23.16-23.16]   Dedup: 23.16->[]
I20260709 12:26:32.449783 26941 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:32.464080 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.450609 26960 consensus_queue.cc:1059] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:32.451249 27002 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:32.454430 18840 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: []
W20260709 12:26:32.423233 26998 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.611s	user 0.005s	sys 0.003s
W20260709 12:26:32.455185 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 317041us
I20260709 12:26:32.461026 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:32.468252 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.406862 26994 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.708s	user 0.002s	sys 0.002s
I20260709 12:26:32.468557 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.468952 18772 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:32.458801 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:32.447515 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 152403us
W20260709 12:26:32.412045 26999 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.589s	user 0.000s	sys 0.003s
I20260709 12:26:32.464695 18842 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: [23.16-23.16]
W20260709 12:26:32.421984 27011 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:26:32.476483 18843 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:32.464078 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.455090 18922 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:32.469739 18766 raft_consensus.cc:2410] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:26:32.469594 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:32.462338 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56094.1us
I20260709 12:26:32.417985 26961 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.445993 26956 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:32.466277 26959 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:32.478736 18887 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.365s (SENT)
I20260709 12:26:32.480235 18766 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:32.491956 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:32.484400 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.493857 18772 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:32.470809 27002 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:32.485116 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:32.496464 18772 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:32.471014 27016 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:32.508315 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.497337 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.497843 18842 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28. Ops: []
I20260709 12:26:32.500730 18840 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:32.515123 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.515915 18766 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:32.517942 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.511339 27008 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.519522 26980 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:26:32.519412 27008 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.522192 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.518718 18847 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:32.535998 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:32.539862 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45544.1us
I20260709 12:26:32.541916 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.551486 18848 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:32.551811 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.556627 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3449) took 1001 ms. Trace:
I20260709 12:26:32.489331 26959 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.513981 27016 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.560007 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.563519 18848 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:32.557087 18918 rpcz_store.cc:276] 0709 12:26:31.554906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.555738 (+   832us) service_pool.cc:224] Handling call
0709 12:26:31.572148 (+ 16410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.740647 (+168499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.740702 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.744865 (+  4163us) log.cc:844] Serialized 26 byte log entry
0709 12:26:32.309761 (+564896us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:32.309832 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.309969 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.553802 (+243833us) raft_consensus.cc:1685] finished
0709 12:26:32.553827 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.556549 (+  2722us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113026,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":31449,"thread_start_us":625761,"threads_started":2,"wal-append.queue_time_us":542875}
I20260709 12:26:32.563978 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.508872 27002 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:32.568006 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.561762 19490 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:32.570963 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.571874 18840 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
W20260709 12:26:32.556083 26875 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.000s
I20260709 12:26:32.572854 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:32.534668 26980 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:32.573889 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.496124 26956 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:32.584992 19456 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.671s (SENT)
I20260709 12:26:32.560011 27001 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:32.498450 27003 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 12:26:32.589915 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:32.590184 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 111512us
I20260709 12:26:32.590791 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:32.602885 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.507s (SENT)
I20260709 12:26:32.603457 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:32.591846 27010 raft_consensus.cc:3055] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:32.591951 26928 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19.
W20260709 12:26:32.592446 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.593241 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.585206 18766 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:32.595471 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:32.566941 26959 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:32.604583 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.567215 27016 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:32.608876 18922 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:26:32.610582 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.611809 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.620954 18848 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 19. Ops: []
W20260709 12:26:32.623801 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 306205us
I20260709 12:26:32.564147 26972 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.631134 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:32.631809 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.632463 18766 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:32.636806 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.600345 26624 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:32.606781 27010 raft_consensus.cc:740] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:32.575855 26930 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
I20260709 12:26:32.568962 27000 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:26:32.858201 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.593240 26875 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.859886 26972 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.860484 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.860976 26875 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.649887 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.645629 26335 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:32.638813 26962 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:26:32.627367 26830 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:26:32.874632 18773 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 12:26:32.875944 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.646786 26969 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:26:32.650741 26688 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.627367 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:32.626209 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.533s (SENT)
I20260709 12:26:32.669945 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.647822 27008 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.827127 26987 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.829778 26843 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:32.830261 18766 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:32.830865 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:32.638134 26346 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:32.834486 26630 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.938856 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.834813 18840 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:32.939733 18766 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:32.638921 19456 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:32.837437 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:32.838079 26915 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.650s	user 0.018s	sys 0.014s
W20260709 12:26:32.844764 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.942302 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.942879 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:32.609855 27012 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:26:32.686010 26980 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.953450 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:32.953641 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 314791us
I20260709 12:26:32.630970 26964 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:32.960640 26964 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:32.961668 26964 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.963269 26964 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:32.963990 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.855608 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.955084 26915 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:32.857313 26624 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:32.862437 26956 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:32.869732 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:32.907437 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:32.907485 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 281322us
I20260709 12:26:32.909886 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:32.975158 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 105595us
I20260709 12:26:32.876647 18773 raft_consensus.cc:2376] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20. Re-sending same reply.
I20260709 12:26:32.975708 18768 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:32.860893 26972 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.937994 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:32.836025 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:32.943816 19491 raft_consensus.cc:2393] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:32.944509 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:32.945158 19487 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:26:32.949149 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.994745 18766 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:32.947948 18764 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:26:32.951556 18844 raft_consensus.cc:2368] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20.
I20260709 12:26:32.952528 19484 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 12:26:32.954154 18847 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:32.959694 19490 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:26:32.997910 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.000257 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:32.883270 26968 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.016022 19491 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:32.940616 26941 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.981753 18839 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:32.981869 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:32.972743 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.038703 18915 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:32.970774 18843 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:26:32.985204 26956 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:32.986200 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:32.972044 26624 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.987700 26916 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:32.988142 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:32.911295 26335 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:32.953207 26630 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.007800 18770 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:33.053638 18766 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
I20260709 12:26:33.036620 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.041771 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:33.105135 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.022908 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:33.003547 18886 connection.cc:256] RPC call timeout handler was delayed by -1.080376883000099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 12:26:33.044881 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:33.087685 18767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.035s	sys 0.076s
I20260709 12:26:33.085278 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:33.085135 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:32.837481 27002 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:33.107131 18767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.035s	sys 0.077s
I20260709 12:26:33.107169 18764 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:33.108726 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.109683 18764 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:33.104498 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:33.110988 18770 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 18: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:32.969574 26915 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:32.931605 18769 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:33.037184 26821 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:33.115267 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.037256 26968 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.017520 26830 raft_consensus.cc:2804] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:33.097112 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:33.126760 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.128544 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.128887 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.129344 18844 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:33.129485 18769 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
W20260709 12:26:33.130722 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.131486 18887 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.544s (SENT)
I20260709 12:26:33.133869 18773 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:33.137318 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.139549 18847 raft_consensus.cc:2410] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:26:33.080255 26346 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.142962 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.145300 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.143244 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.143370 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.126858 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:33.147487 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.748s (SENT)
I20260709 12:26:33.149843 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:33.152061 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 194744us
I20260709 12:26:33.153965 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.155310 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:33.155998 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.156481 18915 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:33.157846 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.158763 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:33.160283 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.160867 18770 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:33.159492 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.160367 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.164225 18918 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:33.165629 18764 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 12:26:33.166041 18764 pending_rounds.cc:85] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 17
I20260709 12:26:33.166275 18764 pending_rounds.cc:107] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 12:26:33.166551 18764 raft_consensus.cc:2889] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:33.118270 26968 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:33.171777 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.171916 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:33.172547 18887 leader_election.cc:336] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.545s (SENT)
W20260709 12:26:33.181167 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.589s (SENT)
I20260709 12:26:33.181764 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:33.183440 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.142711 26808 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:33.191244 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.016556 26972 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.158820 26928 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:33.122992 26843 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.183580 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.185393 18764 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 12:26:33.185719 18739 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:33.153347 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:33.188426 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:33.085180 26941 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.200508 26928 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:33.208186 26928 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:33.209625 26941 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:33.192157 18840 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 16: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:33.193970 26808 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.210822 26808 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:33.210300 26941 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:33.211500 26941 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.214483 26941 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:33.185941 18767 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:26:33.172686 18766 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:26:33.193148 18847 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:26:33.195734 18773 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28. Ops: [24.11-27.12]
I20260709 12:26:33.173810 18769 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
W20260709 12:26:33.233706 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48089.6us
I20260709 12:26:33.234824 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:33.196744 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 289554us
I20260709 12:26:33.163232 26346 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.170961 26915 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:33.100589 27010 consensus_queue.cc:260] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.252817 27002 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:33.256735 27027 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:33.258807 26677 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:33.260143 26335 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.204358 26718 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:26:33.264029 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:33.193936 26930 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:26:33.265753 18764 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:33.185640 27000 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.081s
I20260709 12:26:33.237274 26843 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:33.270681 27030 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:26:33.271952 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.272902 18845 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
W20260709 12:26:33.207121 26813 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.007s
I20260709 12:26:33.243260 18915 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:33.239413 18768 raft_consensus.cc:2376] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27. Re-sending same reply.
I20260709 12:26:33.276201 18770 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:33.274192 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.281544 18845 raft_consensus.cc:2368] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20.
I20260709 12:26:33.282501 18771 raft_consensus.cc:1240] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:33.276520 18920 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
W20260709 12:26:33.264369 27016 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.004s
W20260709 12:26:33.290740 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.292706 18769 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:26:33.288323 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.241026 26968 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:26:33.289258 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 135982us
I20260709 12:26:33.244222 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:33.313496 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.331100 18845 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:33.332249 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.332842 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:33.333519 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.315056 26843 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:33.215840 27001 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.096s
I20260709 12:26:33.277676 26821 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:33.311797 26959 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.001s
I20260709 12:26:33.335539 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.339524 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.290552 26624 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:33.364022 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49333.4us
I20260709 12:26:33.364507 18844 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:33.370638 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.371425 18844 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:33.372695 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.339717 18845 raft_consensus.cc:2376] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27. Re-sending same reply.
I20260709 12:26:33.358191 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:33.359040 27022 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:26:33.336337 26968 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:33.379801 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.380633 18845 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:26:33.391064 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:33.378050 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 198247us
I20260709 12:26:33.382231 18844 pending_rounds.cc:85] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 12
I20260709 12:26:33.394572 18844 pending_rounds.cc:107] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:26:33.394970 18844 raft_consensus.cc:2889] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:33.383060 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:33.361974 26875 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:33.308311 27016 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.378633 26718 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:33.360306 26972 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:33.399705 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:33.393939 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:33.363016 26843 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:33.338603 26959 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:33.411516 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 230395us
I20260709 12:26:33.413153 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:33.388474 26964 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:33.410562 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:33.417203 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:33.375368 26624 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:33.422742 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45460us
I20260709 12:26:33.397567 26830 raft_consensus.cc:697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:33.423434 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:33.402757 27035 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:33.410192 26718 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.413594 26843 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.431121 18842 raft_consensus.cc:2368] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21.
I20260709 12:26:33.425549 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:33.415325 27003 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:33.434918 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:33.431492 19456 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:33.429539 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.433661 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:33.440336 18915 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:33.433172 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:33.402551 27012 consensus_queue.cc:1059] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:26:33.442750 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.419266 26964 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:33.445853 18887 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.699s (SENT)
I20260709 12:26:33.447376 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:33.425283 27044 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:33.422514 26875 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:33.452513 18847 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:33.438835 26916 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:33.463174 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.471778 18840 raft_consensus.cc:2376] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19. Re-sending same reply.
I20260709 12:26:33.463449 26830 consensus_queue.cc:237] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.437968 26718 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:33.438136 26843 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:33.473055 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.740s (SENT)
I20260709 12:26:33.443802 27003 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:33.474607 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3420) took 1029 ms. Trace:
W20260709 12:26:33.472666 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 228507us
I20260709 12:26:33.473848 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:33.442310 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 269948us
W20260709 12:26:33.478790 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68302.3us
I20260709 12:26:33.448304 27008 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:26:33.479681 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 80061.9us
I20260709 12:26:33.486212 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:33.435875 26915 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:26:33.487040 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:33.437649 26703 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:26:33.438673 26972 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:26:33.448202 27037 raft_consensus.cc:2804] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:33.494565 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:33.496115 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52661.8us
I20260709 12:26:33.449087 26964 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:33.482272 18841 rpcz_store.cc:276] 0709 12:26:32.445111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.445233 (+   122us) service_pool.cc:224] Handling call
0709 12:26:32.452065 (+  6832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:32.452527 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.452564 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:32.453143 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:26:32.638783 (+185640us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:32.638845 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.638951 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:33.474330 (+835379us) raft_consensus.cc:1685] finished
0709 12:26:33.474355 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:33.474536 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2714,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2090,"thread_start_us":185110,"threads_started":1,"wal-append.queue_time_us":493827}
I20260709 12:26:33.473330 26688 raft_consensus.cc:3055] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:33.471280 26916 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:33.502671 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:33.449297 26968 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:33.530779 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44670.3us
I20260709 12:26:33.544632 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:33.484863 27003 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:26:33.545917 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.498333 18840 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:33.550719 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:33.556879 19487 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:33.533636 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.516389 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.559787 18841 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:33.494354 26346 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:33.565459 26624 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:33.566567 26875 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.505023 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:33.570294 19491 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
W20260709 12:26:33.578419 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75832.9us
I20260709 12:26:33.579293 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:33.580077 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 75169.2us
I20260709 12:26:33.581718 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:33.534621 27023 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:26:33.535189 27032 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:26:33.487087 27043 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:33.607110 27016 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:33.608454 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:33.609807 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:33.610829 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2948) took 1101 ms. Trace:
I20260709 12:26:33.611284 18772 rpcz_store.cc:276] 0709 12:26:32.509673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.535518 (+ 25845us) service_pool.cc:224] Handling call
0709 12:26:32.560099 (+ 24581us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:32.588562 (+ 28463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.588603 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:32.589320 (+   717us) log.cc:844] Serialized 52 byte log entry
0709 12:26:32.867619 (+278299us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b180018af00. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:26:33.139526 (+271907us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:33.365700 (+226174us) log.cc:844] Serialized 14 byte log entry
0709 12:26:33.367439 (+  1739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.367553 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:33.610471 (+242918us) raft_consensus.cc:1685] finished
0709 12:26:33.610584 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:33.610757 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22088,"prepare.queue_time_us":289579,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3100,"raft.queue_time_us":13556,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":22256,"spinlock_wait_cycles":11905280,"thread_start_us":472219,"threads_started":2,"wal-append.queue_time_us":721632}
W20260709 12:26:33.533878 27031 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:26:33.568487 27002 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:33.503894 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:33.614720 26813 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:33.615319 27040 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:33.615418 26813 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:33.616127 27040 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:33.488981 27008 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.617228 27008 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:33.617314 27040 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:33.618680 27033 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.340s	user 0.005s	sys 0.000s
I20260709 12:26:33.621048 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3436) took 1031 ms. Trace:
I20260709 12:26:33.566190 26987 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:33.622711 26987 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:33.623001 26630 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:33.529533 26959 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:33.625102 27018 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:26:33.605633 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61162.5us
I20260709 12:26:33.621651 18842 rpcz_store.cc:276] 0709 12:26:32.589437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.592917 (+  3480us) service_pool.cc:224] Handling call
0709 12:26:33.620749 (+1027832us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b540041c3d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:33.620955 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882019072}
I20260709 12:26:33.628033 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:33.589504 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:33.529049 26915 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:26:33.590258 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.572465 26916 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:33.585300 27020 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:33.638597 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.657025 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.657846 18766 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:33.585665 27046 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:26:33.600149 26928 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.568989 27037 raft_consensus.cc:697] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:33.586444 26960 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:33.585091 27000 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:26:33.585124 27001 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:26:33.587527 26821 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:33.623852 26987 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.585708 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:33.683100 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 97492.5us
I20260709 12:26:33.686192 18839 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:33.587481 27012 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:26:33.546028 26688 raft_consensus.cc:740] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:33.690223 27010 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:33.691073 27016 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:33.691144 26688 consensus_queue.cc:260] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.692729 26688 raft_consensus.cc:3060] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:33.692942 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:33.693678 18915 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:26:33.638051 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:33.641438 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:33.695302 27001 consensus_queue.cc:1243] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 26.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:26:33.695513 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54159.6us
I20260709 12:26:33.696007 27001 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:33.696422 27001 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:33.696635 27044 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:26:33.697122 27044 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:33.697294 27001 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.698081 27044 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 27.12, Last appended by leader: 12, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.698709 26959 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:33.699213 26959 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.699509 27044 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:33.699597 26959 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:33.666260 27036 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:33.701040 27027 raft_consensus.cc:2764] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 12:26:33.701116 26928 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:33.642098 26930 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:33.697315 27037 consensus_queue.cc:237] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.615244 27002 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:33.642921 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:33.642833 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.706972 27002 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:33.707363 18771 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:33.708276 27002 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.709772 18920 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 19. Preceding OpId from leader: term: 22 index: 20. (index mismatch)
W20260709 12:26:33.710079 27053 log.cc:927] Time spent T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:26:33.710781 18845 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:33.707048 18767 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:33.718123 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:33.621939 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 118142us
I20260709 12:26:33.644044 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:33.644835 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:33.724510 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 80578.2us
I20260709 12:26:33.726317 18887 leader_election.cc:400] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20.
I20260709 12:26:33.726826 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.727967 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:33.644654 26346 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:33.645781 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.646538 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.747495 18769 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:33.648576 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:33.625622 27018 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:26:33.652940 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.659782 18772 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 12:26:33.616163 26813 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:33.605568 26808 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.636865 26972 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:33.634068 26915 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:33.531237 27038 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:33.735921 18845 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:33.755585 18773 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:33.759637 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:33.761600 18918 raft_consensus.cc:2410] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 23 because replica has last-logged OpId of term: 20 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 18.
W20260709 12:26:33.770738 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 125965us
I20260709 12:26:33.772742 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:33.775949 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48055.4us
I20260709 12:26:33.776901 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:33.778172 18915 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:33.720968 26941 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:33.780611 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:33.750126 27001 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:33.734872 27043 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:33.759557 27046 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:33.735502 26819 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:26:33.784875 27035 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:33.769498 26624 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.046s
I20260709 12:26:33.800990 27043 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:33.851526 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 64295.8us
W20260709 12:26:33.862263 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 89683.2us
I20260709 12:26:33.806676 27046 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:33.813366 26630 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:33.875984 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:33.823314 27038 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:33.819941 26930 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:33.865272 27065 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.879446 27068 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.827068 27012 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:33.801694 26718 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.799259 26941 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.861474 27043 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:33.890432 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:33.891038 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:33.892676 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:33.893318 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 112838us
I20260709 12:26:33.893612 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:33.871205 27020 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.895233 26630 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:33.875814 27046 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:33.911015 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:33.914309 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:33.922224 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 145433us
I20260709 12:26:33.923105 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:33.882520 26930 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:33.926595 19483 raft_consensus.cc:2410] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:26:33.912890 26956 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.921155 26968 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:33.930859 27054 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:26:33.943128 27067 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:33.943867 27067 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.920054 27012 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.947460 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:33.873684 26915 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.890698 27065 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.951336 18916 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:33.902678 27068 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.877483 27018 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.927589 27066 raft_consensus.cc:2764] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
W20260709 12:26:33.969087 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54878.4us
I20260709 12:26:33.970634 27070 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:33.972931 27018 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:33.976150 27067 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:33.976852 27067 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:33.977253 27067 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:33.977169 26930 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.942170 26956 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.978799 27064 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:33.978811 26930 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:33.980523 26956 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:33.981344 19491 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:33.953145 26624 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:33.985405 27068 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:33.949641 27008 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.988384 27008 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:33.965655 26630 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:33.992949 27065 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:33.993551 27057 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:26:33.977865 27067 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:33.917161 27020 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:33.998319 18767 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:33.947291 26968 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:34.078523 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76056.7us
I20260709 12:26:33.953428 26843 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.089340 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:34.093197 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:34.082065 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 233109us
I20260709 12:26:34.090265 18768 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
W20260709 12:26:34.101120 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.103252 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:34.103843 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:34.104537 19488 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:34.103971 18767 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:34.100821 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:34.104948 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:34.105805 19484 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:33.956997 27012 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.029275 26941 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.078457 26956 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:34.111289 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:34.121181 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 173787us
I20260709 12:26:34.084224 26808 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:34.122188 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:34.006537 26964 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.098685 27008 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:34.102934 27036 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:34.111260 26703 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:34.154951 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:34.157425 19484 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:34.130108 26346 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.166512 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:34.140837 27016 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.140506 26718 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:34.170950 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 91369.9us
I20260709 12:26:34.145922 26703 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:34.170284 27002 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:26:34.172678 27075 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:34.173157 27002 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:34.173202 27075 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:34.174057 27075 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:34.149181 27008 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.123744 26956 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.146039 27036 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:34.174558 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.180033 27069 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:34.180816 18887 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.783s (SENT)
I20260709 12:26:34.249119 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:34.185669 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 83515.4us
W20260709 12:26:34.252562 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.214334 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:34.228998 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:34.278137 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.249167 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:34.224931 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 528521us
I20260709 12:26:34.286192 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:34.286973 18772 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:34.287333 27078 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.286998 18771 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:34.289376 18916 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:26:34.292145 18770 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:26:34.260768 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.273808 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:34.217166 26916 consensus_meta.cc:287] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
I20260709 12:26:34.307798 18772 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
W20260709 12:26:34.246999 27045 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.747s	user 0.004s	sys 0.000s
I20260709 12:26:34.201864 26972 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:26:34.181417 27056 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:26:34.182051 27071 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:26:34.232002 26964 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:34.242583 27003 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.006s
I20260709 12:26:34.313522 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:34.223264 27020 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:34.278306 26959 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.004s
I20260709 12:26:34.225499 27008 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:34.216326 27027 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:34.211412 26968 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.231470 27068 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.289026 27037 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:34.216596 27012 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:34.239851 26703 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:34.213500 26987 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:34.229786 27036 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:34.296644 26688 consensus_meta.cc:287] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.003s
I20260709 12:26:34.366879 18916 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:34.227494 26956 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:34.180631 27063 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:26:34.322535 18769 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:26:34.321165 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:34.298110 26718 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.322826 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.215574 26843 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.298193 27078 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.039s
I20260709 12:26:34.318850 26972 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:34.329051 26335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.016s	sys 0.036s
I20260709 12:26:34.330750 27084 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.320310 26916 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.201577 26813 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.331440 27082 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:34.262830 27043 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.320015 26677 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:34.248289 27069 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:34.336694 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 83565.7us
W20260709 12:26:34.388839 26335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.017s	sys 0.036s
I20260709 12:26:34.174351 27002 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:34.340708 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50339.9us
I20260709 12:26:34.400303 18917 raft_consensus.cc:1275] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:26:34.400734 18917 pending_rounds.cc:85] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 16
I20260709 12:26:34.401075 18917 pending_rounds.cc:107] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:26:34.401396 18917 raft_consensus.cc:2889] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:34.356014 27068 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.346580 19490 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:34.230774 27016 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:34.351161 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65390us
W20260709 12:26:34.354511 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 173738us
W20260709 12:26:34.350998 27044 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.651s	user 0.014s	sys 0.000s
I20260709 12:26:34.405148 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:34.347347 27027 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:34.370479 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.355839 27037 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:34.371122 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50049.5us
I20260709 12:26:34.374923 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:34.374980 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 52255.3us
I20260709 12:26:34.409538 18916 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:34.409824 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:34.377887 26956 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:34.411834 18767 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:26:34.411700 18913 raft_consensus.cc:1275] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:26:34.344980 27003 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.387073 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3340) took 1512 ms. Trace:
I20260709 12:26:34.345764 27046 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.347815 26959 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.374413 27036 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:26:34.186334 27075 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.402346 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.421875 27016 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:34.422613 18921 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:34.423803 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.425261 27065 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:34.322016 26969 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:26:34.414718 26808 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:34.426617 27065 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:34.427206 27065 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:34.427796 27043 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:34.408769 26960 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:26:34.428269 27065 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.425566 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.429900 26630 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:34.430469 26630 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:34.431788 27003 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:34.432552 18920 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:34.406963 18919 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:34.411665 18737 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:34.434199 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.434453 27090 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:34.435210 27090 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:34.435484 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:34.412452 27037 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:34.436455 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:34.437600 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.396744 27082 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.414294 26943 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
W20260709 12:26:34.405764 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.440516 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.441783 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:34.442371 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:34.431416 26630 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.428457 26830 consensus_queue.cc:1048] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:34.442786 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:34.452024 18844 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:34.442477 18845 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:34.443428 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:34.443733 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:34.443733 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:34.444468 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:34.445183 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:34.455754 19491 raft_consensus.cc:2376] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24. Re-sending same reply.
I20260709 12:26:34.445868 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:34.456022 18913 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:34.456590 19484 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:34.446158 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:34.413064 18848 rpcz_store.cc:276] 0709 12:26:32.874493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.184686 (+310193us) service_pool.cc:224] Handling call
0709 12:26:33.203719 (+ 19033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:33.206631 (+  2912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:33.206670 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:33.207288 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:26:33.381715 (+174427us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:33.660541 (+278826us) log.cc:844] Serialized 14 byte log entry
0709 12:26:33.661002 (+   461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.661125 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:34.246217 (+585092us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:34.373277 (+127060us) raft_consensus.cc:1685] finished
0709 12:26:34.386828 (+ 13551us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.387008 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12768,"prepare.queue_time_us":302525,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":26398,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":53169,"spinlock_wait_cycles":9958272,"thread_start_us":428259,"threads_started":2,"wal-append.queue_time_us":235746}
I20260709 12:26:34.446960 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:34.392868 27084 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.450784 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:34.457388 19488 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 23 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 12:26:34.464937 18840 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:34.460073 18842 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:34.463506 27008 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:34.463382 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:34.464643 26943 consensus_queue.cc:1243] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:26:34.465044 26677 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:34.419431 27040 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 12:26:34.465456 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60439.8us
I20260709 12:26:34.467099 27082 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.381407 26972 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.412282 26930 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:34.463478 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:34.471279 18847 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:34.469442 26808 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:34.489440 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.491153 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:34.492105 18887 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.745s (SENT)
I20260709 12:26:34.493575 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:34.537139 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45081.4us
I20260709 12:26:34.526175 18765 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 30 because replica has last-logged OpId of term: 27 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
W20260709 12:26:34.539260 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49939.9us
I20260709 12:26:34.493171 27016 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.502172 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:34.500496 26677 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.425297 27069 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:34.428373 27068 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.517583 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:34.480858 18918 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:34.520607 18844 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:26:34.516530 18917 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:26:34.449772 27036 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 27 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:34.541014 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.555480 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:34.500228 27020 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:34.481364 27078 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:34.494606 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54174.2us
W20260709 12:26:34.557785 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.561057 19483 raft_consensus.cc:1240] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:34.586597 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.510854 26980 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:26:34.571460 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:34.482234 27008 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.576181 18845 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:34.577694 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:34.579650 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:34.500298 26624 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:26:34.556967 26968 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:34.561785 26677 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:26:34.577833 27001 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.003s
I20260709 12:26:34.606568 18917 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:34.534830 27015 consensus_queue.cc:1048] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 12:26:34.523449 27003 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.058s
I20260709 12:26:34.585547 27002 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.603940 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:34.603972 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:34.597533 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.612720 18917 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:34.578898 26930 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:26:34.582083 27078 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.605394 27000 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:34.601812 27008 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:34.566974 27016 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.622047 19489 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:34.584625 27020 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.608331 27043 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:34.511323 27027 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.613400 26630 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:34.656687 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:26:34.657689 19483 raft_consensus.cc:606] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:34.658167 19483 raft_consensus.cc:614] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:34.617341 26980 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:34.644179 26718 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:34.636497 27000 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:34.674701 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.863s (SENT)
W20260709 12:26:34.674220 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:34.675204 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 134277us
I20260709 12:26:34.675217 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:34.621796 27082 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:26:34.653002 27085 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:34.653843 27065 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:34.683360 27020 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:34.686915 27091 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:26:34.687680 27095 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:34.668293 26630 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:34.667943 26959 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.680501 27089 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:34.690281 26843 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:34.662823 26813 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:34.691114 27082 consensus_queue.cc:1243] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 27.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:26:34.650722 27036 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.728259 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:34.729185 18914 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:34.634284 27002 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:34.731052 27096 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:26:34.733458 27093 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:26:34.733354 27002 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:34.662215 27043 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:34.735303 27043 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.675822 27027 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:34.717841 26808 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:34.739610 26808 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.660389 26968 consensus_queue.cc:1059] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 12:26:34.756279 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 199743us
I20260709 12:26:34.757196 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.757786 18916 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:26:34.769186 18916 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:34.770226 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:34.759267 27000 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.767406 26980 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 26.12, Last appended by leader: 12, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.773316 27000 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:34.773947 27067 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.695s	user 0.006s	sys 0.006s
I20260709 12:26:34.774524 27067 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.775179 27016 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.775794 18915 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:34.776804 26968 raft_consensus.cc:3055] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:34.777278 26968 raft_consensus.cc:740] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:34.716463 27065 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.759692 26916 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.782928 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:34.782891 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:34.783139 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.793280 18914 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:34.717131 27098 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:26:34.796540 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:34.804170 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 164771us
I20260709 12:26:34.808744 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.782792 27084 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:34.813459 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:34.800902 18914 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:34.815186 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:34.816053 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 95852.7us
I20260709 12:26:34.820647 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:34.836338 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:34.838368 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.811251 26718 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:34.820129 26987 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:34.825790 27048 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:34.817591 27103 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:34.866456 27104 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:26:34.869644 27078 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:34.870496 27065 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:34.853375 27106 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:26:34.874176 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:34.820499 26843 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:26:34.880280 18767 raft_consensus.cc:606] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:34.884574 18767 raft_consensus.cc:614] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:34.839215 26808 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:34.803202 26630 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.859503 27048 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:34.873137 26943 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:26:34.892233 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78863us
I20260709 12:26:34.885951 26808 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.875242 27067 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:34.902478 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66242.5us
I20260709 12:26:34.898780 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:34.835834 26968 consensus_queue.cc:260] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.898276 27048 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:34.907681 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.908383 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
W20260709 12:26:34.909870 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 86980.2us
W20260709 12:26:34.910485 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.901427 26808 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:34.911932 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.914276 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:34.899010 27118 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:34.910056 18767 raft_consensus.cc:606] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:34.924152 18767 raft_consensus.cc:614] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:34.889829 27108 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:26:34.911743 26943 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:34.955827 27020 consensus_queue.cc:1175] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 22 status { last_received { term: 22 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 22 index: 12 } }
I20260709 12:26:34.955658 26943 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.913444 27116 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:34.959265 27110 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:34.908617 27037 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:34.958791 27116 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.962677 19487 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27. Ops: [26.18-26.18]
W20260709 12:26:34.965323 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60423.6us
I20260709 12:26:34.912683 26843 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:26:34.973489 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 59324.4us
W20260709 12:26:34.958123 27016 consensus_queue.cc:1175] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47b48b5c69f245b79ecb292eff89927f" responder_term: 22 status { last_received { term: 22 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 22 index: 12 } }
I20260709 12:26:34.926290 27084 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:34.963776 27085 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:26:34.968881 26703 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.004s
I20260709 12:26:34.977861 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:34.960776 27008 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:34.985201 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.977234 26968 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:34.986450 27120 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:34.986979 27120 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:34.987417 27120 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:34.990192 27115 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.990573 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:34.990880 27115 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.990211 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:34.993458 27103 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.994015 27103 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.994864 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:34.996296 27103 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:34.997844 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:34.998554 18839 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:35.000808 18771 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [16.11-18.13]
I20260709 12:26:35.001461 18770 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:35.002529 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.002720 18772 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:26:35.003062 18768 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:35.003897 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.004231 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.004612 18770 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:35.005511 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.005719 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.006199 18766 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:35.008083 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3583) took 1294 ms. Trace:
I20260709 12:26:35.008530 18920 rpcz_store.cc:276] 0709 12:26:33.713644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.715015 (+  1371us) service_pool.cc:224] Handling call
0709 12:26:33.747755 (+ 32740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.432940 (+685185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.007765 (+574825us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54000e3b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:35.007974 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574409472}
I20260709 12:26:35.002038 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:34.993309 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.013793 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:34.990971 27117 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:35.004379 18768 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:35.014869 19488 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:35.017220 18770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:34.986992 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.044481 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:35.021242 18766 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:34.913288 26718 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:34.976995 27065 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:35.052984 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:35.053791 18922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3565) took 2223 ms (client timeout 1771 ms). Trace:
I20260709 12:26:34.976028 27118 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:35.058173 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.054714 18922 rpcz_store.cc:269] 0709 12:26:32.830297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.830513 (+   216us) service_pool.cc:224] Handling call
0709 12:26:35.053443 (+2222930us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400353ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:35.053680 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3448990976}
W20260709 12:26:35.059177 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 78241.3us
I20260709 12:26:35.056136 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.053901 18772 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:35.059927 18768 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:35.059769 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.060915 18771 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:34.993309 27115 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:35.080318 18916 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:35.081161 26980 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:35.081523 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:35.082553 18914 raft_consensus.cc:2410] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 23 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 12:26:35.083494 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:35.084685 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:35.074471 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.077986 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:35.028640 27085 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:35.081627 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:35.086625 26916 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:35.087193 27114 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:35.087393 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:35.096696 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.070793 27112 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 12:26:35.089469 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 71983.4us
W20260709 12:26:35.045441 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 58545.3us
I20260709 12:26:35.101706 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.091228 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:35.072933 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1942) took 1294 ms. Trace:
I20260709 12:26:35.102625 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:35.102943 18918 rpcz_store.cc:276] 0709 12:26:33.778715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.780127 (+  1412us) service_pool.cc:224] Handling call
0709 12:26:33.780659 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.574064 (+793405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.072690 (+498626us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b5400032ad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:35.072869 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581554560}
I20260709 12:26:35.104413 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:35.104277 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.105805 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:35.091252 18916 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:26:35.109776 18914 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:35.073855 27037 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:35.069839 26677 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.109915 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:35.073019 27008 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:35.094210 18771 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:35.115773 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:35.116245 18772 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:35.073683 27089 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:35.012610 26703 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.098475 27065 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:35.141635 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:35.143297 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:35.147467 18766 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:26:35.117019 26987 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:35.150501 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.147544 18922 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 29 because replica has last-logged OpId of term: 27 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 10.
I20260709 12:26:35.096027 26808 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.153663 27119 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:35.183944 18913 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:35.156827 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:35.157708 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:35.158154 26703 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:35.158480 27077 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.156823 26928 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.003s
I20260709 12:26:35.157723 19484 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:35.167497 27008 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.194821 27008 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.098311 26959 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
W20260709 12:26:35.189112 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47545.3us
I20260709 12:26:35.198321 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:35.123698 26964 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:26:35.190549 18768 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:35.140272 27115 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:35.144358 27044 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:35.208750 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.201874 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:35.219480 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.217792 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:35.151635 26813 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:26:35.203266 26335 raft_consensus.cc:2764] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:26:35.203064 27119 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:35.202669 27089 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.241142 26980 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:35.241520 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.242578 27117 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:35.242972 26630 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:35.243019 27117 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:35.244994 27117 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.223441 27044 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:35.233456 26956 raft_consensus.cc:2764] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:26:35.235455 27067 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:35.258778 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:35.263059 26677 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:35.202347 27085 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.255962 27044 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:35.268688 26843 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:35.186645 27118 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.272624 27120 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.254698 27117 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:35.276412 26916 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:35.283814 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.238132 27123 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:35.291683 18841 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:35.291814 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.253931 26813 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:26:35.293090 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1947) took 1034 ms. Trace:
I20260709 12:26:35.293538 18915 rpcz_store.cc:276] 0709 12:26:34.258385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.259674 (+  1289us) service_pool.cc:224] Handling call
0709 12:26:34.260024 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.776260 (+516236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.292853 (+516593us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54000e3654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:35.293031 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185694976}
I20260709 12:26:35.255472 27065 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.296741 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.299234 18915 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:26:35.299762 18915 pending_rounds.cc:85] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 12
I20260709 12:26:35.300051 18915 pending_rounds.cc:107] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:26:35.299962 18846 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:26:35.300669 18915 raft_consensus.cc:2889] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:35.261175 27116 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:35.304955 18769 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:35.305141 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.305465 18769 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:35.306224 18768 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:35.240056 27077 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:26:35.313519 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.303870 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.309787 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.310672 18768 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:35.311888 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.317487 18844 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:35.322023 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.307617 18847 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:35.328676 18847 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:35.331018 18840 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28. Ops: []
I20260709 12:26:35.332636 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.309178 18769 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:35.337340 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.337352 18769 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:35.328353 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.301915 27001 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:35.342199 18768 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:35.298174 27008 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:35.253908 27089 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.342032 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.347148 18848 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:35.329826 18847 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.349524 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.351456 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.356134 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.360095 18771 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:35.341706 26915 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:35.374567 27135 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:35.297724 27048 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.379555 27048 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:35.382778 27089 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:35.384711 27134 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:35.385445 27134 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:35.386756 27134 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.387847 18843 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:26:35.354151 27001 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:35.393712 27001 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.394955 27001 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:35.384915 27120 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:35.388602 27134 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:35.399067 18847 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:35.361166 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.401113 18918 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 12:26:35.405335 18918 pending_rounds.cc:85] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 12
I20260709 12:26:35.405714 18918 pending_rounds.cc:107] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:26:35.406055 18918 raft_consensus.cc:2889] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:35.411373 18767 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:35.412062 18770 raft_consensus.cc:606] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:35.412444 18770 raft_consensus.cc:614] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:35.415251 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 180024us
I20260709 12:26:35.416136 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.422333 18844 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:35.423404 18846 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:35.424233 18768 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:35.426857 18769 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 16. (term mismatch)
I20260709 12:26:35.427374 18769 pending_rounds.cc:85] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 15
I20260709 12:26:35.427670 18769 pending_rounds.cc:107] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 26.16
I20260709 12:26:35.427960 18769 raft_consensus.cc:2889] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:35.428556 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.425091 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.434530 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.435230 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.436324 18768 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:35.395973 27044 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.400087 27135 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:35.457211 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.458089 18768 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:35.454244 18840 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
W20260709 12:26:35.437547 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 219861us
I20260709 12:26:35.462579 18847 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:35.463798 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:35.465231 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:35.467288 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.469463 18769 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:35.470326 26930 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:35.471325 26930 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:35.472550 26930 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.475539 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:35.478794 18769 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:26:35.480144 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.487829 18848 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:35.489064 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.489316 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.492803 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.497753 18768 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:35.498229 18845 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:35.427027 26808 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:35.425700 26964 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:35.437201 26962 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:35.499488 18841 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:35.449813 26821 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:35.456346 27128 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:26:35.490209 27070 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:26:35.490455 27037 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.517793 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.502657 27089 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:35.519742 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.524662 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.525791 18769 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:26:35.529402 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.529950 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.530916 26916 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:35.531857 26916 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:35.532202 26916 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:35.532999 26703 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.506006 26964 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.533603 26703 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.535109 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:35.535540 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:35.536150 26972 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:35.536927 26964 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:35.533035 26916 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.519079 27037 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.537901 26916 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:35.540366 27037 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:35.545661 27107 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.478s	user 0.000s	sys 0.002s
I20260709 12:26:35.547446 26703 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:35.549899 18769 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: []
W20260709 12:26:35.554927 27100 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 27 current term: 27 is higher.
I20260709 12:26:35.562323 18766 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
W20260709 12:26:35.562829 19490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 1364) took 2557 ms (client timeout 1771 ms). Trace:
W20260709 12:26:35.563315 19490 rpcz_store.cc:269] 0709 12:26:33.005129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.005443 (+   314us) service_pool.cc:224] Handling call
0709 12:26:35.562602 (+2557159us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400720bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:35.562724 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2393095936}
I20260709 12:26:35.564795 18766 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:35.569980 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.570712 18844 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:35.571610 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 1490) took 1122 ms. Trace:
I20260709 12:26:35.572011 18765 rpcz_store.cc:276] 0709 12:26:34.449184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.449342 (+   158us) service_pool.cc:224] Handling call
0709 12:26:35.571376 (+1122034us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b540029dbd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:35.571539 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81785216}
I20260709 12:26:35.575055 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.540526 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:35.577028 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:35.579602 18845 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:35.580487 18847 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:35.584151 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.587287 18844 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:26:35.566316 18766 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:35.589600 18766 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:35.591229 18766 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:35.593739 18766 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:26:35.595129 18765 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:35.585796 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:35.603672 18766 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:26:35.606881 18848 raft_consensus.cc:1275] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:26:35.605576 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:35.610522 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.609802 18766 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:35.626220 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.572114 26703 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:35.628773 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.630134 18844 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:35.633875 18848 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:26:35.611569 27100 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:35.634876 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:35.636080 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:35.608172 26964 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:26:35.661343 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:35.662196 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.664368 27043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.023s	sys 0.013s
W20260709 12:26:35.674240 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60162.7us
I20260709 12:26:35.675122 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:35.678726 19492 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:26:35.680483 18766 raft_consensus.cc:606] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:35.680948 18766 raft_consensus.cc:614] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:35.685017 27140 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:26:35.685472 27068 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:35.685963 27068 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:35.687083 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:35.694690 27089 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:35.695389 27089 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:35.663321 27100 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:35.641731 26703 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:35.681118 27043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.024s	sys 0.013s
I20260709 12:26:35.674208 26964 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:26:35.712517 26915 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:35.710443 27036 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.703953 27037 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:35.628417 27135 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.723469 27044 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:35.736238 27067 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:35.742865 27100 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:35.753721 27090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.002s	sys 0.012s
W20260709 12:26:35.754581 27090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.003s	sys 0.012s
I20260709 12:26:35.755813 27090 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:35.756322 27090 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:35.756767 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.757157 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76569.4us
I20260709 12:26:35.758555 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:35.758093 27090 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.759479 27037 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:35.760679 27090 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:35.761204 26964 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:35.761680 26964 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:35.759856 27153 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:35.762701 27153 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.762620 26964 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.763360 27153 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:35.764038 26964 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:35.717846 27068 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.718359 27036 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.732865 27075 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:35.751320 27152 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 12:26:35.776664 26703 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:35.776983 27150 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:26:35.777745 27068 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:35.794121 19489 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:35.787510 27046 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:35.788915 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1367) took 1216 ms. Trace:
I20260709 12:26:35.791111 26987 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:35.798156 19484 rpcz_store.cc:276] 0709 12:26:34.572638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.572807 (+   169us) service_pool.cc:224] Handling call
0709 12:26:34.573129 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.194225 (+621096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.788427 (+594202us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54006739d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:35.788747 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343427840}
I20260709 12:26:35.792711 18771 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
W20260709 12:26:35.811410 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 175466us
I20260709 12:26:35.807010 26987 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:35.823247 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.838735 26987 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.840469 26987 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:35.827600 27089 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:35.857084 27089 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:35.869414 27127 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.608s	user 0.002s	sys 0.000s
I20260709 12:26:35.899073 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1948) took 1626 ms. Trace:
I20260709 12:26:35.899585 18921 rpcz_store.cc:276] 0709 12:26:34.272953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.273132 (+   179us) service_pool.cc:224] Handling call
0709 12:26:34.311526 (+ 38394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.423058 (+111532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.898672 (+1475614us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400032fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:35.898975 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254975232}
I20260709 12:26:35.846369 27153 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:35.919430 27153 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:35.938799 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:35.939723 18764 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:35.958909 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.959527 18764 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
W20260709 12:26:36.054415 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 241511us
I20260709 12:26:35.962414 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:36.055505 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.055925 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.056205 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3586) took 2141 ms. Trace:
I20260709 12:26:36.056571 18919 rpcz_store.cc:276] 0709 12:26:33.915080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.915289 (+   209us) service_pool.cc:224] Handling call
0709 12:26:33.920448 (+  5159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.433357 (+512909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.055946 (+1622589us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54000f6754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:36.056116 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118397824}
W20260709 12:26:36.057351 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 95098us
I20260709 12:26:36.059271 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:35.954097 27068 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.069839 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:36.057212 27040 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:36.072755 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:36.073751 26916 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:36.075325 27167 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:36.070349 27068 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:36.081142 27161 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:36.116056 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.091077 26703 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:36.080663 27040 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:36.119546 27167 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:26:36.126717 26943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.023s	sys 0.054s
W20260709 12:26:36.134184 26943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.024s	sys 0.054s
W20260709 12:26:36.140908 27146 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.472s	user 0.000s	sys 0.013s
W20260709 12:26:36.151744 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 79083.4us
I20260709 12:26:36.152915 27116 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:36.153247 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:36.154286 27037 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:36.156210 27037 consensus_queue.cc:1048] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:26:36.157572 27166 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.310s	user 0.000s	sys 0.007s
I20260709 12:26:36.153407 27116 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:36.159184 27116 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:36.160331 27116 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:36.162549 27167 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:36.165027 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:36.165902 18764 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:36.167259 27068 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:36.178947 27003 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:26:36.179190 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 678677us
I20260709 12:26:36.179677 27003 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:36.180630 27040 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:36.180708 27003 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:36.182041 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.182683 27142 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.183132 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3524) took 1167 ms. Trace:
I20260709 12:26:36.183262 27142 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:36.183533 18772 rpcz_store.cc:276] 0709 12:26:35.015861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.143183 (+127322us) service_pool.cc:224] Handling call
0709 12:26:35.575594 (+432411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.576007 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:26:35.576038 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:35.576562 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:26:35.731264 (+154702us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:26:35.731330 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.731421 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:35.831834 (+100413us) raft_consensus.cc:1685] finished
0709 12:26:35.831855 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.182846 (+350991us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540029dbd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:36.183058 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2095,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":12586,"spinlock_wait_cycles":993582336,"thread_start_us":154276,"threads_started":1,"wal-append.queue_time_us":221429}
I20260709 12:26:36.185786 27142 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:36.185943 27002 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:36.186744 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:36.187021 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:36.198851 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:36.188169 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:36.191521 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:36.193324 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:36.202193 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:36.202543 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.186460 27002 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:36.187682 26930 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.203792 27002 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.204034 26930 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:36.205149 27002 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:36.205808 27125 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.949s	user 0.003s	sys 0.028s
I20260709 12:26:36.186360 27142 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:36.188618 18915 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:36.188835 27001 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:36.207187 27142 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.208042 27001 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.209924 27142 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:36.188031 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:36.191882 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:36.210263 27001 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:36.186628 27027 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.229842 26987 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:36.230348 27027 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.232621 27027 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:36.235841 27119 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:36.237371 26943 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:36.239637 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:36.240095 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:36.242321 19485 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:36.244465 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:36.245628 19484 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:26:36.273248 27126 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.114s	user 0.003s	sys 0.009s
W20260709 12:26:36.281437 27155 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.573s	user 0.000s	sys 0.008s
W20260709 12:26:36.283960 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.292667 27131 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.026s	user 0.005s	sys 0.014s
W20260709 12:26:36.295399 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.313478 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.314713 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:36.315120 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:36.315541 18772 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:36.315958 19491 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:26:36.331601 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3611) took 1193 ms. Trace:
I20260709 12:26:36.312667 26915 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 12:26:36.334255 26930 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:36.314337 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:36.335592 19485 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:26:36.336899 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:36.338193 27037 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:36.339133 18917 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:26:36.340922 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:36.238849 27085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.010s	sys 0.014s
W20260709 12:26:36.344722 27085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.011s	sys 0.015s
I20260709 12:26:36.345570 18770 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28. Ops: []
I20260709 12:26:36.347086 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:36.348803 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:36.350855 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:36.330452 27067 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.353111 26813 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.353628 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:36.249706 27070 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
W20260709 12:26:36.331601 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.370714 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1492) took 1378 ms. Trace:
I20260709 12:26:36.375594 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:36.353740 26813 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.243325 27044 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:36.253118 27049 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.352034 27067 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.371449 18773 rpcz_store.cc:276] 0709 12:26:34.992567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.997014 (+  4447us) service_pool.cc:224] Handling call
0709 12:26:34.997392 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:34.997796 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.997823 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:34.998344 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:26:35.096218 (+ 97874us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:35.096271 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.096372 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.272281 (+1175909us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:36.356481 (+ 84200us) raft_consensus.cc:1685] finished
0709 12:26:36.356516 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.370603 (+ 14087us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3787,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":37145984,"thread_start_us":97375,"threads_started":1,"wal-append.queue_time_us":160077}
I20260709 12:26:36.410579 18922 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 12:26:36.411157 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:36.355214 26916 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:36.417676 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:36.421332 27016 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:26:36.422680 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.390460 27165 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.544s	user 0.004s	sys 0.006s
I20260709 12:26:36.429203 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:36.383324 27085 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.445511 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:36.481141 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52063.9us
I20260709 12:26:36.484426 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:36.488358 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:36.427031 27093 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:26:36.444624 27000 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:36.496515 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:36.495677 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:36.412353 27078 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:26:36.479519 27090 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:36.414016 27049 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.483995 27089 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:26:36.485759 27135 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:36.332103 18914 rpcz_store.cc:276] 0709 12:26:35.139155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.385325 (+246170us) service_pool.cc:224] Handling call
0709 12:26:35.385664 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.385937 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:26:35.386327 (+   390us) log.cc:844] Serialized 14 byte log entry
0709 12:26:36.064536 (+678209us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:36.267924 (+203388us) log.cc:844] Serialized 14 byte log entry
0709 12:26:36.331165 (+ 63241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.331240 (+    75us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:26:36.331293 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.331381 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.331525 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740008,"prepare.queue_time_us":8571,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":742317,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":207,"spinlock_wait_cycles":6171392,"thread_start_us":203580,"threads_started":2,"wal-append.queue_time_us":239867}
I20260709 12:26:36.468822 26930 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:26:36.503786 27134 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:36.413189 27044 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:36.532749 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 174054us
W20260709 12:26:36.536423 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.479488 27100 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:26:36.482511 27043 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 12:26:36.541262 18916 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 12:26:36.483295 27085 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.551270 18918 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:36.505330 27046 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 12:26:36.539212 27000 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:36.529672 27001 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:36.524837 27130 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.552348 27069 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.522754 27090 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:36.554071 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.542603 27176 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:26:36.577029 27130 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:36.681361 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.709479 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64869.7us
W20260709 12:26:36.710577 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 214146us
W20260709 12:26:36.688102 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 266939us
W20260709 12:26:36.657344 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.579113 27089 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:36.651484 27000 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:36.577258 27116 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.146s
W20260709 12:26:36.745954 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 250166us
I20260709 12:26:36.750119 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:36.579449 27001 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:36.780649 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68278.3us
I20260709 12:26:36.781760 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:36.724937 27089 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:36.789163 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:36.580245 27069 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:36.813141 18772 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 28 index: 13. (index mismatch)
I20260709 12:26:36.788844 26813 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:36.855250 27174 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
W20260709 12:26:36.858150 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76503us
I20260709 12:26:36.860097 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:36.866648 27192 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:36.867298 27192 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.870025 27192 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:36.885228 26813 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:36.838228 27003 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:36.824319 27100 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.828339 27016 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:36.904773 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.911158 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.812410 26943 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 12:26:36.859733 27008 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:36.811172 27001 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:36.938026 26916 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.005s
I20260709 12:26:36.880234 27049 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:36.912176 27177 log.cc:927] Time spent T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 12:26:36.898301 27180 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:36.906001 26813 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.877617 26718 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:26:36.905699 27003 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:36.921185 27184 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:26:36.972226 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.972162 27184 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.972920 27184 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:36.909986 27142 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:36.899639 27192 consensus_queue.cc:1059] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.061s
I20260709 12:26:36.924103 27100 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.952098 27044 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:36.787366 27176 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:26:36.871800 27185 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:36.963418 27049 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.964167 27180 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:36.970099 26813 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:36.928659 27016 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:36.970419 26943 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:36.952661 27008 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.020917 27190 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.021476 27190 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.022055 27008 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:36.983678 27090 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.022689 27008 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.023209 27008 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.025570 27008 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.031966 27100 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:36.969609 27000 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.030090 27184 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.035888 27003 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.036614 27184 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.037417 27003 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:36.959537 26916 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:37.039407 26916 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.039881 26916 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.041922 26916 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.047232 27180 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.049126 27180 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:37.054911 27049 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.056792 18920 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:26:37.057349 18920 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:37.060401 27016 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.019075 27130 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.020025 27191 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:36.984818 27044 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:37.095374 27044 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.096246 27052 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.983139 27182 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 12:26:37.097087 27052 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.097803 27044 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.071143 27067 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.067335 27015 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:26:37.073376 27172 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:26:37.098591 27015 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:37.060773 26943 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:37.099874 27015 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.058044 27049 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.096453 26718 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:37.077029 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.985646 27178 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.101359 26718 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.102002 27178 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.104126 26718 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.097681 27182 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:37.104887 27182 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:37.105393 27130 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:37.061642 27183 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:26:37.014433 27069 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.058377 18920 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:37.107470 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:37.111871 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:37.112648 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.115783 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:37.116034 27181 log.cc:927] Time spent T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:26:37.116748 19486 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 25: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:36.978535 27142 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.101415 27015 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:37.104147 27178 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.110505 26916 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.959000 27089 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.153311 27036 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.116350 27191 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:37.159940 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.106166 27130 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.163566 27130 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.163688 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.166306 18914 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:37.164500 18913 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:26:37.173322 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.174446 18916 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
W20260709 12:26:37.174798 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.178777 27089 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:37.177734 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:37.182188 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:37.186421 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.105793 27182 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.201581 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 1970) took 1011 ms. Trace:
I20260709 12:26:37.202217 18921 rpcz_store.cc:276] 0709 12:26:36.190585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.191984 (+  1399us) service_pool.cc:224] Handling call
0709 12:26:36.203708 (+ 11724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:36.241020 (+ 37312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.241071 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:36.250074 (+  9003us) log.cc:844] Serialized 26 byte log entry
0709 12:26:36.600434 (+350360us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:36.600500 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.824840 (+224340us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b540027ced4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:36.824903 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:37.201186 (+376283us) raft_consensus.cc:1685] finished
0709 12:26:37.201219 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.201493 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64136,"raft.queue_time_us":112546,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":32732544,"thread_start_us":266277,"threads_started":1,"wal-append.queue_time_us":524502}
I20260709 12:26:37.194033 27069 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:37.208357 27069 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.194684 27036 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:26:37.212029 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 203095us
I20260709 12:26:37.164546 26916 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.209012 27069 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:37.224059 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 440589us
W20260709 12:26:37.229103 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 331168us
I20260709 12:26:37.230129 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.230988 19484 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 24: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:37.213356 27036 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.243067 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:37.232712 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.232515 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.258285 19486 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
W20260709 12:26:37.243467 19457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.669s (SENT) [suppressed 8 similar messages]
I20260709 12:26:37.245381 19491 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:26:37.259828 19491 pending_rounds.cc:85] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 15
I20260709 12:26:37.260100 19491 pending_rounds.cc:107] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:26:37.260334 19491 raft_consensus.cc:2889] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:37.267194 27175 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.850s	user 0.004s	sys 0.000s
I20260709 12:26:37.275573 27142 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.276866 27142 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.277326 27142 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.288369 26624 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:37.289044 26624 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:37.303761 26624 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.305183 26624 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:37.316632 27191 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.318650 27085 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.262212 27202 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:37.391539 27202 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.321530 26916 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.243533 27186 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:37.395830 27186 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.244742 27198 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 12:26:37.264237 27044 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:26:37.399973 27044 consensus_queue.cc:1243] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 28.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:26:37.242761 27130 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:37.400738 27130 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.403312 27130 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.247454 27036 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:37.262296 27176 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:37.262058 27052 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.409106 27070 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:37.409735 27070 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.410161 27052 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:37.410938 27052 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.412138 27070 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.338379 27170 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:37.415493 27170 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:37.359607 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.359687 27201 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.419934 27070 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:37.420078 27201 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.420614 27070 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.413870 27052 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.367306 18664 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 10 to 15, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 15 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.423444 27070 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.375358 27134 raft_consensus.cc:3055] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:37.424067 27134 raft_consensus.cc:740] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:37.424959 27134 consensus_queue.cc:260] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.378605 27182 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:37.426338 27134 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:37.443459 27201 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.444173 18920 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:37.444837 27186 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.394168 27202 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.446288 27202 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.447006 27202 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.452544 27202 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.453302 27170 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.382243 27190 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.461066 27142 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.464646 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:37.465466 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.487517 18664 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 14 to 16, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 16 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.381245 26813 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.501027 27190 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.501143 27036 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.501709 27190 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:37.502621 18922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.028s
W20260709 12:26:37.552076 18922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.004s	sys 0.028s
W20260709 12:26:37.506167 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.006s	sys 0.026s
W20260709 12:26:37.553601 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.007s	sys 0.026s
W20260709 12:26:37.507205 18738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.009s	sys 0.024s
W20260709 12:26:37.554471 18738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.009s	sys 0.024s
W20260709 12:26:37.507666 18885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.017s	sys 0.015s
W20260709 12:26:37.555212 18885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.018s	sys 0.015s
W20260709 12:26:37.511301 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.014s	sys 0.019s
W20260709 12:26:37.511811 19455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.004s	sys 0.028s
W20260709 12:26:37.557332 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.015s	sys 0.019s
I20260709 12:26:37.554244 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3495) took 1184 ms. Trace:
W20260709 12:26:37.557410 19455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.005s	sys 0.028s
I20260709 12:26:37.480137 27069 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:37.550748 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.019s	sys 0.055s
W20260709 12:26:37.560000 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.019s	sys 0.055s
W20260709 12:26:37.560468 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 697372us
I20260709 12:26:37.560951 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.561895 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:37.558820 18920 rpcz_store.cc:276] 0709 12:26:36.369646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.483577 (+113931us) service_pool.cc:224] Handling call
0709 12:26:36.502766 (+ 19189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.056635 (+553869us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b5400051f20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8d1c0 00007f335af8e231 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c
0709 12:26:37.293628 (+236993us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b5800a022d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335aee70aa 00007f335af69447 00007f335af81fe7 00007f335af837de 00007f335af8db49 00007f335af8e416 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4
0709 12:26:37.443394 (+149766us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400051f20. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af00a1d 00007f335aee71a4 00007f335af69447 00007f335af81fe7 00007f335af837de 00007f335af8db49 00007f335af8e416 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419
0709 12:26:37.553854 (+110460us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:26:37.553890 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:37.553946 (+    56us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:37.553977 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.554052 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.554186 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":306,"spinlock_wait_cycles":547825152}
I20260709 12:26:37.571612 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.573045 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:37.573742 18767 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:37.575688 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:37.577479 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:37.578184 18767 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 29.
I20260709 12:26:37.586513 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:37.588727 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:37.591357 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:37.591706 19491 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:26:37.594888 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:37.595789 19491 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
W20260709 12:26:37.599864 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.600741 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:37.574927 27135 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 28 current term: 28 is higher.
I20260709 12:26:37.601890 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:37.559450 27001 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:37.559762 27170 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:37.608721 18921 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 12:26:37.615278 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.607100 27037 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:37.648690 27037 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.648906 27130 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.649088 27037 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:37.603228 18664 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 11 to 14, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 14 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.649503 27130 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.654799 27130 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.655485 27130 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.605948 18914 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:37.656066 27130 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.656579 27198 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.657122 27198 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.657398 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:37.623495 27179 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.014s	sys 0.031s
I20260709 12:26:37.570497 27015 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.657418 26987 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:37.659255 27015 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.659674 26987 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:37.619650 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.662853 27015 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.643805 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.639791 18922 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 27 index: 12. Preceding OpId from leader: term: 28 index: 13. (index mismatch)
I20260709 12:26:37.615548 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:37.560789 27186 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:37.664683 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49292.2us
I20260709 12:26:37.664825 27186 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.667371 27186 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.668154 27130 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.668859 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.668982 27130 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:37.667996 27186 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:37.669821 27130 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:37.671239 27203 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:26:37.670334 27186 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.672899 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.673144 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3622) took 1335 ms. Trace:
I20260709 12:26:37.673795 18915 raft_consensus.cc:2393] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 25: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:37.673940 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.646786 19491 raft_consensus.cc:1240] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:26:37.674965 18921 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:37.678479 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.678823 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.679641 19492 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:37.680140 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.680826 27016 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:37.613533 18773 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:37.681998 27186 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.683144 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.680967 18921 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:37.684105 18915 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:37.686530 26813 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.656838 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.687528 18914 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:37.585307 27202 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.688884 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:37.687511 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 444045us
I20260709 12:26:37.693593 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:37.585454 27212 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.650481 27085 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:37.658330 27205 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:37.663859 27179 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.014s	sys 0.034s
I20260709 12:26:37.671060 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.718473 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.719163 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.680944 26987 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.686480 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.723595 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.724926 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.725827 18914 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:37.570839 27003 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.570598 27089 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.736837 27070 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:37.723872 27205 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.740265 27089 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.740463 27070 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.638521 27189 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:26:37.743126 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.743440 27070 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.743880 19488 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:37.744980 27089 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:37.587872 27180 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.538s	user 0.016s	sys 0.000s
I20260709 12:26:37.695428 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.700766 27170 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.658282 18918 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 19: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:37.701138 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.747897 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:37.590947 27090 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:37.608152 18772 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:26:37.748767 27170 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.710907 27212 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.610880 27178 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.119s
I20260709 12:26:37.752718 27212 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.755728 27207 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:37.756489 27207 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.757061 27207 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:37.758562 27003 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.761658 27003 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.595715 27049 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:26:37.605662 27119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.012s	sys 0.015s
I20260709 12:26:37.606936 27184 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:37.762768 18916 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:26:37.763368 27184 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:37.724288 18915 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:37.764595 27184 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.764900 27037 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.673496 18917 rpcz_store.cc:276] 0709 12:26:36.337722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.339923 (+  2201us) service_pool.cc:224] Handling call
0709 12:26:36.340274 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:36.370782 (+ 30508us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:26:36.513357 (+142575us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18004637e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335e9833c7 00007f335af959a7 00007f335afa50bf 00007f335afa5038
0709 12:26:36.781536 (+268179us) log.cc:844] Serialized 14 byte log entry
0709 12:26:37.190126 (+408590us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:37.192042 (+  1916us) log.cc:844] Serialized 26 byte log entry
0709 12:26:37.192201 (+   159us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:37.192235 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.192321 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:37.672812 (+480491us) raft_consensus.cc:1685] finished
0709 12:26:37.672921 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.673081 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63605,"prepare.queue_time_us":291800,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":6132,"raft.queue_time_us":52319,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":10027,"spinlock_wait_cycles":7206144,"thread_start_us":578346,"threads_started":2,"wal-append.queue_time_us":707722}
I20260709 12:26:37.593487 27201 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:37.567386 27142 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.767114 27037 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:37.767459 27142 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.767227 27201 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.769249 18922 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:37.716708 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:37.772428 27208 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:26:37.777514 18666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 293) took 17793 ms (client timeout 15000 ms). Trace:
I20260709 12:26:37.706276 27202 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.783757 27202 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.785733 27036 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.763520 18916 pending_rounds.cc:85] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 12
I20260709 12:26:37.787499 18916 pending_rounds.cc:107] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:26:37.787891 18916 raft_consensus.cc:2889] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:37.793272 27142 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:37.794934 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:37.796126 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48327.9us
I20260709 12:26:37.796988 27015 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:37.705753 27052 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:37.799413 27052 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.801254 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:37.722180 27085 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.689507 27001 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:37.763118 27119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.013s	sys 0.016s
I20260709 12:26:37.798748 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:37.819525 18917 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:37.812114 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.821532 19487 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:37.813292 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.802066 27052 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.777834 27190 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.721343 26718 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:37.824074 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.831456 19486 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:37.829030 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.832268 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.837128 19492 raft_consensus.cc:2368] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:37.843113 27001 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.836297 26718 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.854187 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.855408 19492 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:26:37.857156 18887 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.539s (SENT)
I20260709 12:26:37.762859 27049 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.076s
I20260709 12:26:37.820713 27015 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 12:26:37.838479 27205 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.815099 27211 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 12:26:37.855436 26718 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.888203 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.875689 27201 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:37.913506 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.919934 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:37.879472 27001 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:37.931605 27001 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:37.778026 18666 rpcz_store.cc:269] 0709 12:26:19.984284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.984692 (+   408us) service_pool.cc:224] Handling call
0709 12:26:37.777223 (+17792531us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:29.064120 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:29.145870 (+ 81750us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:29.147369 (+  1499us) write_op.cc:435] Acquired schema lock
0709 12:26:29.148330 (+   961us) tablet.cc:662] Decoding operations
0709 12:26:29.180917 (+ 32587us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:29.181018 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:29.181058 (+    40us) tablet.cc:685] Acquiring locks for 31 operations
0709 12:26:29.202851 (+ 21793us) tablet.cc:701] Row locks acquired
0709 12:26:29.202870 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:29.203052 (+   182us) write_op.cc:270] Start()
0709 12:26:29.203180 (+   128us) write_op.cc:276] Timestamp: P: 1783599989202988 usec, L: 0
0709 12:26:29.203204 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:26:29.222950 (+ 19746us) log.cc:844] Serialized 11979 byte log entry
0709 12:26:30.391865 (+1168915us) op_driver.cc:464] REPLICATION: finished
0709 12:26:30.453044 (+ 61179us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8832a 00007f335af0df14 00007f335af0dec3 00007f335af0de38 00007f335af0ddf3 00007f335af0d0dc 00007f335af36e16 00007f335af1ecbb 00007f335af0939d 00007f335af0cd75
0709 12:26:30.615196 (+162152us) write_op.cc:301] APPLY: starting
0709 12:26:30.638890 (+ 23694us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:32.170971 (+1532081us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:32.171028 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:32.701034 (+530006us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:32.856711 (+155677us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 12:26:32.856802 (+    91us) write_op.cc:312] APPLY: finished
0709 12:26:32.858040 (+  1238us) log.cc:844] Serialized 268 byte log entry
0709 12:26:33.175059 (+317019us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:33.360003 (+184944us) write_op.cc:454] Released schema lock
0709 12:26:33.360129 (+   126us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:33.360719 (+   590us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:33.360759 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1343558,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":101668,"apply.run_cpu_time_us":176469,"apply.run_wall_time_us":2764875,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133893,"num_ops":31,"prepare.queue_time_us":123400,"prepare.run_cpu_time_us":41095,"prepare.run_wall_time_us":523447,"raft.queue_time_us":603837,"raft.run_cpu_time_us":13291,"raft.run_wall_time_us":101988,"replication_time_us":1168491,"spinlock_wait_cycles":3455872,"thread_start_us":1199986,"threads_started":5,"wal-append.queue_time_us":867665,"wal-append.run_cpu_time_us":61248,"wal-append.run_wall_time_us":2884492}]]}
W20260709 12:26:37.954090 18666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 283) took 16872 ms (client timeout 15000 ms). Trace:
W20260709 12:26:37.956178 18666 rpcz_store.cc:269] 0709 12:26:21.081623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.953830 (+16872207us) service_pool.cc:211] Skipping call since client already timed out
0709 12:26:37.953987 (+   157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:26:37.961854 27205 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.962661 27205 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.965566 27205 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.959980 27065 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.980283 27065 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:37.960903 27116 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:37.982851 27065 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:37.982784 27116 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:37.985823 27116 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:37.960336 27211 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:37.989223 18844 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:26:37.989323 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 291654us
I20260709 12:26:37.970659 27085 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:37.993219 19457 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.761s (SENT)
I20260709 12:26:37.996753 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:38.002136 19492 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:26:38.005210 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.006088 18846 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
W20260709 12:26:38.003899 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 117175us
I20260709 12:26:38.008538 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.008786 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.009382 18769 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:38.005179 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:38.014307 18769 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:38.011935 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.003243 27001 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:38.015112 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.015332 18770 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:38.016033 18773 raft_consensus.cc:2410] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:26:38.017099 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.001754 27116 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.028386 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.013957 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.035857 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.036585 18767 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:26:38.018466 18764 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:26:38.024407 18766 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:26:38.018415 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.038018 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.038897 18841 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:38.038968 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.039671 18771 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:38.041149 18771 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:26:38.002180 27204 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.038281 18768 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:37.993192 27211 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.021677 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.042704 27204 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:38.043210 27222 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.043440 18770 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:38.043812 27222 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.045148 27204 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:38.049616 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.007289 27190 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.050817 27190 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:38.051187 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.051388 18847 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:38.052565 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.053251 27190 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:38.053530 18845 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 12:26:38.053973 27116 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.056360 27116 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:38.022743 27212 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:38.057165 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.057411 27212 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.057806 27212 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:38.042234 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.059453 18771 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:38.059696 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.059938 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:38.060899 19487 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:38.060688 18917 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:38.053038 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.062487 18842 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:38.064271 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.066635 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.067456 18848 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:38.058349 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:38.069041 18844 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:26:38.063557 19458 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.035277 18769 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:38.072329 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:38.074764 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.075208 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:38.075855 18841 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:38.076089 18846 raft_consensus.cc:2368] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23.
I20260709 12:26:38.077839 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.078890 18771 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:38.078696 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.080084 18846 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:38.080582 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.081364 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.046169 27222 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:38.018365 27198 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:38.079663 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.084625 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.083287 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.086158 18845 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:38.078054 27210 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:38.081729 27191 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:26:38.045188 27211 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:38.082257 18841 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:38.115375 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.086859 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.115832 18771 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:26:38.118253 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.097566 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.115013 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.119029 18841 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:38.120026 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.121536 18848 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:38.120003 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:38.125587 27219 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.204s	user 0.005s	sys 0.001s
I20260709 12:26:38.135842 27069 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:38.137409 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:38.138350 18917 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:38.143404 27142 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:38.144111 27142 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:38.146029 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1611) took 1043 ms. Trace:
I20260709 12:26:38.146602 19485 rpcz_store.cc:276] 0709 12:26:37.102487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.104280 (+  1793us) service_pool.cc:224] Handling call
0709 12:26:37.104709 (+   429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:37.105165 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:26:37.105194 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:37.105856 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 12:26:37.552374 (+446518us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:37.552423 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.552506 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:38.124772 (+572266us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:38.145609 (+ 20837us) raft_consensus.cc:1685] finished
0709 12:26:38.145643 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:38.145943 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11769,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4245,"spinlock_wait_cycles":5239680,"thread_start_us":445971,"threads_started":1,"wal-append.queue_time_us":760489}
I20260709 12:26:38.150187 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:38.155794 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:38.156352 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.159435 18847 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:26:38.162655 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.163631 18770 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:38.165941 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.167907 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.168928 18767 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:38.171911 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.172621 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.084527 27015 raft_consensus.cc:2804] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:38.081481 27003 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:38.191603 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.192039 18841 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:26:38.192469 18846 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:38.195636 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:38.197878 18764 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:38.091157 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:38.175951 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:38.177158 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:38.203356 18770 raft_consensus.cc:3060] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:26:38.186800 18917 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:38.018590 27075 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.066s
I20260709 12:26:38.077787 27135 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:38.206821 27135 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.207432 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.209275 27135 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:38.182824 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.210080 18847 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:38.042723 27207 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.184547 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:38.216765 18845 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:38.216899 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.173851 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.217615 18846 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:38.185599 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.187361 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:38.083091 27189 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:38.210886 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.224929 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.225804 18913 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 17: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:38.225668 18768 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:38.226862 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.227802 18914 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:38.173370 18766 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:38.085038 27202 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.189316 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.090760 26813 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:26:38.232020 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.232784 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:38.233696 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.211936 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.212952 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.213240 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.116896 27191 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:38.211355 27130 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:38.242611 27191 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:38.242708 27015 raft_consensus.cc:697] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:38.243304 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.244468 27189 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.244277 27015 consensus_queue.cc:237] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:38.215965 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.247011 27189 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:38.184633 27211 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:38.218562 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.248661 27211 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:38.249305 27211 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:38.214884 18770 raft_consensus.cc:2468] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:38.251911 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:38.115797 27040 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.221076 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.223137 18916 pending_rounds.cc:85] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 14
I20260709 12:26:38.253901 18916 pending_rounds.cc:107] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 27.15
I20260709 12:26:38.253682 27040 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.224078 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.254743 18921 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
I20260709 12:26:38.256305 27040 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:38.173173 27090 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.258574 27090 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:38.194044 27170 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.261968 27170 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.265018 27170 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:38.185168 27198 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260709 12:26:38.267019 27228 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:38.267896 27228 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.273310 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.277444 27119 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:38.277989 27119 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:38.278873 27119 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:38.279349 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.280174 27119 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:38.282235 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.283587 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.284261 27190 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.284835 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.285470 18841 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:38.286285 18842 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:38.286473 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.287273 18843 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:26:38.287549 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 80227.7us
I20260709 12:26:38.230614 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.254207 18916 raft_consensus.cc:2889] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:38.224349 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:38.292371 18771 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:38.292470 18922 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:38.070259 27001 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.132s
I20260709 12:26:38.302325 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:38.305825 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.305868 18922 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:38.308799 18764 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:26:38.304375 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.310350 18919 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:38.310499 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.311529 18764 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:38.312247 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.312247 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.312938 18839 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:38.315665 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.315847 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.315903 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.316725 18764 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
W20260709 12:26:38.311293 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 87039.5us
I20260709 12:26:38.317673 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.317781 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:38.318753 18848 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:38.320145 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.321503 18739 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.323342 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.221437 27167 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:26:38.351517 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.352891 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.353605 18921 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:38.353730 18766 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:26:38.355085 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.357251 18770 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:38.358206 18764 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:26:38.360795 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:38.327585 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 97079.7us
I20260709 12:26:38.362715 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.363338 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:38.360894 18770 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:38.342352 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.346554 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.347380 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:38.348817 18771 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:38.349220 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.349377 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.369752 18846 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:38.371151 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.215391 27134 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:26:38.358598 18845 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:38.343434 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:38.373558 18848 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:38.328617 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.375303 18922 raft_consensus.cc:2410] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 28 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:26:38.374013 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.376379 18845 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:38.235119 26813 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.377952 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.378005 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:38.381307 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.382117 18914 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:38.384088 18913 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:26:38.389806 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.390597 18842 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:38.286546 27075 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:38.391129 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.403288 18917 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:38.391809 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.389806 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.396267 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:38.400811 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:38.316009 27049 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:38.405145 18918 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 28 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 12:26:38.405565 18847 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:26:38.409811 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.404685 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:38.387331 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.326548 26830 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:38.420370 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.445127 18915 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:38.446547 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:38.453926 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.429247 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.439893 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.232513 27036 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.160s
I20260709 12:26:38.440302 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:38.423045 18922 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:38.441406 18846 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:38.456995 18919 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:38.442808 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:38.351828 27167 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:38.378646 27194 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:38.297127 27003 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 12:26:38.390090 27198 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:38.390280 27170 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:38.457942 26987 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:38.514206 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.464322 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.390776 26813 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:38.296149 27202 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:38.470189 26830 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:38.471608 18812 leader_election.cc:400] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:38.522732 18812 leader_election.cc:403] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:38.473505 27229 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:38.474349 27213 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:38.474706 27224 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:38.475896 27065 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:38.403466 27135 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:26:38.442692 27219 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:26:38.403023 27075 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:38.497756 18848 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:26:38.419862 27040 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.504618 18847 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:38.492658 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:38.284858 27190 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:38.471623 27240 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:38.485150 27167 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:38.469134 27210 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:38.506989 27170 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.507602 27198 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.509817 26987 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:38.560432 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 88977.3us
I20260709 12:26:38.560997 18767 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:38.561033 18843 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:26:38.541342 27065 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.529213 27229 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.539875 27224 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.528820 27213 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.526446 27134 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.111s
I20260709 12:26:38.527837 26830 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.563623 27075 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:38.735787 27244 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:26:38.721700 27228 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:38.738114 27228 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.738838 27228 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.741642 27228 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:38.638554 27227 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 12:26:38.743067 27227 consensus_queue.cc:1243] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 27.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:26:38.694358 27170 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:38.712167 26987 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:38.751391 27238 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:26:38.719391 27065 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:38.561669 27135 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.542444 27194 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.164s
I20260709 12:26:38.567461 27222 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20.
I20260709 12:26:38.689399 27210 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.572369 27040 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.720402 27224 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:38.697147 27198 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:38.698107 27069 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.720793 27229 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:38.788157 27202 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:38.798770 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 475455us
I20260709 12:26:38.767730 27135 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:38.724851 27213 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:38.816469 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:38.830691 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:38.715801 27212 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.000s
I20260709 12:26:38.832805 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:38.826722 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.803972 18767 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:38.797272 27210 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:38.834860 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.845391 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:38.887563 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54868.6us
I20260709 12:26:38.891100 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:38.886904 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:38.899536 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:38.922410 18844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.010s
W20260709 12:26:38.946995 18844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.008s	sys 0.010s
W20260709 12:26:38.948428 19455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.011s
W20260709 12:26:38.948817 19455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.006s	sys 0.011s
I20260709 12:26:38.885973 27068 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:38.953397 18737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.050s	sys 0.115s
I20260709 12:26:38.892433 27037 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:38.957101 18737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.050s	sys 0.115s
I20260709 12:26:38.958740 27037 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:38.957576 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 552922us
I20260709 12:26:38.891738 27036 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:38.922171 19485 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.009s	sys 0.007s
I20260709 12:26:38.823978 27069 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.885500 27202 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:38.888410 27228 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:38.955299 27191 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.712s	user 0.013s	sys 0.000s
I20260709 12:26:38.956676 27068 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:38.885757 27212 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:38.952659 27040 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:38.964761 27036 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:38.982640 18841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.013s	sys 0.102s
W20260709 12:26:39.008009 18841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.013s	sys 0.102s
W20260709 12:26:38.991354 18921 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.007s	sys 0.012s
W20260709 12:26:39.009086 18921 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.008s	sys 0.012s
W20260709 12:26:38.991608 18764 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.010s
I20260709 12:26:38.963078 27090 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:38.994359 18772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.048s	sys 0.074s
W20260709 12:26:38.994379 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:39.010740 18846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.014s	sys 0.011s
W20260709 12:26:39.012434 18846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.015s	sys 0.011s
W20260709 12:26:39.009934 18764 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.010s	sys 0.010s
I20260709 12:26:39.006625 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:38.991858 18738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.002s	sys 0.017s
W20260709 12:26:39.017616 18738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.002s	sys 0.017s
W20260709 12:26:39.018611 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:39.019007 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 677859us
I20260709 12:26:39.023367 18919 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 12:26:38.993358 27119 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.713s	user 0.013s	sys 0.001s
I20260709 12:26:38.989944 27228 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:39.037580 18772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.048s	sys 0.074s
W20260709 12:26:39.005867 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 428051us
I20260709 12:26:39.042135 18765 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:38.999363 27068 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:39.039376 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.989863 27202 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.012461 27036 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:39.089138 27243 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:26:39.094776 27119 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:38.999747 27191 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.044222 27228 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:39.037413 27233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.012s	sys 0.019s
I20260709 12:26:39.084659 27202 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:39.059580 27250 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:39.111186 27069 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.022514 27090 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:39.084764 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 193750us
I20260709 12:26:39.215000 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.122426 27049 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:26:39.124531 27234 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.829s	user 0.006s	sys 0.004s
I20260709 12:26:39.126827 27201 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:39.127173 27211 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.005s
I20260709 12:26:39.039384 27040 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:39.121582 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:39.125790 27170 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:39.154001 27233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.013s	sys 0.020s
I20260709 12:26:39.208760 27250 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:39.224679 18813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.017s	sys 0.066s
I20260709 12:26:39.242489 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:39.232931 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.007s	sys 0.036s
W20260709 12:26:39.245661 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.007s	sys 0.036s
W20260709 12:26:39.233705 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 112210us
W20260709 12:26:39.223052 27219 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:26:39.246254 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 789748us
I20260709 12:26:39.253545 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:39.126192 27068 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.255187 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:39.257822 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.255124 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.258829 19487 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:39.248545 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:39.262867 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:39.245102 18813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.018s	sys 0.066s
I20260709 12:26:39.246845 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.154731 27223 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.080s
W20260709 12:26:39.229919 27243 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:26:39.214504 27090 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:39.272038 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 451268us
I20260709 12:26:39.272301 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.273379 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:39.276523 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.276607 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.276672 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.282611 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:39.280230 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.282521 19486 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:39.242439 27263 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:39.250789 27250 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:39.265161 26830 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:39.249893 27271 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:39.274483 27194 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:39.273808 27003 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:39.283342 27090 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:39.312429 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:39.313020 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 291272us
I20260709 12:26:39.233342 27211 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.315810 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:39.318414 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.240106 27040 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.229625 27201 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.319711 27194 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:39.326925 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:39.320016 27003 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.361698 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:39.328608 27252 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:26:39.328492 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:39.364328 18773 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:39.329314 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.365221 19492 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:39.329589 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:39.338869 27212 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.306305 27263 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.304915 27119 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:39.312170 26813 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.772s	user 0.013s	sys 0.001s
I20260709 12:26:39.281590 27116 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:26:39.309691 27254 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:39.357189 27167 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.002s
I20260709 12:26:39.352445 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1469) took 1003 ms. Trace:
I20260709 12:26:39.374806 18843 rpcz_store.cc:276] 0709 12:26:38.348641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.467528 (+118887us) service_pool.cc:224] Handling call
0709 12:26:38.560688 (+ 93160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.698783 (+138095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.352214 (+653431us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b540041bed0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:39.352376 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178535808}
I20260709 12:26:39.377442 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3534) took 1373 ms. Trace:
I20260709 12:26:39.359678 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.366266 18768 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:39.381098 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:39.371227 19491 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:39.322664 27264 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:39.374100 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 111720us
I20260709 12:26:39.384550 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:39.360809 27194 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:39.383215 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:39.378039 18772 rpcz_store.cc:276] 0709 12:26:38.003638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.006316 (+  2678us) service_pool.cc:224] Handling call
0709 12:26:38.006698 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.006907 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:26:38.307071 (+300164us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.374989 (+1067918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.375069 (+    80us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:39.375136 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.377173 (+  2037us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.377361 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31658,"prepare.queue_time_us":273806,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":187833,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":9930,"thread_start_us":1327869,"threads_started":3,"wal-append.queue_time_us":996253}
I20260709 12:26:39.363528 27003 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:39.400710 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:39.400365 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:39.403574 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44027.6us
I20260709 12:26:39.414518 18773 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 25: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:39.372159 27119 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:39.381865 27184 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:39.407397 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:39.355959 27265 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:26:39.386147 27189 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:39.370560 27263 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:39.415967 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 130324us
I20260709 12:26:39.418380 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:39.384017 27264 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:39.427683 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.428253 19483 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:39.397989 27085 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:39.406358 27191 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:39.431697 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47215.4us
I20260709 12:26:39.372934 26813 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.436667 18772 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:39.407001 27266 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:39.420858 27119 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:39.432103 26987 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.003s
I20260709 12:26:39.436340 27227 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:26:39.405983 27142 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.386690 27167 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.445354 27191 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:39.465932 27191 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.466595 27191 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:39.466776 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3645) took 1166 ms. Trace:
I20260709 12:26:39.467556 18921 rpcz_store.cc:276] 0709 12:26:38.300338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.380557 (+ 80219us) service_pool.cc:224] Handling call
0709 12:26:38.390373 (+  9816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.390636 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:26:39.009936 (+619300us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.466251 (+456315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.466326 (+    75us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:39.466385 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.466508 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.466689 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":889878,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"thread_start_us":1074384,"threads_started":3,"wal-append.queue_time_us":410775}
I20260709 12:26:39.447641 27170 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:39.451138 27249 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:26:39.433992 27265 consensus_queue.cc:1243] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:26:39.452121 27260 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:26:39.460430 19483 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:39.434585 27223 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:26:39.477273 27211 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:39.477641 27267 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:26:39.478339 27211 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:39.443883 27204 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:39.478783 27211 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.432197 27264 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:39.478767 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:39.383739 27254 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.485056 19489 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:39.510856 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:39.520224 18917 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:39.499017 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:39.499854 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:39.524757 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:39.526697 18916 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:39.446542 27049 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.083s
I20260709 12:26:39.441157 27085 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.483108 27068 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.464277 26987 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.542834 19490 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 19.
W20260709 12:26:39.536509 27259 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:26:39.586586 26987 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.529378 27142 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:39.589042 27262 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
W20260709 12:26:39.485349 27213 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.600s	user 0.003s	sys 0.010s
I20260709 12:26:39.590585 19491 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 29. Current term is 30. Ops: []
I20260709 12:26:39.591063 27213 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.442687 27266 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:39.569228 27190 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.483587 27001 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:39.486783 27211 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:39.594702 27001 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:39.595263 27001 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:39.572958 27228 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.599592 27228 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.602432 27207 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:39.566933 27075 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.837s	user 0.016s	sys 0.000s
I20260709 12:26:39.603899 27075 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.604319 27001 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.600167 27266 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:39.606878 27001 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.606704 27211 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.609722 27211 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.581900 27191 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.611111 26813 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.612327 27191 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.606732 27075 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.613205 27201 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.613592 27213 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.614033 27040 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.615505 27167 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.616678 27036 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:39.619997 27065 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.003s
I20260709 12:26:39.620493 27065 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:39.621279 27135 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.003s
I20260709 12:26:39.621691 27135 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.622819 27065 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.623250 26718 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:39.623706 26718 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:39.624769 27198 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.799s	user 0.013s	sys 0.000s
I20260709 12:26:39.624655 26718 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.625208 27198 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.625540 27266 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.626053 26718 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:39.631405 27167 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:39.631532 27189 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:39.566512 27275 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:26:39.465145 27282 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:39.600455 27254 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.623852 27135 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:39.644699 27224 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.825s	user 0.008s	sys 0.007s
W20260709 12:26:39.645725 27229 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.817s	user 0.014s	sys 0.000s
I20260709 12:26:39.635936 27266 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.646121 27189 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:39.662856 27210 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.769s	user 0.014s	sys 0.000s
I20260709 12:26:39.664152 27210 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.667245 27250 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.669234 27250 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.657467 27224 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.671355 27224 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.659236 27229 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.675381 27263 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.676254 27229 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.677887 27264 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.680930 27264 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.713650 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:39.727624 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 299868us
I20260709 12:26:39.732156 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.735711 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 2995) took 1577 ms. Trace:
I20260709 12:26:39.736382 18764 rpcz_store.cc:276] 0709 12:26:38.157930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.359286 (+201356us) service_pool.cc:224] Handling call
0709 12:26:38.359651 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:39.015533 (+655882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.015579 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:39.016091 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:26:39.361531 (+345440us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:39.361586 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.361683 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:39.734947 (+373264us) raft_consensus.cc:1685] finished
0709 12:26:39.735030 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.735404 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158686,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6782,"thread_start_us":967797,"threads_started":2,"wal-append.queue_time_us":542003}
I20260709 12:26:39.743085 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2993) took 1585 ms. Trace:
I20260709 12:26:39.743839 18765 rpcz_store.cc:276] 0709 12:26:38.157088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.215463 (+ 58375us) service_pool.cc:224] Handling call
0709 12:26:39.742465 (+1527002us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540002e254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:39.742806 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806225152}
W20260709 12:26:39.746060 18767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 2992) took 1589 ms (client timeout 1712 ms). Trace:
W20260709 12:26:39.746675 18767 rpcz_store.cc:269] 0709 12:26:38.156821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.186964 (+ 30143us) service_pool.cc:224] Handling call
0709 12:26:39.745690 (+1558726us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54000aebd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:39.745893 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786281344}
W20260709 12:26:39.456197 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:39.753150 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 313925us
I20260709 12:26:39.759063 18772 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:39.766572 18769 raft_consensus.cc:2368] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:39.770696 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:39.774880 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.786141 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:39.793479 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 393032us
I20260709 12:26:39.795354 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:39.802819 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1465) took 1455 ms. Trace:
I20260709 12:26:39.803045 18845 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:39.803354 18841 rpcz_store.cc:276] 0709 12:26:38.347395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.347560 (+   165us) service_pool.cc:224] Handling call
0709 12:26:38.347888 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.350656 (+  2768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.350688 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:38.389907 (+ 39219us) log.cc:844] Serialized 26 byte log entry
0709 12:26:39.008621 (+618714us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:39.314563 (+305942us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.381635 (+ 67072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.384414 (+  2779us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:39.597544 (+213130us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b2400112ec8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357d249c4 00007f3357d22acb 00007f3357edddc9 00007f3357edda55 00007f3357edcfb0 00007f335ab53488 00007f335ab53be8 00007f335ab2b398 00007f335ab2676a 00007f335ab25bb6
0709 12:26:39.801909 (+204365us) raft_consensus.cc:1685] finished
0709 12:26:39.802129 (+   220us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.802491 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36530,"prepare.queue_time_us":116923,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":108832,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":28264,"spinlock_wait_cycles":22934272,"thread_start_us":919151,"threads_started":3,"wal-append.queue_time_us":749136}
I20260709 12:26:39.810132 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:39.811620 18843 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:39.813179 18841 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
W20260709 12:26:39.816244 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 292593us
I20260709 12:26:39.817649 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1479) took 1457 ms. Trace:
I20260709 12:26:39.816211 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.820613 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.528606 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:39.822492 18915 raft_consensus.cc:2410] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:26:39.817991 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:39.822662 27301 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:39.818243 18846 rpcz_store.cc:276] 0709 12:26:38.360228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.467071 (+106843us) service_pool.cc:224] Handling call
0709 12:26:38.467532 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.483761 (+ 16229us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:26:38.484207 (+   446us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.018779 (+534572us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:39.036971 (+ 18192us) log.cc:844] Serialized 26 byte log entry
0709 12:26:39.037155 (+   184us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:39.298314 (+261159us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.387157 (+ 88843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.816623 (+429466us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b540041aad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:39.816715 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:39.816962 (+   247us) raft_consensus.cc:1685] finished
0709 12:26:39.816981 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.817369 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5592,"prepare.queue_time_us":88924,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":77064,"raft.run_cpu_time_us":594,"raft.run_wall_time_us":48655,"spinlock_wait_cycles":37620352,"thread_start_us":878438,"threads_started":3,"wal-append.queue_time_us":757718}
I20260709 12:26:39.836784 18845 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:39.837801 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3646) took 1536 ms. Trace:
W20260709 12:26:39.838889 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:39.841548 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.839223 18914 rpcz_store.cc:276] 0709 12:26:38.300646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.382939 (+ 82293us) service_pool.cc:224] Handling call
0709 12:26:38.449273 (+ 66334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.449942 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.449998 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:38.463063 (+ 13065us) log.cc:844] Serialized 26 byte log entry
0709 12:26:38.998369 (+535306us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:38.998428 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.998499 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:39.475380 (+476881us) raft_consensus.cc:1685] finished
0709 12:26:39.475418 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.836972 (+361554us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5400334d50. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:39.837392 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57158400,"thread_start_us":486372,"threads_started":1,"wal-append.queue_time_us":796587}
W20260709 12:26:39.838796 18845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 1476) took 1479 ms (client timeout 1682 ms). Trace:
W20260709 12:26:39.846876 18845 rpcz_store.cc:269] 0709 12:26:38.359471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.377369 (+ 17898us) service_pool.cc:224] Handling call
0709 12:26:39.838532 (+1461163us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400285854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:39.838721 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173693312}
I20260709 12:26:39.877564 27210 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:39.878546 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49508.6us
I20260709 12:26:39.878960 26813 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:39.879312 27001 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:39.880152 27016 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:39.881682 27263 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:39.887166 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 69430.5us
I20260709 12:26:39.888875 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:39.890652 27264 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:39.896736 27201 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:39.646138 27167 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.649938 27085 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.897886 27213 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:39.898955 27075 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:39.899593 27134 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.916555 26813 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.908346 27049 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:39.920590 27264 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.645720 27202 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.915213 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.915901 27254 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 12:26:39.902989 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:39.929436 27292 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.024s
I20260709 12:26:39.953142 27292 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:26:39.910684 27198 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.901682 27135 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:39.903206 27228 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:39.904963 27277 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:39.954614 27135 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:39.954885 27277 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.657871 27036 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:39.955199 27228 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:39.903060 27191 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.956316 27207 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:39.956620 27191 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.957105 27207 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.919021 27001 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:39.915678 27274 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:39.920920 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:39.954970 27085 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:39.949339 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.958577 27001 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:39.955240 27135 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:39.971995 27207 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.906409 27251 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:39.972754 27003 consensus_meta.cc:287] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.005s
I20260709 12:26:39.973407 27003 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:39.940146 27134 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:39.975544 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54915.4us
I20260709 12:26:39.979444 27191 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.979846 26813 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.980389 27191 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:39.980902 27191 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:39.980685 26813 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:39.981389 27191 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:39.953819 27292 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:39.929783 27213 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:39.921149 27201 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.983050 27213 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:39.983700 27292 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.985709 27292 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:39.902652 27142 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.987918 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:39.988812 27142 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.905886 27255 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.905422 27250 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:39.962081 27277 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:39.925169 27167 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:39.978082 27134 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.985772 27201 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:39.925995 27210 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:39.991606 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 437615us
I20260709 12:26:39.990315 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:40.001250 27090 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.009s
I20260709 12:26:39.993971 27250 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:26:39.961930 27264 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:40.035283 19489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.001s	sys 0.013s
I20260709 12:26:40.040326 27202 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.000447 27001 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.042600 27263 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:40.000764 27274 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:39.994861 27212 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:40.069803 27212 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.070252 27212 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:40.044464 27119 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.010s
W20260709 12:26:40.049345 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 146724us
I20260709 12:26:40.052042 27003 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:40.044540 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:40.062130 27167 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:40.060211 27263 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.064661 27274 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.067544 27001 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:26:40.069275 27194 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.009s
I20260709 12:26:40.016197 27210 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:40.089807 27210 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:40.094789 27194 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.080098 27075 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.992913 27255 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.097590 27194 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.137351 27142 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.139051 27003 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:40.140504 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 96262.2us
I20260709 12:26:40.105538 27274 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:40.127815 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.077320 27090 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.084362 27119 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.155504 27069 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:40.158533 18914 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:40.158812 27069 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.159729 27265 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:40.152257 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:40.145924 27167 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:40.188161 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 198057us
I20260709 12:26:40.181573 27274 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.195060 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:40.195751 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80717.6us
I20260709 12:26:40.195775 18915 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 28. Current term is 29. Ops: [26.12-28.13]
I20260709 12:26:40.199996 19488 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:40.202189 18914 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:26:40.205662 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.206250 27090 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.206911 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:40.207718 18921 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:40.204938 18913 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 12:26:40.209532 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:40.210486 27305 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:40.210994 18916 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:40.211179 27305 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.213619 27305 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.194420 27265 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:40.217855 19488 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:40.210318 18918 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:40.222002 19486 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:40.167970 27075 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.182744 27191 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.214569 27274 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:40.235448 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 93112.7us
I20260709 12:26:40.249603 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:40.251437 18918 raft_consensus.cc:2410] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:26:40.232759 27265 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.239130 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:40.251004 27282 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.262655 27293 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:40.262877 27282 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.264741 18913 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:26:40.265256 27282 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:40.266005 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.266369 18919 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:40.267287 19485 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:40.272796 18916 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:40.269261 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.238235 27210 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:40.278213 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 147425us
I20260709 12:26:40.260831 27069 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:40.249254 27194 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:26:40.296214 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.300909 27307 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:26:40.303503 27250 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.304191 27250 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.307197 27301 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:40.313109 18913 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:26:40.314486 27263 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.301370 27282 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:26:40.316377 18913 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 27. Current term is 28. Ops: []
I20260709 12:26:40.317015 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:40.317768 18916 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:40.301600 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:40.295956 27090 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:40.337831 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:40.345009 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.345611 18921 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
W20260709 12:26:40.352634 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 122209us
I20260709 12:26:40.354113 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:40.296546 27135 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.332381 27119 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.286159 27265 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.361411 27191 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:40.361619 27293 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:40.368407 19488 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
W20260709 12:26:40.370581 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 69024.8us
I20260709 12:26:40.375926 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.376928 19483 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 30: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:40.377957 27202 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:40.378444 27202 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.378818 27202 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:40.378734 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:40.383545 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:40.386466 19486 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:40.359879 27090 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:40.388152 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.388748 27090 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.389459 27277 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.394778 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:40.395820 18916 raft_consensus.cc:2368] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:40.396167 27265 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.398835 27277 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.383569 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.372491 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:40.403776 18915 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:40.405292 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.366783 27250 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.407188 19483 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:40.412228 18919 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 30.
W20260709 12:26:40.418164 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58339.5us
W20260709 12:26:40.421571 27308 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:26:40.427908 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44993.8us
I20260709 12:26:40.439005 27190 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:40.439531 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:40.441953 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:40.443008 18921 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:40.362988 27213 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:40.444361 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93389us
I20260709 12:26:40.444473 18915 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:40.411684 27167 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.416285 27085 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:40.401494 27212 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.439563 27190 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.405592 27189 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:40.454980 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 154562us
W20260709 12:26:40.451414 26718 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.010s
I20260709 12:26:40.455037 27190 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:40.451558 27274 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.462751 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.466780 27228 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:40.468272 27228 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:40.468696 27228 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:40.471773 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.472623 19488 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:40.453011 27075 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.480474 18919 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: []
W20260709 12:26:40.483453 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.460498 27210 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.489548 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.469825 27228 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.490272 19488 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:40.495569 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:40.495827 27301 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.487481 18886 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:40.496660 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:40.501534 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:40.502343 18919 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:40.503085 18918 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:40.487906 26718 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.483608 27274 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:40.499796 27306 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:26:40.488171 27255 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.510365 18916 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:40.504750 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:40.523679 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:40.511096 27135 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.501431 27085 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:26:40.519812 27191 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:26:40.503566 27301 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.520280 27210 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:40.537961 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:40.538498 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63804.3us
I20260709 12:26:40.508244 26718 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.550664 27211 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:26:40.528116 27265 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:26:40.559542 27265 consensus_queue.cc:1243] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 27.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:26:40.560401 27265 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:26:40.560949 27265 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:40.562911 27212 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.562764 27265 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 28.13, Last appended by leader: 13, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.564930 27265 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:40.532234 27191 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.566814 27191 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:40.568418 27194 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:40.569450 27194 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:40.569847 27194 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:40.570847 27194 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.572157 27194 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:40.572544 27293 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:40.574628 27263 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:40.532554 27292 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:40.575861 27292 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:40.576270 27292 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:40.576558 27282 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:40.526871 27119 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:26:40.532297 27167 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
W20260709 12:26:40.580471 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 86402.4us
I20260709 12:26:40.549858 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:40.591192 27167 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:26:40.591321 19457 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.614s (SENT)
I20260709 12:26:40.591840 27167 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:40.593142 27167 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:40.595104 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45664.6us
I20260709 12:26:40.541214 27274 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.636359 27274 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.599311 27250 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.637501 27250 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.638624 27213 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.640421 27250 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.603230 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1395) took 1148 ms. Trace:
I20260709 12:26:40.641243 19489 rpcz_store.cc:276] 0709 12:26:39.455281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.526233 (+ 70952us) service_pool.cc:224] Handling call
0709 12:26:39.528696 (+  2463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:39.529124 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.529157 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:39.529538 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 12:26:40.066952 (+537414us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:40.067051 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.067160 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:40.602896 (+535736us) raft_consensus.cc:1685] finished
0709 12:26:40.602920 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.603144 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6381,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":3044,"thread_start_us":530582,"threads_started":1,"wal-append.queue_time_us":736920}
I20260709 12:26:40.603420 27189 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.647482 27248 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:40.648051 27248 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:40.649166 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:40.606223 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:40.650919 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44803.4us
I20260709 12:26:40.586838 27210 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:40.541870 27228 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:40.620062 26718 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.649035 27248 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.605521 27135 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:40.656584 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.657337 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:40.669165 19483 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
W20260709 12:26:40.668134 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 136041us
I20260709 12:26:40.673210 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:40.673913 19486 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:26:40.674504 27134 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:40.674959 27134 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.675364 27134 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:40.683676 27202 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.657061 27135 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:40.670908 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.696404 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:40.711472 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.720911 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.696015 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.720269 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:40.731628 19486 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:40.733911 19488 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:26:40.702620 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53605.2us
I20260709 12:26:40.720741 27075 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:40.738426 27075 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.739535 27134 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.740845 27075 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:40.753685 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.703631 27036 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:26:40.714267 27301 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.706939 27248 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:40.686362 27202 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:40.766113 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114184us
I20260709 12:26:40.704161 27307 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:40.773818 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.784201 19488 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:40.756187 27263 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:40.688858 27292 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.764423 27277 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:26:40.798077 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.771100 27001 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.003s
I20260709 12:26:40.696199 27191 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.700249 27190 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.808236 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.816612 27307 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:40.819895 27307 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:40.719722 27135 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:40.838474 19486 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
W20260709 12:26:40.840080 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.803416 27134 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.805012 27277 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.695258 18771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:40.798492 27263 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:40.850811 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.823470 27293 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:40.812696 27301 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:40.826417 19488 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:40.824918 27202 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:40.950083 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 378143us
I20260709 12:26:40.953516 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:40.895172 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:40.967036 19483 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:40.893461 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:40.852381 27119 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:40.949236 18771 raft_consensus.cc:606] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:40.851424 26718 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:40.951152 27277 raft_consensus.cc:3060] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:40.883518 27190 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:40.872550 27135 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:40.892143 27191 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:40.971808 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:40.955164 27293 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:41.002108 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.002550 18769 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:26:40.970924 27036 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 30 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:41.009912 27036 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.006318 18766 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:26:40.840072 27210 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 22.20, Last appended by leader: 20, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.011044 27293 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:41.014492 18660 maintenance_manager.cc:419] P bcc1b451ad6147bd802f7cd458a81a5c: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033350
I20260709 12:26:41.023653 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:41.024382 19488 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:41.022274 27292 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:41.034580 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44392.6us
I20260709 12:26:40.970283 27134 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:41.043041 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 71329.4us
I20260709 12:26:40.970572 27119 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:41.049036 18772 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:26:41.041946 19488 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:41.052634 19483 raft_consensus.cc:2468] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:26:41.054173 18886 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:40.972820 26718 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:41.055282 18886 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:41.057724 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:41.036195 27194 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:26:41.065864 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.049789 27090 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:26:41.067919 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51348.5us
W20260709 12:26:41.069617 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.001240 27301 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 12:26:41.072645 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:41.079321 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 399335us
I20260709 12:26:41.079730 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.080593 18769 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:41.055751 27167 raft_consensus.cc:2764] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 12:26:41.073035 18918 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:41.062376 27292 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:26:41.082373 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 189199us
I20260709 12:26:41.071425 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.103034 18919 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:41.084149 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.079430 27315 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 22.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.011s
I20260709 12:26:41.089483 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:41.052940 27134 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:41.103775 18915 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:41.047194 27265 consensus_queue.cc:1059] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:26:41.065332 27001 raft_consensus.cc:2804] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:26:41.046880 27202 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.114344 26718 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.115630 26718 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:41.119052 27134 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:41.120393 18664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 281) took 62928 ms (client timeout 15000 ms). Trace:
I20260709 12:26:41.122733 27292 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:41.119159 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.123885 27292 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.128482 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.133517 18918 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 25: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:41.149314 18769 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:26:41.098991 27090 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:41.158247 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 276561us
I20260709 12:26:41.169699 27090 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.170961 18921 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:26:41.172885 27265 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:41.146436 27194 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:41.175239 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.159526 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.176492 18919 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:41.178520 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.055178 27263 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:41.185657 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46770.4us
I20260709 12:26:41.133029 27001 raft_consensus.cc:697] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:41.196610 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 160230us
I20260709 12:26:41.194834 18769 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:41.202817 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:41.203864 18919 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 30: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:41.173580 27328 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:26:41.182627 27194 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:41.213735 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:41.217396 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.215161 18814 leader_election.cc:400] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:41.218640 18814 leader_election.cc:403] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:26:41.173584 27265 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.222916 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:41.120831 18664 rpcz_store.cc:269] 0709 12:25:38.191644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.198638 (+  6994us) service_pool.cc:224] Handling call
0709 12:25:38.519342 (+320704us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef5090 00007f335af93f3a 00007f3360d49e9c 00007f3360e4804e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc 00007f335f308392 00007f33592c648c 00007f33592c58c6
0709 12:26:41.120160 (+62600818us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:38.274903 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:38.275868 (+   965us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:38.275942 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:26:38.275972 (+    30us) tablet.cc:662] Decoding operations
0709 12:26:38.276795 (+   823us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:38.276910 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:38.276953 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:38.277503 (+   550us) tablet.cc:701] Row locks acquired
0709 12:26:38.277568 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:26:38.277795 (+   227us) write_op.cc:270] Start()
0709 12:26:38.277986 (+   191us) write_op.cc:276] Timestamp: P: 1783599998277711 usec, L: 0
0709 12:26:38.278018 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:26:38.460656 (+182638us) log.cc:844] Serialized 1294 byte log entry
0709 12:26:39.588133 (+1127477us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:39.680852 (+ 92719us) op_driver.cc:464] REPLICATION: finished
0709 12:26:39.682463 (+  1611us) write_op.cc:301] APPLY: starting
0709 12:26:39.682566 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:39.884807 (+202241us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:39.884899 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:39.948715 (+ 63816us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:39.949140 (+   425us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:26:39.949246 (+   106us) write_op.cc:312] APPLY: finished
0709 12:26:39.949904 (+   658us) log.cc:844] Serialized 41 byte log entry
0709 12:26:39.954662 (+  4758us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:40.038242 (+ 83580us) write_op.cc:454] Released schema lock
0709 12:26:40.038339 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:40.039020 (+   681us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:40.039052 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":775863,"reported_tablets":50,"spinlock_wait_cycles":352190208,"child_traces":[["op",{"apply.queue_time_us":1235,"apply.run_cpu_time_us":12133,"apply.run_wall_time_us":356500,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":311051,"prepare.run_cpu_time_us":39682,"prepare.run_wall_time_us":1039202,"raft.queue_time_us":90114,"raft.run_cpu_time_us":1624,"raft.run_wall_time_us":1659,"replication_time_us":1402620,"spinlock_wait_cycles":9183872,"thread_start_us":1175281,"threads_started":4,"wal-append.queue_time_us":852512,"wal-append.run_cpu_time_us":10151,"wal-append.run_wall_time_us":1626743}]]}
I20260709 12:26:41.228808 18915 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:41.222191 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.231215 18918 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:41.200887 27315 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:41.234691 18772 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:41.170065 27119 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:41.249512 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47880.9us
I20260709 12:26:41.251680 18769 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:41.253342 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.254062 18773 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:26:41.258780 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62591.7us
I20260709 12:26:41.259778 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:41.224802 27331 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Stepping down as leader of term 27
W20260709 12:26:41.236654 27228 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.002s
I20260709 12:26:41.271984 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:41.272192 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.273044 18915 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 25: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:41.270411 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61008.6us
I20260709 12:26:41.272328 18773 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
I20260709 12:26:41.239454 27315 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:41.284382 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.285142 18769 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:41.285705 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:41.268532 27331 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:41.294926 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.295677 18768 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:41.299085 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:41.304096 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57326.2us
W20260709 12:26:41.304916 19457 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.467s (SENT)
I20260709 12:26:41.299458 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.307502 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.310770 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.323652 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.325263 18914 raft_consensus.cc:2368] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25.
I20260709 12:26:41.326808 18918 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:41.278689 27326 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:41.328083 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.331336 18920 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:41.332033 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:41.332991 18918 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:41.301470 27264 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:41.333748 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.334303 18769 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:41.330106 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.339290 18770 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:41.337121 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:41.340270 18915 raft_consensus.cc:2393] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 29: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:41.333952 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:41.340306 18887 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.566s (SENT)
I20260709 12:26:41.341253 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:41.303617 27167 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:41.341365 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:41.340319 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:41.344584 18773 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:41.335292 27316 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:41.352917 18767 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:41.350649 27191 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:41.280864 27194 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.353977 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:41.358593 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 98968.3us
I20260709 12:26:41.344735 27321 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.284267 27001 consensus_queue.cc:237] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.402256 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:41.359709 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68918us
I20260709 12:26:41.363286 19486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:26:41.403847 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.404131 19486 raft_consensus.cc:606] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:41.404588 19486 raft_consensus.cc:614] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:41.405120 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 94843.2us
I20260709 12:26:41.365899 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.357070 27194 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:41.372184 27322 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:26:41.373654 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.375276 27228 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:41.378662 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:41.380488 27323 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 12:26:41.382743 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:41.384255 27265 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:41.386672 27327 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:26:41.346778 27330 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:26:41.390938 27263 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:41.391484 27325 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:26:41.391836 27334 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.438486 18765 raft_consensus.cc:2376] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17. Re-sending same reply.
W20260709 12:26:41.407032 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.403899 18920 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:41.354794 27316 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.450640 27316 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:41.452653 18663 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 14 to 17, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 17 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.453989 18768 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:41.418553 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.445855 18769 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:41.448745 27334 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.449753 27119 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:41.348564 27264 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:41.455176 27317 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:41.456576 18663 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 15 to 17, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 17 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.354271 27202 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:41.459529 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.459836 27265 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:41.406235 27321 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.339130 27315 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 22.20, Last appended by leader: 20, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.464640 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.490052 18773 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:41.471194 18921 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:41.477603 18767 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:41.477941 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.348336 27167 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:41.481117 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 142961us
W20260709 12:26:41.481760 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 147135us
W20260709 12:26:41.486891 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.485659 18770 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
W20260709 12:26:41.492636 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61521.7us
W20260709 12:26:41.483415 27248 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.708s	user 0.013s	sys 0.001s
I20260709 12:26:41.505618 18913 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:41.505882 18920 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: []
W20260709 12:26:41.507560 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:41.508006 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.515102 18812 leader_election.cc:400] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:41.520290 18916 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:41.522701 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:41.525420 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:41.489101 27265 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:41.537024 18917 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:26:41.539328 18766 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 20. Ops: [18.15-18.15]
I20260709 12:26:41.506155 27317 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:41.491772 27330 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:26:41.548723 27303 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.490800 27316 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.551791 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:41.553325 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:41.565279 27341 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:26:41.566779 27265 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.568498 27265 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:41.484915 27331 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.571193 27331 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:41.572199 27321 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:41.573294 27329 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:26:41.575599 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.579558 27334 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:41.580931 18772 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
W20260709 12:26:41.582518 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 78142us
W20260709 12:26:41.583225 27277 consensus_meta.cc:287] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.007s
I20260709 12:26:41.583959 27167 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:41.584606 27264 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.586163 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.586764 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.587013 18846 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:41.583704 27277 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.542294 26718 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:41.557547 27135 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.004s
I20260709 12:26:41.611308 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.614166 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.618499 27317 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:41.620860 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:41.620702 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 68987.8us
I20260709 12:26:41.622429 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.624688 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.624940 18772 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:41.626448 27315 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:41.626338 27340 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:26:41.627859 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 94362.5us
I20260709 12:26:41.628697 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:41.629437 18843 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:41.637928 18764 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 28: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:41.639823 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.639943 18768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:41.641567 18768 raft_consensus.cc:606] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:41.635973 18770 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
W20260709 12:26:41.646929 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.617554 27202 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:41.649793 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:41.663520 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.621959 27339 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:41.669358 18887 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.711s (SENT)
I20260709 12:26:41.634526 27340 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:41.671866 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.673007 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.675199 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.679059 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.680096 18663 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:41.686529 27090 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:41.588260 27303 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.710920 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:41.697752 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.682s (SENT)
W20260709 12:26:41.711859 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 62148.1us
I20260709 12:26:41.702286 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:41.702584 18839 raft_consensus.cc:2410] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:26:41.702322 18843 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:41.704620 18772 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:26:41.712726 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:41.705353 18765 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:41.697036 18842 raft_consensus.cc:2376] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20. Re-sending same reply.
I20260709 12:26:41.707262 27277 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:41.700721 18845 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:41.717410 18770 raft_consensus.cc:1275] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:26:41.613055 26718 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.719275 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:41.720693 18768 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:41.726367 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.727421 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.730636 18739 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:41.738054 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.722167 18848 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:41.748132 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.649101 27282 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:41.751375 18843 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 29 because replica has last-logged OpId of term: 28 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 12.
I20260709 12:26:41.756323 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.757083 18768 raft_consensus.cc:2376] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25. Re-sending same reply.
I20260709 12:26:41.761881 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.760504 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.765514 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.784595 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.725452 27189 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:41.724757 27202 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:41.816682 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:41.740507 27250 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:41.834887 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 104368us
I20260709 12:26:41.836577 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.817271 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.816764 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:41.818639 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54994.2us
I20260709 12:26:41.820241 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.820451 27340 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.811812 27228 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:41.822518 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.822979 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.824453 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.825831 27277 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:26:41.831974 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 346256us
I20260709 12:26:41.855393 18840 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 24: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:41.856169 18848 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:41.862902 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:41.864884 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 195618us
W20260709 12:26:41.865749 18887 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.795s (SENT)
W20260709 12:26:41.866894 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.850s (SENT)
I20260709 12:26:41.867296 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:41.870601 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.874289 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:41.716985 27339 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:41.819310 27134 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:41.840971 18739 leader_election.cc:400] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25.
I20260709 12:26:41.845078 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.848104 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.849517 27321 consensus_queue.cc:1048] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:41.884629 18839 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 12:26:41.850778 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.885577 18846 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:41.879150 18739 leader_election.cc:403] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:26:41.768085 27282 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:41.881637 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:41.891167 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54688us
I20260709 12:26:41.891299 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.894244 18840 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:41.895704 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:41.896155 18839 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:41.814105 27248 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:41.895047 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.835044 27191 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 12:26:41.901914 18922 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:26:41.903177 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:41.904023 18839 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:41.904548 18739 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:41.908900 18772 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:41.869223 27277 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:41.910492 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.912851 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.916213 18843 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:26:41.843544 27250 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:41.922358 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55486.8us
I20260709 12:26:41.891407 27210 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:41.918898 18845 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:41.938256 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.946869 18843 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:26:41.916399 27228 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:41.993192 18840 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:26:41.996428 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46219us
W20260709 12:26:41.997473 19457 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.682s (SENT)
I20260709 12:26:41.997730 18842 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:41.954583 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.958292 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:41.911670 27357 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25.
I20260709 12:26:41.962807 18659 maintenance_manager.cc:643] P bcc1b451ad6147bd802f7cd458a81a5c: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.942s	user 0.038s	sys 0.031s Metrics: {"bytes_written":5775,"delete_count":0,"lbm_write_time_us":1048,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":58334,"threads_started":1,"update_count":216,"wal-append.queue_time_us":87597}
I20260709 12:26:41.997956 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:41.958822 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:41.917495 27316 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:41.952828 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:41.926330 27340 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:42.010766 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:41.917614 27292 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
W20260709 12:26:42.023847 18887 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.895s (SENT)
I20260709 12:26:42.037849 18767 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:26:42.040864 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:42.042285 19488 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 28: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:42.002768 27359 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:42.009305 27320 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:42.012363 18840 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 29 because replica has last-logged OpId of term: 28 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 10.
I20260709 12:26:41.945616 27202 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:26:42.003129 27322 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:26:42.010418 27228 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:42.016989 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64337.5us
W20260709 12:26:42.056813 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.020442 27189 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:42.062673 18660 maintenance_manager.cc:419] P bcc1b451ad6147bd802f7cd458a81a5c: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.303734
I20260709 12:26:42.062999 18839 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
W20260709 12:26:42.063598 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 104836us
I20260709 12:26:42.037380 27036 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:42.067183 19483 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:26:42.071403 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.071641 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.072130 18840 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:42.072876 18839 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:42.060665 27293 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.002s	user 0.008s	sys 0.008s
W20260709 12:26:42.078624 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.074656 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:42.084434 27326 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.741s	user 0.013s	sys 0.000s
I20260709 12:26:42.085011 27326 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:42.087778 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.088467 18842 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:42.092958 18844 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 12:26:42.094012 27331 consensus_meta.cc:287] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 12:26:42.065951 26718 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:42.098011 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.070804 27202 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:42.100843 18839 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:42.101918 18841 raft_consensus.cc:2410] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 28 because replica has last-logged OpId of term: 27 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 15.
I20260709 12:26:42.106602 18842 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:42.061605 27359 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.110227 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:42.112372 27358 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:26:42.113124 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.117537 18840 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:42.082021 27293 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.142802 18839 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:42.148129 18844 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:42.153627 18839 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
W20260709 12:26:42.139123 27265 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.002s
I20260709 12:26:42.115293 27303 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:42.156028 27353 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:26:42.070452 27277 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:42.167449 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 143669us
I20260709 12:26:42.170100 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:42.171191 18844 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:42.155561 27339 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:42.175629 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.910s (SENT)
W20260709 12:26:42.179069 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 109527us
W20260709 12:26:42.180797 27119 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.004s
I20260709 12:26:42.194677 27202 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.197221 27250 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:42.200198 27090 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:26:42.203819 18846 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:42.176564 27282 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:42.155036 27228 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.214879 18846 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:26:42.203369 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 107341us
W20260709 12:26:42.220534 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:42.223855 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48279.1us
I20260709 12:26:42.223775 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:42.227881 27359 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:42.228157 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:42.228585 27359 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.229230 27359 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.231082 27366 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:42.231938 27366 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:42.232333 27366 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:42.165707 27189 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.232749 27366 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:42.240887 18663 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 16 to 19, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 19 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:42.244736 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.251704 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.252795 18846 raft_consensus.cc:2410] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:26:42.261176 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:42.262248 27250 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:26:42.262739 27250 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:42.262923 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 132848us
I20260709 12:26:42.263188 27250 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:42.266639 27317 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:42.267642 27316 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:42.268062 27317 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:42.268510 27317 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:42.268524 27316 consensus_queue.cc:1243] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 25.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:26:42.203037 27036 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.041s
I20260709 12:26:42.273473 27282 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.274115 27282 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.277034 27001 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:42.277637 27001 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:42.278756 27001 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.280992 27255 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:42.281658 27255 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:42.269565 27317 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.282927 27255 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:42.284336 27317 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:42.284924 27255 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:42.286731 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.287720 18846 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 29 because replica has last-logged OpId of term: 28 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 12.
I20260709 12:26:42.288473 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:42.289173 27282 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:42.289201 18843 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:42.289556 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.291528 27134 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:42.291852 27292 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:42.292207 27134 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:42.293301 27134 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.295459 27366 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:42.292306 27292 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:42.297030 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:42.297204 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.298265 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:42.301673 18914 raft_consensus.cc:2368] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24.
I20260709 12:26:42.301805 18846 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:26:42.300647 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.308260 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.308660 18920 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:42.308736 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:42.309123 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.309511 18913 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:42.310354 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.291889 27001 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:42.311982 18918 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:26:42.312342 18918 pending_rounds.cc:85] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 12
I20260709 12:26:42.312598 18918 pending_rounds.cc:107] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:26:42.312862 18918 raft_consensus.cc:2889] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:42.317154 27366 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:42.300623 27303 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.319347 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:42.310045 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.321338 18920 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:26:42.322352 18916 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
I20260709 12:26:42.323830 27191 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:26:42.299679 18848 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:42.320597 27359 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:42.333699 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 264659us
I20260709 12:26:42.334486 18814 leader_election.cc:400] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24.
I20260709 12:26:42.334936 18814 leader_election.cc:403] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:26:42.335875 18773 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 30.
I20260709 12:26:42.321679 18913 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:42.342974 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:42.331151 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 149918us
I20260709 12:26:42.319765 27303 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:42.347347 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:42.364213 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:42.365002 18841 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:42.324911 27135 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.362625 18814 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:42.365849 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.372114 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.373251 18845 raft_consensus.cc:2410] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
W20260709 12:26:42.379138 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.338035 27250 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:42.422552 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:42.410415 19457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.979s (SENT) [suppressed 44 similar messages]
I20260709 12:26:42.343474 27326 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:26:42.430801 18845 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:42.431699 18841 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:26:42.445189 18846 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:42.469348 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:42.470059 27293 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:42.470750 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.471946 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:42.472788 18771 raft_consensus.cc:2368] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:42.475073 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:42.475622 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.476478 18914 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 24: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:42.476620 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.477517 18922 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:42.477788 18914 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:26:42.477914 27264 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:42.478204 18914 pending_rounds.cc:85] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 14
I20260709 12:26:42.448009 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:42.451309 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.508741 18845 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:42.453485 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.453089 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:42.375010 27277 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:42.460084 27357 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.460419 27250 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:42.374569 27316 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:26:42.463088 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.520422 18919 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:42.464105 19483 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:42.464012 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.465180 19488 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:42.464893 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:42.465606 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:42.524485 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.368373 27331 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24.
I20260709 12:26:42.466538 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.467833 27336 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:42.478333 27264 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:42.479843 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.480567 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:42.482357 18847 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:26:42.483265 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:42.483307 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 136060us
I20260709 12:26:42.484676 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:42.483160 18846 raft_consensus.cc:2376] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23. Re-sending same reply.
I20260709 12:26:42.486056 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:42.487705 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:42.529556 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.530040 18769 raft_consensus.cc:2368] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:42.482424 27292 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.380754 27347 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:42.485107 18887 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.681s (SENT)
I20260709 12:26:42.549422 18921 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:42.491806 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:42.550529 19491 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:42.493292 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:42.493606 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.551345 19490 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:42.494709 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:42.495932 27364 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.466s	user 0.001s	sys 0.003s
I20260709 12:26:42.498345 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:42.565658 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.499699 27036 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:26:42.501580 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.361346 27359 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:42.434370 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:42.504521 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:42.508034 18914 pending_rounds.cc:107] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:26:42.569168 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:42.569819 18914 raft_consensus.cc:2889] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:42.508574 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:42.455915 27248 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:42.514911 18844 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:42.526726 27316 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:42.519438 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.377270 27135 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:42.527046 18920 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:42.527119 18766 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:26:42.530560 18842 raft_consensus.cc:2368] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26.
W20260709 12:26:42.547552 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.547758 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:42.582342 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:42.571455 18771 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 28. Current term is 29. Ops: [24.11-28.13]
I20260709 12:26:42.516780 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:42.576599 19484 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:42.570250 18764 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
W20260709 12:26:42.577683 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 521726us
I20260709 12:26:42.573454 19489 raft_consensus.cc:2368] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:42.594012 18773 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:42.598135 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:42.599712 27264 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:42.600996 27264 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:42.601027 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:42.603639 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:42.605731 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:42.519750 27357 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.610154 18772 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:42.610700 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:42.611358 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 245349us
I20260709 12:26:42.610240 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:42.625150 18913 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:42.626057 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.586947 27316 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:26:42.580410 18812 connection.cc:256] RPC call timeout handler was delayed by -2.2838621440000679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 12:26:42.631191 18812 connection.cc:256] RPC call timeout handler was delayed by -2.0309621440001138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:26:42.631632 18812 connection.cc:256] RPC call timeout handler was delayed by -1.9670621440000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 12:26:42.632004 18812 connection.cc:256] RPC call timeout handler was delayed by -1.9508621439999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:26:42.632381 18812 connection.cc:256] RPC call timeout handler was delayed by -1.9040621440003633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
I20260709 12:26:42.628297 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:42.633009 18812 connection.cc:256] RPC call timeout handler was delayed by -1.7600621440001305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 12:26:42.633315 18812 connection.cc:256] RPC call timeout handler was delayed by -1.749262144000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 12:26:42.634552 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 315294us
I20260709 12:26:42.635272 18921 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:42.635459 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:42.640239 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 179298us
I20260709 12:26:42.638481 18772 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: [24.12-24.12]
W20260709 12:26:42.640463 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 155386us
I20260709 12:26:42.677160 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:42.630962 27326 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.637831 27282 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:42.639343 27330 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.710588 19486 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:42.776557 27330 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.674535 27293 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:42.779117 27293 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:42.780221 27293 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.636755 26718 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.714116 27282 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.714296 27373 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:42.825352 27282 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:42.764365 27357 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:42.825704 18921 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: []
W20260709 12:26:42.773126 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 137754us
I20260709 12:26:42.826975 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:42.715791 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:42.725189 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:42.827915 19492 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:26:42.733063 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.729419 19491 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:42.797688 18767 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:42.814697 18841 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
W20260709 12:26:42.822232 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.830471 18772 raft_consensus.cc:2393] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:26:42.720759 27374 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:26:42.657919 27191 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:42.832785 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:42.839128 18772 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:42.756961 27292 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:42.823721 27001 consensus_meta.cc:287] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.512s	user 0.001s	sys 0.010s
I20260709 12:26:42.845444 18844 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:26:42.747941 27379 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:42.847908 18738 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:42.740509 27135 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:42.746753 27303 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:42.825539 27373 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:42.820502 27210 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:42.855383 27248 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:42.868705 27248 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:42.875650 27379 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:42.877235 18772 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:26:42.880285 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:42.846009 27380 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:42.820366 27340 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:26:42.784848 27326 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.876840 27379 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:42.894819 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 183966us
I20260709 12:26:42.828895 26718 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:42.888144 19486 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:42.885059 27359 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:42.917934 18772 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 27. Current term is 28. Ops: []
I20260709 12:26:42.913818 27202 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:42.869928 27248 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:42.929381 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:42.935513 18839 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:26:42.933123 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:42.935462 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 325524us
I20260709 12:26:42.933760 27277 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:26:42.944077 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:42.945339 18767 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 17.
W20260709 12:26:42.939860 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 262215us
W20260709 12:26:42.952267 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.957783 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:42.967926 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:42.918968 27380 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:42.972889 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:42.934957 27359 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:42.983386 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.938952 27202 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:42.966642 27228 raft_consensus.cc:2764] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:26:42.997625 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:43.000175 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:43.000770 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:43.001366 18767 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:42.939131 27189 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:26:42.983234 27210 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:43.008318 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:43.010277 18772 raft_consensus.cc:2393] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:42.989781 27330 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:42.992406 27340 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.982151 27090 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 12:26:43.016323 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:42.999447 27119 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:43.003382 27135 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:26:42.940937 27191 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 27.12, Last appended by leader: 12, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.033268 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:43.037267 18767 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:43.027045 18914 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:43.034437 18772 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
W20260709 12:26:43.043628 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 110504us
W20260709 12:26:43.028239 27317 consensus_meta.cc:287] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.003s
I20260709 12:26:42.981495 27373 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.064095 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:43.045094 27202 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:43.053943 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.058769 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:43.021735 27228 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:26:43.082154 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84650.5us
I20260709 12:26:43.027863 27386 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:43.028007 27135 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:43.091683 19488 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:26:43.092159 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.096803 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:43.092504 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82411.3us
I20260709 12:26:43.022136 27340 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.117182 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:43.117990 18772 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:26:43.116276 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:43.138294 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:43.150315 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:43.159271 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.131033 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:43.094600 27228 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.094851 27330 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:43.087821 27303 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:43.168288 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 71596.9us
I20260709 12:26:43.094777 27386 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:43.169869 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 152883us
I20260709 12:26:43.114719 27135 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:43.047248 27359 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.206565 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:43.207621 18772 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:26:43.211024 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:43.211815 18772 raft_consensus.cc:2376] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22. Re-sending same reply.
I20260709 12:26:43.180068 27228 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:43.175426 27090 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:43.182874 26718 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:43.183574 27330 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:43.190872 27390 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:26:43.169293 27326 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:43.181476 27320 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:43.218997 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:43.056318 27380 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.226265 18767 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:26:43.228314 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:43.188431 27386 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:43.226617 27090 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:43.233367 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 137258us
I20260709 12:26:43.238157 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:43.257387 18772 raft_consensus.cc:2376] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25. Re-sending same reply.
I20260709 12:26:43.238602 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:43.258522 18768 raft_consensus.cc:2376] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28. Re-sending same reply.
I20260709 12:26:43.212420 27210 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:43.189797 27369 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.041s
I20260709 12:26:43.224229 27317 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:43.266815 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:43.252513 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 153627us
W20260709 12:26:43.224843 27387 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:26:43.259441 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:43.215430 27388 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:43.191083 27303 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:43.253829 27320 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:43.269325 18887 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:43.271176 18772 raft_consensus.cc:2393] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 28: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:43.231403 27330 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:43.252338 18765 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 27. Current term is 28. Ops: []
I20260709 12:26:43.276099 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:43.270092 27320 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:43.280557 19492 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:26:43.283556 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:43.291682 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:43.292098 18773 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:43.296813 18771 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:43.303213 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43883.1us
I20260709 12:26:43.311002 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:43.313810 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44566.6us
I20260709 12:26:43.319778 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:43.296355 26718 raft_consensus.cc:2764] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:26:43.308123 27389 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:43.319314 27409 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:43.326565 27347 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:43.344681 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 68748.3us
W20260709 12:26:43.330633 27391 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 12:26:43.354828 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:43.328828 27326 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:43.371388 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:43.376559 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:43.383013 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:43.393042 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.345091 27409 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.364032 27389 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:43.397572 19486 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:26:43.401820 18765 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:26:43.402107 18770 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:43.366129 27340 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:43.407177 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:43.407531 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.408100 18771 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:26:43.415666 19491 raft_consensus.cc:1275] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:26:43.416144 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:43.417270 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:43.420344 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 85213.3us
I20260709 12:26:43.418010 19485 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:43.425735 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:43.402205 27293 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:43.397495 27409 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:43.433655 27316 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.002s
I20260709 12:26:43.371467 27411 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.056s
I20260709 12:26:43.408802 27389 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:43.440411 27389 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.376713 27326 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:43.363929 27090 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.409546 27401 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.465665 27418 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:43.345247 27210 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.468317 27326 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:43.425094 27347 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:43.434180 27316 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:43.607951 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57836.9us
I20260709 12:26:43.609380 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:43.611881 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.551826 27340 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:43.629019 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 220052us
W20260709 12:26:43.643131 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 214984us
I20260709 12:26:43.512689 27411 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.150s
W20260709 12:26:43.667790 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 251517us
I20260709 12:26:43.675303 18913 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:26:43.680646 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58808.3us
I20260709 12:26:43.512233 27401 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:43.657250 27282 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.831s	user 0.015s	sys 0.000s
I20260709 12:26:43.681303 27413 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:26:43.687798 27423 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.688375 27360 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.636232 27419 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.689603 18917 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:43.689630 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:43.693612 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.695545 27282 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:43.744997 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 71995.6us
I20260709 12:26:43.692831 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:43.698783 27347 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:43.738263 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 129022us
I20260709 12:26:43.740552 27360 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:43.702740 27357 raft_consensus.cc:993] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:26:43.761176 18919 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:26:43.644716 27330 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.753417 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:43.703640 27388 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:43.768006 27388 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:43.769599 27388 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:26:43.771176 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.852s (SENT)
I20260709 12:26:43.774878 27408 raft_consensus.cc:1081] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
W20260709 12:26:43.775163 27292 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.917s	user 0.014s	sys 0.000s
I20260709 12:26:43.774758 27414 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.742847 27423 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:43.843974 19457 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.596s (SENT)
I20260709 12:26:43.844704 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:43.878682 27431 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:26:43.881368 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 128026us
I20260709 12:26:43.881664 27439 raft_consensus.cc:2764] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:26:43.882519 27414 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.884372 27441 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:43.885557 27414 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:43.893639 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49743.2us
W20260709 12:26:43.896317 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 205976us
I20260709 12:26:43.769476 27401 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:43.898882 27435 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:43.900013 27415 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.423s	user 0.001s	sys 0.000s
W20260709 12:26:43.901100 27430 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:26:43.903359 27410 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:43.908128 27282 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:43.909404 27228 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.002s
I20260709 12:26:43.887076 27119 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:43.897617 27135 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.003s
I20260709 12:26:43.910780 27398 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:43.755081 27419 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.912778 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:43.948601 27330 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:43.951021 27393 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.828s	user 0.013s	sys 0.000s
I20260709 12:26:43.956593 27135 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:43.886309 27414 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:26:43.959306 27135 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:43.962740 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 2046) took 1167 ms. Trace:
I20260709 12:26:43.963234 18915 rpcz_store.cc:276] 0709 12:26:42.795675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.795834 (+   159us) service_pool.cc:224] Handling call
0709 12:26:42.835687 (+ 39853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:42.836684 (+   997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.836717 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:42.851229 (+ 14512us) log.cc:844] Serialized 26 byte log entry
0709 12:26:43.081754 (+230525us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:26:43.081817 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.081929 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:43.950382 (+868453us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:43.962350 (+ 11968us) raft_consensus.cc:1685] finished
0709 12:26:43.962374 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.962664 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":575,"raft.queue_time_us":39355,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":10710272,"thread_start_us":214910,"threads_started":1,"wal-append.queue_time_us":255797}
W20260709 12:26:43.916033 27386 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.004s
I20260709 12:26:43.769362 27316 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:43.874300 27340 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:43.929528 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 172318us
I20260709 12:26:43.930637 18772 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 27. Current term is 28. Ops: []
I20260709 12:26:43.889086 27255 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.999516 18914 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
W20260709 12:26:44.000329 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:43.933033 19457 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.961s (SENT)
I20260709 12:26:43.998178 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:44.006049 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:44.010747 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:44.012734 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 100052us
W20260709 12:26:44.013567 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 80591.1us
W20260709 12:26:44.014799 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.707s (SENT)
I20260709 12:26:43.945856 27228 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.014770 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:44.019603 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.015722 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:43.999012 27293 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:44.011104 27135 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:43.936303 27435 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.034168 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:44.047703 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.003500 27340 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.011871 27255 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.026033 27293 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:44.052614 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:44.002105 27386 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.052803 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:44.067644 27282 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:44.062485 18812 leader_election.cc:400] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:44.045513 27380 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:26:44.060367 27228 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:44.061478 27425 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 12:26:44.045879 27135 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.062112 27428 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:26:44.060599 27340 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:44.061040 27446 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:44.058485 27293 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:44.093132 27135 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:44.103221 27436 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
I20260709 12:26:44.104111 27448 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:26:44.104594 27448 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:44.058034 27383 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:44.105414 27383 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:44.106108 27383 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:44.106920 27446 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:44.108011 27446 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.093294 27442 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:26:44.114835 27380 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:44.116070 27380 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.074931 27452 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.033919 27036 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:26:44.078927 19457 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.835s (SENT)
I20260709 12:26:44.079243 27419 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:44.088654 18812 leader_election.cc:403] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:26:44.119220 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:44.119704 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 63018.1us
I20260709 12:26:44.120052 27360 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:44.120460 19457 leader_election.cc:336] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.877s (SENT)
I20260709 12:26:44.120802 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:44.120913 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:44.122566 27036 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:44.123354 27316 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:44.124171 27316 raft_consensus.cc:2764] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:26:44.125455 27255 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:44.123208 27036 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:44.126072 27090 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:44.126704 27090 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.127249 27386 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:44.129034 27090 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:44.131539 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:44.133857 27428 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.134505 27428 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.134964 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:44.135627 18847 raft_consensus.cc:2376] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25. Re-sending same reply.
I20260709 12:26:44.136813 27428 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:44.137730 27402 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:44.138306 27402 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.138783 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.139073 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.139477 18839 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:44.139705 18847 raft_consensus.cc:2376] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20. Re-sending same reply.
W20260709 12:26:44.140033 27432 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.451s	user 0.002s	sys 0.000s
I20260709 12:26:44.140683 27402 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:44.141274 18844 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:26:44.105508 27448 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.152525 27001 consensus_queue.cc:1048] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:26:44.153103 27448 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:44.153491 27435 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:44.163425 27416 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.757s	user 0.017s	sys 0.015s
I20260709 12:26:44.165572 18769 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 25. Current term is 26. Ops: []
W20260709 12:26:44.166164 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 73225.4us
I20260709 12:26:44.117556 27293 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:44.232306 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59308.3us
I20260709 12:26:44.235282 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:44.274034 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.278800 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.279774 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.280393 18767 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:44.285175 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:41954
I20260709 12:26:44.285921 18919 raft_consensus.cc:606] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:44.286266 18919 raft_consensus.cc:614] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:44.291479 27385 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:44.291241 27443 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:26:44.296094 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.296950 18839 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 24: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:44.297933 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.298151 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:44.298727 18839 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:44.298733 18841 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:44.317437 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:44.318457 18844 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:44.300015 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.272388 27386 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:44.348063 18847 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:44.348220 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.350430 18846 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:44.354336 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.355166 18848 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:44.278481 27255 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.015s
I20260709 12:26:44.363745 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.363745 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.364642 18842 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:44.291923 27385 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:44.367117 18843 raft_consensus.cc:2410] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 25 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:26:44.367220 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.367643 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:44.368132 18845 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:44.368494 18840 raft_consensus.cc:2376] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22. Re-sending same reply.
W20260709 12:26:44.340826 27409 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.864s	user 0.006s	sys 0.006s
W20260709 12:26:44.379716 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.384225 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.385211 18842 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 17.
I20260709 12:26:44.378961 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.387261 18847 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 24: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:44.257531 27452 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.390574 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.391434 18848 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:44.391683 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:44.392611 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:44.394770 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.395879 18846 raft_consensus.cc:2393] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:44.390780 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:44.403244 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:44.375567 27419 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.416138 18841 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:44.366063 27386 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.426266 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.446226 18841 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
W20260709 12:26:44.475807 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:44.482473 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:44.504755 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.388013 27409 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.505820 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.518956 18846 raft_consensus.cc:2393] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:26:44.506951 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.416827 27419 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.541824 19487 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:44.543592 27419 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:44.519399 27134 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:44.554953 27134 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.557528 27134 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:44.567734 27386 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:44.506753 27380 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:44.571046 27380 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.573454 27380 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:44.574738 27293 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:44.576303 27452 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:44.496971 27385 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:44.579582 27409 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:44.518560 27135 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.582533 27135 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:44.583469 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.586609 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.587034 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.587296 18845 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:44.587955 18841 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:26:44.597334 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:44.598188 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.598372 18770 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:26:44.600770 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.602108 18844 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:44.602298 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.607635 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.613451 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.615671 18764 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:44.620487 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.621301 18769 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:44.623298 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:44.624445 18846 raft_consensus.cc:2410] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 25 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:26:44.637931 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:44.650025 19457 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.979s (SENT)
I20260709 12:26:44.650755 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:44.639238 18764 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:44.667112 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:44.673012 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:44.674437 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.679948 18765 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:26:44.681360 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.695593 18764 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:26:44.704754 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:44.705796 18769 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:26:44.711444 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:44.717523 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:44.718346 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:44.718998 18768 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:44.720434 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:44.734328 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:44.736112 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:44.737711 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:44.679558 27328 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:44.771824 18738 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.593s (SENT)
W20260709 12:26:44.832036 27458 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:26:44.832341 18916 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 27. Current term is 28. Ops: []
I20260709 12:26:44.832196 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:44.833237 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:44.833815 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:44.835376 27392 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 1.769s	user 0.002s	sys 0.014s
W20260709 12:26:44.837038 27461 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.314s	user 0.000s	sys 0.000s
I20260709 12:26:44.821969 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:44.835526 18659 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.318s	user 0.000s	sys 0.000s
I20260709 12:26:44.856842 18764 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:44.860730 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 88964.9us
W20260709 12:26:44.861855 18738 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.599s (SENT)
I20260709 12:26:44.866547 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:44.867504 18769 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:44.870510 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:44.872725 18738 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.648s (SENT)
I20260709 12:26:44.873579 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:44.883428 18918 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 12:26:44.903990 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52083.8us
I20260709 12:26:44.910559 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 1419) took 1513 ms. Trace:
I20260709 12:26:44.911158 19487 rpcz_store.cc:276] 0709 12:26:43.397132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.397254 (+   122us) service_pool.cc:224] Handling call
0709 12:26:44.910279 (+1513025us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400788554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:44.910449 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2581823744}
I20260709 12:26:44.914937 27425 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:44.915623 27425 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:44.716897 27293 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.566371 27383 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:44.961915 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 137962us
I20260709 12:26:44.823462 27228 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:44.965267 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:44.966306 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:44.970315 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.983079 18915 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:44.970530 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.714625 27448 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.220s
I20260709 12:26:44.994947 18919 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
W20260709 12:26:44.995967 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.974570 27403 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:45.023005 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57887.3us
I20260709 12:26:45.025153 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:44.738345 18913 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:45.004236 27463 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:26:44.963411 27293 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:45.129070 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:45.142043 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 116996us
I20260709 12:26:45.144387 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:45.084757 19492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.023s
W20260709 12:26:45.145516 19492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.000s	sys 0.024s
W20260709 12:26:45.153460 19489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.122s	sys 0.208s
W20260709 12:26:45.154072 19489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.122s	sys 0.208s
W20260709 12:26:45.155681 18770 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.000s
I20260709 12:26:45.156203 18770 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
W20260709 12:26:45.085157 27379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.763s	user 0.025s	sys 0.012s
I20260709 12:26:44.998243 27228 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.092407 27452 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:45.081300 27282 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.185135 18768 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:26:45.159978 27336 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:45.175426 27379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.860s	user 0.026s	sys 0.013s
I20260709 12:26:45.147874 27403 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.277242 18769 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
W20260709 12:26:45.247397 18766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.011s	sys 0.018s
W20260709 12:26:45.295706 18766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.013s	sys 0.018s
I20260709 12:26:45.218295 18915 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:45.249400 18913 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:45.164330 27135 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:45.199440 27452 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:45.311162 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.000s	sys 0.020s
I20260709 12:26:45.215243 27448 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:45.316341 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.000s	sys 0.020s
I20260709 12:26:45.250263 27303 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.315191 27135 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.320087 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1671) took 1269 ms. Trace:
W20260709 12:26:45.359220 19485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.017s	sys 0.018s
W20260709 12:26:45.361500 19485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.017s	sys 0.019s
I20260709 12:26:45.314561 27452 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:45.378048 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.349406 19492 rpcz_store.cc:276] 0709 12:26:44.051125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.051288 (+   163us) service_pool.cc:224] Handling call
0709 12:26:44.064176 (+ 12888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.415211 (+351035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.415264 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:44.448732 (+ 33468us) log.cc:844] Serialized 26 byte log entry
0709 12:26:45.146093 (+697361us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:45.146155 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.146259 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.319830 (+173571us) raft_consensus.cc:1685] finished
0709 12:26:45.319860 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.320018 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44868,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":95,"thread_start_us":951763,"threads_started":2,"wal-append.queue_time_us":793964}
W20260709 12:26:45.384481 18922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.033s	sys 0.012s
W20260709 12:26:45.386201 18922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.033s	sys 0.013s
I20260709 12:26:45.249506 27282 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.361783 27383 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:45.421579 18764 consensus_meta.cc:287] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 12:26:45.422160 18764 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:45.425638 27381 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:45.426378 27381 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.428939 27381 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.429587 27381 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.429711 27421 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:45.433265 18920 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.076s
W20260709 12:26:45.439173 18920 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.013s	sys 0.076s
W20260709 12:26:45.443827 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.003s	sys 0.059s
W20260709 12:26:45.444396 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.003s	sys 0.059s
I20260709 12:26:45.428892 27189 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:26:45.446594 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.430162 27381 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.468616 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.430270 27421 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.440343 27264 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.471706 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.475386 18846 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 24: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:45.471706 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:45.478863 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.438438 27293 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.481400 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.479725 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.482312 18842 raft_consensus.cc:2376] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24. Re-sending same reply.
I20260709 12:26:45.484341 27293 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.484565 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.485374 18844 raft_consensus.cc:2368] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26.
I20260709 12:26:45.485064 27293 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.486991 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.488292 18841 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:26:45.442515 27228 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.493981 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.494726 18845 raft_consensus.cc:2376] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22. Re-sending same reply.
I20260709 12:26:45.498546 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.499663 18848 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 20: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:45.491878 27466 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 12:26:45.498590 18840 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.009s	sys 0.028s
W20260709 12:26:45.503139 18840 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.009s	sys 0.028s
I20260709 12:26:45.506982 18844 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:45.509969 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3595) took 1501 ms. Trace:
I20260709 12:26:45.479458 27264 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.514775 18844 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:26:45.504055 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 359755us
I20260709 12:26:45.512965 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1504) took 1103 ms. Trace:
I20260709 12:26:45.517398 18840 rpcz_store.cc:276] 0709 12:26:44.410147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.410568 (+   421us) service_pool.cc:224] Handling call
0709 12:26:44.445947 (+ 35379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.446308 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.446336 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:44.459010 (+ 12674us) log.cc:844] Serialized 26 byte log entry
0709 12:26:44.855203 (+396193us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:45.506762 (+651559us) log.cc:844] Serialized 14 byte log entry
0709 12:26:45.507014 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.507102 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.507150 (+    48us) raft_consensus.cc:1685] finished
0709 12:26:45.507162 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.507311 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":4145,"raft.run_wall_time_us":60870,"thread_start_us":876193,"threads_started":2,"wal-append.queue_time_us":748348}
I20260709 12:26:45.500631 27403 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.522722 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.529960 18841 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:45.504009 27135 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.531409 18844 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:26:45.510623 18772 rpcz_store.cc:276] 0709 12:26:44.008253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.008381 (+   128us) service_pool.cc:224] Handling call
0709 12:26:44.008690 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.008888 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:26:44.012844 (+  3956us) log.cc:844] Serialized 14 byte log entry
0709 12:26:45.163424 (+1150580us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b1800430240. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b23a 00007f335af95a2a
0709 12:26:45.503105 (+339681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:45.503181 (+    76us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:26:45.509614 (+  6433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.509702 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.509871 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2773,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"spinlock_wait_cycles":2360192,"thread_start_us":339402,"threads_started":1}
W20260709 12:26:45.539237 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 666519us
W20260709 12:26:45.539944 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.004s	sys 0.037s
W20260709 12:26:45.540273 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.004s	sys 0.037s
W20260709 12:26:45.543681 18738 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.666s (SENT)
I20260709 12:26:45.550904 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1422) took 1196 ms. Trace:
I20260709 12:26:45.551563 19491 rpcz_store.cc:276] 0709 12:26:44.354512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.356179 (+  1667us) service_pool.cc:224] Handling call
0709 12:26:44.381665 (+ 25486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.405006 (+ 23341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.405041 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:44.417412 (+ 12371us) log.cc:844] Serialized 26 byte log entry
0709 12:26:44.753697 (+336285us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:44.753760 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.753855 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.550525 (+796670us) raft_consensus.cc:1685] finished
0709 12:26:45.550561 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.550789 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72079,"raft.queue_time_us":25459,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":26208,"thread_start_us":255428,"threads_started":1,"wal-append.queue_time_us":753636}
W20260709 12:26:45.562100 18738 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.679s (SENT)
I20260709 12:26:45.562687 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:45.600401 27478 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:45.603157 27478 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.603860 27478 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:45.561937 27465 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:26:45.608925 18840 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:26:45.616986 18840 pending_rounds.cc:85] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 12
I20260709 12:26:45.617267 18840 pending_rounds.cc:107] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:26:45.617614 18840 raft_consensus.cc:2889] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:45.613246 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 51173.1us
I20260709 12:26:45.553164 27293 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:45.615576 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.621371 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:45.622545 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:45.631054 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:45.645012 27293 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.647855 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:45.650192 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:45.639135 27468 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:26:45.663116 27347 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:45.663447 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3602) took 1240 ms. Trace:
I20260709 12:26:45.663641 27347 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.664072 27347 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:45.664932 18847 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:26:45.637964 27481 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:45.666378 27481 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.667050 18842 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:45.663823 18766 rpcz_store.cc:276] 0709 12:26:44.423438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.423587 (+   149us) service_pool.cc:224] Handling call
0709 12:26:44.445396 (+ 21809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.447671 (+  2275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.447714 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:44.503370 (+ 55656us) log.cc:844] Serialized 26 byte log entry
0709 12:26:45.296157 (+792787us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:45.296204 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.296290 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.663211 (+366921us) raft_consensus.cc:1685] finished
0709 12:26:45.663232 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.663385 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1919,"raft.queue_time_us":1454,"raft.run_cpu_time_us":1226,"raft.run_wall_time_us":42554,"thread_start_us":737195,"threads_started":1,"wal-append.queue_time_us":848021}
I20260709 12:26:45.668859 27481 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:45.669237 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:45.639036 27467 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:26:45.669863 18839 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:45.609581 27474 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:45.671015 27474 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.650113 27293 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.673262 27474 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.673415 27421 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.673851 27474 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.652009 27255 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:45.675192 18843 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:26:45.675143 27255 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.675629 27282 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.676414 27282 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.676584 18843 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:45.677177 27135 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.677522 27255 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:45.677697 27135 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.655426 27423 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.678216 27264 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.678741 27423 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.668190 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.679179 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1425) took 1307 ms. Trace:
I20260709 12:26:45.676919 27282 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.610203 27414 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:45.668891 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.652673 18845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:45.680141 18846 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:45.680573 18845 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:45.681025 18845 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:45.681529 18738 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.700s (SENT)
I20260709 12:26:45.679657 19489 rpcz_store.cc:276] 0709 12:26:44.372024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.372155 (+   131us) service_pool.cc:224] Handling call
0709 12:26:44.372627 (+   472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:44.382978 (+ 10351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.383028 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:44.383796 (+   768us) log.cc:844] Serialized 52 byte log entry
0709 12:26:45.154683 (+770887us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:45.154746 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.154845 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.678909 (+524064us) raft_consensus.cc:1685] finished
0709 12:26:45.678935 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.679098 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14077,"raft.queue_time_us":15280,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8845,"spinlock_wait_cycles":1014528,"thread_start_us":739276,"threads_started":1,"wal-append.queue_time_us":986855}
W20260709 12:26:45.647418 27471 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:26:45.686197 27414 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.687300 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1423) took 1332 ms. Trace:
W20260709 12:26:45.688203 18914 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3559) took 2014 ms (client timeout 2071 ms). Trace:
I20260709 12:26:45.688652 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:45.688606 18914 rpcz_store.cc:269] 0709 12:26:43.673320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.673504 (+   184us) service_pool.cc:224] Handling call
0709 12:26:45.688020 (+2014516us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54002b48d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:45.688122 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586483584}
I20260709 12:26:45.690001 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:45.690327 27135 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:45.673286 27293 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.687688 19485 rpcz_store.cc:276] 0709 12:26:44.354838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.356807 (+  1969us) service_pool.cc:224] Handling call
0709 12:26:44.381844 (+ 25037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.518190 (+136346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.518268 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:44.530505 (+ 12237us) log.cc:844] Serialized 26 byte log entry
0709 12:26:45.365147 (+834642us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:45.365210 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.365319 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.687088 (+321769us) raft_consensus.cc:1685] finished
0709 12:26:45.687109 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.687240 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40299,"raft.queue_time_us":74272,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6609,"thread_start_us":779691,"threads_started":1,"wal-append.queue_time_us":948758}
I20260709 12:26:45.693763 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:45.695413 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:45.695659 27425 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.697615 27408 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:45.697925 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:45.698689 19490 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:45.698616 27366 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:45.704071 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.704833 18840 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:26:45.666064 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.683853 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:45.690212 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.707463 27483 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:45.707989 19491 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:45.708045 27483 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.709100 19490 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:45.710834 27483 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.717347 18847 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:45.718540 18842 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:26:45.682734 27423 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.721807 27423 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:45.719277 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:45.688675 27414 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.723040 18840 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:45.727823 27452 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.645766 18659 maintenance_manager.cc:643] P bcc1b451ad6147bd802f7cd458a81a5c: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 3.582s	user 0.144s	sys 0.025s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":26984,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"lbm_read_time_us":114039,"lbm_reads_10-100_ms":4,"lbm_reads_lt_1ms":21,"lbm_write_time_us":2196,"lbm_writes_lt_1ms":11,"peak_mem_usage":283278,"reinsert_count":0,"thread_start_us":203631,"threads_started":2,"update_count":239}
W20260709 12:26:45.732434 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.692444 27282 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.748224 19488 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:45.751106 18839 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:45.682029 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:45.749207 18660 maintenance_manager.cc:419] P bcc1b451ad6147bd802f7cd458a81a5c: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:26:45.747906 18845 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.756378 18659 maintenance_manager.cc:643] P bcc1b451ad6147bd802f7cd458a81a5c: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 12:26:45.760993 27445 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:45.674325 27474 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.768890 27474 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.751197 27330 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:26:45.771445 27330 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:26:45.771876 27330 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:45.773018 27452 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:45.772807 27330 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:45.774166 27330 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:45.778640 18845 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:45.758965 27282 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.782919 27282 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:45.784746 18662 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 168) took 62838 ms (client timeout 15000 ms). Trace:
I20260709 12:26:45.785320 27282 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:45.785256 18662 rpcz_store.cc:269] 0709 12:25:42.946018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.946595 (+   577us) service_pool.cc:224] Handling call
0709 12:26:45.784606 (+62838011us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":792407,"reported_tablets":32}
I20260709 12:26:45.786578 27347 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:45.789067 27347 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:45.790306 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:45.794339 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:45.797186 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:45.799695 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:45.800520 18913 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:45.792872 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:45.803193 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 121692us
I20260709 12:26:45.795264 18922 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:45.805301 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:45.807231 18913 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:45.810750 18769 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 29. Current term is 30. Ops: []
I20260709 12:26:45.811172 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:45.811826 18771 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:45.789697 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:45.806753 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:45.814013 18772 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:45.803786 18920 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:45.816684 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:45.819361 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:45.821158 18766 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:45.822291 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:45.823208 18764 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:26:45.864715 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:45.865551 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51195.3us
W20260709 12:26:45.866880 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54021.5us
W20260709 12:26:45.868535 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44228.9us
I20260709 12:26:45.870119 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:45.865748 18917 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:26:45.876219 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:45.877025 18773 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 30.
I20260709 12:26:45.866736 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:45.815332 27228 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:45.904397 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:45.920787 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:45.876660 27483 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:45.878961 27360 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:45.889747 27421 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:45.934520 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.969933 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:45.971213 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:45.971908 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.948508 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:45.892923 27382 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:26:45.977373 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 297292us
I20260709 12:26:46.050450 27473 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:46.045651 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.101339 18842 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:46.102356 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.103008 18842 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:26:46.103885 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.104481 18842 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:46.008183 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.821374 27282 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 12:26:46.017776 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.968060 27250 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:26:46.106962 27385 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:45.990039 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.108510 18846 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
W20260709 12:26:45.987514 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:46.047257 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 98862.5us
I20260709 12:26:46.107016 18840 raft_consensus.cc:2393] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:46.057847 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:46.109764 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.109920 18848 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
W20260709 12:26:46.058456 18887 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.658s (SENT)
I20260709 12:26:45.976866 19458 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:46.111697 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 134930us
I20260709 12:26:45.976377 27409 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.889178 27407 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 12:26:45.920157 27189 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.083s
I20260709 12:26:45.976174 27490 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:45.977210 27403 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.117784 27490 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.117982 27403 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:46.119451 27459 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 1.452s	user 0.007s	sys 0.021s
I20260709 12:26:46.119855 27189 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:46.120289 27189 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:46.120501 27403 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:45.972323 27135 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.945312 27489 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:45.924739 27491 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.130s
I20260709 12:26:45.972970 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:46.131884 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 159022us
W20260709 12:26:46.061086 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 151104us
I20260709 12:26:46.132674 18812 leader_election.cc:400] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:46.054755 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.015322 18841 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 20. Preceding OpId from leader: term: 23 index: 21. (index mismatch)
I20260709 12:26:46.133800 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:45.889343 27408 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:26:45.910835 27445 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:26:45.915009 27413 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 12:26:46.016435 27293 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.137763 27403 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:45.920625 27474 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:45.966176 27421 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.978446 27382 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:26:46.022970 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.067425 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:45.972590 27228 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.017385 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.094849 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:46.095729 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:46.096597 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:46.050807 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.113602 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.109961 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:46.115738 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57377.8us
I20260709 12:26:46.115046 27409 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.121670 27135 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.121260 27189 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.155076 18840 raft_consensus.cc:2376] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22. Re-sending same reply.
I20260709 12:26:46.153012 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.156299 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.157553 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.158272 18840 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:46.139659 18842 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:46.160233 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.160885 18842 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
W20260709 12:26:46.136865 19457 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.241s (SENT)
I20260709 12:26:46.161643 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.161886 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:46.129339 18845 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:26:46.135622 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.163580 18848 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:46.118269 27490 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:46.177601 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.178182 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.178679 18842 raft_consensus.cc:2376] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20. Re-sending same reply.
W20260709 12:26:46.166977 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57089.7us
W20260709 12:26:46.183342 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46515.2us
I20260709 12:26:46.163693 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.164867 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.131153 27489 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.166180 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:46.193199 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:46.114578 18771 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
W20260709 12:26:46.204028 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70318.6us
I20260709 12:26:46.176272 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.205636 18812 leader_election.cc:400] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:46.206674 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:46.124542 27481 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:46.186149 18845 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:46.187356 27503 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:46.203043 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.165505 27421 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:46.151010 27478 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:46.180083 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.156890 27473 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.165850 27408 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:46.135267 27282 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:46.208870 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:46.210435 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.141849 27491 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:46.232487 27491 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:46.233755 27491 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.235668 27491 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:46.143838 27381 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:46.210781 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:46.243552 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:46.175140 18839 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:46.212061 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.212745 19484 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:26:46.175009 27483 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:46.215389 18842 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:46.182371 27474 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:46.181951 27330 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:26:46.138231 27403 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.214995 27500 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:26:46.217978 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.229543 18840 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:46.192759 27255 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:46.138161 27293 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.296552 27293 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:46.266589 27403 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:46.212459 27250 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:46.245344 18846 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:46.302907 27360 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:26:46.247979 18848 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:46.304288 18846 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 12:26:46.304761 18846 pending_rounds.cc:85] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 13
I20260709 12:26:46.305055 18846 pending_rounds.cc:107] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 12:26:46.305289 18846 raft_consensus.cc:2889] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:46.208187 27489 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:46.222008 27481 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:46.216048 27472 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:26:46.215878 27503 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.315558 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:46.237890 27408 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.319025 27481 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.320097 27408 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:46.216058 27495 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:46.320923 27495 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:46.321789 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.322913 18841 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:46.223013 27473 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:46.337330 18768 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:46.268733 18840 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:26:46.338426 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:46.279796 27409 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:46.212355 27202 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:26:46.283597 27135 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:46.302970 27250 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:46.344117 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 137513us
I20260709 12:26:46.217563 27407 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:26:46.258950 27484 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:46.287606 27474 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.291505 27228 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:46.258363 27478 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:46.263304 27189 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:46.213893 27382 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.303159 18843 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:46.383965 27382 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:46.257283 18839 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:26:46.384987 18839 pending_rounds.cc:85] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 12
I20260709 12:26:46.385300 18839 pending_rounds.cc:107] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:26:46.385581 18839 raft_consensus.cc:2889] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:46.305665 18848 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 29. Current term is 30. Ops: []
I20260709 12:26:46.254963 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:46.387892 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 133084us
I20260709 12:26:46.388741 27484 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:46.389392 27409 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:46.389837 27409 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:46.309867 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:45.979588 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:46.390333 27409 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:46.389778 27484 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:46.325629 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 137255us
I20260709 12:26:46.393734 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:46.394812 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.396301 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:46.342656 18847 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:26:46.344058 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:46.268216 27282 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:46.268411 27500 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.398732 27500 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:46.362365 27403 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.317687 27503 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:46.408640 27503 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:46.409591 27503 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:46.262769 27330 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:46.410645 27330 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:46.411115 27409 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.411548 27500 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.412127 27403 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:46.417804 27500 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:46.365639 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:46.373719 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:46.377341 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:46.343403 27479 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.463860 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:46.473433 18771 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
I20260709 12:26:46.464864 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:46.466271 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:46.475195 18772 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:46.376070 27250 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:26:46.477790 18887 connection.cc:256] RPC call timeout handler was delayed by -1.3407361850004236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 12:26:46.491361 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:46.492126 18766 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:46.500882 18772 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
W20260709 12:26:46.503278 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 131152us
I20260709 12:26:46.504321 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:46.378625 27478 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:46.510164 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:46.517299 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.472630 27409 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:46.484579 27505 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:26:46.523175 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:46.519397 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:46.492827 27282 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:46.532409 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:46.544169 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.477001 27479 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.517606 27478 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:46.565066 18845 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 12:26:46.569900 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46812.3us
I20260709 12:26:46.571101 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:46.572996 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.564280 27502 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:46.574708 27264 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:26:46.574962 27502 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:46.575930 18663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 272) took 46678 ms (client timeout 15000 ms). Trace:
I20260709 12:26:46.572054 27495 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:46.528096 27505 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:46.578743 27505 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 29.13, Last appended by leader: 13, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.580034 27505 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:46.584507 27479 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:46.586278 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:46.587296 18917 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 12:26:46.594457 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:46.517006 27507 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:46.533700 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:46.534037 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.603219 18848 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:46.559486 18847 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:46.534515 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:46.606105 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 72478.4us
I20260709 12:26:46.607795 18766 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:46.556093 27409 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:26:46.589988 27421 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.628851 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:46.627154 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.595105 27135 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:46.626829 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 109670us
I20260709 12:26:46.631922 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.633576 18845 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:46.606405 27282 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:46.576470 18663 rpcz_store.cc:269] 0709 12:25:59.897456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.929999 (+ 32543us) service_pool.cc:224] Handling call
0709 12:26:46.575834 (+46645835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:42.637288 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:42.716355 (+ 79067us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:42.716411 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:26:42.716432 (+    21us) tablet.cc:662] Decoding operations
0709 12:26:42.717103 (+   671us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:42.717215 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:42.717255 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:26:42.717706 (+   451us) tablet.cc:701] Row locks acquired
0709 12:26:42.717758 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:26:42.717958 (+   200us) write_op.cc:270] Start()
0709 12:26:42.718126 (+   168us) write_op.cc:276] Timestamp: P: 1783600002717891 usec, L: 0
0709 12:26:42.718146 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:26:42.896293 (+178147us) log.cc:844] Serialized 1672 byte log entry
0709 12:26:43.199978 (+303685us) op_driver.cc:464] REPLICATION: finished
0709 12:26:43.698543 (+498565us) write_op.cc:301] APPLY: starting
0709 12:26:43.747721 (+ 49178us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:43.914946 (+167225us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8832a 00007f335af0df14 00007f335af0dec3 00007f335af0de38 00007f335af0ddf3 00007f335af0d0dc 00007f335af36e16 00007f335af1ecbb 00007f335af0939d 00007f335af0cd75
0709 12:26:44.061752 (+146806us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:44.061784 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:44.098046 (+ 36262us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:44.098263 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=16,mrs_lookups=0
0709 12:26:44.098305 (+    42us) write_op.cc:312] APPLY: finished
0709 12:26:44.146520 (+ 48215us) log.cc:844] Serialized 49 byte log entry
0709 12:26:44.426895 (+280375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:44.444535 (+ 17640us) write_op.cc:454] Released schema lock
0709 12:26:44.474547 (+ 30012us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:44.534928 (+ 60381us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:44.541291 (+  6363us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2440956,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":427043,"apply.run_cpu_time_us":23614,"apply.run_wall_time_us":843129,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":327805,"prepare.run_cpu_time_us":22037,"prepare.run_wall_time_us":491967,"raft.queue_time_us":23436,"raft.run_cpu_time_us":37289,"raft.run_wall_time_us":835713,"replication_time_us":397829,"spinlock_wait_cycles":23451904,"thread_start_us":672723,"threads_started":5,"wal-append.queue_time_us":612406,"wal-append.run_cpu_time_us":7496,"wal-append.run_wall_time_us":2270826}]]}
I20260709 12:26:46.623023 27036 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:46.619041 27409 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:46.655608 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 261222us
I20260709 12:26:46.660434 18839 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: [20.11-21.12]
I20260709 12:26:46.660657 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:46.661276 18847 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:46.668988 18848 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:26:46.670876 18845 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:26:46.671753 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:46.651937 27506 raft_consensus.cc:2764] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 12:26:46.656850 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:46.707933 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:46.674474 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:46.709898 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53655.8us
I20260709 12:26:46.650131 27508 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.634248 27090 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
I20260709 12:26:46.655088 27409 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:46.722283 18738 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:46.725277 27202 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:26:46.725908 27202 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:46.726888 27202 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.728796 27504 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:46.730885 27508 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.731725 27473 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.733318 27508 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:46.733982 27508 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:26:46.734359 27381 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:26:46.736513 18841 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260709 12:26:46.715660 27385 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.006s
I20260709 12:26:46.682647 27282 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:46.714980 27228 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:46.716002 27483 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:46.756438 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.654696 27135 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.735996 27508 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:46.735009 27381 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:46.681564 27366 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:26:46.730322 27504 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
W20260709 12:26:46.758091 27490 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.007s
I20260709 12:26:46.757059 27414 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:46.767308 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 109058us
I20260709 12:26:46.757416 27473 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:46.772552 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:46.773535 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:46.762967 27508 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:26:46.775940 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:46.779517 18921 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:46.776023 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:46.759948 27228 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:46.782670 27228 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.778366 27036 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:46.759944 27489 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.787904 27036 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.789907 27489 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:46.790820 18844 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 25: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:46.791234 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:46.792001 18915 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:46.793603 18773 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:46.794819 27381 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.797435 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:46.799003 27328 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:46.800064 27328 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:26:46.800534 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.800981 18915 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:46.801144 27328 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:46.802734 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:46.814584 27421 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:46.775940 27282 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:46.820751 27478 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.770469 27490 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.829957 27490 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:46.830662 18846 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:26:46.831113 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:46.832080 27411 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:46.832461 27411 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:46.832841 27512 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:26:46.832858 27411 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:46.842947 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:46.847530 18921 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:46.847723 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:46.855552 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:46.858053 18914 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:46.860951 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:46.864579 18842 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:46.864886 18917 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:46.761587 27483 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.866304 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:46.867681 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:46.871039 18919 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 28: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:46.865232 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:46.874384 18921 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 12:26:46.874872 18921 pending_rounds.cc:85] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 15
I20260709 12:26:46.875144 18921 pending_rounds.cc:107] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:26:46.875433 18921 raft_consensus.cc:2889] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:46.876009 18847 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:46.885588 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:46.883087 18664 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 19 to 24, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 24 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:46.887599 18664 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:46.889192 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114216us
I20260709 12:26:46.890305 18664 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 20, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 20 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:46.894443 18664 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 20 to 21, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 21 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:46.901870 18664 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 24 to 27, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 27 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:46.904428 18916 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:46.864054 27293 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:46.911049 18917 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:46.915119 18918 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 12:26:46.922170 18918 pending_rounds.cc:85] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 13
I20260709 12:26:46.922614 18918 pending_rounds.cc:107] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 12:26:46.923062 18918 raft_consensus.cc:2889] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:46.923559 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:46.922410 18664 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 20, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 20 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.776551 27414 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:46.873607 27489 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:46.910287 27514 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 12:26:46.921627 18842 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:46.926972 18664 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.959285 18664 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.930647 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:46.953804 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:46.910065 27282 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:46.905030 27473 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:26:46.972146 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 259265us
I20260709 12:26:46.973997 18664 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.978979 18664 catalog_manager.cc:5697] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 20 to 22, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 22 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:46.981130 18664 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 21 to 23, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 23 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:46.982828 18664 catalog_manager.cc:5697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 19, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 19 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.977994 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:46.886451 27421 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 12:26:46.989464 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:46.932596 27510 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:46.904193 27366 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:26:46.956164 27423 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:46.957032 27293 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:47.003654 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:46.995608 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65058.7us
I20260709 12:26:46.976217 27282 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:46.897837 27502 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:47.009899 27445 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:26:47.010964 27519 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:26:47.017509 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.018159 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:47.020955 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 99679.8us
I20260709 12:26:47.007005 18664 catalog_manager.cc:5697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 25 to 28. New cstate: current_term: 28 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.029158 18664 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:47.032068 18664 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.005232 27507 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:46.961769 27489 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.040653 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:47.042105 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.004205 27503 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:47.043849 18842 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:26:47.046808 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.016141 27264 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:47.051087 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:47.053951 18664 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 20, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 20 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:47.057471 18664 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 21 to 23, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 23 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:26:47.062568 18664 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 24, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.068079 18664 catalog_manager.cc:5697] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 20 to 23, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 23 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:47.070294 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50576.3us
I20260709 12:26:47.023137 27282 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:47.004041 27472 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:26:47.028083 27504 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:47.083129 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.087425 18918 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:47.076169 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:47.085763 18664 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 22 to 23, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 23 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.025164 27445 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:47.044489 27507 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.010367 27518 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 12:26:47.011005 27250 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.072731 27510 raft_consensus.cc:2764] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election decision vote started in defunct term 28: won
I20260709 12:26:47.020288 27423 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:47.086021 27505 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.506s	user 0.016s	sys 0.000s
I20260709 12:26:47.027266 27491 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:26:47.079720 27421 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:47.108551 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67979us
I20260709 12:26:47.109400 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.092447 18664 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 15 to 19, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 19 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:26:47.099280 27507 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:47.132544 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.134310 18768 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:47.096735 27135 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:47.097143 27478 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:47.093343 27366 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:26:47.121299 27473 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:47.155308 18915 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: [22.11-24.12]
W20260709 12:26:47.156842 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52222.6us
I20260709 12:26:47.150995 18914 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:47.151113 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.134339 27509 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:26:47.160717 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:47.162933 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.135507 27421 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:47.169595 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 84891.7us
I20260709 12:26:47.175256 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:47.175655 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:47.176367 18915 raft_consensus.cc:2376] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23. Re-sending same reply.
I20260709 12:26:47.178622 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:47.163336 27521 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 12:26:47.166517 27520 log.cc:927] Time spent T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:26:47.180972 18919 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 28: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:47.183095 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.181224 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:47.185513 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.165729 27510 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:47.189836 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.176956 27526 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:47.198365 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:47.199402 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:47.189218 18886 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:47.200219 18914 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:47.201678 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:47.175956 27509 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:47.211798 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:47.222254 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 112927us
I20260709 12:26:47.227193 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.229370 18770 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:47.230332 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:47.232962 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:47.234535 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:47.235250 19486 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:47.239101 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:47.239709 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:47.246910 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:47.251590 27407 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:47.252161 27407 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:47.253131 27407 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.253767 27491 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:47.149709 27445 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.149470 27293 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.242057 27483 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:47.207852 27330 consensus_meta.cc:287] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.004s
I20260709 12:26:47.283989 18842 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:26:47.307191 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:47.307472 18769 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:26:47.200985 27503 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:47.207633 27510 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:47.268828 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:47.313004 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.286156 18918 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:47.344501 18846 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:47.318883 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.282290 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:47.300590 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:47.254012 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2773285049997867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 12:26:47.300920 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:47.190913 27502 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:47.303884 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:47.348694 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2359285049997197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 12:26:47.348989 18767 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
W20260709 12:26:47.302105 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75004.4us
I20260709 12:26:47.301438 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:47.258224 27414 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:47.348230 18766 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:47.350179 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:47.278627 18770 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:47.350869 18842 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:47.349310 27502 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:26:47.351190 18847 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
W20260709 12:26:47.349112 18812 connection.cc:256] RPC call timeout handler was delayed by -1.003728504999799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 12:26:47.281387 27523 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.126s
I20260709 12:26:47.260609 27385 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:47.235734 27536 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.356138 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:47.207297 27135 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:47.365008 18842 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
W20260709 12:26:47.300918 27530 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:26:47.254317 27407 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:47.389285 27385 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:47.236480 27504 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:47.266754 27500 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:26:47.312424 27522 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
W20260709 12:26:47.391700 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77566.4us
I20260709 12:26:47.254549 27491 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.404873 27385 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.329219 27483 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:26:47.313609 27330 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:47.406965 27533 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:26:47.389575 27515 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:26:47.389230 27512 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:26:47.403630 19486 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:47.409843 27500 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:47.389883 27456 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:26:47.442493 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 86448.3us
I20260709 12:26:47.391009 27489 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:47.449905 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 138517us
I20260709 12:26:47.382970 27255 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:47.500036 27255 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.501019 27330 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:47.443969 27135 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:47.502288 27255 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:47.503211 27539 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 12:26:47.470142 27503 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.343670 27421 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.477923 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.300624 27473 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.447947 27250 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:47.482515 18841 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
W20260709 12:26:47.488200 27532 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:26:47.466037 27328 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.498803 27385 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:47.499262 27423 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:47.499163 27504 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:26:47.498252 27409 consensus_meta.cc:287] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.750s	user 0.002s	sys 0.007s
W20260709 12:26:47.539459 18887 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.517s (SENT)
I20260709 12:26:47.409384 27536 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.478948 27542 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:47.544741 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:47.544900 27478 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:47.568058 18770 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:47.547798 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:47.548143 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:47.483378 27456 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:47.549919 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.677s (SENT)
I20260709 12:26:47.528085 27491 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:47.573527 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:47.536158 27544 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:47.570369 18769 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
W20260709 12:26:47.548986 27529 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
W20260709 12:26:47.581760 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.832s (SENT) [suppressed 29 similar messages]
I20260709 12:26:47.572772 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1579) took 1180 ms. Trace:
W20260709 12:26:47.537243 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 59414.6us
W20260709 12:26:47.571625 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 350563us
W20260709 12:26:47.549248 27531 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 12:26:47.583794 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:47.537735 27330 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:47.595552 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.595880 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.577057 18770 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:26:47.582858 18768 rpcz_store.cc:276] 0709 12:26:46.392728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.392882 (+   154us) service_pool.cc:224] Handling call
0709 12:26:46.393255 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.134841 (+741586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.572445 (+437604us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54001d6d54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:47.572684 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703873792}
I20260709 12:26:47.415982 27509 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 28.13, Last appended by leader: 13, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.609849 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.602617 27555 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:47.603452 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:47.566886 27409 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.604676 27541 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:47.598575 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.567188 27538 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.619766 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.579146 27456 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:47.624761 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 77076.7us
I20260709 12:26:47.625439 27491 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:47.629633 27563 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:47.630385 27563 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.632962 27563 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:47.633652 27563 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:47.636579 27523 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:47.637897 27552 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:26:47.637696 18886 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:47.640642 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:47.641702 27554 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:47.502321 27135 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.643709 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:47.642726 27523 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:47.645715 27523 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:47.582512 27500 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.646183 27523 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:47.646601 27500 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:47.648512 27558 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:47.649587 27558 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:47.649924 27558 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:47.584714 27090 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.650602 27090 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.577960 27544 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:47.654197 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44393.9us
I20260709 12:26:47.655412 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:47.657900 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:47.658960 18839 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:47.550066 27328 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:47.644186 27508 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.827s	user 0.008s	sys 0.007s
I20260709 12:26:47.620142 27548 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:47.623776 27414 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:47.617326 27381 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:47.673946 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.684088 18845 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:47.642349 27554 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.618002 27250 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
W20260709 12:26:47.680527 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.624344 27228 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:26:47.696252 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.667760 27555 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:47.667974 27330 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:47.697837 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.618765 27542 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 12:26:47.703593 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:47.709928 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 90267.7us
I20260709 12:26:47.715728 18846 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:26:47.538193 27510 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.712069 18839 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:47.716528 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.652035 27538 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.687359 27554 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:47.722935 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:47.723587 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 141874us
W20260709 12:26:47.724586 18887 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.048s (SENT)
I20260709 12:26:47.719424 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.720484 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.725598 18846 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:47.726824 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.724318 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.675935 27508 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.730857 18846 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:47.669991 27558 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:47.699712 27555 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:47.731156 18839 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 24: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:47.735252 27535 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:26:47.741391 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.742148 18887 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.699s (SENT)
I20260709 12:26:47.705608 27557 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:47.830582 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.831619 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:47.747244 27409 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:47.852396 27575 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:47.852681 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:47.853441 18845 raft_consensus.cc:2376] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21. Re-sending same reply.
I20260709 12:26:47.742085 27330 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:47.856200 27330 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:47.791723 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 72414.6us
I20260709 12:26:47.861531 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:47.839963 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 97864.6us
W20260709 12:26:47.863445 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.843087 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:47.845521 18839 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
I20260709 12:26:47.865556 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.867239 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:47.868485 18839 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:47.869568 18920 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 30. Current term is 31. Ops: []
I20260709 12:26:47.882347 18848 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 12:26:47.887763 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.890197 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.829654 27555 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:47.905979 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.909600 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.947928 18739 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.949028 27381 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:47.948954 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84752us
I20260709 12:26:47.951234 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:47.881778 27250 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:26:47.955116 27566 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:47.891166 27414 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:47.891240 27558 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:47.904716 27575 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:26:47.961050 27507 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.835s	user 0.013s	sys 0.001s
I20260709 12:26:47.939942 27228 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:47.702351 27544 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:47.943188 27408 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:47.940989 27538 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:47.958590 27381 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:47.983013 27250 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:47.991030 27293 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:48.017638 27328 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:47.996629 27504 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.027500 27576 log.cc:927] Time spent T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:26:48.022435 27411 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.189s	user 0.012s	sys 0.004s
I20260709 12:26:48.017387 27536 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:47.992333 27507 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.064606 27586 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.045s
W20260709 12:26:48.065649 27282 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.967s	user 0.013s	sys 0.000s
I20260709 12:26:48.022380 27250 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:48.062443 27407 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.666s	user 0.013s	sys 0.000s
W20260709 12:26:48.099741 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 149098us
I20260709 12:26:48.103266 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:48.101645 18887 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.105693 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:48.113448 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.117491 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.119953 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.120383 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.120481 27503 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:48.120906 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.121439 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.053781 27293 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.119204 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.123827 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.124383 18768 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:26:48.096992 27282 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:48.126063 27568 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:26:48.128130 27282 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:48.128921 27527 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.051s	user 0.002s	sys 0.000s
I20260709 12:26:48.062484 27504 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.150308 27250 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:48.152329 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.166677 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:48.153666 27500 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.001s
I20260709 12:26:48.153102 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.178244 18773 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:48.154897 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.160320 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:48.161155 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:48.091864 27411 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.163676 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:48.118294 27526 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:48.118829 27508 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:48.096180 27456 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.186540 27264 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:48.188618 27456 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.189399 19489 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: []
W20260709 12:26:48.190585 27574 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:26:48.192520 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:48.195184 27584 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:26:48.195691 27507 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.125264 27479 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:48.147008 27536 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.185403 27411 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:48.182780 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:48.197966 18771 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:26:48.169039 27502 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:48.221618 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3497) took 1565 ms. Trace:
I20260709 12:26:48.211465 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:48.159330 27503 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:26:48.216037 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:48.225584 27589 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:48.198248 27479 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.217024 27504 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:48.222143 18848 rpcz_store.cc:276] 0709 12:26:46.656215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.670009 (+ 13794us) service_pool.cc:224] Handling call
0709 12:26:46.871352 (+201343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:47.890879 (+1019527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.095153 (+204274us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400206054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:48.221364 (+126211us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400206050. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:48.221540 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786586880}
I20260709 12:26:48.226191 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.236646 18769 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:48.207487 27536 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.233916 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:48.238032 18766 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:26:48.239661 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:48.212792 27508 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:48.229764 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:48.224293 27507 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:48.251374 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.252199 18848 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:48.254251 18766 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
W20260709 12:26:48.255120 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.245330 27282 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:48.226958 27264 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:48.264317 27536 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.266424 27479 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:48.266944 27445 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:48.269274 27554 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.001s
W20260709 12:26:48.269678 27534 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.094s	user 0.008s	sys 0.016s
I20260709 12:26:48.266525 27264 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.271605 27293 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:48.272357 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:48.273279 18843 raft_consensus.cc:2393] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:48.274816 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3489) took 1740 ms. Trace:
W20260709 12:26:48.275624 27523 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
I20260709 12:26:48.276413 27523 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.271987 27264 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:48.284662 27523 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:48.274231 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:48.275239 18840 rpcz_store.cc:276] 0709 12:26:46.534656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.539239 (+  4583us) service_pool.cc:224] Handling call
0709 12:26:46.539725 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:46.569410 (+ 29685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.569441 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:46.586796 (+ 17355us) log.cc:844] Serialized 26 byte log entry
0709 12:26:46.816258 (+229462us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800305ce0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:26:47.020289 (+204031us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:47.020340 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.020442 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.269019 (+1248577us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:48.274566 (+  5547us) raft_consensus.cc:1685] finished
0709 12:26:48.274592 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.274753 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47306,"raft.queue_time_us":30903,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"spinlock_wait_cycles":29617792,"thread_start_us":203806,"threads_started":1,"wal-append.queue_time_us":515319}
I20260709 12:26:48.290632 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.242918 27508 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.287967 18843 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:48.293177 18840 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:48.307293 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.308071 18840 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:48.309543 18848 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:48.301326 27526 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:48.312633 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.313620 18843 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 24: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:48.314675 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.315285 18843 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:48.327272 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:48.311766 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 151554us
I20260709 12:26:48.307590 27508 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:48.328048 18847 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:48.335110 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:48.335970 18842 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:48.336468 27228 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:26:48.337329 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:48.337672 27593 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:26:48.269850 27554 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.339334 18847 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 22. Current term is 23. Ops: []
W20260709 12:26:48.305896 27385 consensus_meta.cc:287] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.745s	user 0.004s	sys 0.009s
I20260709 12:26:48.344931 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:48.345631 18847 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:48.347086 18847 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:48.340333 18843 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 29.
I20260709 12:26:48.347978 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:48.349228 18766 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:48.348026 18840 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:48.351943 18840 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:26:48.352120 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:48.359308 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:48.365511 18768 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:26:48.367029 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:48.368148 18766 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:48.355067 27523 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:26:48.355674 27586 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:48.394060 27264 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.364916 27403 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:48.365550 27495 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.361378 27282 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:48.408955 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49796.5us
I20260709 12:26:48.385871 27330 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.411477 18766 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:48.400892 27586 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.408121 27554 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:48.292972 27555 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.424751 18848 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: []
W20260709 12:26:48.425330 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 682444us
W20260709 12:26:48.464497 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.424947 27586 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:48.472728 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48192.5us
I20260709 12:26:48.473502 27597 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:48.465024 27598 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:48.466941 27507 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:48.465629 27595 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 12:26:48.412489 27403 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:48.486346 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 864295us
I20260709 12:26:48.487123 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.415078 27282 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.534329 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.475526 27518 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:48.414335 27495 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.536605 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:48.543365 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107050us
I20260709 12:26:48.414225 27526 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.424803 27330 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.546501 27573 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.551673 27135 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:48.552193 18768 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:26:48.488050 27598 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:48.538829 27541 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:48.535300 27503 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:48.558799 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:48.557186 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.561293 19486 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 20: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:48.533725 27403 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:48.540751 27504 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:48.539568 27518 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:48.565738 19484 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:48.560874 27255 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:48.553486 27573 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.567082 27255 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.569447 27255 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.563264 27541 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.570502 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:48.571094 18768 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:48.572037 27541 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.572197 27282 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:48.558480 27456 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:48.573096 27456 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.575294 27456 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:48.575654 18918 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:26:48.579176 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.580505 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:48.581161 18918 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:48.569357 27454 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:48.583580 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.583886 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.584471 18846 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
I20260709 12:26:48.587286 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.584985 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.589535 18768 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:48.589803 19484 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:48.591059 18848 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:26:48.593267 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:48.595353 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.595816 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.600387 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:48.602615 18915 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:26:48.602466 18921 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:48.605314 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.559319 27598 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:48.607446 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:48.609133 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:48.533216 27507 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.569650 27573 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.570322 27255 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:48.611663 18913 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 12:26:48.617246 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3500) took 1779 ms. Trace:
I20260709 12:26:48.589695 27282 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.628221 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1439) took 1323 ms. Trace:
I20260709 12:26:48.619057 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:48.618929 18841 rpcz_store.cc:276] 0709 12:26:46.837845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.840165 (+  2320us) service_pool.cc:224] Handling call
0709 12:26:46.840512 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.536704 (+696192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.616942 (+1080238us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54003bd154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:48.617175 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475980160}
I20260709 12:26:48.628883 19489 rpcz_store.cc:276] 0709 12:26:47.305307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.305541 (+   234us) service_pool.cc:224] Handling call
0709 12:26:47.312781 (+  7240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:48.189868 (+877087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.627843 (+437975us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54006ff254. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:48.628125 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015553920}
I20260709 12:26:48.619959 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.623013 18918 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:26:48.553963 27561 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:26:48.635102 18921 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:26:48.635710 18921 pending_rounds.cc:85] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 9
I20260709 12:26:48.636031 18921 pending_rounds.cc:107] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:26:48.636327 18921 raft_consensus.cc:2889] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:48.638219 27454 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:48.601589 27135 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:48.626814 27525 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:48.600838 27503 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:48.647815 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.672792 18918 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:26:48.673002 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.674468 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.660950 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.650867 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.632311 27597 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
W20260709 12:26:48.676723 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 112900us
I20260709 12:26:48.638859 27454 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:48.644362 27518 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.653824 27264 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.661289 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.631256 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.676901 27589 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:26:48.677263 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 77982.2us
I20260709 12:26:48.678086 27589 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:48.678066 18919 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:48.678102 27454 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.679600 27589 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.680217 27454 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:48.681002 19489 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:48.682804 27264 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.683410 27264 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.685706 27264 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.686158 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:48.686816 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:48.687000 18841 raft_consensus.cc:2376] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21. Re-sending same reply.
I20260709 12:26:48.687762 18848 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:48.688066 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.681030 27589 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:48.691027 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.691632 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 29 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:48.690302 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:48.693784 18840 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 28. Current term is 29. Ops: []
I20260709 12:26:48.695582 18840 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:26:48.698614 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.699522 18848 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 20: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:48.691279 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.700440 27293 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:48.700471 27597 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:48.701776 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:48.702740 18768 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:26:48.700506 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.707448 18848 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:48.708935 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:48.638288 27583 log.cc:927] Time spent T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.624s	user 0.004s	sys 0.001s
W20260709 12:26:48.710604 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.714839 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:48.716434 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:48.717015 18841 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:48.717463 19457 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:48.663478 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:48.715512 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:48.713471 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:48.609568 27562 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.116s
I20260709 12:26:48.633222 27255 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.702291 27597 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:48.772816 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:48.751185 19458 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:48.723971 18843 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:26:48.778461 18766 raft_consensus.cc:1240] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 28. Current term is 29. Ops: []
I20260709 12:26:48.775831 27202 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.761420 19457 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:48.908313 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:48.982679 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 231635us
I20260709 12:26:48.639878 27282 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.989429 27090 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:48.991415 27481 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:48.991894 18846 raft_consensus.cc:2376] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28. Re-sending same reply.
W20260709 12:26:48.821285 27607 log.cc:927] Time spent T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:26:48.800649 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1515) took 1143 ms. Trace:
W20260709 12:26:48.850803 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 260544us
I20260709 12:26:48.770747 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3598) took 1091 ms. Trace:
I20260709 12:26:48.801910 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:48.791392 18848 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:48.719712 27454 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:48.718870 18841 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:26:48.777850 18771 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:48.781826 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 2079) took 1944 ms. Trace:
I20260709 12:26:48.779069 18768 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:48.905119 27535 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.777261 18770 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:26:48.809831 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:49.000465 18847 rpcz_store.cc:276] 0709 12:26:47.679434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.349005 (+669571us) service_pool.cc:224] Handling call
0709 12:26:48.349330 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:48.370189 (+ 20859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:48.370247 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:48.380998 (+ 10751us) log.cc:844] Serialized 26 byte log entry
0709 12:26:48.592644 (+211646us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:48.592686 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.592744 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.770496 (+177752us) raft_consensus.cc:1685] finished
0709 12:26:48.770520 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.770674 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6976,"raft.queue_time_us":8344,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":22269,"thread_start_us":193690,"threads_started":1,"wal-append.queue_time_us":366759}
W20260709 12:26:48.983038 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74950us
I20260709 12:26:48.672782 27595 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.934762 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:48.740032 27528 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:48.913327 27421 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:49.011284 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:49.012215 18772 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:49.006309 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:49.056749 18919 raft_consensus.cc:3055] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:26:49.057199 18919 raft_consensus.cc:740] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:48.814944 27293 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:48.992563 19490 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:48.739871 18765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:49.063542 18765 raft_consensus.cc:606] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:49.063651 19486 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:48.810132 27544 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:48.840324 27264 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.839447 27478 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.001266 18842 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:49.001878 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:48.906055 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.002380 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:49.003008 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:48.723790 27538 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:48.725728 27573 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:48.725890 27604 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:48.759847 27560 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:48.741192 27320 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:48.762262 27555 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:48.807231 27495 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.763350 27330 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:48.808301 27503 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:49.003684 18920 rpcz_store.cc:276] 0709 12:26:46.837107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.837261 (+   154us) service_pool.cc:224] Handling call
0709 12:26:46.837584 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.884265 (+1046681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.781570 (+897305us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:48.781761 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353758464}
I20260709 12:26:48.771545 27507 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:49.056870 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 343720us
I20260709 12:26:48.643306 27523 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.336s
I20260709 12:26:49.059304 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:48.990128 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 228806us
I20260709 12:26:49.008011 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:49.139192 18771 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:26:48.981436 27202 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.058008 18919 consensus_queue.cc:260] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.140372 18919 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:49.079582 27611 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:49.065382 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59166.7us
I20260709 12:26:49.143970 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:48.991972 27483 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:49.003912 27382 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:48.769863 27508 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:48.719383 27525 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:49.084259 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 82181us
I20260709 12:26:49.080363 27264 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.099531 18766 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 12:26:49.148370 27599 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:26:49.058066 27528 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:49.010357 27535 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.068758 27090 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:49.131780 18913 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:26:49.136785 18887 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:49.140100 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:49.211331 18768 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:49.106683 27320 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.082034 27573 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:49.061329 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56471.5us
I20260709 12:26:49.000465 18844 rpcz_store.cc:276] 0709 12:26:47.657865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.658014 (+   149us) service_pool.cc:224] Handling call
0709 12:26:47.676566 (+ 18552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:47.677018 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:47.677053 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:47.689276 (+ 12223us) log.cc:844] Serialized 26 byte log entry
0709 12:26:47.951943 (+262667us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:48.147083 (+195140us) log.cc:844] Serialized 14 byte log entry
0709 12:26:48.147436 (+   353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.147519 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.586646 (+439127us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:48.800260 (+213614us) raft_consensus.cc:1685] finished
0709 12:26:48.800395 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.800566 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72,"prepare.queue_time_us":62829,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":11853,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":3913,"spinlock_wait_cycles":7461632,"thread_start_us":358314,"threads_started":2,"wal-append.queue_time_us":313387}
I20260709 12:26:49.166076 27382 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:49.142899 19457 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:49.139787 27503 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:49.217710 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74893.3us
I20260709 12:26:49.218653 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:49.064796 27421 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.062608 27595 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:49.148013 27403 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.004s
I20260709 12:26:49.157505 18814 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:49.244454 18919 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 17. (term mismatch)
I20260709 12:26:49.244884 18919 pending_rounds.cc:85] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 16
I20260709 12:26:49.245170 18919 pending_rounds.cc:107] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 28.17
I20260709 12:26:49.245424 18919 raft_consensus.cc:2889] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:49.247778 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 90361.5us
I20260709 12:26:49.097584 18772 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:49.157837 18771 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 31.
I20260709 12:26:49.084944 27478 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.264609 27597 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:49.265511 27478 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:49.139963 27330 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:49.079234 27293 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.267475 27595 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:49.268671 27255 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:49.269912 27293 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:49.271260 27614 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:26:49.287909 27508 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:49.292932 27135 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.003s
I20260709 12:26:49.293571 27135 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:49.296211 27503 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:49.223757 27558 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:49.300863 27421 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:49.301812 27421 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.245107 27481 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:26:49.302973 27481 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 29 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:49.304148 27481 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.189612 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 29 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:48.710999 27540 consensus_queue.cc:1175] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "43b520eabb65493abe84f4cf06806cba" responder_term: 26 status { last_received { term: 25 index: 17 } last_committed_idx: 16 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:49.194857 27528 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:49.146207 27483 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.203681 18916 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:26:49.229772 27538 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:49.149739 27563 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:26:49.150619 27611 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:49.217919 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81237.3us
W20260709 12:26:49.202257 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.328043 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:49.103971 18842 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:49.329609 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 1522) took 1669 ms. Trace:
I20260709 12:26:49.235111 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:49.331087 18768 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:26:49.250702 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:49.332444 19487 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:26:49.216584 27573 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:49.216979 27320 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:49.168293 18766 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 28 index: 13. (index mismatch)
I20260709 12:26:49.254976 27507 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:49.266237 27478 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:49.310868 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61455.9us
I20260709 12:26:49.142449 18765 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:49.317006 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:49.330122 18842 rpcz_store.cc:276] 0709 12:26:47.660210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.336734 (+676524us) service_pool.cc:224] Handling call
0709 12:26:48.801731 (+464997us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:26:49.329519 (+527788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3920256}
I20260709 12:26:49.331921 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:49.240451 27454 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 30.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.092s
I20260709 12:26:49.308527 27282 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:49.315595 27599 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:26:49.342954 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:49.343247 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:49.322278 27483 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:49.208698 27509 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 12:26:49.342423 27478 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:49.252023 27403 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.316910 27330 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:26:49.339954 27495 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:49.359197 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.351468 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:49.355638 27508 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:49.307300 27610 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:26:49.341362 27538 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:49.310550 27421 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.355320 27595 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:26:49.377816 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 3066) took 1228 ms. Trace:
I20260709 12:26:49.344157 27503 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:26:49.361191 27478 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:49.404598 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:49.411175 18842 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:49.354444 27504 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:26:49.349880 27541 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:26:49.376351 27495 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.413080 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:49.358470 27542 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:26:49.401667 18769 rpcz_store.cc:276] 0709 12:26:48.148912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.242160 (+ 93248us) service_pool.cc:224] Handling call
0709 12:26:48.258846 (+ 16686us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:48.259267 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:48.259297 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:48.259940 (+   643us) log.cc:844] Serialized 52 byte log entry
0709 12:26:48.353385 (+ 93445us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:48.388328 (+ 34943us) log.cc:844] Serialized 14 byte log entry
0709 12:26:48.388678 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 12:26:48.407175 (+ 18497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.407310 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.879591 (+472281us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b1800487840. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:26:49.377490 (+497899us) raft_consensus.cc:1685] finished
0709 12:26:49.377532 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.377736 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2710,"prepare.queue_time_us":71449,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":127,"raft.queue_time_us":21805,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":18680,"spinlock_wait_cycles":10263936,"thread_start_us":92956,"threads_started":1,"wal-append.queue_time_us":166180}
I20260709 12:26:49.378665 27282 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:49.358989 27507 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:26:49.422955 18842 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:26:49.400501 27293 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:49.425999 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:49.435055 18844 raft_consensus.cc:2393] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:49.430699 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:49.438247 27611 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:49.439950 27495 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:49.421891 27598 consensus_meta.cc:287] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.000s
I20260709 12:26:49.444345 27502 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:49.441972 27598 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.448057 27403 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:49.448282 27598 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:49.448976 18917 raft_consensus.cc:1240] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:49.401702 27508 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:49.452843 27560 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:49.453459 27560 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:49.419826 27595 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:49.456918 27595 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:49.420634 27586 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.894s	user 0.012s	sys 0.000s
I20260709 12:26:49.462639 27507 consensus_queue.cc:1243] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:26:49.463689 27560 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.466158 27560 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:49.468228 27250 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:49.480098 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:49.483292 27617 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:26:49.484349 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.487876 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.489627 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.486336 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.498476 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:49.461585 27586 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.375765 27558 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:49.505899 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.508563 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.509547 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:49.504467 19489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:26:49.453351 27508 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.510473 19489 raft_consensus.cc:606] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:49.511351 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:49.500362 27202 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:49.499830 27616 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.512771 27525 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:49.434516 27293 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:49.515767 18916 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 25: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:49.535691 27293 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:49.536532 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.490971 27255 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:26:49.428105 27282 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:49.538622 27255 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:49.538832 27535 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:49.539275 27282 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.539901 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:49.539702 27255 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 30.21, Last appended by leader: 21, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.540728 27282 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:49.540985 27255 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:26:49.520292 19486 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:26:49.538434 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.521016 18921 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:26:49.543705 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.544018 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:49.548249 27421 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:49.510944 27562 consensus_queue.cc:1059] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 12:26:49.549687 27562 raft_consensus.cc:3055] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:49.550163 27562 raft_consensus.cc:740] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:49.551358 27562 consensus_queue.cc:260] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.552886 27562 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:49.367249 27382 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.562317 18913 raft_consensus.cc:1240] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:49.581717 27525 consensus_queue.cc:1059] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:49.582912 27525 raft_consensus.cc:3055] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:49.542603 27538 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.570488 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:49.573153 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.534821 27586 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:49.574409 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:49.502012 27542 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:49.519619 27202 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.519582 27616 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.572268 27264 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:49.604960 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.617898 18917 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:26:49.618487 18841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.051s
W20260709 12:26:49.614913 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.583263 27525 raft_consensus.cc:740] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:49.510759 27558 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:49.618906 18841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.000s	sys 0.051s
W20260709 12:26:49.619258 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 475371us
I20260709 12:26:49.598961 27604 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:49.620322 18913 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
I20260709 12:26:49.628710 18921 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 29 index: 13. Preceding OpId from leader: term: 28 index: 13. (term mismatch)
I20260709 12:26:49.632427 18921 pending_rounds.cc:85] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 12
I20260709 12:26:49.632705 18921 pending_rounds.cc:107] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 29.13
I20260709 12:26:49.633020 18921 raft_consensus.cc:2889] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:49.632066 18847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.027s	sys 0.048s
W20260709 12:26:49.635205 18847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.027s	sys 0.049s
I20260709 12:26:49.604574 27535 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:49.606465 27503 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.043s
W20260709 12:26:49.658020 18918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.034s	sys 0.063s
W20260709 12:26:49.659760 18918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.034s	sys 0.063s
I20260709 12:26:49.615236 27202 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.652376 27518 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:49.640782 27609 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.018s	sys 0.039s
W20260709 12:26:49.669562 27609 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.019s	sys 0.039s
I20260709 12:26:49.718488 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.654546 27535 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.657436 27478 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.717295 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:49.731390 18922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.028s	sys 0.011s
W20260709 12:26:49.736382 18922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.028s	sys 0.011s
I20260709 12:26:49.737473 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3606) took 1067 ms. Trace:
I20260709 12:26:49.736193 27282 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:26:49.732375 27621 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:49.675719 27525 consensus_queue.cc:260] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:49.764608 27090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.016s	sys 0.011s
I20260709 12:26:49.691820 27542 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:49.784221 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.032s
I20260709 12:26:49.748397 27282 consensus_queue.cc:1243] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 27.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:26:49.784722 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.006s	sys 0.032s
W20260709 12:26:49.766350 27544 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.005s
I20260709 12:26:49.795075 27558 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:49.779032 27090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.017s	sys 0.011s
I20260709 12:26:49.796293 27090 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:49.796644 27525 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:49.798065 18767 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 12:26:49.797441 27090 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.798676 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3615) took 1102 ms. Trace:
W20260709 12:26:49.799504 18767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33742 (request call id 3058) took 1679 ms (client timeout 1766 ms). Trace:
I20260709 12:26:49.799088 18841 rpcz_store.cc:276] 0709 12:26:48.696959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.001615 (+304656us) service_pool.cc:224] Handling call
0709 12:26:49.001926 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.002169 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.002192 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.007803 (+  5611us) log.cc:844] Serialized 26 byte log entry
0709 12:26:49.630194 (+622391us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:49.630241 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.630344 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:49.794362 (+164018us) raft_consensus.cc:1685] finished
0709 12:26:49.798428 (+  4066us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.798607 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":553007,"threads_started":1,"wal-append.queue_time_us":702011}
I20260709 12:26:49.770011 27621 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.801818 27621 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:49.806419 27478 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:49.808352 27320 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.810075 19487 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:49.815985 27561 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.816648 27561 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:49.800040 18767 rpcz_store.cc:269] 0709 12:26:48.119656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.121123 (+  1467us) service_pool.cc:224] Handling call
0709 12:26:49.799277 (+1678154us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540036bfd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:49.799429 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3853601536}
I20260709 12:26:49.738005 18922 rpcz_store.cc:276] 0709 12:26:48.669670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.817171 (+147501us) service_pool.cc:224] Handling call
0709 12:26:48.817510 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:48.817748 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:26:49.078013 (+260265us) log.cc:844] Serialized 14 byte log entry
0709 12:26:49.736993 (+658980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:49.737070 (+    77us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:49.737136 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.737231 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.737397 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":696956,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":114,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":6478,"spinlock_wait_cycles":14592,"thread_start_us":917233,"threads_started":2}
W20260709 12:26:49.821524 18848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.008s	sys 0.021s
I20260709 12:26:49.822090 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:49.825932 27505 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.826911 18922 pending_rounds.cc:85] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 8
I20260709 12:26:49.826548 27505 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:49.827860 18919 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:26:49.828409 18922 pending_rounds.cc:107] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:26:49.828706 18922 raft_consensus.cc:2889] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:49.829035 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:49.749557 27483 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:49.823757 18848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.009s	sys 0.021s
I20260709 12:26:49.829531 27320 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:49.848752 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 2101) took 1130 ms. Trace:
I20260709 12:26:49.819413 27421 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.849237 18919 rpcz_store.cc:276] 0709 12:26:48.718143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.253442 (+535299us) service_pool.cc:224] Handling call
0709 12:26:49.253800 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.828214 (+574414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.848338 (+ 20124us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54003e6554. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:49.848661 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319453952}
I20260709 12:26:49.854902 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:49.863265 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:49.864530 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 642576us
I20260709 12:26:49.875631 18770 raft_consensus.cc:2368] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21.
I20260709 12:26:49.858268 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:49.889632 18737 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.019s	sys 0.031s
W20260709 12:26:49.890192 18737 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.019s	sys 0.031s
I20260709 12:26:49.851491 27616 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:49.861138 27202 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:49.916098 18840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.010s	sys 0.004s
W20260709 12:26:49.917642 18845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.014s
I20260709 12:26:49.861383 27427 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
I20260709 12:26:49.891899 27561 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:49.862814 27421 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:49.919544 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 287842us
I20260709 12:26:49.895203 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:49.895247 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 506553us
I20260709 12:26:49.897285 27626 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:49.954171 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:49.967788 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.975644 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3604) took 1306 ms. Trace:
I20260709 12:26:49.985224 18919 pending_rounds.cc:85] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 11
I20260709 12:26:49.988423 18919 pending_rounds.cc:107] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 27.12
I20260709 12:26:49.989885 18919 raft_consensus.cc:2889] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:49.900615 27293 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:49.976240 18914 rpcz_store.cc:276] 0709 12:26:48.668931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.815925 (+146994us) service_pool.cc:224] Handling call
0709 12:26:48.816316 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:48.990841 (+174525us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:26:49.361577 (+370736us) log.cc:844] Serialized 14 byte log entry
0709 12:26:49.860803 (+499226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:49.860894 (+    91us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:49.860973 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.975370 (+114397us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000f5854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:49.975421 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.975563 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17036,"prepare.queue_time_us":524376,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":15585,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":400576384,"thread_start_us":793493,"threads_started":2,"wal-append.queue_time_us":607690}
W20260709 12:26:50.020525 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 125436us
I20260709 12:26:50.007277 19491 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 29 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
W20260709 12:26:50.025417 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.954752 27202 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:49.985668 27589 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.017s	sys 0.007s
W20260709 12:26:50.019954 27504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.010s	sys 0.034s
I20260709 12:26:49.973860 27535 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.046065 18839 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:50.046218 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:50.056145 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:50.001569 27616 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:50.041536 27589 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.018s	sys 0.007s
I20260709 12:26:50.057646 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3636) took 1279 ms. Trace:
I20260709 12:26:50.035928 27507 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:50.042815 27633 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:26:50.066357 18770 rpcz_store.cc:276] 0709 12:26:48.778371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.055708 (+277337us) service_pool.cc:224] Handling call
0709 12:26:50.054344 (+998636us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54000af0d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:50.057555 (+  3211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694328192}
W20260709 12:26:50.063827 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 183048us
I20260709 12:26:50.064252 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:50.080271 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:50.084704 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.094722 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.970640 27626 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.103471 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:50.101075 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:50.034885 27621 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.060153 27638 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:50.110200 19487 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:50.077060 27264 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:50.041752 27202 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.119230 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3616) took 1421 ms. Trace:
I20260709 12:26:50.078819 27642 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:50.128274 18848 rpcz_store.cc:276] 0709 12:26:48.697831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.003483 (+305652us) service_pool.cc:224] Handling call
0709 12:26:49.006448 (+  2965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.006878 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.006918 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.007384 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:26:49.833261 (+825877us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:49.861442 (+ 28181us) log.cc:844] Serialized 14 byte log entry
0709 12:26:49.861733 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.861847 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.118963 (+257116us) raft_consensus.cc:1685] finished
0709 12:26:50.118985 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.119159 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19769,"prepare.queue_time_us":27814,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":55,"raft.queue_time_us":111721,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":22232,"thread_start_us":732353,"threads_started":1,"wal-append.queue_time_us":849146}
I20260709 12:26:50.053155 27282 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
W20260709 12:26:50.141994 27627 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:26:50.145061 27202 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.098541 27542 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:50.102633 27639 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:26:50.158139 27634 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:26:50.162920 27293 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.078539 27616 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:50.176215 27560 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.000s
I20260709 12:26:50.177361 18920 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 25 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 12:26:50.121619 27483 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.154690 27638 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:50.080173 27330 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:26:50.154806 27635 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:26:50.172533 27616 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.151135 27264 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:26:50.199921 27629 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
W20260709 12:26:50.201898 27573 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.004s
I20260709 12:26:50.221809 27481 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:50.228579 27264 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.197924 27639 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:50.184788 27542 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.152909 27642 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.264916 27621 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.268412 27639 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.271857 27642 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:50.306718 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 466113us
W20260709 12:26:50.314508 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 290432us
I20260709 12:26:50.240083 27481 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:50.353655 18886 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.002s	sys 0.002s
W20260709 12:26:50.354310 18886 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.003s	sys 0.002s
W20260709 12:26:50.354985 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 529717us
I20260709 12:26:50.387575 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3617) took 1689 ms. Trace:
I20260709 12:26:50.389077 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3608) took 1718 ms. Trace:
I20260709 12:26:50.389669 27542 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.239073 27573 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:50.396974 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 85893.1us
I20260709 12:26:50.411361 27293 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:50.412791 27293 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.389588 18918 rpcz_store.cc:276] 0709 12:26:48.670325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.058602 (+388277us) service_pool.cc:224] Handling call
0709 12:26:49.058987 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.064859 (+  5872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.064897 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.068748 (+  3851us) log.cc:844] Serialized 26 byte log entry
0709 12:26:49.660527 (+591779us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:49.660573 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.660652 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.388353 (+727701us) raft_consensus.cc:1685] finished
0709 12:26:50.388405 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.388733 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61964,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"thread_start_us":539436,"threads_started":1,"wal-append.queue_time_us":711534}
I20260709 12:26:50.416109 19491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1704) took 1103 ms. Trace:
I20260709 12:26:50.388262 18847 rpcz_store.cc:276] 0709 12:26:48.698634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.005946 (+307312us) service_pool.cc:224] Handling call
0709 12:26:49.065478 (+ 59532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.636905 (+571427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.636956 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.647103 (+ 10147us) log.cc:844] Serialized 26 byte log entry
0709 12:26:50.042011 (+394908us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:50.042101 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.042279 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.386849 (+344570us) raft_consensus.cc:1685] finished
0709 12:26:50.386925 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.387321 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61368,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7885,"thread_start_us":929584,"threads_started":2,"wal-append.queue_time_us":479870}
I20260709 12:26:50.416631 19491 rpcz_store.cc:276] 0709 12:26:49.312836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.314484 (+  1648us) service_pool.cc:224] Handling call
0709 12:26:49.331430 (+ 16946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:50.023084 (+691654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.415288 (+392204us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400555fd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:50.415717 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553552768}
W20260709 12:26:50.407989 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 92102.8us
I20260709 12:26:50.420379 27282 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.421620 27282 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.423274 27481 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:50.424831 27330 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.428231 27330 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.432559 27282 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.436270 27330 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.441370 27090 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.442811 27293 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.442572 27090 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.443698 27655 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:50.444808 27655 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.446731 27665 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:50.447057 27483 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:26:50.447937 27665 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.448662 27483 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:50.449283 27505 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.451027 27483 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.451594 19484 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:50.451745 27421 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.451908 27483 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.452983 27421 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:26:50.453518 27421 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:50.456216 27561 raft_consensus.cc:993] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
W20260709 12:26:50.458792 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.459368 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50859us
I20260709 12:26:50.460767 27615 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:50.461460 27615 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:50.462885 27478 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:50.464361 27478 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:50.466838 27670 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:50.467607 27670 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:50.467530 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:50.469244 27661 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:26:50.470276 27250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.008s
W20260709 12:26:50.470861 27250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.000s	sys 0.009s
I20260709 12:26:50.455453 27421 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.473263 27090 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.469787 27670 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.481511 27483 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:50.482705 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 264932us
I20260709 12:26:50.484012 27670 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:50.485015 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3516) took 1082 ms. Trace:
I20260709 12:26:50.485534 18840 rpcz_store.cc:276] 0709 12:26:49.402836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.403383 (+   547us) service_pool.cc:224] Handling call
0709 12:26:49.403844 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.916704 (+512860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.916745 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.917440 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 12:26:50.409126 (+491686us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:50.435884 (+ 26758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.474950 (+ 39066us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.475022 (+    72us) raft_consensus.cc:1685] finished
0709 12:26:50.475041 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.484790 (+  9749us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36745,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":840356,"threads_started":2,"wal-append.queue_time_us":300799}
I20260709 12:26:50.487205 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3523) took 1071 ms. Trace:
W20260709 12:26:50.488638 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.489717 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.487653 18845 rpcz_store.cc:276] 0709 12:26:49.415342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.415507 (+   165us) service_pool.cc:224] Handling call
0709 12:26:49.415901 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.918299 (+502398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.918345 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.929507 (+ 11162us) log.cc:844] Serialized 26 byte log entry
0709 12:26:50.486545 (+557038us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:50.486665 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.486787 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.486833 (+    46us) raft_consensus.cc:1685] finished
0709 12:26:50.486843 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.487030 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24893,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"thread_start_us":943250,"threads_started":2,"wal-append.queue_time_us":295680}
W20260709 12:26:50.497895 27528 consensus_meta.cc:287] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 1.167s	user 0.014s	sys 0.004s
I20260709 12:26:50.434973 27654 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:50.510298 27573 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.511125 27595 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:50.512354 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 396779us
I20260709 12:26:50.513221 27616 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.498503 27528 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.529755 19488 raft_consensus.cc:1240] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:50.514190 27665 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.512363 27615 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.533756 27615 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:50.534726 27654 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.519170 27597 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:50.539136 27597 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.539633 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:50.541937 27597 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.522203 27621 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:50.542625 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 351457us
I20260709 12:26:50.543018 27621 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.545957 27621 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.481314 27525 raft_consensus.cc:1081] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:26:50.538205 27654 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.555567 27677 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 28.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:26:50.556388 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:50.558892 18920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3745) took 1180 ms (client timeout 1533 ms). Trace:
W20260709 12:26:50.559489 18920 rpcz_store.cc:269] 0709 12:26:49.378510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.479731 (+101221us) service_pool.cc:224] Handling call
0709 12:26:50.558274 (+1078543us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b5400334854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:50.558655 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600489344}
I20260709 12:26:50.568302 27595 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.570277 27655 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.571441 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:50.572057 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.572779 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.573477 27330 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.573915 27631 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:50.574164 27616 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.575423 27677 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:26:50.576000 27677 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:50.574373 27330 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.577751 27616 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:50.577512 27677 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.591012 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.591840 27677 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:50.579290 27330 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.580260 27293 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:50.549197 27665 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:50.584419 27282 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:50.586527 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:50.603529 18922 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:50.587495 27626 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.587604 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:50.588778 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1447) took 1756 ms. Trace:
I20260709 12:26:50.589613 27631 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:50.589231 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:50.589310 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.605572 19488 rpcz_store.cc:276] 0709 12:26:48.832511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.832739 (+   228us) service_pool.cc:224] Handling call
0709 12:26:48.833229 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:50.532265 (+1699036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.588450 (+ 56185us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54003075d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:50.588704 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3900516096}
I20260709 12:26:50.605147 27282 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:50.629343 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.629818 18918 raft_consensus.cc:2410] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 12:26:50.631492 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:50.631734 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:50.629370 27202 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:50.620368 27282 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:50.636344 27626 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.637341 27626 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.633924 27202 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:50.642273 27630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.015s	sys 0.034s
W20260709 12:26:50.642889 27630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.015s	sys 0.034s
I20260709 12:26:50.644981 18917 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:50.610809 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.652483 27655 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.615036 27293 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.663642 27655 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.642079 27202 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.668184 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.669620 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.670643 27665 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:26:50.670931 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:50.671264 27665 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.671799 27665 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:50.672590 27655 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.674594 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:50.671829 18916 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:50.680433 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 91554.1us
I20260709 12:26:50.683064 27639 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:50.685400 27518 consensus_meta.cc:287] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.010s	user 0.004s	sys 0.018s
I20260709 12:26:50.686425 18915 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:50.686894 27595 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:50.670998 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.694761 18921 raft_consensus.cc:2393] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:50.695425 27639 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:50.695938 27595 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:26:50.696244 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.697057 27595 consensus_queue.cc:1059] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260709 12:26:50.697676 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.698062 27595 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:50.698587 27616 raft_consensus.cc:3055] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:50.701401 27616 raft_consensus.cc:740] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:50.702890 27616 consensus_queue.cc:260] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 23.21, Last appended by leader: 21, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.704486 27616 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:50.706620 27595 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:50.708405 27421 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:50.708338 27595 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.708972 27631 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.710220 27631 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:50.712455 27558 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.699188 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:50.693734 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:50.718320 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.719215 18914 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:50.720399 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.721319 18914 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:50.715400 27595 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:50.726502 27558 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.722278 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.642092 27626 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.736922 18916 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:50.738687 18922 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:26:50.742708 27293 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.746517 27518 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.747377 27518 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.749917 27518 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:50.714373 27528 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.751995 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:50.753214 27677 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:50.753684 27677 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:50.736802 18915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3742) took 2102 ms (client timeout 1676 ms). Trace:
I20260709 12:26:50.756516 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:50.754380 18915 rpcz_store.cc:269] 0709 12:26:48.628056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.630471 (+  2415us) service_pool.cc:224] Handling call
0709 12:26:50.728050 (+2097579us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540011fdd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:50.730281 (+  2231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4545349888}
I20260709 12:26:50.760476 18921 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:26:50.769727 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 220046us
I20260709 12:26:50.772655 27264 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:26:50.774570 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.775475 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.783242 27655 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:50.783300 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 89867.2us
I20260709 12:26:50.754071 27677 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:26:50.793256 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.795692 18917 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:50.796655 18920 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:50.799541 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:50.803162 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.806457 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:50.782280 27282 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.813651 27528 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.814770 27626 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:50.810976 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:50.833559 18737 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:50.839931 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:50.842244 27630 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:50.828600 27626 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:50.838346 27528 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.843072 27626 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:50.843191 27630 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:26:50.835361 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 46966.9us
I20260709 12:26:50.844352 27661 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:50.844477 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:50.844810 27661 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:50.842795 27654 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:50.845014 27528 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.845862 27661 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:50.834896 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 73378.2us
W20260709 12:26:50.851131 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45916.5us
I20260709 12:26:50.847630 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:50.854055 27538 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:50.855415 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:50.856184 18920 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:50.851172 27558 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:50.857698 18920 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:26:50.858167 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:50.859304 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:50.869817 27528 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:50.872217 27528 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.872730 27528 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:50.874812 27639 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:50.877224 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:50.835261 27655 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:50.821262 27264 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.886343 18918 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
W20260709 12:26:50.906635 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 69012.8us
I20260709 12:26:50.910418 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:50.887431 27538 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:50.838550 18914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:57874
I20260709 12:26:50.929567 18914 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:50.930169 18914 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:50.901854 27655 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:50.942490 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.927572 27670 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:50.926542 27639 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:50.930089 27621 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:50.933251 27202 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:50.951247 27670 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.962564 27382 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:50.967129 27688 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
W20260709 12:26:50.967506 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.984602 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.984979 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.969182 27687 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:26:50.974902 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 130557us
I20260709 12:26:50.974763 19458 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:50.991912 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81708.2us
I20260709 12:26:50.958362 27621 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:50.994012 27282 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:50.996802 27282 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:50.997366 27282 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:50.998373 27282 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.000226 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3761) took 1065 ms. Trace:
I20260709 12:26:50.995374 27621 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:50.977362 27670 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:51.000880 27632 raft_consensus.cc:993] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:26:51.022028 27632 raft_consensus.cc:1081] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:26:51.003237 27661 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:50.954772 27528 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.012411 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:51.037160 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.015604 27561 raft_consensus.cc:2804] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:51.017895 18919 rpcz_store.cc:276] 0709 12:26:49.934732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.984528 (+ 49796us) service_pool.cc:224] Handling call
0709 12:26:49.984970 (+   442us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:26:50.022098 (+ 37128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:50.022148 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:26:50.023082 (+   934us) log.cc:844] Serialized 78 byte log entry
0709 12:26:50.560894 (+537812us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b18002ddc00. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:26:50.622157 (+ 61263us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:50.622238 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.622376 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.999723 (+377347us) raft_consensus.cc:1685] finished
0709 12:26:50.999746 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.000031 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30384,"raft.queue_time_us":30529,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7305,"spinlock_wait_cycles":21178240,"thread_start_us":60732,"threads_started":1,"wal-append.queue_time_us":777771}
I20260709 12:26:51.046478 27630 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.047231 27630 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.008361 27677 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:50.988610 27382 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:51.051554 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.052982 27382 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:51.054498 27677 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.055529 27561 raft_consensus.cc:697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:51.056829 27561 consensus_queue.cc:237] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 23.21, Last appended by leader: 21, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.059912 27677 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:51.062762 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.063004 27682 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:51.063486 27682 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:51.064077 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:51.064756 18921 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:51.065511 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.066059 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:51.073670 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.081895 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 216803us
I20260709 12:26:51.081157 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.081867 18914 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:50.961398 27538 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.106894 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:51.115309 18918 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 31.
I20260709 12:26:51.118412 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:51.123099 19491 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:26:51.123577 19491 pending_rounds.cc:85] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 16
I20260709 12:26:51.123836 19491 pending_rounds.cc:107] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:26:51.124152 19491 raft_consensus.cc:2889] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:51.124099 27665 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.127310 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.128130 19490 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 31.
I20260709 12:26:51.118808 27654 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:26:51.134560 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.136444 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.051561 27630 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:51.145182 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.147794 18918 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:51.149487 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:51.158049 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.006672 27655 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.169950 18922 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:26:51.183990 18914 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:51.064571 27682 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.163844 18739 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:51.141122 27639 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.196293 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.198539 27563 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:26:51.199940 27563 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.200652 27563 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.188345 27665 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.208242 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.209479 18918 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:51.210690 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:51.210917 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 198689us
I20260709 12:26:51.212656 27677 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:51.210830 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.223639 27703 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:51.232672 27703 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.233613 27264 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.234833 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.235944 18922 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 26: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:51.214694 27666 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:51.244408 27666 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.248467 27682 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:51.185065 27654 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:51.224772 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.188223 27626 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.253623 27626 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:51.260072 27525 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:51.260751 27525 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:26:51.229007 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 121041us
I20260709 12:26:51.270146 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:51.290763 18916 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
W20260709 12:26:51.294072 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.295704 27382 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:51.296710 27595 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.262013 27525 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.297537 27525 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:51.297325 27595 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.296545 27382 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:51.306546 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 295075us
W20260709 12:26:51.357484 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.372673 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:51.365971 27631 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:26:51.314518 27626 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 12:26:51.371554 27264 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.406615 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:51.407575 18917 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:51.402213 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:51.392187 27631 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.432152 27538 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:51.432612 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 160940us
I20260709 12:26:51.433827 27703 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.436416 27621 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.411338 27666 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:51.440171 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44088us
W20260709 12:26:51.442526 27691 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:26:51.442672 27282 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:51.404458 27630 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:26:51.447430 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 234688us
I20260709 12:26:51.420432 27631 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:26:51.457978 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:51.459090 27666 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.459785 27666 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.464685 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:51.466573 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.476632 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:51.477795 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.475919 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:51.647004 18769 raft_consensus.cc:2410] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 29 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 17.
I20260709 12:26:51.482463 27528 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.426882 27563 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.462173 27666 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:51.529554 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 71954.2us
W20260709 12:26:51.650131 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.650645 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.553740 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.554512 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.556942 27558 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:51.562739 18914 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:51.469197 27264 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.494612 27595 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:51.653950 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.612396 27708 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.070s	user 0.002s	sys 0.003s
I20260709 12:26:51.613262 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.616233 18920 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 14. (term mismatch)
I20260709 12:26:51.655233 18920 pending_rounds.cc:85] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 13
I20260709 12:26:51.616650 27202 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:51.618345 18913 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 15. (term mismatch)
I20260709 12:26:51.658448 18913 pending_rounds.cc:85] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 14
I20260709 12:26:51.658816 18913 pending_rounds.cc:107] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 24.15
I20260709 12:26:51.659126 18913 raft_consensus.cc:2889] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:51.623121 27670 consensus_meta.cc:287] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.602s	user 0.013s	sys 0.004s
I20260709 12:26:51.475870 27638 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:51.624815 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.626005 27382 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:51.626739 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 174216us
I20260709 12:26:51.661207 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:51.661875 18920 pending_rounds.cc:107] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 25.14
I20260709 12:26:51.662437 18920 raft_consensus.cc:2889] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:51.627313 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:51.627619 27621 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:51.628782 27702 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.202s	user 0.000s	sys 0.005s
W20260709 12:26:51.629706 27661 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.002s
W20260709 12:26:51.632937 18921 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
I20260709 12:26:51.635318 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.645334 19488 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:51.609838 27630 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:51.650906 18917 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:51.674688 18921 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:51.678059 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.681954 18765 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
W20260709 12:26:51.682183 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.684801 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.696760 19492 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:51.700460 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.702685 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.685022 27525 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:51.685544 27682 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:51.666668 27670 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.718961 27525 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:51.733618 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.739037 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:51.740311 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.741346 19492 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:51.741554 27595 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:51.747314 27525 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.694854 27638 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:51.783120 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.791179 18768 raft_consensus.cc:2368] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 24. Current term is 25.
I20260709 12:26:51.713692 27330 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 12:26:51.770330 27595 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:51.815946 18739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.001s	sys 0.009s
W20260709 12:26:51.823144 18739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.001s	sys 0.009s
W20260709 12:26:51.823707 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 659945us
I20260709 12:26:51.826124 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.827597 19492 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:51.830271 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.830754 27706 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:51.831190 19488 raft_consensus.cc:2368] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:51.831386 27706 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.833799 27706 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:51.834062 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.834523 27639 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.835024 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.835150 27639 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.836374 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.803269 27293 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:26:51.837172 18771 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:51.837788 27639 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.838889 18771 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 18. (term mismatch)
I20260709 12:26:51.838977 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.839414 18771 pending_rounds.cc:85] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 17
I20260709 12:26:51.839690 18771 pending_rounds.cc:107] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 28.18
I20260709 12:26:51.839955 18771 raft_consensus.cc:2889] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:51.847426 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:51.848378 18764 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:26:51.847142 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:51.857177 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.872704 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:51.878221 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:51.877980 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:51.888708 27202 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.889333 27202 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:51.885646 27631 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.891149 27638 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:51.892722 27631 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:51.893348 18886 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.529s (SENT)
I20260709 12:26:51.891263 18769 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 30. Current term is 32. Ops: []
I20260709 12:26:51.893890 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:51.895277 27558 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:26:51.896565 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.897517 18771 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:26:51.898370 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.898876 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.899586 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.900020 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.900774 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.901137 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.902010 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.906023 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.909114 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.906901 18773 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:51.911478 18772 raft_consensus.cc:2410] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:26:51.916869 18764 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 29.
I20260709 12:26:51.908577 27638 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.926503 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.930438 27626 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:51.914049 27621 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:51.932829 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.941449 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:51.942059 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.942616 18772 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:26:51.944558 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:51.942749 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.947903 19458 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:51.928646 27670 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:51.911686 27595 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:51.959199 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.959506 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:51.956369 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.931460 27626 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.965539 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:51.965204 18915 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 21. Preceding OpId from leader: term: 24 index: 22. (index mismatch)
W20260709 12:26:51.951977 27632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.013s	sys 0.016s
I20260709 12:26:51.954784 27538 raft_consensus.cc:2804] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:51.953094 27525 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:51.971024 18771 raft_consensus.cc:2368] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23.
I20260709 12:26:51.971899 18764 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 12:26:51.954777 27264 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:51.971804 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:51.961736 27558 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.979435 18772 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 12:26:51.979967 18772 pending_rounds.cc:85] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 13
I20260709 12:26:51.980276 18772 pending_rounds.cc:107] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 12:26:51.980580 18772 raft_consensus.cc:2889] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:51.977490 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:51.978137 18847 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:51.949566 27638 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:51.984596 18840 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:51.993392 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:51.997785 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.998724 18916 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:51.974567 27525 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.000985 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:51.997017 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.005053 19490 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:26:51.995462 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:51.962741 27621 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.004204 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:52.007408 19491 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:52.012485 27626 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:51.986002 27558 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:52.015347 27720 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:26:52.017831 27558 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:52.019730 27202 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:52.007598 27525 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:51.988747 27538 raft_consensus.cc:697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:52.010190 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:52.005215 18845 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:26:52.056044 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74801.7us
I20260709 12:26:52.059175 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:52.056612 27701 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:26:52.064363 18847 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
W20260709 12:26:52.072115 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.970552 27632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.013s	sys 0.016s
I20260709 12:26:52.139411 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:52.139935 18840 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:52.145805 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:52.148012 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:52.149116 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:52.153499 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.166954 18773 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 12. (term mismatch)
I20260709 12:26:52.155804 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.210350 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:52.188671 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.211695 18768 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:52.205076 18773 pending_rounds.cc:85] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 11
I20260709 12:26:52.218288 18773 pending_rounds.cc:107] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 24.12
I20260709 12:26:52.219087 18773 raft_consensus.cc:2889] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:52.215091 18766 raft_consensus.cc:2410] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:26:52.059199 27654 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:26:52.224504 19456 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.692s (SENT)
W20260709 12:26:52.226800 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.223397 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:52.229328 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 267925us
W20260709 12:26:52.233021 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.225046 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:52.132599 27202 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.266331 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:52.267381 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 126496us
I20260709 12:26:52.224366 27654 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:52.251401 27682 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.281543 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:52.282627 18772 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:52.287485 18916 raft_consensus.cc:2393] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 24: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:52.291817 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:52.300130 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75652.8us
I20260709 12:26:52.302000 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.302480 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.303280 18841 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 25: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:52.259657 27202 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:52.295385 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:52.340538 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57441.3us
I20260709 12:26:52.346979 18840 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:52.346575 18769 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
W20260709 12:26:52.356598 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67031.2us
W20260709 12:26:52.363373 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 97173.7us
I20260709 12:26:52.282881 27682 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.369256 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:52.373274 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.374188 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.366549 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.381844 18841 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
W20260709 12:26:52.403625 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.405548 18772 raft_consensus.cc:2410] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:26:52.417286 18914 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:26:52.406924 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.410044 18769 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:52.422294 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.425807 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.430445 19490 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 32.
I20260709 12:26:52.434465 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:52.435545 27723 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:26:52.436131 27723 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:52.437085 27723 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 30.21, Last appended by leader: 21, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.444020 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.427304 18773 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:52.397068 27639 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.420548 18845 raft_consensus.cc:2376] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23. Re-sending same reply.
I20260709 12:26:52.425758 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:52.360370 27538 consensus_queue.cc:237] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.459955 18847 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:26:52.463740 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.380482 27654 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:52.479305 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.481384 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.492820 18769 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:52.454174 27293 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:52.497898 18768 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:26:52.495384 19491 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
W20260709 12:26:52.469344 27734 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:26:52.500113 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:52.469292 27738 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:26:52.470026 27739 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:26:52.505399 27632 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:52.478716 27621 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:52.478094 27639 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:52.466382 27638 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:52.512468 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.456564 27741 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 12:26:52.559032 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.547845 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.468662 27604 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.181s
W20260709 12:26:52.565476 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.601051 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 208583us
I20260709 12:26:52.554944 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1601) took 1095 ms. Trace:
I20260709 12:26:52.601708 18767 rpcz_store.cc:276] 0709 12:26:51.459733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.477041 (+ 17308us) service_pool.cc:224] Handling call
0709 12:26:51.610784 (+133743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:51.625319 (+ 14535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.625349 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:51.625882 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:26:51.955341 (+329459us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:51.955380 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.955446 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:52.554365 (+598919us) raft_consensus.cc:1685] finished
0709 12:26:52.554422 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:52.554655 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19254,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":329017,"threads_started":1,"wal-append.queue_time_us":920540}
W20260709 12:26:52.538894 19457 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.966s (SENT)
W20260709 12:26:52.604508 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.123s (SENT) [suppressed 50 similar messages]
W20260709 12:26:52.605332 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66554.4us
W20260709 12:26:52.524497 18886 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.667s (SENT)
W20260709 12:26:52.608148 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 83695.3us
W20260709 12:26:52.608763 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.609805 18886 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.773s (SENT)
I20260709 12:26:52.497152 27293 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:52.612388 27293 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:52.612941 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:52.613651 18922 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:52.500180 27382 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:26:52.533595 27749 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
I20260709 12:26:52.617149 18922 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:52.618124 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:52.618849 19491 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:26:52.570113 18840 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:26:52.611730 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:52.623261 18913 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:26:52.610181 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:52.629987 27293 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.631493 18845 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:52.634027 18913 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 32.
I20260709 12:26:52.542739 27282 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.637425 18839 raft_consensus.cc:1275] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:26:52.638185 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.516450 27525 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.528334 27682 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:52.644797 18772 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
W20260709 12:26:52.644972 27748 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:26:52.651144 27525 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:52.651669 27747 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:26:52.545032 27728 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.097s
W20260709 12:26:52.662478 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 86362.6us
I20260709 12:26:52.599908 27202 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:52.635425 27632 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:52.659696 27739 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:26:52.674649 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64906.1us
I20260709 12:26:52.675462 18772 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 12:26:52.681200 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.660144 27282 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.692648 18769 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:52.691504 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:52.672163 27726 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.386s	user 0.000s	sys 0.002s
I20260709 12:26:52.695030 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.688886 18840 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:52.697722 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.698835 18841 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
W20260709 12:26:52.695603 18886 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.619s (SENT)
I20260709 12:26:52.702364 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.703677 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.703760 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.704628 18769 raft_consensus.cc:2410] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 26 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 13.
I20260709 12:26:52.704866 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.705698 18766 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:26:52.702248 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.705396 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.668555 27661 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:52.709625 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:52.709792 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.712073 18921 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:26:52.712982 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.718695 18839 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:52.719276 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.719730 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.719962 18841 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:52.720355 18839 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:52.720934 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.721412 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.722234 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.722846 18848 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:52.723280 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.727083 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.727928 18844 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:52.743685 18846 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:52.745399 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.751235 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.751991 18842 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:26:52.753273 18842 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:26:52.758420 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.759505 18773 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
W20260709 12:26:52.764478 18887 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.619s (SENT)
I20260709 12:26:52.721594 18841 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:52.674674 27666 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:26:52.682698 27754 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:26:52.786765 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.787765 18847 raft_consensus.cc:3060] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:52.746264 18846 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:52.774566 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.777402 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.790385 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 29 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.792013 18840 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:52.793682 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:52.799155 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:52.783069 27282 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:52.806334 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.807152 18840 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:52.788560 27293 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:52.767608 27661 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.809342 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.795728 27740 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:52.820303 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:52.806365 27725 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.347s	user 0.000s	sys 0.002s
I20260709 12:26:52.800453 27655 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:52.825452 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.826063 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:52.828399 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.830487 18840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:52.831103 18840 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.831457 18840 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:52.833333 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.798533 27712 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 12:26:52.808137 27758 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:52.837754 18917 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:52.837127 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.839458 18764 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:52.836068 18845 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:52.847173 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:52.853397 27752 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:26:52.855254 27716 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:52.855801 27716 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.856164 27716 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:52.856567 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.858726 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.858871 27682 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.859555 27682 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:52.859097 18766 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
I20260709 12:26:52.871773 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.877310 18848 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:26:52.878652 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 183092us
W20260709 12:26:52.885381 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.820276 27630 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:26:52.836026 27655 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:52.890636 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.891431 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.806233 27632 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.896276 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.899252 18845 raft_consensus.cc:3060] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 22
W20260709 12:26:52.893163 18887 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.653s (SENT)
I20260709 12:26:52.902729 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.908867 18764 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:52.910025 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.910576 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.912122 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.913187 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.914852 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.917371 18764 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:52.917539 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:52.915905 18840 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:52.924242 18847 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:26:52.925348 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.926724 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:52.927170 27760 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:26:52.927428 18764 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:52.927783 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.929000 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.929142 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:52.929706 18766 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:52.930773 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:52.930841 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:52.931160 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.667s (SENT)
I20260709 12:26:52.931562 18767 raft_consensus.cc:2376] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23. Re-sending same reply.
I20260709 12:26:52.931631 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:52.932809 27755 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:52.933578 27755 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:52.931579 18766 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:26:52.932682 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:52.936187 18764 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:26:52.939553 18767 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 28. Current term is 29. Ops: []
I20260709 12:26:52.940200 18766 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
W20260709 12:26:52.943150 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 112948us
I20260709 12:26:52.943961 18848 raft_consensus.cc:2368] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 25. Current term is 26.
I20260709 12:26:52.949868 18845 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:52.950754 18766 pending_rounds.cc:85] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 11
I20260709 12:26:52.951076 18766 pending_rounds.cc:107] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:26:52.946591 18841 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:52.951382 18766 raft_consensus.cc:2889] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:52.952134 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:52.952610 27724 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.877s	user 0.000s	sys 0.004s
I20260709 12:26:52.861611 27758 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:52.955374 27661 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:52.955518 27654 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:52.957403 27595 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:52.959026 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1600) took 1502 ms. Trace:
I20260709 12:26:52.920027 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:52.961220 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.951186 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.966958 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:52.918378 27639 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:52.974193 18846 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:52.972319 18840 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:52.972523 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:52.965610 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:52.970110 27595 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:52.970335 18770 rpcz_store.cc:276] 0709 12:26:51.459220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.462729 (+  3509us) service_pool.cc:224] Handling call
0709 12:26:51.463226 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:51.463575 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.463606 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:51.464166 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:26:51.935073 (+470907us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:26:51.935121 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.935202 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:52.958683 (+1023481us) raft_consensus.cc:1685] finished
0709 12:26:52.958706 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:52.958853 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":470425,"threads_started":1,"wal-append.queue_time_us":992312}
I20260709 12:26:52.975571 18764 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 12:26:52.977564 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.987282 27682 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:52.968354 27765 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:52.971871 18845 raft_consensus.cc:2376] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24. Re-sending same reply.
W20260709 12:26:52.978516 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.978842 18773 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
W20260709 12:26:52.980875 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60934us
I20260709 12:26:52.989949 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:52.984827 18844 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:52.994591 19491 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:52.997617 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.001601 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:53.001787 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72790.2us
I20260709 12:26:53.001888 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.002770 18845 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:53.002336 18919 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:53.011303 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:53.011345 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.011942 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:53.012547 18913 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:53.014783 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.015560 18841 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:26:52.994673 27754 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:26:53.019765 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.017017 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:53.024304 18887 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.759s (SENT)
I20260709 12:26:53.024808 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:53.007880 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:53.026651 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.028280 18764 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:53.029934 18773 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: [23.13-24.14]
I20260709 12:26:53.032461 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.033178 18841 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:26:53.034948 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.035633 18844 raft_consensus.cc:2376] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27. Re-sending same reply.
I20260709 12:26:53.039845 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.043612 27528 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:53.044018 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.058879 18844 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:53.026880 27736 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:53.060418 18841 raft_consensus.cc:1275] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 21. Preceding OpId from leader: term: 24 index: 22. (index mismatch)
I20260709 12:26:53.063287 18845 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:53.064566 18913 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:26:53.022680 27754 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:53.030678 27740 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:53.059289 27741 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:53.081460 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.084335 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:53.088732 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 64453.2us
I20260709 12:26:53.093587 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.099601 18918 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 30 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
W20260709 12:26:53.100623 27762 log.cc:927] Time spent T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:26:53.101519 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 95728.9us
I20260709 12:26:53.102624 18845 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:53.097016 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:53.080013 27754 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:53.112634 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:53.047292 27655 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:53.158259 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45745.5us
I20260709 12:26:53.159291 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:53.166568 18841 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:53.168120 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.106076 27682 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:53.173239 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:53.173710 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 174602us
I20260709 12:26:53.178720 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:53.181417 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.182294 18840 raft_consensus.cc:2368] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:26:53.166409 27741 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:53.166168 27421 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:53.243496 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75429us
I20260709 12:26:53.217515 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:53.172619 27740 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:53.172991 27682 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.245608 18845 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
W20260709 12:26:53.218976 27769 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:26:53.244701 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:53.185024 27558 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:53.258999 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:53.259171 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54160.7us
W20260709 12:26:53.252388 19457 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.656s (SENT)
I20260709 12:26:53.105983 27765 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.092s
I20260709 12:26:53.249925 18840 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:53.260010 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:53.264690 18841 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:26:53.267119 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:53.272226 27717 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:53.258306 27753 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:53.251179 27630 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:26:53.254614 27682 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:53.248914 27730 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:53.252183 27758 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:53.284552 18841 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:53.286804 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.287315 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.288113 18842 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:26:53.292423 18846 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:53.289202 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.250355 27421 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:53.272955 27717 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:53.299340 27730 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:53.332567 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.307353 27595 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:53.311492 27728 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:53.324035 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.337214 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.337934 18846 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:53.276372 27753 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:53.338614 27753 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:53.279831 27630 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.291247 27558 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:26:53.342612 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64861us
I20260709 12:26:53.342980 27558 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:53.343458 27558 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:53.345445 27741 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:53.346657 27741 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:53.347656 27755 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:26:53.348109 27755 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:53.348804 18848 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:26:53.349036 27755 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:53.350644 18847 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 26. Ops: []
I20260709 12:26:53.351122 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:53.327776 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.350147 18848 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 28. Current term is 29. Ops: []
I20260709 12:26:53.342650 27630 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:26:53.364993 27716 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 12:26:53.366074 27716 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:53.367480 18772 raft_consensus.cc:2368] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27.
W20260709 12:26:53.378959 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.382870 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.384750 18848 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:26:53.385972 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.386750 18841 raft_consensus.cc:2376] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22. Re-sending same reply.
I20260709 12:26:53.387890 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.388760 18842 raft_consensus.cc:2368] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:26:53.389791 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.391343 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.398525 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.353543 27755 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:26:53.432302 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.433370 18847 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:26:53.432477 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:53.435570 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:53.439108 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 246004us
I20260709 12:26:53.342069 27754 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:53.378490 27528 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:52.734560 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:53.430970 27595 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:53.376468 27740 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.109s
W20260709 12:26:53.511868 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 160821us
I20260709 12:26:53.427263 27728 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:53.527470 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.532262 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.488157 27630 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:53.571121 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 318739us
I20260709 12:26:53.508740 27753 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:53.569311 27733 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.105s	user 0.006s	sys 0.009s
I20260709 12:26:53.598222 27789 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:53.611944 27421 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:53.800998 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 204536us
I20260709 12:26:53.737099 27789 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:53.863883 27784 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 12:26:53.868333 27779 log.cc:927] Time spent T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.383s	user 0.011s	sys 0.003s
I20260709 12:26:53.869505 27740 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:53.788642 27717 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:53.879127 27782 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.880926 27728 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:53.882320 27630 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:53.879254 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1613) took 2064 ms. Trace:
I20260709 12:26:53.883397 18765 rpcz_store.cc:276] 0709 12:26:51.814549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.814720 (+   171us) service_pool.cc:224] Handling call
0709 12:26:51.830253 (+ 15533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:51.876077 (+ 45824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.876125 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:51.891862 (+ 15737us) log.cc:844] Serialized 26 byte log entry
0709 12:26:52.225318 (+333456us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:52.225356 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.225426 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:53.428111 (+1202685us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:53.856679 (+428568us) raft_consensus.cc:1685] finished
0709 12:26:53.856715 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.879158 (+ 22443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30147,"raft.queue_time_us":50633,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":21459,"spinlock_wait_cycles":32652672,"thread_start_us":333071,"threads_started":1,"wal-append.queue_time_us":504547}
W20260709 12:26:53.889050 27654 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.919s	user 0.012s	sys 0.000s
I20260709 12:26:53.891072 18769 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
W20260709 12:26:53.895519 27786 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.296s	user 0.000s	sys 0.000s
I20260709 12:26:53.724740 27558 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:53.899399 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:53.905090 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 302361us
W20260709 12:26:53.906555 18887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.907680 19457 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.826s (SENT)
I20260709 12:26:53.881319 27782 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:53.920043 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:53.923705 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.855921 27789 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:53.927320 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.916047 27558 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:53.940511 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 427524us
I20260709 12:26:53.943576 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:53.944464 18918 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:53.925254 27728 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:53.926353 27754 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:53.950628 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.961902 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.962884 18847 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
W20260709 12:26:53.965548 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.965548 18886 leader_election.cc:400] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27.
W20260709 12:26:53.967521 18737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.022s	sys 0.013s
I20260709 12:26:53.967423 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:53.968045 18737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.022s	sys 0.014s
W20260709 12:26:53.969907 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 62276.7us
I20260709 12:26:53.972188 18843 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:26:53.966894 18886 leader_election.cc:403] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:26:53.976712 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.952661 27615 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:26:53.984350 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:53.985035 18765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:53.967171 27754 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:53.973238 27654 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.991107 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.988687 18765 raft_consensus.cc:606] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Received request to transfer leadership to TS 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:53.989283 19457 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 3.363s (SENT)
I20260709 12:26:53.971091 27630 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:53.959172 27728 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:53.995818 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3547) took 1275 ms. Trace:
I20260709 12:26:54.028427 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:54.029984 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.994741 18843 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:54.040936 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:54.042630 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:54.023582 27661 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:54.049854 18840 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:26:54.044909 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 65393.7us
W20260709 12:26:54.053398 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 104286us
W20260709 12:26:54.061780 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.062057 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:54.062472 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 125595us
W20260709 12:26:54.062665 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.031286 27723 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.023675 27799 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:54.068815 19487 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 30 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:26:54.065557 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.067377 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:53.995626 27654 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.064597 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:54.078356 18844 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:54.063961 27421 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:26:54.073176 27778 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:26:54.073421 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:54.037902 27753 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:54.073719 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:54.074071 18770 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:54.074968 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.077361 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:54.046891 18839 rpcz_store.cc:276] 0709 12:26:52.720098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.855405 (+135307us) service_pool.cc:224] Handling call
0709 12:26:52.855834 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.994386 (+138552us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:26:53.016773 (+ 22387us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.101563 (+ 84790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:53.101619 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:53.101664 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.995502 (+893838us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400108bd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:53.995567 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.995740 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21186,"prepare.queue_time_us":22464,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":814,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":2398,"spinlock_wait_cycles":299577088,"thread_start_us":57847,"threads_started":1,"wal-append.queue_time_us":164628}
I20260709 12:26:54.082583 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.084429 18916 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:54.070168 18843 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:54.086755 18914 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30. Ops: []
I20260709 12:26:54.025655 27754 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.092195 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:54.096622 18764 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:54.090204 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:54.098281 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:54.099041 18771 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:54.093991 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:54.088382 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:26:54.090735 19457 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.530s (SENT)
I20260709 12:26:54.095456 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:54.103034 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.872s (SENT)
I20260709 12:26:54.103505 18767 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:54.103570 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:54.101815 19486 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:54.098094 27717 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:54.110700 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.116384 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:54.130151 18771 raft_consensus.cc:2468] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 30.
I20260709 12:26:54.087327 27793 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:54.084337 27421 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:54.095715 27558 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:54.151712 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:54.122531 19457 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.033s (SENT)
I20260709 12:26:54.110065 27797 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:54.092406 27791 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:54.066864 27630 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.160539 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.157037 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:54.157780 18839 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:54.158028 18840 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:26:54.078773 27723 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.165402 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:54.127345 27615 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:54.169857 18764 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:54.171962 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:54.155020 27421 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:54.110090 27785 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.057s
I20260709 12:26:54.183780 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1633) took 1006 ms. Trace:
I20260709 12:26:54.155391 27661 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:54.087494 27799 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.204138 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:54.141716 27793 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:54.153162 27728 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.191767 18773 rpcz_store.cc:276] 0709 12:26:53.177551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.178567 (+  1016us) service_pool.cc:224] Handling call
0709 12:26:53.178879 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:53.179245 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:53.179268 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:53.183269 (+  4001us) log.cc:844] Serialized 26 byte log entry
0709 12:26:53.543669 (+360400us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:53.543712 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.543779 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:54.183433 (+639654us) raft_consensus.cc:1685] finished
0709 12:26:54.183466 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.183688 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2752,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4411,"thread_start_us":357546,"threads_started":1,"wal-append.queue_time_us":610432}
I20260709 12:26:54.214359 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:54.173944 27798 raft_consensus.cc:2764] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:26:54.174409 27782 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.225085 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:54.191870 27615 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:54.221323 27682 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.928s	user 0.010s	sys 0.005s
I20260709 12:26:54.226887 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:54.222456 27661 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:54.237725 27615 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:54.237807 27804 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:54.243535 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.640s (SENT)
W20260709 12:26:54.264748 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104339us
I20260709 12:26:54.245532 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:54.267078 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:54.272033 18773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:54.274832 18773 raft_consensus.cc:606] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.220638 27728 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:26:54.191041 27797 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.241474 27661 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:54.301344 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57849.2us
I20260709 12:26:54.302697 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.235474 27682 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:54.307399 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.662s (SENT)
I20260709 12:26:54.288697 27654 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.313392 18767 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:54.191138 27791 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.303064 27661 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:54.299671 27746 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:54.378651 27803 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 12:26:54.380323 27808 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:26:54.305601 27806 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:54.306209 27798 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:54.410754 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 103358us
I20260709 12:26:54.312956 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:54.241389 18656 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf32cd3655eb4943abc0cdbf54a32206 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 43b520eabb65493abe84f4cf06806cba is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:26:54.448212 18656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 352064us
W20260709 12:26:54.374485 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.236145 27793 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.450438 27793 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:54.378654 27202 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.077s
I20260709 12:26:54.289449 27804 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.366017 27792 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:54.467839 27682 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.475872 27741 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:54.477209 27791 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.478150 27812 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:54.478931 27812 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:54.452979 27754 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:54.500305 27796 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.457s	user 0.004s	sys 0.009s
I20260709 12:26:54.457196 27799 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.504513 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3652) took 1064 ms. Trace:
W20260709 12:26:54.507650 27757 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.656s	user 0.008s	sys 0.024s
I20260709 12:26:54.505046 18913 rpcz_store.cc:276] 0709 12:26:53.440497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.440659 (+   162us) service_pool.cc:224] Handling call
0709 12:26:53.441195 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:53.636854 (+195659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:53.636909 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:53.639448 (+  2539us) log.cc:844] Serialized 26 byte log entry
0709 12:26:53.922755 (+283307us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:53.922824 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.922992 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:54.499530 (+576538us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:54.504119 (+  4589us) raft_consensus.cc:1685] finished
0709 12:26:54.504153 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.504428 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153618,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3940,"spinlock_wait_cycles":13682432,"thread_start_us":332740,"threads_started":2,"wal-append.queue_time_us":255042}
I20260709 12:26:54.515070 19486 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
W20260709 12:26:54.482672 27755 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.990s	user 0.010s	sys 0.005s
I20260709 12:26:54.506044 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:54.546978 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 242114us
W20260709 12:26:54.494810 27595 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.990s	user 0.012s	sys 0.003s
W20260709 12:26:54.558195 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 435666us
I20260709 12:26:54.561600 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
W20260709 12:26:54.562295 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.159s (SENT)
I20260709 12:26:54.562546 19483 raft_consensus.cc:606] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.562834 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:54.563126 19483 raft_consensus.cc:614] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:54.494029 27630 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.479964 27812 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.524058 27604 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:26:54.495560 27791 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:26:54.559299 27811 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:54.560380 27799 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:54.611585 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49307.9us
W20260709 12:26:54.612254 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 106288us
I20260709 12:26:54.485711 27792 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:54.613448 19457 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.784s (SENT)
I20260709 12:26:54.563024 27793 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.615401 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.609349 27811 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:54.614483 27773 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:54.629987 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:54.630041 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 317340us
I20260709 12:26:54.616225 27730 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.631305 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:54.631999 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:54.637341 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.640058 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:54.628443 27382 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:54.614902 27799 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.632591 27528 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.652308 27804 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.637135 27754 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:26:54.648672 27807 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:26:54.629253 27811 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:54.650261 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.651491 27670 raft_consensus.cc:993] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: : Instructing follower 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:26:54.635818 27525 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.654364 27528 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.626358 27793 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.642130 27755 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:54.672676 18772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f"
dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:37870
I20260709 12:26:54.647727 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:54.641400 27798 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:54.675570 27798 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.676034 27798 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:54.652818 27730 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:54.678133 27730 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:54.678608 27730 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:54.679227 18769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3656) took 1879 ms (client timeout 1952 ms). Trace:
W20260709 12:26:54.679652 18769 rpcz_store.cc:269] 0709 12:26:52.799507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.837569 (+ 38062us) service_pool.cc:224] Handling call
0709 12:26:54.679020 (+1841451us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001c2854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:54.679137 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372438400}
I20260709 12:26:54.680562 27755 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:54.669368 27797 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:54.680402 27791 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:54.685638 27793 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.686270 27792 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.683231 27755 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:26:54.687224 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.689787 27789 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.004s
I20260709 12:26:54.692232 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:54.693552 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 141870us
I20260709 12:26:54.698608 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.699434 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.700431 19490 raft_consensus.cc:2368] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25.
I20260709 12:26:54.699451 19488 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:54.702595 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.696630 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:54.721730 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.695526 27824 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:54.726719 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.727555 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.695609 27630 raft_consensus.cc:1081] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Signalling peer 47b48b5c69f245b79ecb292eff89927f to start an election
I20260709 12:26:54.690291 27789 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:54.738670 27421 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.003s
I20260709 12:26:54.739728 27421 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.719353 27818 consensus_queue.cc:1059] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 29.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:26:54.742079 27421 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.716464 27807 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:54.681578 27525 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:54.743288 27813 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.191s	user 0.002s	sys 0.001s
I20260709 12:26:54.744908 27525 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.745826 27817 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:54.747776 27716 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:54.750152 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 52476.7us
I20260709 12:26:54.752576 27716 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:26:54.752840 18738 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.759425 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:54.724716 27754 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:26:54.753696 27716 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:54.806468 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:54.810532 19487 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:54.808702 18886 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:54.764744 27421 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:26:54.818502 18773 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:54.753931 27789 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:54.807782 27797 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.814052 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:54.814713 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:54.823884 19458 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:54.817242 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:54.817436 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:54.818907 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:54.737035 27824 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:54.826422 19488 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:26:54.767669 27826 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:54.768198 27670 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:54.826061 18770 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:54.766912 27791 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:54.766073 27630 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
I20260709 12:26:54.838526 19488 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:54.754163 27661 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.806155 27202 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:54.807144 27806 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.806922 27741 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:54.874671 27773 raft_consensus.cc:2804] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:54.841588 18765 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:54.828272 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:54.898561 27202 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.898932 18769 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
I20260709 12:26:54.809894 27716 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:54.901047 27716 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.811398 27654 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:54.903002 27528 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:54.902918 27654 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.904382 27730 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.849413 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:54.860257 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:54.907097 18773 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:54.910622 18768 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:54.913151 27716 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:26:54.868580 27774 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:26:54.915035 27654 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.858254 27670 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.916885 18771 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 30.
I20260709 12:26:54.917995 27670 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.919422 27799 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:54.848649 27797 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.920250 18773 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
W20260709 12:26:54.922967 27558 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.764s	user 0.013s	sys 0.000s
I20260709 12:26:54.923487 27558 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27.
I20260709 12:26:54.862686 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:54.863729 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.927209 19487 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:26:54.822027 27792 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:54.928143 27792 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.930867 18772 raft_consensus.cc:606] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:54.931272 18772 raft_consensus.cc:614] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:54.827961 27595 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.867902 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:54.936520 18919 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:54.868387 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:54.871459 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:54.873749 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49995us
I20260709 12:26:54.941690 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.941908 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.942435 19491 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:54.942458 19486 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 15.
I20260709 12:26:54.909829 27755 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.930279 27792 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.843616 27826 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:54.894318 27723 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:54.893873 27824 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.863315 27791 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:54.895531 27806 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.932019 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.932737 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:54.933713 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:26:54.890159 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 164858us
I20260709 12:26:54.860697 27807 raft_consensus.cc:2804] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:26:54.945946 27773 raft_consensus.cc:697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:54.989357 18913 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:26:54.901131 27202 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:54.964707 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 96882.6us
I20260709 12:26:54.945691 27595 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:54.992686 18916 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:54.992982 18918 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
W20260709 12:26:54.995478 18812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.015s	sys 0.003s
W20260709 12:26:54.996551 18812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.015s	sys 0.003s
I20260709 12:26:54.996143 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:54.994336 18921 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:54.997087 18845 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:55.000721 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:55.000849 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.001434 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.002233 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:55.002425 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.002846 18840 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:55.005867 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:55.006953 18844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:55.007768 18844 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:55.008325 18844 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:55.008661 18768 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:55.008594 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.009652 18769 raft_consensus.cc:2410] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:26:55.010648 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:55.011718 18847 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:26:55.011590 18843 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:26:55.014755 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:55.015399 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:55.019176 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:55.019428 18773 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:55.019629 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:55.020015 18771 raft_consensus.cc:2368] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26.
W20260709 12:26:55.014132 18812 connection.cc:256] RPC call timeout handler was delayed by -1.4132972839997819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:26:55.020558 18812 connection.cc:256] RPC call timeout handler was delayed by -1.4060972839997703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:26:55.020902 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3700972839997121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 12:26:55.021227 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3592972839996946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:26:55.021531 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3547972839996874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 12:26:55.021827 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3538972839996859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 12:26:55.021999 18766 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []
W20260709 12:26:55.022181 18812 connection.cc:256] RPC call timeout handler was delayed by -1.3259972839996408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 12:26:55.022535 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2692972840000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 12:26:55.022946 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2548972839999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 12:26:55.023885 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:55.024420 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 90790.3us
I20260709 12:26:55.024847 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:55.025205 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 214626us
I20260709 12:26:55.025581 18839 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
W20260709 12:26:55.026592 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2404972839999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 12:26:55.027112 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2170972839999195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:26:55.027518 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2044972839998991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:26:55.027899 18812 connection.cc:256] RPC call timeout handler was delayed by -1.2044972839998991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:26:55.028281 18812 connection.cc:256] RPC call timeout handler was delayed by -1.1423972839997987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 12:26:55.028676 18812 connection.cc:256] RPC call timeout handler was delayed by -1.1324972839997827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 12:26:55.029942 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.019444 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:55.031499 18812 connection.cc:256] RPC call timeout handler was delayed by -1.0388972839996313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
I20260709 12:26:55.031637 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:55.031890 18812 connection.cc:256] RPC call timeout handler was delayed by -1.0190972839995993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
I20260709 12:26:55.032274 18845 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:55.025880 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:55.033605 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:55.035346 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:54.995132 27604 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:26:55.037245 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:55.010143 27807 raft_consensus.cc:697] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 30 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:55.037907 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:55.044056 18840 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:55.017117 27716 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:55.019219 27717 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:55.029461 27825 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:26:55.041651 27838 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:26:55.049933 27806 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:55.052203 27791 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:55.088807 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:55.037437 27661 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:55.053329 27837 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:55.054488 27844 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:26:55.059832 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:55.073216 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.030939 27827 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.077796 27654 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:55.080488 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:55.107932 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:55.096624 18845 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:55.081998 27754 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:55.034546 27774 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:55.103474 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.106228 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:55.111563 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:55.086688 27746 consensus_queue.cc:1048] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
W20260709 12:26:55.119376 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 84747us
I20260709 12:26:55.123247 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:55.110229 27654 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.087296 27717 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:55.084024 27716 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:55.108538 18844 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:55.121806 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:55.131407 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93583.3us
I20260709 12:26:55.125483 19490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e"
dest_uuid: "43b520eabb65493abe84f4cf06806cba"
mode: GRACEFUL
new_leader_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:56838
I20260709 12:26:55.094360 27800 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:26:55.084540 27811 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.109717 27844 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:55.135980 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 98829.9us
I20260709 12:26:55.116097 27525 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:55.038800 27826 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.135905 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:55.132201 27630 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:55.156353 27630 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:55.156855 27630 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:55.158085 27716 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:55.110055 27827 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.158458 27844 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:55.159768 18844 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:55.160527 27827 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:55.161345 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:55.130813 27654 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:55.173043 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:55.173343 27661 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:26:55.174172 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:55.128721 27754 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:55.175700 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:55.175419 27754 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.177348 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:55.135094 27798 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.163311 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:55.140260 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:55.171507 18765 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:26:55.130965 27846 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:55.121905 27774 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.169286 18886 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:55.192946 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:55.210059 18916 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:55.193732 18915 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 30 because replica has last-logged OpId of term: 28 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 15.
I20260709 12:26:55.130237 27202 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:55.204146 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:55.207830 18921 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:26:55.155660 27829 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:55.127627 27807 consensus_queue.cc:237] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:55.227686 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93459.8us
I20260709 12:26:55.190696 27799 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:26:55.162837 27525 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:55.227269 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:55.202870 27826 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:55.222456 18767 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:26:55.221807 27798 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:55.111241 27773 consensus_queue.cc:237] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:55.191726 27421 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:26:55.194423 27846 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:55.229782 18921 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:55.203832 27716 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:26:55.244150 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 136282us
I20260709 12:26:55.201823 27755 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:55.206194 27774 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:55.204001 27670 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:55.235510 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:55.235769 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:55.211977 27595 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:55.233069 27525 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:55.236510 27421 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.247139 27846 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:55.252038 27421 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:55.254949 27797 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:55.245630 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:55.247092 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 69810.2us
W20260709 12:26:55.236114 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66965.1us
I20260709 12:26:55.263574 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:55.264041 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:55.230921 27799 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:55.267347 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.268545 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.269145 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:55.269228 18765 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:55.269407 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.270433 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.275846 18916 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:55.276944 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:55.277595 18916 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:26:55.282812 18840 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:55.283452 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:55.285585 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:55.249625 27836 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:26:55.271903 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:55.286707 18843 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:55.292354 18916 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:26:55.291031 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.271085 18772 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:55.244627 27791 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:26:55.244649 27716 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:55.290556 19483 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:26:55.294132 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:55.294813 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:55.294204 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:55.297958 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:55.301822 18848 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:55.291975 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:55.301169 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70377.1us
I20260709 12:26:55.297546 27741 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:55.304458 27741 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:55.304787 27848 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:55.304911 27780 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:55.234642 27819 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.217s
I20260709 12:26:55.280200 27799 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:26:55.288551 27670 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:55.305051 27741 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:55.289223 27842 raft_consensus.cc:2764] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:26:55.291882 27840 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:55.297924 27828 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:55.328277 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:55.304499 27849 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:55.302237 27716 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:55.357554 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 65653.3us
I20260709 12:26:55.359570 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3809) took 1284 ms. Trace:
I20260709 12:26:55.360047 18920 rpcz_store.cc:276] 0709 12:26:54.074920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.076511 (+  1591us) service_pool.cc:224] Handling call
0709 12:26:54.083406 (+  6895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.143187 (+ 59781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.143236 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:54.143301 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:54.143349 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.359320 (+1215971us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540027c9d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:55.359369 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.359511 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136881536}
I20260709 12:26:55.361168 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:55.295929 27421 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.313540 27780 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:55.279062 27829 consensus_queue.cc:1048] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.045s
I20260709 12:26:55.320870 27853 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:55.318781 27848 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:55.373633 19483 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 26. Ops: []
I20260709 12:26:55.326355 27797 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:55.353693 27839 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:55.359918 27827 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:55.554638 27827 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.555145 27827 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:55.555312 27525 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:55.556814 19490 raft_consensus.cc:606] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Received request to transfer leadership to TS 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:55.557260 19490 raft_consensus.cc:614] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:55.355315 27828 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:55.559342 27828 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.560796 27828 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:55.386740 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 83429us
I20260709 12:26:55.564909 18812 leader_election.cc:400] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23.
I20260709 12:26:55.565346 18812 leader_election.cc:403] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:26:55.372430 27791 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:55.485754 27858 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 12:26:55.201969 27804 consensus_queue.cc:1175] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 24 status { last_received { term: 23 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:55.567148 27791 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.486196 27831 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:55.359709 27840 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:55.486999 27850 log.cc:927] Time spent T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:26:55.378209 27797 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.499269 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:55.487886 27848 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:55.502619 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 141564us
I20260709 12:26:55.503165 27863 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:55.526551 27780 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:55.516666 19457 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.618s (SENT)
I20260709 12:26:55.447873 27839 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:55.733058 27525 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:55.499657 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:55.494953 27811 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:55.742748 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 136806us
W20260709 12:26:55.820197 18848 consensus_meta.cc:287] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.500s	user 0.002s	sys 0.006s
I20260709 12:26:55.820848 18848 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:55.541713 27654 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.849643 18812 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:55.612730 27853 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:55.732029 27799 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:55.781025 27797 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:55.531889 27670 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:55.537564 27854 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:26:55.797015 27839 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:55.589692 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:55.869316 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 294921us
I20260709 12:26:55.539306 27421 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:55.753273 27863 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:55.619110 27818 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23.
W20260709 12:26:55.793895 27773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.018s	sys 0.022s
W20260709 12:26:55.794061 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 277449us
I20260709 12:26:55.828421 27558 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:55.859983 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:55.853833 18841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.030s	sys 0.069s
I20260709 12:26:55.531565 27717 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:55.873651 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:55.886065 27716 consensus_meta.cc:287] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.003s
I20260709 12:26:55.543953 27846 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:55.892445 18841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.030s	sys 0.070s
I20260709 12:26:55.867338 27728 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.895177 27558 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:55.892050 27773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.018s	sys 0.026s
I20260709 12:26:55.931945 27832 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.193s
I20260709 12:26:55.931442 27595 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:26:55.940043 19457 leader_election.cc:336] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.961s (SENT)
W20260709 12:26:55.940965 27630 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.000s
I20260709 12:26:55.943892 27789 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:55.942319 27654 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:55.952960 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:55.961752 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.011889 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:55.963225 27862 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:26:55.976989 27730 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:55.978700 27528 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:55.980640 27821 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:55.932677 27866 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:55.989501 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 128031us
I20260709 12:26:55.856061 27754 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:55.930716 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 70850.5us
W20260709 12:26:55.991559 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.013s	sys 0.025s
W20260709 12:26:56.118314 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.013s	sys 0.025s
W20260709 12:26:56.118803 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 835404us
W20260709 12:26:55.994059 18919 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.015s	sys 0.024s
W20260709 12:26:56.122056 18919 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.016s	sys 0.024s
W20260709 12:26:55.995988 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 310484us
I20260709 12:26:55.871374 27765 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:55.996798 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.993901 27716 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:56.007335 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 67351.4us
I20260709 12:26:56.129554 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:55.893010 27863 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:55.990360 27741 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.669s	user 0.000s	sys 0.010s
I20260709 12:26:56.137292 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:56.138260 19457 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.853s (SENT)
I20260709 12:26:56.138790 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:55.999418 27728 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.003140 27595 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:56.127331 18918 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:56.017103 27528 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:55.571009 27840 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.130620 18914 raft_consensus.cc:1240] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 30 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30. Ops: []
I20260709 12:26:56.130952 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:56.187398 18768 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:56.132084 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:56.132378 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:56.009737 27789 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:56.189179 18921 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:56.189801 27807 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:56.189648 27789 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.190862 27789 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:56.190652 27807 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:55.856622 27853 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.145386 18917 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []
W20260709 12:26:56.123396 27854 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:26:56.156005 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:56.217394 18845 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:56.219683 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:56.220104 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:56.145638 18913 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:56.154675 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:56.158602 27604 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:56.159561 18839 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:26:56.159672 27865 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:56.160666 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:56.222705 18847 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:56.020056 27821 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:56.194231 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:56.224016 18842 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:56.009367 27630 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.201581 18915 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:26:56.128633 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 104304us
I20260709 12:26:56.225399 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:56.230641 27869 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.292s	user 0.003s	sys 0.000s
W20260709 12:26:56.233863 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.234023 27814 raft_consensus.cc:3055] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:26:56.235033 18845 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:56.161916 27595 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:56.204401 19486 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.249881 27528 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.251263 27528 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:56.251317 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56838 (request call id 18) took 1126 ms. Trace:
I20260709 12:26:56.255475 19490 rpcz_store.cc:276] 0709 12:26:55.124866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.125345 (+   479us) service_pool.cc:224] Handling call
0709 12:26:56.251089 (+1125744us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54001f4854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af85853 00007f335ff5360a 00007f33594d97d4 00007f33594d9762 00007f33594d9691 00007f33594d960c 00007f33594d88c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:56.251215 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970484096}
W20260709 12:26:56.261343 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 391011us
I20260709 12:26:56.137777 27851 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:26:56.145386 27682 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.099s
I20260709 12:26:56.134791 27754 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.268882 18765 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:56.128177 27866 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:56.247102 27774 consensus_meta.cc:287] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.979s	user 0.012s	sys 0.000s
I20260709 12:26:56.283587 18916 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:56.184607 27765 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.090s
I20260709 12:26:56.145948 27741 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.234505 27814 raft_consensus.cc:740] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:56.298075 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3569) took 1280 ms. Trace:
I20260709 12:26:56.303617 27807 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.324383 18918 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 12:26:56.306732 27791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.010s	sys 0.010s
W20260709 12:26:56.326782 27791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.010s	sys 0.010s
W20260709 12:26:56.327534 27870 log.cc:927] Time spent T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 12:26:56.327508 27791 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:56.328233 27741 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.328414 27791 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.331148 27791 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.332445 27821 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.334678 27682 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:56.335144 27682 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:56.336110 27682 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.337586 27682 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:56.338471 27832 consensus_queue.cc:1175] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "43b520eabb65493abe84f4cf06806cba" responder_term: 24 status { last_received { term: 24 index: 18 } last_committed_idx: 18 last_received_current_leader { term: 24 index: 18 } }
I20260709 12:26:56.340268 27853 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.340517 27866 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.343417 19488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1747) took 1077 ms. Trace:
W20260709 12:26:56.344426 27827 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.788s	user 0.012s	sys 0.000s
I20260709 12:26:56.345152 27827 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.347983 27754 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.347360 27814 consensus_queue.cc:260] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.348968 27814 raft_consensus.cc:3060] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:26:56.351287 27812 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:56.298049 27774 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.356855 27774 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:56.357685 19491 raft_consensus.cc:1240] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:26:56.279896 27865 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:56.358728 27865 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.361112 27865 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.361994 27799 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:56.354480 27728 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:56.338778 27846 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:56.344758 19457 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.028s (SENT)
I20260709 12:26:56.343895 19488 rpcz_store.cc:276] 0709 12:26:55.265897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.287416 (+ 21519us) service_pool.cc:224] Handling call
0709 12:26:55.287833 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.294408 (+  6575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.294444 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:55.300429 (+  5985us) log.cc:844] Serialized 26 byte log entry
0709 12:26:55.782541 (+482112us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:26:55.782604 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.782726 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:56.343167 (+560441us) raft_consensus.cc:1685] finished
0709 12:26:56.343189 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.343343 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6719,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8827,"thread_start_us":460988,"threads_started":1,"wal-append.queue_time_us":567220}
I20260709 12:26:56.366905 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:56.305490 18846 rpcz_store.cc:276] 0709 12:26:55.018174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.018304 (+   130us) service_pool.cc:224] Handling call
0709 12:26:55.036611 (+ 18307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.060443 (+ 23832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.060497 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:55.078641 (+ 18144us) log.cc:844] Serialized 26 byte log entry
0709 12:26:55.226573 (+147932us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:26:55.244305 (+ 17732us) log.cc:844] Serialized 14 byte log entry
0709 12:26:55.244575 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.244655 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:55.950888 (+706233us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b1800409f00. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:26:56.278793 (+327905us) raft_consensus.cc:1685] finished
0709 12:26:56.297829 (+ 19036us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.298003 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15696,"prepare.queue_time_us":17520,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":11555,"raft.queue_time_us":54126,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":7011,"spinlock_wait_cycles":3602688,"thread_start_us":131942,"threads_started":1,"wal-append.queue_time_us":203503}
I20260709 12:26:56.368755 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:56.369661 18842 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:56.310667 18737 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:26:56.371284 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60716.9us
I20260709 12:26:56.320429 18847 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30.
W20260709 12:26:56.376772 19457 leader_election.cc:336] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.178s (SENT)
W20260709 12:26:56.377696 19457 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.219s (SENT)
I20260709 12:26:56.377830 18915 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 30 because replica has last-logged OpId of term: 28 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 15.
I20260709 12:26:56.378062 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:56.334088 27821 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:56.386231 19490 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:26:56.400838 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:56.327438 27716 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:56.339006 27630 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.402454 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:56.392468 27825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.010s	sys 0.045s
W20260709 12:26:56.400887 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.389501 27807 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.379913 27765 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:56.402930 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:56.386569 27774 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:56.390055 27830 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:56.425938 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.411409 27825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.010s	sys 0.045s
W20260709 12:26:56.441696 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.447316 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 283419us
I20260709 12:26:56.427731 27630 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:56.465565 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 322650us
W20260709 12:26:56.477519 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 252187us
I20260709 12:26:56.486833 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.488730 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:56.490927 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.517089 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.519627 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3673) took 1295 ms. Trace:
I20260709 12:26:56.447081 27826 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:56.523031 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:56.539321 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66924us
I20260709 12:26:56.520247 18919 rpcz_store.cc:276] 0709 12:26:55.224796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.232887 (+  8091us) service_pool.cc:224] Handling call
0709 12:26:55.243410 (+ 10523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.243667 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 22
0709 12:26:56.129262 (+885595us) log.cc:844] Serialized 14 byte log entry
0709 12:26:56.512825 (+383563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:56.519144 (+  6319us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:26:56.519219 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.519318 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.519544 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8954,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":50953,"thread_start_us":1203859,"threads_started":2}
I20260709 12:26:56.428004 27807 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:56.494961 27824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.015s
I20260709 12:26:56.544643 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:56.566742 18922 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:56.548396 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59764.7us
W20260709 12:26:56.555015 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.562923 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 180154us
I20260709 12:26:56.473035 27525 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.472720 27855 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:56.595577 27780 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:56.599392 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3691) took 1785 ms. Trace:
I20260709 12:26:56.599936 18767 rpcz_store.cc:276] 0709 12:26:54.814315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.814816 (+   501us) service_pool.cc:224] Handling call
0709 12:26:54.815242 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.231791 (+416549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.599006 (+1367215us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b540002e754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:56.599298 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935857536}
I20260709 12:26:56.603121 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:56.604641 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:56.612592 27877 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:26:56.615172 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.609891 27804 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:26:56.616837 27804 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:56.617938 27804 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:56.617986 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3700) took 1333 ms. Trace:
I20260709 12:26:56.623606 18768 rpcz_store.cc:276] 0709 12:26:55.284912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.760069 (+475157us) service_pool.cc:224] Handling call
0709 12:26:55.760335 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.197310 (+436975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.617713 (+420403us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54002a1a54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:56.617919 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981570432}
I20260709 12:26:56.618922 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:56.625135 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3699) took 1355 ms. Trace:
I20260709 12:26:56.625545 18771 rpcz_store.cc:276] 0709 12:26:55.269350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.270096 (+   746us) service_pool.cc:224] Handling call
0709 12:26:56.618796 (+1348700us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800003398. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66eee 000000000036eb39 00007f335feda1e0 00007f335ffa30c4 00007f335ffa3131 00007f335ff510a0 00007f335ff50984 00007f33594cb6d4 00007f33594cb662
0709 12:26:56.625063 (+  6267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834048}
I20260709 12:26:56.620105 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3572) took 1339 ms. Trace:
I20260709 12:26:56.626646 18844 rpcz_store.cc:276] 0709 12:26:55.281012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.281152 (+   140us) service_pool.cc:224] Handling call
0709 12:26:55.281468 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.376597 (+ 95129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.376627 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:55.376671 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:55.376700 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.619822 (+1243122us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b5400205654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:56.619871 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.620040 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218294528}
W20260709 12:26:56.628227 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.628481 27797 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.000s
I20260709 12:26:56.629971 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:56.629562 27804 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.631778 27804 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:56.467070 27851 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.110s
I20260709 12:26:56.560778 27838 raft_consensus.cc:2764] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:26:56.637077 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:56.577208 27824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.007s	sys 0.015s
I20260709 12:26:56.640532 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.658181 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:56.515642 27818 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 12:26:56.671833 27818 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:56.672276 27818 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:56.672657 27818 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:56.674479 27828 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.113s	user 0.014s	sys 0.003s
I20260709 12:26:56.662823 27716 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:56.675679 27716 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.636672 27525 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.662513 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:56.679472 27525 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:56.682052 27827 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:56.653156 27723 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:56.683516 27723 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:56.684495 27723 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.684988 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:56.685658 19488 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:56.686792 27755 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:56.687264 27755 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.687608 27755 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:56.689356 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:56.691114 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:56.692272 18764 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:56.694772 27807 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:56.695451 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.696367 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:56.698076 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1649) took 1418 ms. Trace:
I20260709 12:26:56.698431 27879 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.698555 18765 rpcz_store.cc:276] 0709 12:26:55.279580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.281374 (+  1794us) service_pool.cc:224] Handling call
0709 12:26:55.281633 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.292415 (+1010782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.697770 (+405355us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b540017b1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:56.698008 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270025600}
I20260709 12:26:56.699066 27879 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.645311 27855 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.701496 27879 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:56.701805 27855 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:56.702762 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3578) took 1419 ms. Trace:
I20260709 12:26:56.667341 27824 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:26:56.668094 27846 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:56.668927 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.513199 27630 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:56.706635 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.706749 19490 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:56.707867 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:56.703235 18841 rpcz_store.cc:276] 0709 12:26:55.282833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.284064 (+  1231us) service_pool.cc:224] Handling call
0709 12:26:55.284370 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.992080 (+707710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.992129 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:55.993933 (+  1804us) log.cc:844] Serialized 26 byte log entry
0709 12:26:56.446319 (+452386us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:56.446374 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.446509 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:56.702421 (+255912us) raft_consensus.cc:1685] finished
0709 12:26:56.702458 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.702683 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1260,"raft.queue_time_us":29490,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6379,"thread_start_us":1131958,"threads_started":2,"wal-append.queue_time_us":652539}
W20260709 12:26:56.719738 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 55649.4us
I20260709 12:26:56.629138 27797 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.723253 18916 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:56.726552 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:56.727726 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58897.7us
I20260709 12:26:56.745179 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.746302 27851 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:56.746934 27851 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:56.748150 27851 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.750480 27630 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:56.752399 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3688) took 1939 ms. Trace:
I20260709 12:26:56.752919 18764 rpcz_store.cc:276] 0709 12:26:54.813338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.813479 (+   141us) service_pool.cc:224] Handling call
0709 12:26:54.813809 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.692748 (+1878939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.752105 (+ 59357us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540002d854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:56.752322 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4319584128}
I20260709 12:26:56.732709 27888 raft_consensus.cc:2764] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election decision vote started in defunct term 29: won
W20260709 12:26:56.729048 27789 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.001s
I20260709 12:26:56.653095 27872 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:56.726845 19488 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:56.760421 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3826) took 1501 ms. Trace:
I20260709 12:26:56.756470 27728 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:56.767251 18922 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:26:56.763835 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:56.765426 27872 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:56.764863 27846 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:56.768692 27863 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.001s
W20260709 12:26:56.766247 27839 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.001s
I20260709 12:26:56.766031 18914 rpcz_store.cc:276] 0709 12:26:55.259297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.262348 (+  3051us) service_pool.cc:224] Handling call
0709 12:26:55.262664 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.186206 (+923542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.760152 (+573946us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54000e3154. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:56.760333 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995711360}
I20260709 12:26:56.762984 27865 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:56.771657 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:56.783273 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 242973us
I20260709 12:26:56.804615 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:56.797468 27840 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:56.779374 27848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.021s	sys 0.035s
W20260709 12:26:56.810621 27848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.021s	sys 0.035s
I20260709 12:26:56.804948 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.807442 27780 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.807631 27421 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:56.816052 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:56.812685 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.820469 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:56.792141 27872 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:56.775319 27716 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:56.825477 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 57925us
I20260709 12:26:56.830163 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.833765 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.825556 27879 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:56.841924 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:56.844856 18812 leader_election.cc:400] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26.
I20260709 12:26:56.845366 18812 leader_election.cc:403] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:26:56.838543 27886 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:56.839167 27885 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:56.847101 27885 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:56.848130 27885 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.850742 27827 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:56.853238 27887 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:56.856980 27868 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.913s	user 0.000s	sys 0.003s
I20260709 12:26:56.859472 27832 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:56.843720 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:56.837289 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.827733 27888 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:56.862860 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.806865 27846 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.877116 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.806231 27863 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.841727 27838 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:26:56.808590 27839 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:56.887126 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43513.6us
I20260709 12:26:56.887975 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:56.813442 27865 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.827018 27780 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.842353 27848 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:26:56.889540 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52380.7us
I20260709 12:26:56.893846 18739 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.866735 27887 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26.
I20260709 12:26:56.874678 27879 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:56.915295 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.915171 27879 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.907045 18920 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:56.916483 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:56.918649 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:56.919286 18920 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:56.919541 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:56.920492 27897 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.921041 27846 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.867132 27799 consensus_queue.cc:1059] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:26:56.921131 27897 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.922086 27799 raft_consensus.cc:3055] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:56.922490 27799 raft_consensus.cc:740] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:56.922667 27898 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.923243 27898 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.923319 27799 consensus_queue.cc:260] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.924278 27558 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:56.924695 27799 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:56.925488 27898 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:56.867334 27837 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:26:56.926826 27837 consensus_queue.cc:1243] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:26:56.927286 27812 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:56.926203 27774 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:56.927675 27812 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:56.928408 27774 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:56.928797 27774 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:56.928646 27812 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.930090 27812 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:56.929207 27839 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:56.930598 18913 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:56.881305 27886 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:56.930712 27561 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:56.944161 27595 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.002s
I20260709 12:26:56.933163 27875 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:26:56.933377 27893 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:56.892493 27824 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:26:56.977731 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:56.980933 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:56.937677 27740 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:56.982273 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.933190 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:56.907493 27888 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:56.986096 18846 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:26:56.939961 27789 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:56.940968 27716 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:26:56.941615 27682 consensus_meta.cc:287] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.003s
I20260709 12:26:56.942763 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:56.822216 27840 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.943195 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:56.829732 27421 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:56.944087 27832 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.944309 27797 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.892303 27630 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:56.946193 27863 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:56.870064 27755 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.946811 27670 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:56.918735 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:57.031278 18841 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:56.948851 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:56.920598 18920 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:26:56.896152 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:56.954648 27846 consensus_queue.cc:1059] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:56.980329 27818 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.022179 27839 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:56.957121 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:56.959398 18842 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:26:56.960330 27780 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:56.963971 18917 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:56.964797 18765 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:56.960523 18766 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:26:56.969010 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:56.928808 18921 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:56.936257 27865 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:56.985675 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52556.7us
W20260709 12:26:56.987025 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.008397 27872 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:56.929868 27774 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.033006 27630 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:57.071636 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:26:57.014791 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 221710us
I20260709 12:26:57.014544 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.059000 18915 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:56.978673 27848 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:56.982004 27827 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.021919 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:56.988054 27824 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:56.988384 27789 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:57.013187 27717 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:26:56.955224 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.956563 18844 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:26:56.977113 27561 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.042543 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:57.042582 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 146539us
I20260709 12:26:57.103829 18767 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:26:56.983173 27595 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.107533 27824 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.15, Last appended by leader: 15, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.108628 27595 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:57.109494 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 43649.7us
I20260709 12:26:57.111131 27789 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.088172 27887 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:57.112578 27789 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:57.112495 27887 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.075071 27855 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.049041 18922 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:26:57.114940 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.115581 18919 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:57.056005 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.116034 18767 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
W20260709 12:26:57.116726 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60804.1us
I20260709 12:26:57.013619 27716 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.077808 18841 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:57.026605 27832 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.045308 27839 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:57.092782 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:57.121291 18773 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:57.052490 27804 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:26:57.094262 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 79858.8us
I20260709 12:26:57.098716 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.052386 18771 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:26:57.124008 18842 raft_consensus.cc:2410] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 31 because replica has last-logged OpId of term: 29 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 15.
I20260709 12:26:57.102488 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:57.064343 27421 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:57.116283 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:57.062579 27800 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:57.117923 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.132977 18845 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:57.102355 27911 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.018s
I20260709 12:26:57.122829 18920 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 30. Current term is 31. Ops: []
W20260709 12:26:57.124212 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.127838 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.135205 18848 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:57.118016 27885 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:57.124784 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.127465 18738 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:57.135494 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.122931 27654 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:57.123827 27774 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:57.148768 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.151549 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:57.096110 27827 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.133049 27804 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:57.156636 27827 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:57.156524 27804 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.157508 18847 raft_consensus.cc:2410] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 27 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 12:26:57.151443 27885 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:57.158635 27846 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:57.158805 27872 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:57.159154 27846 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.159554 27846 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:57.127002 27670 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 12:26:57.114969 27826 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
W20260709 12:26:57.169670 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.169401 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:57.181910 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:57.182260 18771 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 31.
I20260709 12:26:57.184231 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.142625 27825 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:57.139410 27837 raft_consensus.cc:2764] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
W20260709 12:26:57.188621 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 86258.1us
I20260709 12:26:57.188482 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:57.132253 27875 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:26:57.190783 18773 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:57.123939 27855 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.159433 27887 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:57.152869 27654 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:57.152768 27525 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:26:57.132789 27717 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 12:26:57.227697 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 88249.1us
I20260709 12:26:57.230854 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:57.201627 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:57.185438 27851 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:57.139448 27800 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.201417 18812 leader_election.cc:400] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:57.168229 27558 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:26:57.186748 27879 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:57.129097 27630 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.248710 27755 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:57.196885 27844 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.252074 18812 leader_election.cc:403] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:57.229125 27682 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:57.199606 27825 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:26:57.168422 27848 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.230299 27654 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:57.228502 27886 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:57.202024 27828 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:26:57.259553 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 58339.6us
I20260709 12:26:57.294740 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:57.295977 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:57.259827 27814 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:26:57.260370 27879 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.256012 27723 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:57.266963 27914 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:57.189417 27740 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:26:57.187440 27839 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:57.272140 27907 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:26:57.272046 27800 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:57.273075 27905 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:26:57.238696 27789 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:26:57.280372 27844 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.326040 27789 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 31 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:57.326285 27906 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:26:57.293941 27886 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:57.327100 27789 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 30.14, Last appended by leader: 14, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.327736 27844 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:57.280730 18769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3697) took 2012 ms (client timeout 2153 ms). Trace:
W20260709 12:26:57.329113 18769 rpcz_store.cc:269] 0709 12:26:55.268752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.268867 (+   115us) service_pool.cc:224] Handling call
0709 12:26:57.280504 (+2011637us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540029d6d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:57.280663 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3476660608}
I20260709 12:26:57.311580 27879 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.290508 27682 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:26:57.273826 27909 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:26:57.253105 27840 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:57.297102 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:57.344736 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 47706.4us
I20260709 12:26:57.345772 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:57.245206 27881 log.cc:927] Time spent T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:26:57.327646 27886 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:57.251771 27900 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:57.334086 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:57.312481 27818 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:57.354025 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:57.299858 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 2171) took 1042 ms. Trace:
I20260709 12:26:57.336175 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:57.354017 18769 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:26:57.297890 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.336236 18771 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260709 12:26:57.341928 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 88621.3us
I20260709 12:26:57.323220 27832 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:57.303365 27561 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:57.350010 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:57.358965 19492 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:57.351191 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.351367 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:57.329128 27797 raft_consensus.cc:3055] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:57.356663 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:57.357923 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:57.354741 19491 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:57.355072 18921 rpcz_store.cc:276] 0709 12:26:56.257038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.258738 (+  1700us) service_pool.cc:224] Handling call
0709 12:26:56.928611 (+669873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:57.052403 (+123792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.299559 (+247156us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b5400334350. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:57.299768 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539797888}
I20260709 12:26:57.362156 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.304045 27864 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:57.303929 27851 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:57.359510 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:57.307034 27807 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:57.300362 27828 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:57.367256 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:57.367549 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:57.367651 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.368913 19489 raft_consensus.cc:2393] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:26:57.371697 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.369323 18768 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:57.381165 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:57.348008 27872 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:57.315240 27723 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.418612 19489 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:26:57.383839 27807 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.399904 27864 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 30.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:26:57.372862 27825 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.364317 27797 raft_consensus.cc:740] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:57.412276 27818 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:57.372171 27814 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:57.412932 27682 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:57.400765 27915 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:26:57.414176 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.414049 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:57.409803 27828 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.376576 27561 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:57.418597 27887 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:57.410782 27879 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:57.419472 27826 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:57.381847 19484 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:26:57.390697 18812 leader_election.cc:400] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25.
I20260709 12:26:57.425087 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 2173) took 1140 ms. Trace:
I20260709 12:26:57.390681 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.386178 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.386497 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:26:57.498320 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.498577 18922 raft_consensus.cc:2368] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27.
I20260709 12:26:57.393106 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.500025 18913 raft_consensus.cc:2410] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
W20260709 12:26:57.429239 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.392670 19491 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
I20260709 12:26:57.433175 18842 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:26:57.434262 19492 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:57.399674 27837 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:26:57.371223 27851 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:57.442610 18770 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:26:57.504518 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:57.448001 27846 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.457435 18919 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:26:57.442030 27812 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:26:57.432588 27525 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:57.461500 18812 leader_election.cc:403] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:57.462067 18918 rpcz_store.cc:276] 0709 12:26:56.284338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.286089 (+  1751us) service_pool.cc:224] Handling call
0709 12:26:56.286447 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.324986 (+ 38539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.424833 (+1099847us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54000e3654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:57.425022 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86017280}
I20260709 12:26:57.504148 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:57.514458 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:57.412955 27855 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:57.514911 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:57.512542 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:57.515652 18770 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:57.517546 27840 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:57.518306 27840 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:57.519346 27840 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.524621 27654 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.529479 18770 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:57.533926 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.535790 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:57.536687 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.535799 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:57.539004 18770 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:57.542079 18920 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []
W20260709 12:26:57.543484 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 155623us
I20260709 12:26:57.546756 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.552194 18770 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:57.552559 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.546258 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:57.553689 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.534505 27828 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:57.513013 27812 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:57.496994 27595 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.087s
I20260709 12:26:57.583082 18772 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:26:57.540951 27799 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:57.564700 27885 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:26:57.560861 27723 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:57.563800 27716 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:57.562304 27846 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:57.560352 27740 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:26:57.567324 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:57.594336 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.595033 18772 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
W20260709 12:26:57.598029 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 626359us
I20260709 12:26:57.587791 18848 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 12:26:57.608016 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62811.6us
I20260709 12:26:57.611121 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:26:57.611836 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44587.3us
I20260709 12:26:57.551092 27821 raft_consensus.cc:3060] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:26:57.621481 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:57.622615 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.625437 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:57.627694 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:57.628391 18772 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:26:57.557778 27806 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:57.629688 18772 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:57.548458 27879 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:57.574257 27921 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:57.633263 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.591543 27818 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:57.589093 27780 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:57.588200 27799 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:57.535535 27525 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.632786 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:26:57.586261 27826 consensus_queue.cc:1243] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:26:57.641125 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.567044 27654 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:57.621078 27887 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:57.655177 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.659770 18920 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:57.551841 27886 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.620923 27846 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:26:57.621124 27837 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.635249 27851 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:26:57.655761 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:57.702178 18772 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:57.699335 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.708297 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.712965 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:57.721712 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.643603 27780 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.723210 18916 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:26:57.641194 27818 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:57.735829 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.608397 27824 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:26:57.742689 18920 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:26:57.736428 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 103933us
I20260709 12:26:57.648255 27806 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:57.593325 27812 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 30.14, Last appended by leader: 14, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.744573 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:57.746078 18843 raft_consensus.cc:1275] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:26:57.661597 27755 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:26:57.746711 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.771792 18840 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:26:57.743729 27901 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:26:57.811789 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.605700 27797 consensus_queue.cc:260] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.643359 27919 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.092s
W20260709 12:26:57.740774 27911 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.013s	sys 0.015s
I20260709 12:26:57.644196 27879 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.746523 27780 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:57.744252 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.752895 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.779350 18848 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:26:57.657651 27855 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.102s
I20260709 12:26:57.737100 27615 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:57.815511 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.828357 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:57.828866 18845 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:57.755163 27888 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:57.817502 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47621.4us
I20260709 12:26:57.739228 27846 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:57.723453 27837 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.855221 18845 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:26:57.820111 18918 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 21.
I20260709 12:26:57.661262 27914 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.111s
I20260709 12:26:57.697556 27793 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 12:26:57.818233 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.831017 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:57.722129 27863 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.094s
I20260709 12:26:57.768775 27838 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.827145 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:26:57.834546 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 87624us
W20260709 12:26:57.830469 27558 consensus_queue.cc:1175] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e2529a8cff04207bb1b07c108e16983" responder_term: 24 status { last_received { term: 24 index: 13 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:57.835614 27615 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:57.837278 27855 raft_consensus.cc:3055] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:26:57.819293 27911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.013s	sys 0.015s
I20260709 12:26:57.820062 18841 raft_consensus.cc:2376] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22. Re-sending same reply.
I20260709 12:26:57.852830 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:26:57.531436 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:57.855724 18773 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:57.821507 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.858847 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.854120 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:57.863639 18920 raft_consensus.cc:2410] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:26:57.866736 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:57.833693 27797 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:57.925196 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.916339 27838 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:58.076042 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.859686 27897 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:57.986459 27863 consensus_queue.cc:1243] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:26:57.827930 27799 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:57.998884 27919 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.864331 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:58.042650 18840 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:26:58.123147 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:58.043076 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:58.124948 18841 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 25: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:58.048736 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:58.068316 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 214295us
I20260709 12:26:58.127339 18845 raft_consensus.cc:2376] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22. Re-sending same reply.
W20260709 12:26:58.128438 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 264184us
I20260709 12:26:58.037428 27855 raft_consensus.cc:740] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:57.866062 27818 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.027319 27807 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.134819 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:58.136265 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:57.995321 27806 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.107782 27654 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:58.013490 27846 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.121299 27525 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.135097 27863 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:58.156044 27886 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:58.173223 18664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 294) took 20131 ms (client timeout 15000 ms). Trace:
W20260709 12:26:58.173720 18664 rpcz_store.cc:269] 0709 12:26:38.019072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.368094 (+3349022us) service_pool.cc:224] Handling call
0709 12:26:58.134650 (+16766556us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:47.868968 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:48.024752 (+155784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:48.028031 (+  3279us) write_op.cc:435] Acquired schema lock
0709 12:26:48.053608 (+ 25577us) tablet.cc:662] Decoding operations
0709 12:26:48.278624 (+225016us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:48.278698 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:48.278731 (+    33us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:26:48.280675 (+  1944us) tablet.cc:701] Row locks acquired
0709 12:26:48.280703 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:26:48.280901 (+   198us) write_op.cc:270] Start()
0709 12:26:48.281053 (+   152us) write_op.cc:276] Timestamp: P: 1783600008280824 usec, L: 0
0709 12:26:48.281088 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:26:48.284075 (+  2987us) log.cc:844] Serialized 8167 byte log entry
0709 12:26:48.972827 (+688752us) op_driver.cc:464] REPLICATION: finished
0709 12:26:49.789277 (+816450us) write_op.cc:301] APPLY: starting
0709 12:26:49.789377 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:49.870143 (+ 80766us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:49.870265 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:50.549973 (+679708us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:50.550802 (+   829us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 12:26:50.550937 (+   135us) write_op.cc:312] APPLY: finished
0709 12:26:50.552114 (+  1177us) log.cc:844] Serialized 188 byte log entry
0709 12:26:50.615179 (+ 63065us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:50.706764 (+ 91585us) write_op.cc:454] Released schema lock
0709 12:26:50.706852 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:50.707482 (+   630us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:50.707526 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":463857,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":806628,"apply.run_cpu_time_us":43912,"apply.run_wall_time_us":918155,"cfile_cache_hit":86,"cfile_cache_hit_bytes":92033,"cfile_init":1,"lbm_read_time_us":491,"lbm_reads_lt_1ms":4,"num_ops":21,"prepare.queue_time_us":367863,"prepare.run_cpu_time_us":54111,"prepare.run_wall_time_us":570046,"raft.queue_time_us":313362,"raft.run_cpu_time_us":59704,"raft.run_wall_time_us":843731,"replication_time_us":653467,"thread_start_us":1154673,"threads_started":5,"wal-append.queue_time_us":305680,"wal-append.run_cpu_time_us":26896,"wal-append.run_wall_time_us":2309262}]]}
W20260709 12:26:58.179903 27900 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.002s
W20260709 12:26:58.186820 27932 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:26:58.187551 27934 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.189925 27879 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.162189 27615 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.191915 27838 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.171830 27863 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:26:58.204375 18772 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260709 12:26:58.134989 27919 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.218897 18772 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
W20260709 12:26:58.219070 18664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 284) took 15881 ms (client timeout 15000 ms). Trace:
W20260709 12:26:58.219702 18664 rpcz_store.cc:269] 0709 12:26:42.323231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.178384 (+15855153us) service_pool.cc:211] Skipping call since client already timed out
0709 12:26:58.204872 (+ 26488us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:26:58.222110 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:58.226122 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.231794 18767 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 30 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
I20260709 12:26:58.235036 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:58.239367 18887 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.616s (SENT)
W20260709 12:26:58.241847 18887 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.622s (SENT)
I20260709 12:26:58.239533 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.206239 27900 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:58.248416 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.243283 18886 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:26:58.252074 18887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.762s (SENT) [suppressed 29 similar messages]
I20260709 12:26:58.258298 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.260192 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:58.265105 18765 raft_consensus.cc:1240] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:58.267582 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:26:58.268281 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: true dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:58.269196 19492 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:58.276979 18887 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.739s (SENT)
I20260709 12:26:58.237929 27911 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:58.278491 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.281440 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:58.253947 27654 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:58.286696 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.250486 27943 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:58.262647 27615 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:58.261754 27837 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.207000 27934 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.272727 27421 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:58.254200 27782 consensus_queue.cc:1048] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 12:26:58.198133 27855 consensus_queue.cc:260] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.284876 27879 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:58.270414 27670 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:26:58.296955 27897 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:58.281917 27900 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:26:58.267772 27936 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:26:58.331332 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:58.335621 18841 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:58.311362 27837 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.318866 27615 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:58.320565 27879 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:58.338218 19492 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:58.347921 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:58.337445 27828 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.000s
I20260709 12:26:58.353189 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.353823 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:58.354034 18764 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:26:58.354883 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: true dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:58.356562 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:58.290405 27911 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.345122 27814 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:26:58.361953 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.311734 27863 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.365476 18921 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:26:58.367690 18841 raft_consensus.cc:2410] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
W20260709 12:26:58.371246 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.372615 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3850) took 1005 ms. Trace:
I20260709 12:26:58.373132 18919 rpcz_store.cc:276] 0709 12:26:57.366757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.367328 (+   571us) service_pool.cc:224] Handling call
0709 12:26:58.372433 (+1005105us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b54000339d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:58.372554 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179332864}
I20260709 12:26:58.372728 18769 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: [25.12-25.12]
W20260709 12:26:58.376513 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.348047 27879 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:58.383188 18920 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:26:58.345657 27914 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:26:58.387180 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.367058 27806 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.397811 18916 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:58.399310 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.366940 27814 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:58.350932 27837 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.386730 27828 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.389191 27942 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.429363 18914 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:26:58.440860 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:58.451930 27963 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.452720 27956 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:26:58.453233 18812 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35888 dropped due to backpressure: service queue is full with 50 items
I20260709 12:26:58.452693 27963 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:26:58.455255 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 91471.9us
I20260709 12:26:58.459235 27961 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.459916 27961 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.467563 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:58.430773 27952 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:58.423575 27806 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.449302 27919 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.494771 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.496610 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:58.499287 27957 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:58.499931 27957 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:58.500651 27948 log.cc:927] Time spent T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:26:58.501188 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.698s (SENT)
I20260709 12:26:58.498145 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:58.502382 27947 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:26:58.507074 27938 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:26:58.503002 27814 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.510771 27958 consensus_queue.cc:1059] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:26:58.402374 27914 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.513397 27914 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:26:58.514797 27953 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:26:58.517275 27924 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.767s	user 0.003s	sys 0.023s
I20260709 12:26:58.518841 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3604) took 1101 ms. Trace:
I20260709 12:26:58.519210 18847 rpcz_store.cc:276] 0709 12:26:57.417361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.418696 (+  1335us) service_pool.cc:224] Handling call
0709 12:26:57.419037 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:57.419408 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:57.419436 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:57.420000 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 12:26:57.536074 (+116074us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:57.536126 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.536191 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.516561 (+980370us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:58.518513 (+  1952us) raft_consensus.cc:1685] finished
0709 12:26:58.518537 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.518779 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1232,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":95,"spinlock_wait_cycles":15482112,"thread_start_us":115699,"threads_started":1,"wal-append.queue_time_us":222663}
I20260709 12:26:58.525933 27838 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:58.526790 27838 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.444397 27828 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.529758 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:58.532851 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.024s (SENT)
I20260709 12:26:58.539496 18767 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:58.453573 18812 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35888 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3684)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3680)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1587)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3709)
W20260709 12:26:58.549379 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.578888 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46083.5us
W20260709 12:26:58.579985 18887 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.028s (SENT)
I20260709 12:26:58.545486 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:58.444144 27615 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.446168 27942 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.577504 27934 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.577600 27789 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:58.620779 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.587916 27958 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:58.600037 27824 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:58.602049 27919 raft_consensus.cc:2764] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:26:58.609025 27957 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.650470 27941 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.651051 27797 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:58.655361 18769 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 30. Current term is 31. Ops: []
I20260709 12:26:58.489698 27952 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.588373 27914 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
W20260709 12:26:58.671267 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 274319us
W20260709 12:26:58.672776 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 86621.8us
I20260709 12:26:58.676051 27957 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.644150 27789 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.690979 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:58.692317 18766 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:58.693666 18768 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 18.
W20260709 12:26:58.687354 27821 consensus_meta.cc:287] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 1.058s	user 0.014s	sys 0.003s
I20260709 12:26:58.697467 18766 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:58.697813 27821 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25.
I20260709 12:26:58.699249 27952 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:58.699525 27942 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.658226 27958 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.682843 27797 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.679757 27964 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:58.702265 27958 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.703202 18914 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:58.702867 27964 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.703202 18766 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:26:58.704361 18843 raft_consensus.cc:2468] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
W20260709 12:26:58.705402 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.679500 27911 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.708660 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.704373 27807 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:26:58.690075 27900 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:26:58.723944 27797 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:58.708408 27837 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.716703 18812 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:35888 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3680)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1587)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3709)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3716)
I20260709 12:26:58.721002 27919 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:58.681736 27941 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.744270 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3719) took 1393 ms. Trace:
I20260709 12:26:58.748489 18773 rpcz_store.cc:276] 0709 12:26:57.350773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.584034 (+233261us) service_pool.cc:224] Handling call
0709 12:26:58.744036 (+1160002us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54001d6354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:58.744199 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527389440}
I20260709 12:26:58.694788 27957 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.750065 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.732017 27911 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:58.752769 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.754189 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.750276 18812 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:35888 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3680)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1587)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3709)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3716)
I20260709 12:26:58.745247 27789 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.757014 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:58.760960 27959 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.747520 27919 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.755400 27950 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:58.762737 27972 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.031s
I20260709 12:26:58.761610 27962 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.074s
I20260709 12:26:58.772718 19457 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.733716 27807 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.800338 27807 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:58.801358 27972 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:58.801800 27972 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:58.802632 27972 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.803458 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:58.784251 27911 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:58.780177 19484 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
W20260709 12:26:58.783391 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.806617 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.804085 19483 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:58.751645 27828 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.753082 27893 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:26:58.792879 27780 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.962s	user 0.013s	sys 0.002s
I20260709 12:26:58.752588 27806 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.795131 27957 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.784641 27919 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:58.804080 27972 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:58.782222 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.826297 27827 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:58.826834 27827 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:58.806532 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:58.784401 27959 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.827838 27827 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.829264 27827 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:58.830116 27959 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:58.811921 27780 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.831738 18773 raft_consensus.cc:2368] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24.
I20260709 12:26:58.827912 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.811666 27893 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:58.839094 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.795642 27950 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:58.827688 27941 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.810798 27914 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:58.846966 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.845336 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:58.844190 27821 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:58.852296 27780 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:58.846998 27973 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:26:58.853781 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.856488 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.857982 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.849852 27941 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:26:58.855964 27914 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:58.879878 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.887966 19483 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:58.875602 27615 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.849558 27879 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:58.879789 18887 leader_election.cc:336] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:35888 dropped due to backpressure: service queue is full with 50 items
I20260709 12:26:58.914505 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:58.915261 27615 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.928975 27615 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:58.935204 27942 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:58.936223 27942 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.938486 27914 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.939682 27942 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:58.943959 27950 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:58.915997 27941 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.947016 27893 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:58.947328 27941 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:58.949533 27941 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:58.954267 19456 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:26:58.955353 27973 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:58.955938 27973 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:58.956452 27973 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:58.958385 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:58.960435 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 80679.3us
I20260709 12:26:58.967492 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.964519 27936 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:58.974002 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.980180 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:58.975939 18768 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
W20260709 12:26:58.984113 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 138354us
W20260709 12:26:59.001499 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 156199us
I20260709 12:26:59.004321 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:26:59.007575 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.008577 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:26:59.009577 18918 raft_consensus.cc:2468] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:26:59.009655 18768 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:58.965649 27977 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:26:59.076819 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.988s (SENT)
I20260709 12:26:59.064555 18768 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:26:59.018599 27821 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:59.093462 18737 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:26:59.095069 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 102582us
W20260709 12:26:59.099043 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 80311.1us
I20260709 12:26:58.974638 27936 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.087262 27911 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:59.104285 19488 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:26:59.108487 19483 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:59.012009 27942 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 30.14, Next index: 15, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:26:59.113070 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:59.110232 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:59.110175 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:59.130749 27848 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:59.131563 27848 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.104197 27987 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.041s
I20260709 12:26:59.148974 27996 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.149338 27992 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:59.149859 27992 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.149788 27996 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.150460 27992 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:59.170900 27936 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:59.178117 27997 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.159606 27879 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:59.164122 27991 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:59.108745 27911 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:59.180593 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56127.3us
I20260709 12:26:59.126499 27942 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:59.183315 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:59.183449 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:59.187199 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:59.196033 19484 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:26:59.207456 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:59.207501 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:59.216150 19488 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:26:59.218182 27824 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:26:59.220343 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 152919us
I20260709 12:26:59.178952 27997 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.231582 27997 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:59.206712 27942 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.214211 27879 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
W20260709 12:26:59.238679 27984 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 12:26:59.223004 27848 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:59.194912 27919 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.269534 19492 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:26:59.282217 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:59.285337 27930 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.266s	user 0.000s	sys 0.011s
I20260709 12:26:59.287039 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3606) took 1754 ms. Trace:
I20260709 12:26:59.287515 18844 rpcz_store.cc:276] 0709 12:26:57.533100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.533244 (+   144us) service_pool.cc:224] Handling call
0709 12:26:57.537892 (+  4648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:57.557726 (+ 19834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:57.557761 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:57.563275 (+  5514us) log.cc:844] Serialized 26 byte log entry
0709 12:26:57.817636 (+254361us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:57.817678 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.817747 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:59.280901 (+1463154us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:26:59.286669 (+  5768us) raft_consensus.cc:1685] finished
0709 12:26:59.286690 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.286963 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19443,"raft.queue_time_us":34251,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"spinlock_wait_cycles":16670592,"thread_start_us":253733,"threads_started":1,"wal-append.queue_time_us":438069}
I20260709 12:26:59.289517 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.290366 18844 raft_consensus.cc:2410] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 12:26:59.291765 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.295989 27996 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:59.301029 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.307384 18845 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:59.309638 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.247736 27942 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:59.336040 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.277325 27821 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:59.337209 18845 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:59.338855 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.339681 18844 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:59.274499 27973 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:26:59.345036 27929 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 1.300s	user 0.002s	sys 0.008s
I20260709 12:26:59.345640 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.347326 27919 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:59.349001 27991 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:59.349782 18844 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:59.350812 27911 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:59.362311 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:59.363382 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.294932 27992 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.364178 18845 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:59.366474 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.410949 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.412324 18845 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:59.365056 19491 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:26:59.415352 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.416687 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:59.427866 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 327981us
W20260709 12:26:59.431747 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.368297 27821 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.432490 27991 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 12:26:59.437448 27992 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:59.444857 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 3132) took 1087 ms. Trace:
I20260709 12:26:59.445345 18764 rpcz_store.cc:276] 0709 12:26:58.357767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.602024 (+244257us) service_pool.cc:224] Handling call
0709 12:26:58.952927 (+350903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.953169 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:26:58.953483 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 12:26:59.074053 (+120570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.074168 (+   115us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:59.074246 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.074359 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.443839 (+369480us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b18003bc080. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4
0709 12:26:59.444642 (+   803us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54002116d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:59.444782 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1336,"prepare.queue_time_us":3374,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":53850,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":5792,"spinlock_wait_cycles":845587584,"thread_start_us":62657,"threads_started":1,"wal-append.queue_time_us":163156}
I20260709 12:26:59.456990 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:26:59.446952 27950 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:26:59.458673 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.824s (SENT)
I20260709 12:26:59.373941 27973 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:59.452450 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:59.477442 27997 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:59.486972 27844 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:59.487720 27844 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.490245 27844 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:59.492877 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:26:59.509343 27827 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:59.510231 27827 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:26:59.511569 27827 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.517464 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:59.518328 19491 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:26:59.520766 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:59.521597 18764 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:26:59.522215 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:59.522840 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:59.524438 18768 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []
I20260709 12:26:59.535934 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:59.538283 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:59.538509 27997 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.539203 27997 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.540194 18764 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:26:59.541803 27997 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:26:59.542850 27821 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:59.543502 27821 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.546600 27821 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:59.551358 19485 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
W20260709 12:26:59.549480 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.549258 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:26:59.556071 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:59.559588 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:26:59.563297 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:59.555660 27821 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.568792 28004 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:59.562549 27997 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:59.577288 27997 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:59.575071 27821 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.571976 28004 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.603622 27997 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:59.656119 27839 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:59.661923 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3698) took 1835 ms. Trace:
I20260709 12:26:59.662629 18915 rpcz_store.cc:276] 0709 12:26:57.826066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.826248 (+   182us) service_pool.cc:224] Handling call
0709 12:26:57.826665 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.770330 (+943665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.770370 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:58.770440 (+    70us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:26:58.770482 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.661523 (+891041us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:59.661603 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.661825 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169717120}
I20260709 12:26:59.666780 27913 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:59.667567 27913 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:59.677410 18922 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:59.678017 18922 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:26:59.678864 18922 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.642753 28008 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:26:59.686069 18922 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:59.694983 27682 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:26:59.669996 27913 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.702628 27913 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:59.703508 18767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 3125) took 1351 ms. Trace:
I20260709 12:26:59.703987 18767 rpcz_store.cc:276] 0709 12:26:58.352043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.364425 (+ 12382us) service_pool.cc:224] Handling call
0709 12:26:58.530484 (+166059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.575847 (+ 45363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.703248 (+1127401us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54001ca2d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:59.703438 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380905856}
I20260709 12:26:59.705977 18922 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:26:59.706670 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:26:59.707406 28013 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:26:59.707454 27865 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:26:59.709883 18843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45432 (request call id 1576) took 1963 ms (client timeout 2178 ms). Trace:
I20260709 12:26:59.711035 27821 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:26:59.711978 27954 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.322s	user 0.000s	sys 0.004s
I20260709 12:26:59.688637 28008 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.706764 18922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3700) took 1845 ms. Trace:
W20260709 12:26:59.716816 18843 rpcz_store.cc:269] 0709 12:26:57.746306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.811357 (+ 65051us) service_pool.cc:224] Handling call
0709 12:26:59.709649 (+1898292us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400020b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:59.709788 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049617152}
I20260709 12:26:59.720134 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.720934 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3706) took 1272 ms. Trace:
I20260709 12:26:59.721238 18843 rpcz_store.cc:276] 0709 12:26:58.450300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.719868 (+1269568us) service_pool.cc:224] Handling call
0709 12:26:59.720873 (+  1005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.722539 27561 raft_consensus.cc:3055] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:59.718915 18922 rpcz_store.cc:276] 0709 12:26:57.861379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.861549 (+   170us) service_pool.cc:224] Handling call
0709 12:26:57.982753 (+121204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.677279 (+1694526us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54001674a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af02dc0 00007f335af8d1c0 00007f335af8e231 00007f335af8ad8f 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c
0709 12:26:59.706473 (+ 29194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.706707 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317019392}
I20260709 12:26:59.723251 27561 raft_consensus.cc:740] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:59.722139 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.724340 18843 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:26:59.724977 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3691) took 1287 ms. Trace:
I20260709 12:26:59.725374 18843 rpcz_store.cc:276] 0709 12:26:58.437620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.721875 (+1284255us) service_pool.cc:224] Handling call
0709 12:26:59.724904 (+  3029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.726473 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.727341 18843 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 30: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:59.727841 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3690) took 1290 ms. Trace:
I20260709 12:26:59.728229 18843 rpcz_store.cc:276] 0709 12:26:58.437380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.726157 (+1288777us) service_pool.cc:224] Handling call
0709 12:26:59.727783 (+  1626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.729524 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.733227 27793 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.733898 27793 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.735051 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3726) took 2202 ms. Trace:
I20260709 12:26:59.735929 27561 consensus_queue.cc:260] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.737174 27561 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:59.737672 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1665) took 2402 ms. Trace:
I20260709 12:26:59.738116 18765 rpcz_store.cc:276] 0709 12:26:57.335216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.335500 (+   284us) service_pool.cc:224] Handling call
0709 12:26:57.335781 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.265657 (+929876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.737415 (+1471758us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540025fb54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:26:59.737607 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136669440}
I20260709 12:26:59.735461 18771 rpcz_store.cc:276] 0709 12:26:57.532031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.601489 (+ 69458us) service_pool.cc:224] Handling call
0709 12:26:57.601830 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:57.602190 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:57.602219 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:59.642339 (+2040120us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b2c00057528. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:26:59.642819 (+   480us) log.cc:844] Serialized 52 byte log entry
0709 12:26:59.694317 (+ 51498us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:59.694344 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.694727 (+   383us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:59.734271 (+ 39544us) raft_consensus.cc:1685] finished
0709 12:26:59.734294 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.734802 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10350,"raft.queue_time_us":2915,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11786,"spinlock_wait_cycles":14512384,"thread_start_us":46969,"threads_started":1,"wal-append.queue_time_us":84178}
I20260709 12:26:59.739742 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:26:59.740799 18841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3694) took 1302 ms (client timeout 1622 ms). Trace:
W20260709 12:26:59.741204 18841 rpcz_store.cc:269] 0709 12:26:58.438322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.739403 (+1301081us) service_pool.cc:224] Handling call
0709 12:26:59.740728 (+  1325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.747143 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.747761 27963 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:26:59.747846 18841 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:59.749524 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3669) took 1506 ms. Trace:
I20260709 12:26:59.749864 18841 rpcz_store.cc:276] 0709 12:26:58.242923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.746829 (+1503906us) service_pool.cc:224] Handling call
0709 12:26:59.749460 (+  2631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.751031 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.752879 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3703) took 1310 ms. Trace:
I20260709 12:26:59.753284 18841 rpcz_store.cc:276] 0709 12:26:58.442958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.750758 (+1307800us) service_pool.cc:224] Handling call
0709 12:26:59.752812 (+  2054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.754207 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.755272 18841 raft_consensus.cc:2376] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27. Re-sending same reply.
I20260709 12:26:59.755823 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3717) took 1063 ms. Trace:
I20260709 12:26:59.762110 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.763523 18839 raft_consensus.cc:2410] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
W20260709 12:26:59.764130 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3704) took 1320 ms (client timeout 1592 ms). Trace:
W20260709 12:26:59.764639 18839 rpcz_store.cc:269] 0709 12:26:58.443230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.761688 (+1318458us) service_pool.cc:224] Handling call
0709 12:26:59.764034 (+  2346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.756199 18841 rpcz_store.cc:276] 0709 12:26:58.692630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.753948 (+1061318us) service_pool.cc:224] Handling call
0709 12:26:59.755771 (+  1823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.767192 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.767094 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.768379 18839 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:26:59.768952 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3686) took 1332 ms. Trace:
I20260709 12:26:59.769309 18839 rpcz_store.cc:276] 0709 12:26:58.436463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.765390 (+1328927us) service_pool.cc:224] Handling call
0709 12:26:59.768880 (+  3490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.770349 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.771059 18839 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:59.771704 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3718) took 1059 ms. Trace:
I20260709 12:26:59.772068 18839 rpcz_store.cc:276] 0709 12:26:58.711902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.770113 (+1058211us) service_pool.cc:224] Handling call
0709 12:26:59.771648 (+  1535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.774183 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.773808 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3693) took 1335 ms. Trace:
I20260709 12:26:59.776353 18841 rpcz_store.cc:276] 0709 12:26:58.438095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.766361 (+1328266us) service_pool.cc:224] Handling call
0709 12:26:59.773740 (+  7379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180928}
I20260709 12:26:59.777494 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.778182 18841 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:59.781546 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3689) took 1344 ms. Trace:
I20260709 12:26:59.781874 18841 rpcz_store.cc:276] 0709 12:26:58.437157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.777232 (+1340075us) service_pool.cc:224] Handling call
0709 12:26:59.781487 (+  4255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.779628 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3711) took 1327 ms. Trace:
I20260709 12:26:59.783393 18839 rpcz_store.cc:276] 0709 12:26:58.451851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.772762 (+1320911us) service_pool.cc:224] Handling call
0709 12:26:59.779561 (+  6799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.779019 27934 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:59.773944 28008 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:26:59.785580 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:59.786067 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.786821 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.798856 18841 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
I20260709 12:26:59.800302 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3702) took 1357 ms. Trace:
I20260709 12:26:59.800629 18841 rpcz_store.cc:276] 0709 12:26:58.442556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.784070 (+1341514us) service_pool.cc:224] Handling call
0709 12:26:59.800245 (+ 16175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.799696 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3701) took 1357 ms. Trace:
I20260709 12:26:59.801615 18839 rpcz_store.cc:276] 0709 12:26:58.442270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.784458 (+1342188us) service_pool.cc:224] Handling call
0709 12:26:59.799630 (+ 15172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.802561 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.803272 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.788857 27851 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:59.811443 18843 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:26:59.818835 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3674) took 1483 ms. Trace:
I20260709 12:26:59.789942 27821 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.819281 18843 rpcz_store.cc:276] 0709 12:26:58.335852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.729221 (+1393369us) service_pool.cc:224] Handling call
0709 12:26:59.818772 (+ 89551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.804212 18841 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:26:59.820578 18814 leader_election.cc:400] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27.
I20260709 12:26:59.787653 27934 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.822278 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:59.837064 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.931767 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.905718 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.932957 18843 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:26:59.934330 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3708) took 1483 ms. Trace:
I20260709 12:26:59.934921 18843 rpcz_store.cc:276] 0709 12:26:58.451103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.821984 (+1370881us) service_pool.cc:224] Handling call
0709 12:26:59.934200 (+112216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.936362 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.937250 18843 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:26:59.937932 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3712) took 1485 ms. Trace:
W20260709 12:26:59.935132 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.938248 18843 rpcz_store.cc:276] 0709 12:26:58.452093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.935974 (+1483881us) service_pool.cc:224] Handling call
0709 12:26:59.937872 (+  1898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.939774 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.940542 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3699) took 1498 ms. Trace:
I20260709 12:26:59.940874 18843 rpcz_store.cc:276] 0709 12:26:58.441783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.939482 (+1497699us) service_pool.cc:224] Handling call
0709 12:26:59.940488 (+  1006us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.941753 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.942629 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3700) took 1500 ms. Trace:
I20260709 12:26:59.943251 18841 rpcz_store.cc:276] 0709 12:26:58.442034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.801292 (+1359258us) service_pool.cc:224] Handling call
0709 12:26:59.942562 (+141270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.944728 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:26:59.902136 18887 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.050s (SENT)
W20260709 12:26:59.946923 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44866us
W20260709 12:26:59.829820 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.952836 27723 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:26:59.953701 27723 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:26:59.794942 27888 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.972710 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 1676) took 1235 ms. Trace:
I20260709 12:26:59.973905 18773 rpcz_store.cc:276] 0709 12:26:58.737004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.753928 (+ 16924us) service_pool.cc:224] Handling call
0709 12:26:59.961537 (+1207609us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b5400179dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:59.972585 (+ 11048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176434944}
I20260709 12:26:59.958123 18843 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:26:59.978549 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3707) took 1527 ms. Trace:
I20260709 12:26:59.978943 18843 rpcz_store.cc:276] 0709 12:26:58.450760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.941492 (+1490732us) service_pool.cc:224] Handling call
0709 12:26:59.978466 (+ 36974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.980387 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:26:59.802712 27972 consensus_queue.cc:1059] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.178s
I20260709 12:26:59.980283 27964 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:26:59.822754 18848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 3613) took 2169 ms (client timeout 1653 ms). Trace:
I20260709 12:26:59.982175 18814 leader_election.cc:403] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
W20260709 12:26:59.983412 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 162937us
I20260709 12:26:59.983865 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:59.984653 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:26:59.985519 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:26:59.986307 18771 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 27: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:26:59.991030 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:26:59.992070 18773 raft_consensus.cc:2410] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:26:59.987304 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:26:59.982151 18848 rpcz_store.cc:269] 0709 12:26:57.649991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.651176 (+  1185us) service_pool.cc:224] Handling call
0709 12:26:59.818626 (+2167450us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b540041aad4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:26:59.818769 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160222464}
I20260709 12:26:59.994300 19456 leader_election.cc:400] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24.
I20260709 12:26:59.994735 19456 leader_election.cc:403] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:59.818603 27886 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:26:59.981436 27919 raft_consensus.cc:3055] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:26:59.998349 18887 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.147s (SENT)
I20260709 12:27:00.001171 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:26:59.997782 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:00.005837 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.006230 18841 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:00.006867 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3687) took 1570 ms. Trace:
I20260709 12:26:59.996443 27937 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:00.007242 18841 rpcz_store.cc:276] 0709 12:26:58.436688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.944171 (+1507483us) service_pool.cc:224] Handling call
0709 12:27:00.006808 (+ 62637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.008440 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.009219 18841 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:27:00.010228 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.012503 27887 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:00.013159 27887 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:00.013622 27887 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:00.013110 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.016147 18841 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:27:00.016654 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3681) took 1581 ms. Trace:
I20260709 12:26:59.981349 27723 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:00.017202 18841 rpcz_store.cc:276] 0709 12:26:58.435259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.012707 (+1577448us) service_pool.cc:224] Handling call
0709 12:27:00.016594 (+  3887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.018520 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.018734 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.019316 18841 raft_consensus.cc:2468] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:26:59.821197 27950 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.019986 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3688) took 1583 ms. Trace:
I20260709 12:27:00.036705 18841 rpcz_store.cc:276] 0709 12:26:58.436921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.018212 (+1581291us) service_pool.cc:224] Handling call
0709 12:27:00.019918 (+  1706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.038304 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.037348 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:00.045271 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.044791 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:00.000694 27972 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:26:59.857442 27971 consensus_queue.cc:1059] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.196s
I20260709 12:26:59.998214 27872 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:00.047436 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.000926 27919 raft_consensus.cc:740] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:26:59.827332 27821 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:26:59.956256 27997 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.053830 18841 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:27:00.048979 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:26:59.995893 27888 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.008234 27804 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:26:59.822494 27851 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.063016 18839 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:00.064708 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:00.076241 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.082333 27864 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:00.083043 27864 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.042591 27950 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.082532 27851 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:00.041810 27945 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:00.048609 27826 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:00.093216 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.089442 27864 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:27:00.094247 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 49574.4us
W20260709 12:27:00.096815 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 93096.8us
I20260709 12:27:00.008962 27886 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.060819 27888 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.097431 27826 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.105926 18841 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:00.090162 27814 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:00.054774 28006 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.111135 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:00.116655 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:00.116762 18843 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:27:00.117511 18846 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:00.109220 27827 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.010s
I20260709 12:27:00.120657 27827 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:00.121064 27827 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:00.121507 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.121907 27827 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.122566 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:27:00.123281 27827 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:00.104251 27804 consensus_queue.cc:1243] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 24.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:27:00.112807 27826 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:27:00.143836 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.117458 27780 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.096735 27945 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:00.149638 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.137410 27872 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:27:00.161412 18920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3707) took 1472 ms. Trace:
W20260709 12:27:00.167899 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.151010 27780 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.170810 27821 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.172595 27780 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.174576 27818 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:00.176198 18843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3715) took 1519 ms. Trace:
I20260709 12:27:00.176613 18843 rpcz_store.cc:276] 0709 12:26:58.656439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.980085 (+1323646us) service_pool.cc:224] Handling call
0709 12:27:00.176003 (+195918us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400380754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:00.176131 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311866752}
I20260709 12:27:00.135509 28006 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.178087 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.179764 18843 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:00.163066 18920 rpcz_store.cc:276] 0709 12:26:58.688887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.689112 (+   225us) service_pool.cc:224] Handling call
0709 12:26:58.706229 (+ 17117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.739749 (+ 33520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.739789 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.748292 (+  8503us) log.cc:844] Serialized 26 byte log entry
0709 12:26:58.959910 (+211618us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:58.975551 (+ 15641us) log.cc:844] Serialized 14 byte log entry
0709 12:26:59.708376 (+732825us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b180046d740. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:27:00.160836 (+452460us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b180046d740. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e18c0a 00007f3361558219 00007f3357ea0a40 00007f3357e9b4e4 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:27:00.161055 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.161137 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.161180 (+    43us) raft_consensus.cc:1685] finished
0709 12:27:00.161196 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.161347 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31167,"prepare.queue_time_us":15672,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1200825,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":4347,"spinlock_wait_cycles":21040256,"thread_start_us":217476,"threads_started":2,"wal-append.queue_time_us":210765,"wal-append.run_cpu_time_us":2825,"wal-append.run_wall_time_us":1139803}
I20260709 12:27:00.187897 18918 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:00.188382 18841 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:27:00.189014 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.196055 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.197916 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.199647 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:00.200651 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.200883 18843 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:27:00.201318 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.185191 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:00.205924 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.207798 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.208647 18915 raft_consensus.cc:2410] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 31 because replica has last-logged OpId of term: 28 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 15.
I20260709 12:27:00.160502 27934 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:00.211474 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.206743 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.207019 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.212154 18765 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:00.212314 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.215579 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.217585 18921 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:00.217612 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.218317 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.220988 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.224265 18846 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:27:00.211544 27825 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:00.207279 27595 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:00.225900 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.226145 27825 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:00.226312 27595 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.226648 27825 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:00.226584 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:00.229698 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 231370us
I20260709 12:27:00.230420 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:00.230894 18887 leader_election.cc:336] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.762s (SENT)
I20260709 12:27:00.231345 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:00.231396 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.232055 18770 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:27:00.141439 27919 consensus_queue.cc:260] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:00.233886 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.234663 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.236804 18919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3709) took 1274 ms. Trace:
I20260709 12:27:00.237682 18915 raft_consensus.cc:1240] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:00.238036 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.237457 18919 rpcz_store.cc:276] 0709 12:26:58.976782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.977038 (+   256us) service_pool.cc:224] Handling call
0709 12:26:58.977546 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.977846 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:26:59.095945 (+118099us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.169147 (+1073202us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.236243 (+ 67096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.236321 (+    78us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:00.236408 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.236516 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.236726 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1084828,"prepare.queue_time_us":140244,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":91,"raft.queue_time_us":1074032,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":55,"thread_start_us":167189,"threads_started":2}
I20260709 12:27:00.240604 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.244354 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:00.247264 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.247980 18922 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:27:00.239459 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.259313 18915 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:27:00.264662 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.211268 27944 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.265949 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:00.268872 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.271364 18846 raft_consensus.cc:2410] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:27:00.267848 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:00.272993 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.273891 18920 raft_consensus.cc:2410] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:27:00.214753 27780 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:00.235920 27963 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:00.281553 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50692.6us
W20260709 12:27:00.282255 18887 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.775s (SENT)
I20260709 12:27:00.282639 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.283304 18922 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:00.235877 27799 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:00.279740 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.279757 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:00.235761 27885 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:00.285144 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.292686 18846 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:27:00.293704 18886 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:00.279145 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.265376 27997 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.291287 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.235749 27846 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:00.280947 27919 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:00.296890 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.300282 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:00.286665 27977 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:00.276734 27723 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:00.315202 18764 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
W20260709 12:27:00.315570 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.280617 27717 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:00.294957 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 191883us
I20260709 12:27:00.310009 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:00.321125 18919 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:00.310964 18920 raft_consensus.cc:2410] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:27:00.323029 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.294210 27978 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:00.301429 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 21 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.316208 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:00.287806 27945 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:00.319484 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:00.292773 27950 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.327934 18770 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:27:00.313318 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:00.327328 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.285431 27780 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.278347 27944 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.303369 28006 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:00.339473 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.285845 27887 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.324434 27728 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:00.343670 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.345461 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.357542 18922 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:00.287575 27963 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.292516 27799 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.339579 27888 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:00.342218 27717 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.360296 27558 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:00.356377 27789 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:00.360145 28031 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:00.376508 27789 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.379323 27789 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:27:00.364784 28025 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:27:00.383195 18847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3684) took 1947 ms (client timeout 1616 ms). Trace:
W20260709 12:27:00.383895 18847 rpcz_store.cc:269] 0709 12:26:58.435964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.382910 (+1946946us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:00.383048 (+   138us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:00.385537 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:00.391695 18847 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:27:00.394537 18847 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 26. Current term is 27. Ops: [25.17-26.18]
I20260709 12:27:00.309448 27846 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:00.398977 28027 log.cc:927] Time spent T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:27:00.400439 27846 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.395401 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3712) took 1410 ms. Trace:
I20260709 12:27:00.401603 27937 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535) with higher term. Message: Invalid argument: T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27.
I20260709 12:27:00.402125 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1584) took 2578 ms. Trace:
I20260709 12:27:00.401204 18916 rpcz_store.cc:276] 0709 12:26:58.985216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.985395 (+   179us) service_pool.cc:224] Handling call
0709 12:26:58.985873 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.161295 (+1175422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.161328 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:00.162525 (+  1197us) log.cc:844] Serialized 26 byte log entry
0709 12:27:00.314028 (+151503us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:27:00.314112 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.314201 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.395110 (+ 80909us) raft_consensus.cc:1685] finished
0709 12:27:00.395145 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.395326 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1174898,"raft.queue_time_us":1181356,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":140331,"threads_started":1,"wal-append.queue_time_us":180995}
I20260709 12:27:00.365664 27782 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:27:00.356805 27728 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:00.414418 27728 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:00.407707 18847 rpcz_store.cc:276] 0709 12:26:57.824073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.393578 (+2569505us) service_pool.cc:224] Handling call
0709 12:27:00.394238 (+   660us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:00.401821 (+  7583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.402063 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.367902 18921 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:00.413813 27799 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.403704 27944 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.411499 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:00.419596 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.423381 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:00.425743 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 79610.1us
I20260709 12:27:00.424763 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:00.425354 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 96089.1us
I20260709 12:27:00.429919 27855 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:27:00.430317 19455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.432513 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:00.432767 27961 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.434216 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:00.435668 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1587) took 2605 ms. Trace:
I20260709 12:27:00.436203 18848 rpcz_store.cc:276] 0709 12:26:57.832631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.434641 (+2602010us) service_pool.cc:224] Handling call
0709 12:27:00.434986 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.435297 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.435326 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.435371 (+    45us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:00.435406 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.435465 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.435609 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.437506 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:00.377466 27717 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.435770 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1580) took 2613 ms. Trace:
I20260709 12:27:00.426515 18916 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:00.440217 18738 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:00.442906 18916 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:00.437753 18848 raft_consensus.cc:1240] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:00.375655 27888 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.440559 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3711) took 1456 ms. Trace:
I20260709 12:27:00.453935 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1589) took 2600 ms. Trace:
I20260709 12:27:00.454370 18848 rpcz_store.cc:276] 0709 12:26:57.854296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.437240 (+2582944us) service_pool.cc:224] Handling call
0709 12:27:00.437582 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.453691 (+ 16109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.453878 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.455633 18847 raft_consensus.cc:1217] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Deduplicated request from leader. Original: 20.14->[23.15-23.15]   Dedup: 23.15->[]
I20260709 12:27:00.456197 18847 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:27:00.456547 27717 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:00.439831 18840 rpcz_store.cc:276] 0709 12:26:57.822023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.143215 (+321192us) service_pool.cc:224] Handling call
0709 12:26:59.818769 (+1675554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.819152 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.819181 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.822619 (+  3438us) log.cc:844] Serialized 26 byte log entry
0709 12:27:00.020923 (+198304us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:27:00.050691 (+ 29768us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.112980 (+ 62289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.113060 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.113100 (+    40us) raft_consensus.cc:1685] finished
0709 12:27:00.113111 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.435594 (+322483us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540041aad0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:00.435691 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":400,"prepare.queue_time_us":92984,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":15924,"raft.queue_time_us":38015,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":8968,"spinlock_wait_cycles":3852434304,"thread_start_us":240170,"threads_started":3,"wal-append.queue_time_us":164809}
I20260709 12:27:00.456768 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1586) took 2632 ms. Trace:
I20260709 12:27:00.458156 18847 rpcz_store.cc:276] 0709 12:26:57.824692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.428694 (+2604002us) service_pool.cc:224] Handling call
0709 12:27:00.455494 (+ 26800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.456520 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.456710 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.458611 18841 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23. Ops: [20.11-22.12]
I20260709 12:27:00.452513 18913 rpcz_store.cc:276] 0709 12:26:58.984807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.984976 (+   169us) service_pool.cc:224] Handling call
0709 12:26:58.985542 (+   566us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:00.161169 (+1175627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.161201 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:00.165862 (+  4661us) log.cc:844] Serialized 52 byte log entry
0709 12:27:00.335684 (+169822us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:27:00.345347 (+  9663us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.440179 (+ 94832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.440256 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.440298 (+    42us) raft_consensus.cc:1685] finished
0709 12:27:00.440313 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.440484 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1175030,"prepare.queue_time_us":38775,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":1183449,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":7841,"spinlock_wait_cycles":169856,"thread_start_us":210497,"threads_started":2,"wal-append.queue_time_us":175978}
I20260709 12:27:00.458873 18848 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
W20260709 12:27:00.460496 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 147241us
I20260709 12:27:00.461333 18921 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 30 index: 16. (term mismatch)
I20260709 12:27:00.452306 27898 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.461870 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.463032 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3675) took 2112 ms. Trace:
I20260709 12:27:00.474622 18848 rpcz_store.cc:276] 0709 12:26:58.350811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.458379 (+2107568us) service_pool.cc:224] Handling call
0709 12:27:00.458697 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.460800 (+  2103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.462971 (+  2171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.476426 18848 raft_consensus.cc:1275] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:27:00.477190 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3696) took 2036 ms. Trace:
I20260709 12:27:00.477599 18848 rpcz_store.cc:276] 0709 12:26:58.441025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.475527 (+2034502us) service_pool.cc:224] Handling call
0709 12:27:00.475959 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.476882 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.477119 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.464002 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3670) took 2220 ms. Trace:
I20260709 12:27:00.479693 18841 rpcz_store.cc:276] 0709 12:26:58.243330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.457962 (+2214632us) service_pool.cc:224] Handling call
0709 12:27:00.458312 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:00.463627 (+  5315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.463926 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.464318 18921 pending_rounds.cc:85] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 15
I20260709 12:27:00.465771 18840 raft_consensus.cc:1240] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 12:27:00.487813 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3671) took 2221 ms. Trace:
I20260709 12:27:00.488310 18840 rpcz_store.cc:276] 0709 12:26:58.275512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.458080 (+2182568us) service_pool.cc:224] Handling call
0709 12:27:00.465455 (+  7375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.487394 (+ 21939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.487730 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.456725 27888 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:00.489880 18921 pending_rounds.cc:107] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 28.16
W20260709 12:27:00.492188 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.463996 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:00.495313 18921 raft_consensus.cc:2889] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:00.496397 18848 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:27:00.504637 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3697) took 2063 ms. Trace:
I20260709 12:27:00.505055 18848 rpcz_store.cc:276] 0709 12:26:58.441275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.478523 (+2037248us) service_pool.cc:224] Handling call
0709 12:27:00.478909 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.504173 (+ 25264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.504543 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:00.495738 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.453410 27952 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:00.516515 27952 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:00.517642 27952 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:00.519094 28040 log.cc:927] Time spent T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:27:00.452062 27999 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.521938 27999 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.524271 27999 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:00.499395 18916 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 12:27:00.515739 27780 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:00.527298 18916 pending_rounds.cc:85] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 11
I20260709 12:27:00.528291 18916 pending_rounds.cc:107] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:27:00.532153 27864 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.533524 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3710) took 1549 ms. Trace:
W20260709 12:27:00.533785 28014 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.886s	user 0.000s	sys 0.018s
I20260709 12:27:00.505934 27821 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.499258 27898 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:00.537093 27963 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.540696 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.494884 18841 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 12:27:01.885797 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.541986 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:00.624889 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:01.891451 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.892000 18921 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:27:01.892292 18922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3722) took 1535 ms (client timeout 1662 ms). Trace:
I20260709 12:27:01.893131 18921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3877) took 1355 ms. Trace:
W20260709 12:27:01.892956 18922 rpcz_store.cc:269] 0709 12:27:00.356216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.541685 (+185469us) service_pool.cc:224] Handling call
0709 12:27:01.891919 (+1350234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:01.886087 18738 connection.cc:256] RPC call timeout handler was delayed by -1.2467738269997426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2618s for a response
I20260709 12:27:01.880666 28048 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.575354 18917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3685) took 2875 ms. Trace:
I20260709 12:27:01.893687 18921 rpcz_store.cc:276] 0709 12:27:00.537829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.624478 (+ 86649us) service_pool.cc:224] Handling call
0709 12:27:01.893015 (+1268537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:01.899974 28048 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:01.887452 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3678) took 3452 ms (client timeout 2153 ms). Trace:
W20260709 12:27:01.901582 18839 rpcz_store.cc:269] 0709 12:26:58.434356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.802266 (+1367910us) service_pool.cc:224] Handling call
0709 12:27:01.886706 (+2084440us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54003bdb54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:01.887127 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597165824}
I20260709 12:27:00.541905 18845 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
W20260709 12:27:01.827126 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.905555 18847 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:00.839138 18915 raft_consensus.cc:1217] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Deduplicated request from leader. Original: 21.12->[23.13-25.14]   Dedup: 23.13->[25.14-25.14]
W20260709 12:27:01.821328 18772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.393s	user 0.000s	sys 0.006s
W20260709 12:27:01.822067 18846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.471s	user 0.023s	sys 0.023s
I20260709 12:27:01.889356 18840 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:27:00.543164 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:01.907388 18918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3873) took 1552 ms (client timeout 1562 ms). Trace:
I20260709 12:27:00.578276 18919 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:27:00.746316 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.909142 18916 raft_consensus.cc:2889] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:01.912488 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 1.44833e+06us
I20260709 12:27:01.900125 18917 rpcz_store.cc:276] 0709 12:26:57.629922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.630321 (+   399us) service_pool.cc:224] Handling call
0709 12:26:58.374511 (+744190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.374781 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.374822 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:58.374885 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:58.374932 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.375013 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.505500 (+2130487us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54000339d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:00.505640 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668038016}
W20260709 12:27:01.921277 18918 rpcz_store.cc:269] 0709 12:27:00.354877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.540278 (+185401us) service_pool.cc:224] Handling call
0709 12:27:01.907153 (+1366875us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:01.947417 18772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.519s	user 0.005s	sys 0.009s
W20260709 12:27:01.947199 18846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.597s	user 0.024s	sys 0.034s
W20260709 12:27:00.726254 27972 consensus_meta.cc:287] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.000s
W20260709 12:27:00.781394 19488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45478 (request call id 1779) took 1668 ms (client timeout 1596 ms). Trace:
I20260709 12:27:01.961822 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3682) took 3518 ms. Trace:
I20260709 12:27:01.962019 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3709) took 3500 ms. Trace:
W20260709 12:27:00.986855 27919 consensus_meta.cc:287] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.004s
W20260709 12:27:00.758190 27825 consensus_meta.cc:287] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.000s
I20260709 12:27:00.812216 19492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1461) took 2055 ms. Trace:
I20260709 12:27:01.967463 18840 rpcz_store.cc:276] 0709 12:26:58.451335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.489309 (+2037974us) service_pool.cc:224] Handling call
0709 12:27:01.841702 (+1352393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.926848 (+ 85146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.951200 (+ 24352us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:00.653764 27913 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.950s	user 0.011s	sys 0.003s
I20260709 12:27:01.972348 27818 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.973526 27818 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:01.974426 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:01.975242 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:01.977635 27818 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:01.978055 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3723) took 1570 ms. Trace:
I20260709 12:27:01.978814 18916 rpcz_store.cc:276] 0709 12:27:00.407821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.454582 (+ 46761us) service_pool.cc:224] Handling call
0709 12:27:00.454860 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.977344 (+1522484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.977870 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:01.978927 27821 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:01.980391 19457 connection.cc:256] RPC call timeout handler was delayed by -1.4669695859997773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
I20260709 12:27:01.980945 18844 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 16.
W20260709 12:27:01.978385 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.983337 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.983834 27827 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.678632 27973 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.984983 27827 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:00.815439 27793 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:01.985769 27973 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:01.986696 27838 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:01.986864 27837 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.989723 27837 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:01.991026 19488 rpcz_store.cc:269] 0709 12:26:59.112632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.112778 (+   146us) service_pool.cc:224] Handling call
0709 12:27:00.781036 (+1668258us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b5400720454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:00.781231 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162439424}
I20260709 12:27:01.963263 27998 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.993531 27837 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:00.849903 27595 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:01.966717 18847 rpcz_store.cc:276] 0709 12:26:58.435505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.462796 (+2027291us) service_pool.cc:224] Handling call
0709 12:27:01.904120 (+1441324us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b58001e8d98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffa30ab 00007f335ffa3131 00007f335ff64fc0 00007f335ff4f929 00007f335ff4f3d2 00007f33594c6bd4
0709 12:27:01.904576 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.926998 (+ 22422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.953423 (+ 26425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8524672}
I20260709 12:27:00.843036 27879 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:27:02.009058 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.643029 27851 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:27:02.013048 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.014686 18915 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: [23.13-25.14]
W20260709 12:27:02.014912 18919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3718) took 1658 ms (client timeout 1547 ms). Trace:
I20260709 12:27:01.980580 19492 rpcz_store.cc:276] 0709 12:26:58.756702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.756912 (+   210us) service_pool.cc:224] Handling call
0709 12:26:58.768667 (+ 11755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.270136 (+501469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.811793 (+1541657us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400580054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:00.812110 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151189248}
I20260709 12:27:00.549337 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:01.965776 27812 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:00.589294 28008 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:01.994717 27898 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:02.017225 18919 rpcz_store.cc:269] 0709 12:27:00.304775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.309723 (+  4948us) service_pool.cc:224] Handling call
0709 12:27:01.959924 (+1650201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:02.030788 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48936.4us
W20260709 12:27:02.032503 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68692us
I20260709 12:27:00.822943 27886 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:01.994351 27998 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:02.043179 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 128368us
I20260709 12:27:02.051111 27528 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.052301 27528 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.042636 18920 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:27:02.055629 18920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3874) took 1690 ms (client timeout 2104 ms). Trace:
I20260709 12:27:02.056439 18843 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 25: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:02.009140 27825 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.060068 27825 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.040460 27972 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24.
I20260709 12:27:02.061650 18769 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28. Ops: []
I20260709 12:27:00.633359 27826 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.062568 27851 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:02.064304 27851 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.064983 27827 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.065330 27826 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.066670 27879 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:02.068826 27879 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.071136 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1501) took 1635 ms. Trace:
I20260709 12:27:02.071749 19486 rpcz_store.cc:276] 0709 12:27:00.435601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.437297 (+  1696us) service_pool.cc:224] Handling call
0709 12:27:00.437663 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.438048 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.438075 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:00.438615 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:27:00.514768 (+ 76153us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:00.514832 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.514939 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.070501 (+1555562us) raft_consensus.cc:1685] finished
0709 12:27:02.070556 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.070882 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22218,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":32271,"thread_start_us":75657,"threads_started":1,"wal-append.queue_time_us":1549086}
I20260709 12:27:02.055505 27942 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.056464 18913 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:27:02.056216 18920 rpcz_store.cc:269] 0709 12:27:00.364925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.542837 (+177912us) service_pool.cc:224] Handling call
0709 12:27:02.055541 (+1512704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.087046 28008 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.089524 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54084 (request call id 3876) took 1552 ms. Trace:
I20260709 12:27:02.093047 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3698) took 3596 ms. Trace:
I20260709 12:27:02.089928 18913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54084 (request call id 3875) took 1552 ms. Trace:
I20260709 12:27:02.096736 18915 rpcz_store.cc:276] 0709 12:27:00.537560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.834077 (+296517us) service_pool.cc:224] Handling call
0709 12:27:00.838827 (+  4750us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:02.040865 (+1202038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.089408 (+ 48543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.098869 18913 rpcz_store.cc:276] 0709 12:27:00.537167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.549034 (+ 11867us) service_pool.cc:224] Handling call
0709 12:27:02.087684 (+1538650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.720660 27728 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.098361 18841 rpcz_store.cc:276] 0709 12:26:58.441525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.480885 (+2039360us) service_pool.cc:224] Handling call
0709 12:27:00.481293 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.967609 (+1486316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.037882 (+ 70273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.099754 27825 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:02.095676 19458 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:00.722100 27789 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.111420 27886 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:02.112502 27864 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.105301 27919 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.112273 27886 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.113890 27789 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.109800 28024 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.115283 27851 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:02.097560 27942 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.015132 18914 rpcz_store.cc:276] 0709 12:26:58.984182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.984402 (+   220us) service_pool.cc:224] Handling call
0709 12:26:59.019264 (+ 34862us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:00.161915 (+1142651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.161948 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:00.169646 (+  7698us) log.cc:844] Serialized 52 byte log entry
0709 12:27:00.321493 (+151847us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:00.498088 (+176595us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.533107 (+ 35019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.533199 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.533248 (+    49us) raft_consensus.cc:1685] finished
0709 12:27:00.533261 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.533450 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1260835,"prepare.queue_time_us":167202,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":1183901,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":277,"thread_start_us":147436,"threads_started":1,"wal-append.queue_time_us":197734,"wal-append.run_cpu_time_us":4297,"wal-append.run_wall_time_us":1166995}
I20260709 12:27:02.133749 28051 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:02.131546 27972 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.114331 27919 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.144739 27879 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:02.159996 18839 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:02.163204 27913 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.164175 27913 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.146112 28048 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.161770 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1601) took 2645 ms. Trace:
I20260709 12:27:02.169922 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1605) took 2425 ms. Trace:
I20260709 12:27:02.171798 18839 rpcz_store.cc:276] 0709 12:26:59.741633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.155392 (+2413759us) service_pool.cc:224] Handling call
0709 12:27:02.155886 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.160414 (+  4528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.166993 (+  6579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.170562 18840 rpcz_store.cc:276] 0709 12:26:59.513308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.088344 (+2575036us) service_pool.cc:224] Handling call
0709 12:27:02.125538 (+ 37194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.153552 (+ 28014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.153574 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.158071 (+  4497us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:02.158115 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.158178 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.158309 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.169188 28051 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.140590 28008 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:02.185576 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 102531us
I20260709 12:27:02.183619 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1602) took 2670 ms. Trace:
I20260709 12:27:02.187150 18841 rpcz_store.cc:276] 0709 12:26:59.513574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.117525 (+2603951us) service_pool.cc:224] Handling call
0709 12:27:02.151578 (+ 34053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.183143 (+ 31565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.183194 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.183291 (+    97us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:02.183345 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.183441 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.183564 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.157238 28024 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.166752 27825 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.186642 27595 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.191876 27595 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.193069 28024 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.183434 27774 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:02.189589 27528 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.181984 27972 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.202294 27728 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:02.208285 27886 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.213932 27942 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.216096 28008 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:02.218684 27972 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:02.224359 27887 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.217684 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3614) took 2207 ms. Trace:
I20260709 12:27:02.234944 18839 rpcz_store.cc:276] 0709 12:27:00.010009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.196787 (+2186778us) service_pool.cc:224] Handling call
0709 12:27:02.216714 (+ 19927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.217152 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.217191 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.217274 (+    83us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:02.217320 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.217399 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.217566 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.237239 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1583) took 4414 ms. Trace:
I20260709 12:27:02.233525 28053 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:02.237726 18846 rpcz_store.cc:276] 0709 12:26:57.822977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.302207 (+2479230us) service_pool.cc:224] Handling call
0709 12:27:00.319186 (+ 16979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.319579 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.319614 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:00.326488 (+  6874us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.028689 (+1702201us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:27:02.235321 (+206632us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.236793 (+  1472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.236922 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.236967 (+    45us) raft_consensus.cc:1685] finished
0709 12:27:02.236978 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.237174 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":180855,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":812,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":18900,"thread_start_us":1788623,"threads_started":2,"wal-append.queue_time_us":1594899}
I20260709 12:27:02.239168 28053 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:02.241801 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 222126us
W20260709 12:27:02.244024 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 195875us
I20260709 12:27:02.216158 28051 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.241106 27595 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.240619 27913 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:02.266300 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 46067.9us
W20260709 12:27:02.269549 19457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.264824 28051 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.278640 28055 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:02.312458 28051 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.312636 28055 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.315794 28055 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.280525 28053 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.282054 27898 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:02.317588 27898 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.291285 28004 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:02.306591 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44708.5us
I20260709 12:27:02.319491 28051 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.310921 18841 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:27:02.322088 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3616) took 2311 ms. Trace:
I20260709 12:27:02.322490 18841 rpcz_store.cc:276] 0709 12:27:00.010616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.199212 (+2188596us) service_pool.cc:224] Handling call
0709 12:27:02.270866 (+ 71654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.321778 (+ 50912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.322005 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.324110 18841 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:02.324764 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3620) took 2282 ms. Trace:
I20260709 12:27:02.325116 18841 rpcz_store.cc:276] 0709 12:27:00.042273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.323355 (+2281082us) service_pool.cc:224] Handling call
0709 12:27:02.323823 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.324494 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.324685 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.326105 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.328064 28053 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:02.328685 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3621) took 2281 ms. Trace:
I20260709 12:27:02.329295 18841 rpcz_store.cc:276] 0709 12:27:00.047213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.325962 (+2278749us) service_pool.cc:224] Handling call
0709 12:27:02.326377 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.328268 (+  1891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.328302 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.328368 (+    66us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:27:02.328410 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.328476 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.328611 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.331290 27789 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.332391 27919 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.332731 27789 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.335680 27789 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.337778 18764 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:27:02.338511 18841 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:02.339268 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3622) took 2287 ms. Trace:
I20260709 12:27:02.340194 27828 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.340533 18769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3748) took 2097 ms. Trace:
I20260709 12:27:02.340801 27828 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.340975 18769 rpcz_store.cc:276] 0709 12:27:00.243159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.243322 (+   163us) service_pool.cc:224] Handling call
0709 12:27:00.243722 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.062515 (+1818793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.340190 (+277675us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54001ca2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:02.340440 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4179559296}
I20260709 12:27:02.342733 18842 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 31.
W20260709 12:27:02.344604 18842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3668) took 4110 ms (client timeout 1622 ms). Trace:
I20260709 12:27:02.345117 18848 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 30 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
W20260709 12:27:02.345145 18842 rpcz_store.cc:269] 0709 12:26:58.234379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.281106 (+ 46727us) service_pool.cc:224] Handling call
0709 12:27:02.344252 (+4063146us) spinlock_profiling.cc:243] Waited 4.06 s on lock 0x7b540041afd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:02.344483 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9337729792}
I20260709 12:27:02.334589 27825 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.346959 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3716) took 3666 ms. Trace:
I20260709 12:27:02.347764 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3625) took 2263 ms. Trace:
I20260709 12:27:02.348244 18842 rpcz_store.cc:276] 0709 12:27:00.084053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.346509 (+2262456us) service_pool.cc:224] Handling call
0709 12:27:02.347030 (+   521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.347379 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.347412 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.347476 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:02.347514 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.347572 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.347704 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.349861 27821 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.350287 18842 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 12:27:02.351177 18845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3672) took 4050 ms (client timeout 1988 ms). Trace:
I20260709 12:27:02.359783 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:02.367974 18845 rpcz_store.cc:269] 0709 12:26:58.301082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.416454 (+1115372us) service_pool.cc:224] Handling call
0709 12:27:02.350794 (+2934340us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400124b54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:02.350990 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2586151296}
I20260709 12:27:02.360495 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.351109 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3626) took 2258 ms. Trace:
I20260709 12:27:02.370142 18842 rpcz_store.cc:276] 0709 12:27:00.092470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.349319 (+2256849us) service_pool.cc:224] Handling call
0709 12:27:02.349799 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.350774 (+   975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.351043 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:02.370827 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.339638 18841 rpcz_store.cc:276] 0709 12:27:00.051549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.337742 (+2286193us) service_pool.cc:224] Handling call
0709 12:27:02.338197 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.339037 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.339214 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.347417 18848 rpcz_store.cc:276] 0709 12:26:58.680263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.879609 (+3199346us) service_pool.cc:224] Handling call
0709 12:27:02.344499 (+464890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.345655 (+  1156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.346695 (+  1040us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540041afd0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:02.346857 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062709632}
I20260709 12:27:02.365468 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.366115 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.374725 18917 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 32.
I20260709 12:27:02.376369 18842 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:27:02.377151 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3628) took 2279 ms. Trace:
I20260709 12:27:02.377564 18916 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:27:02.377512 18842 rpcz_store.cc:276] 0709 12:27:00.098162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.375436 (+2277274us) service_pool.cc:224] Handling call
0709 12:27:02.375858 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.376841 (+   983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.377068 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:02.391702 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.384161 18848 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:27:02.379462 18913 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:02.385237 27774 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.415832 27774 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:02.382036 18844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3667) took 4148 ms (client timeout 2028 ms). Trace:
I20260709 12:27:02.385540 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.396440 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3617) took 2385 ms. Trace:
I20260709 12:27:02.356400 27998 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:02.379817 28044 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.302s	user 0.008s	sys 0.000s
I20260709 12:27:02.379143 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3751) took 1952 ms. Trace:
I20260709 12:27:02.418149 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3634) took 2302 ms. Trace:
W20260709 12:27:02.387444 19457 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.515s (SENT)
I20260709 12:27:02.423133 27782 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.423775 27789 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:02.428891 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.429733 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.429636 27782 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:02.430552 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.430917 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:02.385776 27913 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:02.424389 28045 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.353s	user 0.000s	sys 0.002s
I20260709 12:27:02.428545 27789 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.432243 27913 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.433151 27963 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:02.434284 27789 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:02.379634 28048 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:02.435146 27782 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.435279 27913 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:02.435417 28048 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.436398 27898 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.437242 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.431624 18917 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
W20260709 12:27:02.418618 18844 rpcz_store.cc:269] 0709 12:26:58.233999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.366162 (+1132163us) service_pool.cc:224] Handling call
0709 12:27:02.381766 (+3015604us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b5400285354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:02.381952 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5911724800}
I20260709 12:27:02.438655 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:02.427253 18848 rpcz_store.cc:276] 0709 12:27:00.115812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.383070 (+2267258us) service_pool.cc:224] Handling call
0709 12:27:02.383600 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.413344 (+ 29744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.418074 (+  4730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.426334 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3619) took 2390 ms. Trace:
I20260709 12:27:02.427718 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.442906 18846 rpcz_store.cc:276] 0709 12:27:00.035708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.261540 (+2225832us) service_pool.cc:224] Handling call
0709 12:27:02.374714 (+113174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.420468 (+ 45754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.420504 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.426015 (+  5511us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:02.426066 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.426135 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.426274 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.442518 18845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3627) took 2347 ms. Trace:
I20260709 12:27:02.445987 27525 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.446501 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.446856 27525 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.447598 27958 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.448161 28058 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.448879 28058 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.449590 27525 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.451263 27774 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:02.451649 27828 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.452193 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.452917 28058 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.453141 18916 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
W20260709 12:27:02.453958 28062 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 12:27:02.455274 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.453052 18914 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:27:02.461789 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3635) took 2324 ms. Trace:
W20260709 12:27:02.463979 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.464711 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.466568 18769 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:27:02.467361 28048 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.466821 18920 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 24 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:27:02.419839 18839 rpcz_store.cc:276] 0709 12:27:00.010879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.236136 (+2225257us) service_pool.cc:224] Handling call
0709 12:27:02.236752 (+   616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.237238 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:27:02.237719 (+   481us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.375239 (+137520us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.396029 (+ 20790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.396101 (+    72us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:02.396156 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.396227 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.396356 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20844,"prepare.queue_time_us":5860,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":82,"raft.queue_time_us":24882,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":14773,"thread_start_us":134253,"threads_started":1}
I20260709 12:27:02.471382 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.442039 27789 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:02.476176 27789 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.479240 18913 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:27:02.481353 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.483976 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:02.468770 18843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 3618) took 2452 ms (client timeout 2618 ms). Trace:
I20260709 12:27:02.484989 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.422637 18772 rpcz_store.cc:276] 0709 12:27:00.426960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.427105 (+   145us) service_pool.cc:224] Handling call
0709 12:27:00.427395 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.427613 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:27:00.427909 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.374783 (+1946874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.378561 (+  3778us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:02.378665 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.378818 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.379034 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6756,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":270453,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":317,"thread_start_us":1826972,"threads_started":2,"wal-append.queue_time_us":1511225}
W20260709 12:27:02.486286 18843 rpcz_store.cc:269] 0709 12:27:00.016520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.278868 (+262348us) service_pool.cc:224] Handling call
0709 12:27:02.456808 (+2177940us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400381654. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:02.468698 (+ 11890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3958265216}
I20260709 12:27:02.444939 18845 rpcz_store.cc:276] 0709 12:27:00.095547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.369041 (+2273494us) service_pool.cc:224] Handling call
0709 12:27:02.369488 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.369898 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:27:02.370611 (+   713us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.441827 (+ 71216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.442135 (+   308us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:02.442198 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.442279 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.442451 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":651,"prepare.queue_time_us":176,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":16441,"thread_start_us":55145,"threads_started":1}
I20260709 12:27:02.469072 28053 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:02.497236 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 62319.3us
I20260709 12:27:02.497380 28053 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.498503 18886 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:02.500056 27728 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:02.500458 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.501542 28052 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.502259 28052 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.502794 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:02.504134 18914 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:27:02.505204 28052 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.506119 28053 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.494838 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.509574 27793 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.510553 27793 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.511581 27789 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.480482 27963 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:27:02.513468 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.514350 18841 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:27:02.517568 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.518131 18841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3631) took 2412 ms. Trace:
I20260709 12:27:02.518806 18841 rpcz_store.cc:276] 0709 12:27:00.106203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.401268 (+2295065us) service_pool.cc:224] Handling call
0709 12:27:02.457435 (+ 56167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.514862 (+ 57427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.518077 (+  3215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.491937 27851 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.462281 18842 rpcz_store.cc:276] 0709 12:27:00.137944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.413604 (+2275660us) service_pool.cc:224] Handling call
0709 12:27:02.450563 (+ 36959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.453730 (+  3167us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:27:02.454954 (+  1224us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.461191 (+  6237us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.461427 (+   236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.461475 (+    48us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:27:02.461521 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.461588 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.461716 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":781,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":279,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":313,"spinlock_wait_cycles":529152,"thread_start_us":5460,"threads_started":1}
I20260709 12:27:02.520632 18916 raft_consensus.cc:2410] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 28 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 12:27:02.516523 27793 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:02.527540 27851 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.530834 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.531816 18764 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:02.535136 27973 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.538544 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:02.538839 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.539368 18920 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:02.448208 27958 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.527738 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.546526 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:02.494024 27998 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.553551 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.559199 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.549268 27851 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.572959 27872 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:02.576618 18844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3636) took 2437 ms. Trace:
I20260709 12:27:02.576736 18666 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 19 to 20, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 20 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:02.572296 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:02.593055 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.597072 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 209690us
I20260709 12:27:02.573491 27972 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:27:02.607856 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3735) took 4146 ms. Trace:
I20260709 12:27:02.608150 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.608616 19488 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:27:02.608913 19492 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:02.609565 27958 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.603566 27782 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:02.610460 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.611095 27782 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.611394 18772 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:02.611564 27782 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:02.605933 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.613909 19486 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:02.560969 28053 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:27:02.597635 18844 rpcz_store.cc:276] 0709 12:27:00.139707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.462820 (+2323113us) service_pool.cc:224] Handling call
0709 12:27:02.467602 (+  4782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.468040 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:27:02.468428 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.567994 (+ 99566us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.576219 (+  8225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.576278 (+    59us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:27:02.576330 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.576396 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.576544 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12649,"prepare.queue_time_us":3042,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":3191,"raft.queue_time_us":18421,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":227,"thread_start_us":82489,"threads_started":1,"wal-append.queue_time_us":127739}
I20260709 12:27:02.622923 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:02.608423 18766 rpcz_store.cc:276] 0709 12:26:58.457710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.730044 (+272334us) service_pool.cc:224] Handling call
0709 12:26:58.730444 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.862577 (+132133us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:26:58.877368 (+ 14791us) log.cc:844] Serialized 14 byte log entry
0709 12:26:58.895469 (+ 18101us) log.cc:844] Serialized 14 byte log entry
0709 12:26:58.917309 (+ 21840us) log.cc:844] Serialized 14 byte log entry
0709 12:26:59.684810 (+767501us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b18004b7420. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e522 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:27:01.913360 (+2228550us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b18004b7420. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335af83060 00007f335af95716 00007f335afa6287 00007f335afa6208
0709 12:27:02.232891 (+319531us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.280948 (+ 48057us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.281682 (+   734us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.281851 (+   169us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:02.281884 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.282546 (+   662us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.602205 (+319659us) raft_consensus.cc:1685] finished
0709 12:27:02.602232 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.603470 (+  1238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31785,"prepare.queue_time_us":66030,"prepare.run_cpu_time_us":169,"prepare.run_wall_time_us":174,"raft.queue_time_us":100988,"raft.run_cpu_time_us":728,"raft.run_wall_time_us":7482,"spinlock_wait_cycles":25024512,"thread_start_us":506107,"threads_started":4,"wal-append.queue_time_us":70623,"wal-append.run_cpu_time_us":2157,"wal-append.run_wall_time_us":1024868}
I20260709 12:27:02.624533 27913 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:27:02.604262 27972 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.627193 27972 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:27:02.628443 28063 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:02.630298 18840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3615) took 2620 ms. Trace:
I20260709 12:27:02.630756 18840 rpcz_store.cc:276] 0709 12:27:00.010296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.298993 (+2288697us) service_pool.cc:224] Handling call
0709 12:27:02.299510 (+   517us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:02.300052 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.300085 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:02.300921 (+   836us) log.cc:844] Serialized 52 byte log entry
0709 12:27:02.420317 (+119396us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:02.420359 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.420440 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.630017 (+209577us) raft_consensus.cc:1685] finished
0709 12:27:02.630038 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.630221 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18730,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":107,"thread_start_us":118799,"threads_started":1,"wal-append.queue_time_us":222297}
W20260709 12:27:02.643239 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 105059us
I20260709 12:27:02.644381 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:02.645330 27837 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.645910 27837 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:02.646700 27872 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:02.648660 27837 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.654999 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1595) took 3146 ms. Trace:
I20260709 12:27:02.655613 18847 rpcz_store.cc:276] 0709 12:26:59.508663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.048544 (+2539881us) service_pool.cc:224] Handling call
0709 12:27:02.104552 (+ 56008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.135231 (+ 30679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.135272 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.416715 (+281443us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b2c0005b308. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:27:02.417321 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.495274 (+ 77953us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:27:02.495312 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.495388 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.654510 (+159122us) raft_consensus.cc:1685] finished
0709 12:27:02.654541 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.654884 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1628,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":32944,"spinlock_wait_cycles":12450560,"thread_start_us":76800,"threads_started":1,"wal-append.queue_time_us":154616}
I20260709 12:27:02.563696 27998 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.657845 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.658671 19492 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:02.659792 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.661873 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:02.662621 19488 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:02.659821 27998 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.680241 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.681450 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:02.682721 18766 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:02.683454 27782 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.686805 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.687865 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.689262 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.690673 19484 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:27:02.690834 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:02.692809 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.694470 18771 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:27:02.694653 18767 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:27:02.695652 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.698208 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.697726 18666 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:02.699432 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.710709 19492 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:02.700986 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.704069 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.706354 18920 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:27:02.681870 19457 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.541s (SENT)
W20260709 12:27:02.716620 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 92994.4us
I20260709 12:27:02.711997 19489 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 19.
I20260709 12:27:02.717149 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:02.715706 19485 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:02.721324 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.651940 18814 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.720845 27973 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:02.728777 27782 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:02.731164 19483 raft_consensus.cc:2368] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25.
I20260709 12:27:02.737670 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.744742 18914 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
W20260709 12:27:02.745877 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 93926.1us
I20260709 12:27:02.746626 27913 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:02.747112 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.747296 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.747331 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:02.759505 19491 raft_consensus.cc:3060] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:02.747730 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.748198 27958 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:02.749205 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 134093us
I20260709 12:27:02.741222 27973 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.750437 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.757220 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.759951 19488 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:27:02.760376 18917 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 21.
I20260709 12:27:02.761125 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.765511 18915 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:27:02.752271 27828 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:02.770496 18918 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:02.758915 27913 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.772394 27913 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:02.766438 27973 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:02.774993 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:02.779320 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.671s (SENT)
I20260709 12:27:02.783324 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.799358 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.800316 19491 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:27:02.800494 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.801316 28050 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:02.801515 28060 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:02.801831 28050 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.802019 28060 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.802280 28050 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:02.802451 28060 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:02.804096 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:02.804828 18918 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:27:02.806763 27958 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:02.807261 27958 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.807641 27958 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:02.813261 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.814679 27825 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:02.815202 27825 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.815546 27825 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:02.822009 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:02.826977 18666 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:02.829216 18666 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:02.832931 18666 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 10 to 15, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 15 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:02.843067 18773 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:02.843250 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.823310 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.853111 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:02.852852 28050 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:02.854825 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:02.855614 18840 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 16.
I20260709 12:27:02.868046 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:02.881875 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.883952 18665 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 280) took 110571 ms (client timeout 15000 ms). Trace:
W20260709 12:27:02.884873 18665 rpcz_store.cc:269] 0709 12:25:12.312212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.337219 (+ 25007us) service_pool.cc:224] Handling call
0709 12:27:02.883728 (+110546509us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6994778,"reported_tablets":50}
I20260709 12:27:02.885659 18918 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:27:02.888638 27825 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:02.898699 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53469.3us
I20260709 12:27:02.901757 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.902809 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.904193 19491 raft_consensus.cc:2393] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:02.906147 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 137779us
I20260709 12:27:02.769352 27828 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:02.920298 27898 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:27:02.921304 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.922149 28054 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:02.925911 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:02.926838 18847 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 26: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:02.927932 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:02.928704 19484 raft_consensus.cc:2368] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25.
I20260709 12:27:02.929571 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.932152 18766 raft_consensus.cc:2468] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 20.
I20260709 12:27:02.930176 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:02.930204 18765 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:27:02.939154 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.941130 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:02.942378 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 163083us
I20260709 12:27:02.942378 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.964437 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:02.909407 27782 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:02.916165 27998 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:02.917974 27828 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:02.975914 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.976917 18918 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:27:02.978171 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.979460 19486 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:27:02.968369 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:02.982259 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.986889 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.916041 27825 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:02.989404 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.989424 18814 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:02.991791 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:02.993706 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:02.994549 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.994717 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.995049 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.994798 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:02.999336 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.004055 18765 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:03.003849 18764 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:27:03.022866 18767 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:03.019240 18771 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:27:03.023052 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.024174 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.024174 18918 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:03.026180 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.005308 18915 raft_consensus.cc:2376] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22. Re-sending same reply.
I20260709 12:27:03.049744 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:03.047567 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:02.980307 27998 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:03.054111 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.056618 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.059228 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:03.054824 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 135986us
I20260709 12:27:03.056778 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:03.067437 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 124277us
I20260709 12:27:03.067658 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.047282 27837 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:03.074141 18918 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 18.
I20260709 12:27:03.072109 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.068516 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:03.068917 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.079353 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:03.057983 27998 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:03.081511 18773 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 27: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:03.084003 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:03.086844 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.086973 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.082319 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:03.065876 27872 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:03.090191 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.091292 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 32 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.095323 18773 raft_consensus.cc:2410] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 32 because replica has last-logged OpId of term: 31 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 30 index: 14.
I20260709 12:27:03.092316 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.095984 18769 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:27:03.092968 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.098989 18771 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:27:03.073900 27837 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.105561 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:03.115598 18768 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:03.117472 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.128662 18769 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:27:03.118994 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:27:03.134666 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53183.9us
I20260709 12:27:03.136315 18814 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:03.139586 18886 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:03.141031 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.141451 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:03.145823 27782 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:03.121187 27837 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:03.115453 27958 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.147866 28058 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:03.148453 28058 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.148908 28058 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:03.149068 27958 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:03.146615 27782 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:03.151851 27782 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:03.153690 28071 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:27:03.153891 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.094331 27872 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:03.114914 28050 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:03.157270 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:03.162922 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 80682.5us
I20260709 12:27:03.126950 27963 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:03.166381 27872 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:03.189720 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50288.8us
I20260709 12:27:03.197103 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.197902 18920 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:03.175036 27728 raft_consensus.cc:2804] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:03.203953 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.179965 27963 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.214071 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.215248 19484 raft_consensus.cc:2368] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
W20260709 12:27:03.227835 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 91663.8us
I20260709 12:27:03.234479 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:03.235333 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.235543 19489 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:27:03.234596 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.240147 19486 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:03.246634 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.211673 27963 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:03.250967 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.179013 27793 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260709 12:27:03.220108 27728 raft_consensus.cc:697] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:03.255791 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.262363 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.257066 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.252429 28089 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:27:03.258944 28083 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:03.278643 19491 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:03.280117 19489 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 16.
W20260709 12:27:03.265506 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 146588us
I20260709 12:27:03.270963 27728 consensus_queue.cc:237] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.289561 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:03.295495 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:27:03.302543 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 90357.1us
I20260709 12:27:03.307977 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.309185 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.309803 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.309603 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.314749 19491 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:03.310957 18922 raft_consensus.cc:2376] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25. Re-sending same reply.
W20260709 12:27:03.313705 27972 consensus_meta.cc:287] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.003s
I20260709 12:27:03.304656 28082 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:03.330295 27789 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:27:03.330888 27789 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:03.331902 27789 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:03.333459 27789 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:27:03.334537 28076 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.233s	user 0.003s	sys 0.000s
I20260709 12:27:03.341912 18920 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:27:03.338917 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.343420 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.306939 27825 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 12:27:03.325116 27913 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.005s
I20260709 12:27:03.347617 19458 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:03.321583 28087 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:27:03.360246 28060 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:27:03.360782 28060 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.335852 27972 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.361364 27837 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.363811 27972 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:03.364729 19483 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 33: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:03.355659 27774 raft_consensus.cc:2804] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:03.367424 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.369529 19489 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 32. Current term is 33. Ops: []
I20260709 12:27:03.355228 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.324877 28082 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.382732 28082 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:03.382974 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 32 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.361763 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:03.370926 19488 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 28: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:03.375754 27898 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.356725 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.378516 28058 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.379407 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.380635 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:03.399614 18767 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:27:03.381781 28087 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:03.355161 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.389551 18768 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:27:03.355945 27913 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.423550 19486 raft_consensus.cc:2393] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 19: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:03.427783 19490 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:03.400250 27973 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.597s	user 0.002s	sys 0.010s
W20260709 12:27:03.434437 18814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.349368 27828 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:03.391265 27774 raft_consensus.cc:697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:03.442500 19486 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:27:03.442765 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:03.445139 27837 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:03.446050 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.404134 27972 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:03.384891 27872 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:03.456496 19490 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:03.369577 27998 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:03.461401 19485 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:03.461918 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 100248us
W20260709 12:27:03.460016 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 106541us
I20260709 12:27:03.457964 19483 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
W20260709 12:27:03.471987 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.471999 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.491906 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.448686 28090 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.482672 18840 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
W20260709 12:27:03.498443 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51501.4us
I20260709 12:27:03.503429 18842 raft_consensus.cc:1240] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
W20260709 12:27:03.504015 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.492866 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.492956 18844 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:03.507774 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.510131 18845 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:03.502159 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.426043 27898 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.468360 27972 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:03.516273 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.425103 28089 consensus_queue.cc:1048] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.069s
I20260709 12:27:03.451457 27973 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.527402 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:03.535955 18843 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:03.545275 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.546221 18917 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:03.549618 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.530766 27972 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:03.515837 28083 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:03.573292 19491 raft_consensus.cc:1240] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:03.575488 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.524088 28060 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:03.580027 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75889.1us
I20260709 12:27:03.583362 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.515447 28090 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.602088 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:03.607033 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 65596.1us
I20260709 12:27:03.553560 27825 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 12:27:03.548347 27728 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:27:03.621869 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.624817 18847 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:27:03.625998 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.628085 27828 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:03.629788 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.634037 18841 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:03.587378 28088 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:27:03.609730 28053 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:27:03.599778 27774 consensus_queue.cc:237] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.648475 27828 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 12:27:03.662986 28089 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:03.663394 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:03.664743 27973 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:03.668332 28107 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
W20260709 12:27:03.670930 28093 log.cc:927] Time spent T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.231s	user 0.000s	sys 0.003s
I20260709 12:27:03.673454 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.674209 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.674909 18842 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:03.677750 28058 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:03.651099 28105 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.722083 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.722705 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:03.723426 18841 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 31.
I20260709 12:27:03.653043 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.609598 28100 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:27:03.719784 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:03.674212 18845 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
W20260709 12:27:03.726651 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75466.7us
W20260709 12:27:03.733992 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 152082us
I20260709 12:27:03.646936 27913 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:03.586032 28087 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:03.741021 18847 raft_consensus.cc:2410] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 28 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:27:03.743722 18843 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
W20260709 12:27:03.654124 28099 log.cc:927] Time spent T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:27:03.739565 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:03.645854 28052 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.095s
I20260709 12:27:03.718339 27872 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:03.723122 27828 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:03.655702 28090 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:03.760412 27837 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:03.764756 27837 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:03.765265 27837 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:27:03.765810 28098 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:27:03.765887 27879 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:03.768333 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:03.768807 28102 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.052s	user 0.000s	sys 0.002s
I20260709 12:27:03.769781 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:03.771189 28109 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:27:03.773196 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.774468 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.775712 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.760488 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:03.777441 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:03.778330 28101 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:03.778853 27898 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:03.779191 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:03.780335 18812 leader_election.cc:400] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:27:03.780622 18812 leader_election.cc:403] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:03.781735 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:03.783175 28106 log.cc:927] Time spent T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 12:27:03.744799 28084 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:27:03.784031 28104 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:27:03.784025 27872 raft_consensus.cc:3060] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:27:03.776835 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.782701 28085 consensus_queue.cc:1059] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:03.788968 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.751549 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:03.745379 27998 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:03.791412 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:03.795325 28096 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:27:03.795138 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet 1485e54f9795416785f4baf244599201 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:60130
I20260709 12:27:03.796007 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.779197 28101 raft_consensus.cc:2764] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
W20260709 12:27:03.798468 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 78794us
I20260709 12:27:03.647222 28083 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:03.799703 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49963.6us
I20260709 12:27:03.824358 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:03.662058 28082 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.798836 28054 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:03.784873 27793 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:27:03.805621 18913 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 28 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 14.
I20260709 12:27:03.807405 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.812603 18917 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
I20260709 12:27:03.763331 27828 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.827785 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:03.821455 18737 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.40.4:44937 timed out after 1.732s (SENT) [suppressed 59 similar messages]
W20260709 12:27:03.809944 27963 consensus_meta.cc:287] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.000s
I20260709 12:27:03.841679 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:03.841817 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 263957us
W20260709 12:27:03.846825 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 85589.8us
I20260709 12:27:03.851851 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:03.853384 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:03.815104 28090 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:03.776067 27837 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.855583 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:03.745121 28105 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:03.860394 18739 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.532s (SENT)
I20260709 12:27:03.882918 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:03.861706 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:03.881069 18922 raft_consensus.cc:1240] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:03.827394 28054 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:03.841400 27828 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:27:03.887753 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46164.9us
I20260709 12:27:03.884459 28113 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:03.886603 28085 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:03.892463 28085 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.892164 28054 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:03.826575 27789 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:27:03.892980 28085 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:03.894027 28054 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:03.912891 18918 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:27:03.877061 28090 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:03.952875 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 91379.4us
I20260709 12:27:03.953421 18917 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
W20260709 12:27:03.892226 28095 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.223s	user 0.004s	sys 0.000s
I20260709 12:27:03.911478 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:03.959684 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48337.8us
I20260709 12:27:03.894168 28082 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:03.915526 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 94114.4us
I20260709 12:27:03.855154 27963 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:03.901557 28100 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:03.964814 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55995.5us
I20260709 12:27:03.918416 27958 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:03.975917 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:03.894594 28101 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:03.977236 18919 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
W20260709 12:27:03.979267 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.917377 28104 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:27:03.980768 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120411us
W20260709 12:27:03.982894 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 129597us
I20260709 12:27:03.984668 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:03.985304 18886 leader_election.cc:400] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25.
I20260709 12:27:03.985680 18886 leader_election.cc:403] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:03.958608 28090 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:27:03.988844 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 161149us
I20260709 12:27:03.995270 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:03.999094 18739 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.547s (SENT)
I20260709 12:27:03.999672 18739 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.000483 18921 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 27: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:03.983668 28111 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:04.010903 27837 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:04.012481 28114 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:27:04.017618 27872 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 21. Current term is 22.
I20260709 12:27:04.018615 28116 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25.
W20260709 12:27:04.037125 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 76511.7us
I20260709 12:27:04.038101 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:04.039983 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47515.3us
W20260709 12:27:04.041687 18739 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Timed out: RequestConsensusVote RPC to 127.17.40.3:41535 timed out after 1.662s (SENT)
I20260709 12:27:04.019490 27963 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:04.019932 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:04.042719 27879 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:27:04.043174 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46578.4us
I20260709 12:27:04.043561 27879 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:04.043992 27879 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.044625 27879 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:03.987430 27958 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.959412 28107 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 12:27:04.034152 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 48628.3us
I20260709 12:27:03.991931 27793 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:04.036794 28124 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:04.043934 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:04.020499 28081 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:04.009284 18737 leader_election.cc:336] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Timed out: RequestConsensusVote RPC to 127.17.40.4:44937 timed out after 1.596s (SENT)
W20260709 12:27:04.071274 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 87720.7us
I20260709 12:27:04.077098 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.045517 28111 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:27:04.081662 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 43662.6us
I20260709 12:27:04.082736 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.082768 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:04.154279 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 71602us
W20260709 12:27:04.143982 27972 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.004s
I20260709 12:27:04.134650 28058 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:27:04.135018 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 137367us
I20260709 12:27:04.136963 27898 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:04.137097 27998 raft_consensus.cc:3055] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:04.138491 28127 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:04.070485 27958 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:04.138195 28104 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.083648 28113 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
W20260709 12:27:04.144556 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 134711us
W20260709 12:27:04.145329 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74835.1us
I20260709 12:27:04.032732 28126 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:04.144040 28119 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 12:27:04.158627 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 83297.2us
I20260709 12:27:04.174256 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:04.165647 27913 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.013s
I20260709 12:27:04.180563 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:04.181933 19491 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:04.183310 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.592s (SENT)
W20260709 12:27:04.185026 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 103264us
I20260709 12:27:04.080616 27837 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.100s
I20260709 12:27:04.164975 27793 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:04.162516 27998 raft_consensus.cc:740] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:04.184762 28082 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:04.186836 28126 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.194268 28100 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:27:04.197431 18887 leader_election.cc:336] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.676s (SENT)
I20260709 12:27:04.162734 27972 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.165894 28083 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:04.204967 28111 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:04.206283 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 211080us
I20260709 12:27:04.153527 28052 consensus_queue.cc:1059] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:27:04.213613 28090 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.215643 27898 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:04.224336 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.184165 28120 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:04.234915 28126 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:04.241276 27879 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:04.241660 18887 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.741s (SENT)
I20260709 12:27:04.228492 27898 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:04.242640 27998 consensus_queue.cc:260] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.243422 27898 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:04.244176 27998 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:04.245260 27972 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:04.250702 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.248452 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.230363 28120 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:04.254798 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:04.257997 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.232421 28127 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:04.230901 28100 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:04.254827 28126 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:04.279659 28101 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:04.252830 28120 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:04.292058 28090 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:04.292433 27793 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:27:04.296365 28100 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:04.297588 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56012.1us
W20260709 12:27:04.298619 18887 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.835s (SENT)
W20260709 12:27:04.299904 18887 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.876s (SENT)
W20260709 12:27:04.303661 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45810.3us
I20260709 12:27:04.304417 18812 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.269651 27837 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:27:04.308276 18887 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.932s (SENT)
W20260709 12:27:04.306175 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 132024us
I20260709 12:27:04.309176 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.308813 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.311734 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.252995 27828 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:04.315037 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 232403us
I20260709 12:27:04.305226 28083 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:04.312619 28101 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:04.318069 28138 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:04.318256 28101 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.318750 28101 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:04.313802 27872 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:04.319407 27872 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.319886 27872 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:04.320366 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.321429 27825 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:04.323213 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.324837 27825 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:04.325289 27825 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:04.325707 27825 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:04.330479 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.332616 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.334674 28090 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.334879 28087 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.341254 27872 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:04.342885 18737 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.313175 27837 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:04.330587 27728 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:04.350279 18843 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:04.350665 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.347178 28090 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:04.352674 27879 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:04.351749 27828 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:04.370925 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 120353us
I20260709 12:27:04.348290 27837 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:04.355311 18841 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:27:04.342813 28100 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260709 12:27:04.356830 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.357064 28139 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:04.356830 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:04.358579 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.358760 27958 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.370884 18847 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 27 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:27:04.378705 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.353634 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:04.379663 18845 raft_consensus.cc:2376] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21. Re-sending same reply.
I20260709 12:27:04.380141 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.380388 27958 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:04.380694 19491 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:27:04.381073 18839 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 30: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:04.382102 27872 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:04.378773 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.383248 18843 raft_consensus.cc:2368] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23.
I20260709 12:27:04.383253 27879 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 32.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:27:04.372529 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.375419 18844 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
W20260709 12:27:04.377120 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 75268.7us
I20260709 12:27:04.377314 18840 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:04.382273 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.392999 28145 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:27:04.393522 28145 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:04.393628 28139 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:04.394151 28139 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:04.394644 28145 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 32.22, Last appended by leader: 22, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.395023 28139 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.396188 28139 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:27:04.397446 18887 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 1.933s (SENT)
I20260709 12:27:04.397547 18848 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:04.398016 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.366079 28085 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.396927 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:04.407305 19491 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:27:04.409797 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:04.410744 19485 raft_consensus.cc:2393] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:04.416361 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 93277.6us
I20260709 12:27:04.422943 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:04.425536 28137 raft_consensus.cc:3055] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:04.426107 28137 raft_consensus.cc:740] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:04.426739 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.427527 18840 raft_consensus.cc:2468] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:04.419020 27872 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.430979 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:04.432651 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46555.9us
W20260709 12:27:04.433548 18887 leader_election.cc:336] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.078s (SENT)
I20260709 12:27:04.433985 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:04.437148 18887 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.100s (SENT)
I20260709 12:27:04.437651 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:04.438843 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66378.5us
I20260709 12:27:04.439750 18814 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.441056 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.442668 27872 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:04.443527 27872 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:04.445289 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 72905.1us
I20260709 12:27:04.451031 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:04.415238 28092 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:04.456197 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:04.458379 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.124s (SENT)
W20260709 12:27:04.459784 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.136s (SENT)
I20260709 12:27:04.460238 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.449621 28113 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:04.462615 18840 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:04.462057 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:04.449579 28089 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:04.469789 18844 raft_consensus.cc:2368] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27.
I20260709 12:27:04.470765 18843 raft_consensus.cc:1240] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:04.468447 28092 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:04.472653 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 286887us
I20260709 12:27:04.473521 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.458405 28054 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:04.472746 28085 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:04.478991 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.479861 27837 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.483668 18848 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:04.480526 28105 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:04.480962 27825 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:04.502843 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:04.503501 19485 raft_consensus.cc:1813] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Handling vote request from an unknown peer 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.495911 28137 consensus_queue.cc:260] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:04.504057 19485 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:04.452174 28100 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 12:27:04.504710 28137 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:04.504908 27825 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:04.477217 28054 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.493527 28139 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:04.493214 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.498355 28120 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:04.497046 18887 leader_election.cc:336] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.138s (SENT)
I20260709 12:27:04.509451 28054 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:04.512619 27898 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:04.467350 28144 consensus_queue.cc:1059] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 12:27:04.492772 28145 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:04.502715 27837 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:04.503607 28101 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:04.484865 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:04.538328 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.153s (SENT)
I20260709 12:27:04.538924 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.508086 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:04.500591 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45338.3us
I20260709 12:27:04.528666 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.542995 18848 raft_consensus.cc:2410] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260709 12:27:04.545827 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59916.4us
I20260709 12:27:04.547880 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.551054 19492 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:04.553248 18843 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:04.551023 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.551479 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.493630 28092 consensus_queue.cc:1059] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:27:04.566079 18842 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 31.
I20260709 12:27:04.552023 28105 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:04.551625 28148 raft_consensus.cc:3055] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:04.563541 28053 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.563513 28100 raft_consensus.cc:3060] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:04.549738 27837 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:04.576598 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.587535 18843 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
W20260709 12:27:04.587852 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 109632us
I20260709 12:27:04.581202 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:04.588743 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.589138 18848 raft_consensus.cc:2368] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28.
I20260709 12:27:04.565954 27825 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.583629 27898 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:04.582033 28113 raft_consensus.cc:3055] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:04.593155 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.591061 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:04.592252 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 126728us
I20260709 12:27:04.593609 28113 raft_consensus.cc:740] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:04.595360 27837 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.596264 28113 consensus_queue.cc:260] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.597754 28113 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:04.571645 28089 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:27:04.580631 28148 raft_consensus.cc:740] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:27:04.632385 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 116145us
I20260709 12:27:04.633175 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.611654 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:04.636174 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:04.636173 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.653882 27825 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:04.654428 27825 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.606685 27837 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:04.655334 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 43764.6us
I20260709 12:27:04.657680 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.660866 18737 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.663554 28147 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:04.637689 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:04.641057 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet 1485e54f9795416785f4baf244599201 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:27:04.642693 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.607405 28141 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:04.658465 28090 consensus_queue.cc:1059] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:04.637007 28144 consensus_queue.cc:1059] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:27:04.659219 28101 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:04.659524 18814 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.650801 27998 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:04.654811 27825 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:04.682382 28130 raft_consensus.cc:3055] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:04.672134 18848 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 26 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:27:04.685941 28130 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:04.687192 28120 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:04.670775 18658 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56923.4us
I20260709 12:27:04.686928 28130 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:04.677278 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.671640 28052 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:04.697499 27825 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:04.699599 18887 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.204s (SENT)
I20260709 12:27:04.705503 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.705775 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.706595 18842 raft_consensus.cc:2410] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
W20260709 12:27:04.706720 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 155784us
I20260709 12:27:04.712868 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:04.714464 18842 raft_consensus.cc:2410] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 26 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:27:04.703361 28124 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:04.726428 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:04.726938 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 67515.4us
I20260709 12:27:04.727293 18842 raft_consensus.cc:2368] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 16. Current term is 17.
W20260709 12:27:04.732123 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57183.1us
I20260709 12:27:04.732347 19491 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:04.730011 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:04.734436 18887 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.205s (SENT)
I20260709 12:27:04.736608 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:04.738354 18842 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:27:04.739275 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:04.740396 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.741060 18842 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28. Ops: []
I20260709 12:27:04.746337 18843 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:04.746644 18842 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:04.748064 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:04.733484 28089 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:04.752205 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:04.734059 28138 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:04.753213 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:04.758306 18848 raft_consensus.cc:2368] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24.
I20260709 12:27:04.758977 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.754638 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.760787 18840 raft_consensus.cc:2410] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:27:04.755038 18913 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:04.755504 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.747669 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:04.759121 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:04.753355 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.764334 18766 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 27: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:04.718539 28054 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.767803 18769 raft_consensus.cc:1275] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:04.747254 28130 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:04.777386 18768 raft_consensus.cc:1240] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:04.775739 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:04.781836 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.786293 18766 raft_consensus.cc:1240] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:27:04.786655 18845 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:27:04.787596 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.780853 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:04.789903 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:04.790828 18769 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:27:04.734760 28148 consensus_queue.cc:260] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:04.804390 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:04.805311 18770 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 27: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:04.805346 18844 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:04.805538 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.806450 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:04.807176 18845 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:27:04.807739 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:04.808948 18772 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:04.809667 28054 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:04.809993 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:04.810691 18772 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:04.806360 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:04.820580 18738 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.825438 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:27:04.811661 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78807.5us
I20260709 12:27:04.779778 28155 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:04.833398 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.214s (SENT)
I20260709 12:27:04.833487 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.834722 18844 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:27:04.834203 18887 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.837643 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:04.838696 19491 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:04.832154 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.798272 28139 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.777041 28122 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 12:27:04.827303 28089 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.848168 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.831951 28100 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:04.791332 27774 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:27:04.856999 18764 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:04.857692 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:04.858464 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.830366 28121 consensus_queue.cc:1048] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:27:04.834193 28105 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:27:04.852524 27789 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:04.877272 18767 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
W20260709 12:27:04.888546 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 59892.4us
I20260709 12:27:04.864207 28054 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:27:04.862776 28139 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:04.870501 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.902978 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.907735 19491 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:04.909201 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:27:04.933691 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 63310.4us
I20260709 12:27:04.945065 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.946478 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.946955 18918 raft_consensus.cc:2410] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:27:04.947273 18844 raft_consensus.cc:2393] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:04.948691 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:04.949393 19490 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:04.927109 28139 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:04.935247 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.952286 28139 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:04.958264 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:27:04.958959 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49858.8us
W20260709 12:27:04.952275 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.233s (SENT)
I20260709 12:27:04.959249 18766 raft_consensus.cc:2393] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 27: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:04.959717 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:04.959867 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:04.962174 18848 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:04.963299 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.971607 18773 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 33.
I20260709 12:27:04.925535 27728 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:04.926513 27825 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:04.982239 19456 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:04.984797 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:04.985978 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:04.983556 28138 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:04.958601 28092 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 12:27:04.989589 28092 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:04.990005 28092 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:04.961999 28161 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:04.991135 28161 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:04.984874 27774 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:04.964015 28100 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:04.990931 28092 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:04.961704 27958 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:05.000967 19488 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:04.996462 19484 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:04.997382 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 430116us
I20260709 12:27:04.997596 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:05.002259 19486 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:04.999200 18772 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:27:05.002130 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:05.004424 19456 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:27:05.017484 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 112475us
W20260709 12:27:05.019065 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Timed out: RequestConsensusVote RPC to 127.17.40.2:36959 timed out after 2.243s (SENT)
I20260709 12:27:04.985476 28113 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:05.023711 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.026710 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:04.997095 27913 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:27:04.965803 28111 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.053s
I20260709 12:27:04.843758 28155 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.045288 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:05.046738 19491 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 28: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:05.052995 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:05.014762 28100 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:04.992570 28161 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:05.059697 27998 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.091840 27998 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:05.061640 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:05.062808 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:05.065271 19490 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
W20260709 12:27:05.056587 28158 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:27:05.095889 19487 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 12:27:05.048475 28126 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:05.050696 27913 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 33 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:05.102022 27793 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:05.048092 28092 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:05.094620 19491 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 17: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:04.994554 27728 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.040266 28088 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:05.100957 28120 raft_consensus.cc:3055] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:05.090582 28100 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.107847 18842 raft_consensus.cc:2468] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:27:05.137686 19486 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:27:05.094908 28147 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:05.139794 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.141943 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.143107 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:05.148591 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 129565us
I20260709 12:27:05.095750 27998 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:05.160148 18846 raft_consensus.cc:2393] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 25: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:05.147490 18839 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:27:05.175020 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.112232 27793 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:05.136745 28120 raft_consensus.cc:740] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:05.191551 18915 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:27:05.206034 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.206943 18839 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
I20260709 12:27:05.212508 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:05.215157 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 197645us
I20260709 12:27:05.160737 28088 raft_consensus.cc:697] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:05.218469 18846 raft_consensus.cc:2368] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 27. Current term is 28.
I20260709 12:27:05.136379 28126 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:05.236325 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 232001us
I20260709 12:27:05.238250 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:05.245092 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 287197us
I20260709 12:27:05.225667 28105 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:05.291493 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.308373 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:05.312819 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 79604.1us
I20260709 12:27:05.285329 27789 consensus_queue.cc:1059] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:27:05.335134 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.337324 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.344452 18846 raft_consensus.cc:2368] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24.
I20260709 12:27:05.244871 27913 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 32.22, Last appended by leader: 22, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:05.355024 28167 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:27:05.356091 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.369990 18844 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:27:05.358505 28169 log.cc:927] Time spent T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
W20260709 12:27:05.361573 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61527.1us
I20260709 12:27:05.304627 28105 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.364912 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.294252 28139 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:05.347566 28137 consensus_meta.cc:287] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.011s
I20260709 12:27:05.361837 18841 raft_consensus.cc:1240] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 29. Current term is 30. Ops: []
I20260709 12:27:05.313452 28111 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.060s
I20260709 12:27:05.382730 18841 raft_consensus.cc:1240] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:27:05.388850 28138 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:05.389453 28138 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:05.295671 28120 consensus_queue.cc:260] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:05.394713 28159 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.582s	user 0.007s	sys 0.004s
I20260709 12:27:05.370754 28088 consensus_queue.cc:237] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.397444 28122 raft_consensus.cc:3055] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:05.397935 28122 raft_consensus.cc:740] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:05.398084 28139 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:05.331404 28113 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:27:05.287205 27793 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.404443 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.405464 18847 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:05.410307 18770 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
W20260709 12:27:05.320253 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69061.4us
I20260709 12:27:05.422827 18840 raft_consensus.cc:2468] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 19.
I20260709 12:27:05.430804 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.432083 18840 raft_consensus.cc:2393] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 17: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:27:05.436998 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 413642us
I20260709 12:27:05.438380 18771 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:05.438848 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.439706 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.440069 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.441043 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:05.441478 27789 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:05.441855 18767 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:05.442909 18771 raft_consensus.cc:1240] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:05.443249 27789 raft_consensus.cc:3055] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:05.443820 27789 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:27:05.444202 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70777.2us
I20260709 12:27:05.445405 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:05.445066 27789 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:05.447636 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.449672 19492 raft_consensus.cc:1240] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:05.450702 19489 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:05.451488 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:05.478685 18772 raft_consensus.cc:2468] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:05.505447 19457 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:05.549928 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.471800 18737 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:27:05.575626 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 103933us
I20260709 12:27:05.429560 27793 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:05.600626 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 155316us
I20260709 12:27:05.607789 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.608639 18840 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
W20260709 12:27:05.609799 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 104517us
W20260709 12:27:05.613018 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.617130 19457 leader_election.cc:400] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 27. Current term is 28.
I20260709 12:27:05.617563 19457 leader_election.cc:403] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 12:27:05.619181 18887 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:05.620085 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.601658 28161 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:05.574903 28137 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.627043 18848 raft_consensus.cc:2468] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:27:05.576825 27728 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:05.631011 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.634790 18846 raft_consensus.cc:1275] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:05.654966 28161 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:05.619323 27958 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:05.687659 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.681139 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.689612 18840 raft_consensus.cc:2393] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:27:05.685021 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 61109.6us
I20260709 12:27:05.700614 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:05.704412 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.692081 28113 consensus_queue.cc:1243] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 23.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:27:05.710057 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:05.714838 28161 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:05.719242 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 108082us
I20260709 12:27:05.791905 19457 leader_election.cc:400] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 23. Current term is 24.
I20260709 12:27:05.718987 28206 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:05.695068 28188 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba for earlier term 27. Current term is 28.
I20260709 12:27:05.726943 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.796663 27972 consensus_queue.cc:1059] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 29.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:27:05.429175 28179 consensus_queue.cc:1175] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47b48b5c69f245b79ecb292eff89927f" responder_term: 21 status { last_received { term: 20 index: 14 } last_committed_idx: 14 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:27:05.797771 28196 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:27:05.684710 28126 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:05.741814 18847 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:27:05.798750 28105 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:05.798804 28176 consensus_queue.cc:1059] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:05.799381 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.799906 28176 raft_consensus.cc:3055] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:05.800252 28176 raft_consensus.cc:740] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:05.800616 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.743269 18848 raft_consensus.cc:1240] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:05.743201 18844 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:27:05.803007 28105 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:05.803714 28105 consensus_queue.cc:1243] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 25.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:27:05.804083 28179 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.804575 28179 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.805615 28105 raft_consensus.cc:2804] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:05.806298 28105 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.806871 28179 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:05.742017 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.807017 28105 raft_consensus.cc:3060] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:05.808785 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.809173 27972 raft_consensus.cc:3055] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:27:05.809563 18771 raft_consensus.cc:1240] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:05.810006 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:05.810504 18765 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:27:05.809602 27972 raft_consensus.cc:740] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:05.812162 18773 raft_consensus.cc:1240] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:05.811785 27972 consensus_queue.cc:260] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.795591 19457 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:05.813107 27972 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:05.814617 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:05.815678 28185 raft_consensus.cc:2804] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:05.816226 28185 raft_consensus.cc:697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:05.817190 28185 consensus_queue.cc:237] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.749840 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.637746 28137 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:05.818770 28188 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:05.819319 28188 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:05.819608 18767 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:27:05.819759 28188 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:05.820493 28137 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:05.761999 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:05.821880 28126 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:05.774223 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.823201 18764 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 24: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:05.823521 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:05.824941 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 63056.3us
W20260709 12:27:05.781085 18839 consensus_meta.cc:287] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 12:27:05.782145 19487 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:27:05.826439 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:05.622067 28122 consensus_queue.cc:260] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:05.827908 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.787634 28201 raft_consensus.cc:2764] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:27:05.775552 27998 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.013s
I20260709 12:27:05.789047 28205 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:05.707808 28113 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:27:05.790696 18772 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: [25.19-25.19]
I20260709 12:27:05.870886 28113 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:05.792373 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.818982 18842 raft_consensus.cc:2393] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 24: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:05.782786 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:05.702610 27789 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:05.786587 28089 consensus_queue.cc:1059] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:05.826911 18839 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
I20260709 12:27:05.876418 18841 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
W20260709 12:27:05.828692 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 119824us
I20260709 12:27:05.877542 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:05.842710 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:05.878412 18764 raft_consensus.cc:2376] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26. Re-sending same reply.
I20260709 12:27:05.843349 28104 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:27:05.844004 28124 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.846525 28187 consensus_queue.cc:1059] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:05.851387 18844 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 28: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:05.849090 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:05.879449 28124 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.882262 28124 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:05.801466 28176 consensus_queue.cc:260] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:05.896008 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 483251us
I20260709 12:27:05.849746 28126 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:05.917647 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.937829 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:05.938524 19491 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:27:05.940838 19483 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:05.942471 28192 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:05.937498 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:05.943101 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:05.943724 19485 raft_consensus.cc:2393] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:05.943816 19484 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 26: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:05.945008 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:05.933928 27728 raft_consensus.cc:3055] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:27:05.945883 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:05.946228 27728 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:05.947201 27728 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:05.948608 27728 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:05.950516 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:05.952184 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.953372 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:05.950610 28201 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.954334 28201 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:05.956574 28201 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:05.956872 28138 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.002s
I20260709 12:27:05.957365 28138 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:05.967500 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:05.963035 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:05.921543 28176 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:05.927528 27958 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:05.974623 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:05.982533 18844 raft_consensus.cc:2393] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 30: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:05.871961 28113 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:05.977427 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:05.885733 28177 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.076s
I20260709 12:27:06.004499 28177 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:27:06.004984 28177 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:05.927083 28126 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:06.007222 28126 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:06.007947 19458 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:05.991137 28092 consensus_meta.cc:287] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.003s
W20260709 12:27:05.998661 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 121197us
I20260709 12:27:05.953739 28122 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:05.935010 28111 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.015617 18768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33738 (request call id 3773) took 1258 ms. Trace:
I20260709 12:27:06.016086 18768 rpcz_store.cc:276] 0709 12:27:04.757216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.757384 (+   168us) service_pool.cc:224] Handling call
0709 12:27:04.757680 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.778772 (+ 21092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.015349 (+1236577us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b540036b5d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:06.015549 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44872960}
I20260709 12:27:05.977357 28199 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:27:06.062872 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 213865us
I20260709 12:27:06.034633 27972 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:27:06.087486 28219 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:06.087308 28203 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:27:06.043919 28199 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.093083 18812 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:06.085850 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.097009 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 85218.4us
I20260709 12:27:06.097491 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:06.097973 18887 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:06.101763 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:06.006068 28177 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:06.104559 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.033080 28111 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:06.082063 28113 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:06.116184 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.120082 18839 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:06.096657 28199 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:06.122264 18887 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:06.074805 27837 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 12:27:06.141783 28206 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:06.101999 28138 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.142077 18887 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:06.146292 28101 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:27:06.142742 28090 consensus_queue.cc:1059] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:06.105202 28219 raft_consensus.cc:2804] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:06.109692 27998 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:06.151063 28126 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:27:06.166806 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:06.170873 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54910us
I20260709 12:27:06.171868 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.160228 28177 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:06.161166 28155 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:06.185694 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.188570 28184 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:06.190295 27998 consensus_queue.cc:1059] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:27:06.197750 18768 raft_consensus.cc:1240] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28. Ops: []
I20260709 12:27:06.198660 18766 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:27:06.198949 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.200340 18768 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:06.175834 27789 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:06.203677 27789 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.205107 28209 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:06.194885 28145 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:06.206058 28148 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:27:06.206686 28212 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:27:06.209352 28211 log.cc:927] Time spent T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:27:06.212160 28150 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:06.213845 28213 raft_consensus.cc:2804] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:06.214561 28213 raft_consensus.cc:697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:06.214799 28229 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:06.180581 28188 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:06.215669 28213 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.217983 28188 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:06.219358 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:06.206228 28145 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.216117 28150 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:27:06.225440 28121 raft_consensus.cc:3060] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:06.226078 28194 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:06.226553 28194 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:06.227469 28194 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:06.228739 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.230063 28222 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:06.185910 28201 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.233165 28201 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:06.236004 28179 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:06.236456 28179 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:06.236815 28121 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:06.237586 28155 consensus_queue.cc:1059] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:06.238528 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.181051 28219 raft_consensus.cc:697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:06.239138 18913 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:06.239905 28219 consensus_queue.cc:237] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.240747 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.244053 28111 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:06.245393 28126 raft_consensus.cc:3055] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:06.245893 28126 raft_consensus.cc:740] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:06.247241 28124 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:06.246901 28126 consensus_queue.cc:260] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.248179 28147 raft_consensus.cc:3055] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:06.248338 28126 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:06.248653 28147 raft_consensus.cc:740] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:06.249563 28104 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:27:06.250042 28104 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:06.237586 28179 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.250793 28090 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:27:06.251554 28179 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:06.251094 28104 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:06.252195 27998 raft_consensus.cc:3055] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:06.252653 27998 raft_consensus.cc:740] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:06.253649 28104 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:06.253566 27998 consensus_queue.cc:260] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.236493 28145 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.278220 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:06.278452 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:06.279176 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:06.310837 18766 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 33 index: 23. (index mismatch)
I20260709 12:27:06.314450 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:06.319784 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.320803 18766 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:06.322921 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:06.323335 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:06.324337 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.247694 28124 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:27:06.333197 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 193625us
I20260709 12:27:06.334596 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:06.350953 18885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.351440 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.234314 28105 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:06.352273 18914 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
W20260709 12:27:06.357704 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.369870 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.370819 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:06.372967 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:06.373232 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:06.360850 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 189054us
I20260709 12:27:06.366715 18768 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:27:06.342289 28101 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:06.377410 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.355060 18919 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:27:06.348022 27998 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:06.249606 28147 consensus_queue.cc:260] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.390532 18915 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:06.352142 28217 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:06.363646 28090 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:27:06.363437 28127 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:06.363595 28229 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:06.400751 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.404306 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.419895 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.421079 28149 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:06.424410 28149 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:06.429723 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.435405 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.468797 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:06.482832 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:06.394599 28101 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.426295 28230 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:06.487382 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 110073us
I20260709 12:27:06.495949 18765 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:06.496377 18814 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.461520 27825 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:06.466542 28147 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:06.431499 28127 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:06.509048 18813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.509510 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.394809 28124 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:06.467306 28090 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:06.510340 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 215559us
I20260709 12:27:06.487533 28100 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:06.411434 28217 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.502050 28148 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:06.543440 28176 consensus_queue.cc:1048] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:27:06.547852 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:06.548177 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:06.549158 18845 raft_consensus.cc:2410] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:27:06.550765 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:06.545073 28148 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.557947 18842 raft_consensus.cc:1275] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:27:06.431186 28229 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.562985 28241 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:06.563933 28241 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:06.570806 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:06.570981 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:06.574206 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77954.7us
I20260709 12:27:06.567621 18846 pending_rounds.cc:85] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 13
I20260709 12:27:06.504509 28230 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.548810 28100 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:06.577970 28241 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.575412 18814 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.553354 28148 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:06.579631 28248 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:27:06.530109 28090 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.566943 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:06.575932 18846 pending_rounds.cc:107] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 25.14
I20260709 12:27:06.593966 18846 raft_consensus.cc:2889] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:06.584143 28105 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:06.596634 28221 log.cc:927] Time spent T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:27:06.584132 18841 raft_consensus.cc:2410] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 27 because replica has last-logged OpId of term: 26 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:27:06.597877 28190 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:06.595088 28231 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.595559 28232 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.596078 28186 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:06.600564 18844 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:27:06.597978 28234 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:27:06.597114 28244 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 12:27:06.566913 28243 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:27:06.642843 28100 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.643551 28243 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:06.603634 18769 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:06.645201 18843 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:27:06.605393 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.599433 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:06.611148 28231 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.612135 28127 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.612629 28090 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.615398 28217 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:06.617046 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.622303 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:06.623494 28054 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:06.625639 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.652855 18765 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 33.
I20260709 12:27:06.626804 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:06.631440 18888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.588505 28219 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:06.633222 28232 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:06.638273 28237 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:27:06.638701 28113 consensus_meta.cc:287] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
W20260709 12:27:06.639226 28235 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:27:06.656363 28232 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:06.641227 27728 consensus_meta.cc:287] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.001s
W20260709 12:27:06.641521 28238 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:27:06.642700 28122 consensus_meta.cc:287] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.004s
I20260709 12:27:06.657992 18918 raft_consensus.cc:2410] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:27:06.650833 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:06.660560 18766 raft_consensus.cc:2393] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:06.667114 18917 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
W20260709 12:27:06.671167 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66687.8us
I20260709 12:27:06.674438 18814 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.676255 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:06.677894 18848 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:27:06.682197 18814 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.687757 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:06.672048 28090 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:27:06.696880 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.697881 18914 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:27:06.699011 28230 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.703990 28231 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.668236 28054 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:27:06.709589 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 138776us
I20260709 12:27:06.709877 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:06.669906 28092 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.715216 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:06.716641 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.719825 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.721016 19485 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:27:06.721288 28190 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:27:06.722307 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.721385 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.725564 18920 raft_consensus.cc:2410] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 29 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 14.
I20260709 12:27:06.726032 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:06.724243 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.727344 28190 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:06.728108 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.729545 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.733490 18765 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 28 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 12.
I20260709 12:27:06.736212 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.741130 18845 raft_consensus.cc:2393] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 28: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:06.745471 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.750451 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:06.751135 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:06.752106 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:06.753230 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 77098.8us
I20260709 12:27:06.756332 18913 raft_consensus.cc:2410] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 28 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 12.
I20260709 12:27:06.761514 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:06.759445 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:06.764400 18845 raft_consensus.cc:2393] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:06.764753 18766 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:27:06.651785 28186 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:06.744340 28179 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:06.739686 28092 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:06.765055 28206 consensus_meta.cc:287] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.001s
I20260709 12:27:06.800478 18766 raft_consensus.cc:3060] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:06.812523 28229 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.813462 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:06.814194 18844 raft_consensus.cc:2376] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28. Re-sending same reply.
I20260709 12:27:06.767524 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:06.816975 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49536.2us
I20260709 12:27:06.757084 28127 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:06.772950 28122 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:27:06.825654 18919 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 12:27:06.824889 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 106963us
I20260709 12:27:06.762283 28230 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:27:06.832850 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:06.833573 18844 raft_consensus.cc:2376] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22. Re-sending same reply.
I20260709 12:27:06.818253 28206 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:06.765668 28113 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 12:27:06.821211 28209 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:06.822633 28122 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.844981 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:06.845952 28104 consensus_meta.cc:287] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.003s
I20260709 12:27:06.848031 28249 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:06.848526 28214 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:27:06.849810 28251 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:27:06.855260 19489 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
I20260709 12:27:06.864688 19484 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 12:27:06.865900 28126 consensus_meta.cc:287] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.003s
W20260709 12:27:06.868176 28177 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 12:27:06.871202 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:06.892071 18844 raft_consensus.cc:2376] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23. Re-sending same reply.
I20260709 12:27:06.893136 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:06.871519 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.823993 28190 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:06.877679 28122 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:27:06.824198 28127 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:06.923105 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 165518us
I20260709 12:27:06.910426 28243 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:06.910179 28248 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:06.919906 27998 consensus_meta.cc:287] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 12:27:06.932282 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:27:06.939139 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 177076us
I20260709 12:27:06.925298 28214 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:06.913650 28054 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.927309 28176 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.930488 28241 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.962287 18840 raft_consensus.cc:1275] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:27:06.943825 28088 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.306s	user 0.014s	sys 0.004s
I20260709 12:27:06.960210 27998 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:06.969431 18772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 3188) took 1370 ms. Trace:
I20260709 12:27:06.976064 18845 pending_rounds.cc:85] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 17
I20260709 12:27:06.977198 27998 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.977242 18772 rpcz_store.cc:276] 0709 12:27:05.598842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.599092 (+   250us) service_pool.cc:224] Handling call
0709 12:27:05.790432 (+191340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.871092 (+ 80660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.969093 (+1098001us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540036c4d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:06.969330 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439120128}
I20260709 12:27:06.981403 27998 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.982065 18845 pending_rounds.cc:107] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 26.18
I20260709 12:27:06.983129 18845 raft_consensus.cc:2889] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:06.951548 28257 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:27:06.968150 28088 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.341s	user 0.015s	sys 0.005s
I20260709 12:27:06.933506 28234 consensus_queue.cc:1048] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:27:07.007083 18766 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 31. Current term is 32. Ops: []
I20260709 12:27:06.941331 28252 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.049s
I20260709 12:27:06.935624 28243 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.019752 27879 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.020452 27879 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:06.952776 28244 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:27:07.028681 28092 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:06.942121 28248 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.032722 28248 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.019831 28215 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.036578 28054 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.036396 28215 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.037068 28101 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:06.988525 28176 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.005420 28138 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.038988 28215 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.039081 28138 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.041149 27879 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.041775 28138 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.051566 28127 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:07.044440 28199 consensus_meta.cc:287] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.887s	user 0.009s	sys 0.003s
I20260709 12:27:07.054766 28199 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:07.025295 28147 consensus_meta.cc:287] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.007s
I20260709 12:27:07.000388 28257 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:07.056994 28257 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:06.997825 28190 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.057087 18770 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:27:07.057927 28190 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.060429 28190 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.064438 28243 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.050875 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.067657 18915 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:27:07.071326 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:07.073319 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:07.074271 18841 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:27:07.077555 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:07.078648 18844 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:07.083329 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.093515 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.092864 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:07.073697 28203 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.075330 27728 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.106880 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.056485 28148 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.110297 18919 raft_consensus.cc:1275] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:27:07.113325 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:07.029758 28214 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.119704 18844 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 12:27:07.125916 18844 pending_rounds.cc:85] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 17
I20260709 12:27:07.126340 18844 pending_rounds.cc:107] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 12:27:07.126716 18844 raft_consensus.cc:2889] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:07.120644 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.121641 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.123579 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.131590 28101 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:07.134896 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.136086 18919 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 27: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:27:07.153082 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.107831 28127 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:07.153945 28127 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.158471 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.168625 27879 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:07.114452 28203 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.093323 28218 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:27:07.205874 18765 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260709 12:27:07.208386 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 46522.4us
I20260709 12:27:07.214182 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.214990 18766 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:27:07.214917 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.221393 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.125054 28092 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.129747 28176 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.235277 28199 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.203459 27879 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.231127 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:07.231807 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.238003 28203 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.239157 28148 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.120114 27728 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:07.243027 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.229339 19456 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:07.222414 18913 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
I20260709 12:27:07.254460 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:07.166198 28122 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.256953 27879 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:07.281395 18841 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 32.
I20260709 12:27:07.249099 28209 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 31.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:27:07.288213 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:07.290134 18914 raft_consensus.cc:1240] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 33. Current term is 34. Ops: []
I20260709 12:27:07.270987 28127 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.273509 28088 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:07.292689 19456 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:07.246120 28092 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.277619 28186 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.252743 28155 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 12:27:07.290831 28139 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.035s
I20260709 12:27:07.325735 28177 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.299068 28088 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.325901 28255 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:27:07.333455 19489 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:27:07.354995 28088 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:07.301594 28277 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:27:07.370239 28280 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:07.301604 28257 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:07.332760 28179 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.007s
I20260709 12:27:07.336267 28270 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 12:27:07.390106 18839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3682) took 1440 ms. Trace:
I20260709 12:27:07.390614 18839 rpcz_store.cc:276] 0709 12:27:05.949962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.951612 (+  1650us) service_pool.cc:224] Handling call
0709 12:27:05.951944 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.120802 (+168858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.389860 (+1269058us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400285854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:07.390039 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386049920}
I20260709 12:27:07.376122 28277 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:07.384045 28176 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.356469 28177 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.385756 28179 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:07.426214 28126 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.426791 28209 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.427093 28234 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.453181 28278 log.cc:927] Time spent T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:27:07.449924 28176 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:07.453850 28281 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:27:07.428916 27728 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:07.460999 28273 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:27:07.476456 28257 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.454861 28126 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.479842 28126 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.457278 28209 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.485327 28209 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.493713 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:07.458781 28234 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.507566 28092 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.519388 18841 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:07.486195 27879 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.541128 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:07.544234 18919 raft_consensus.cc:2410] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:27:07.563839 27879 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.564854 27789 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.525571 28277 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.15, Last appended by leader: 15, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.581395 27793 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:27:07.581954 27793 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:07.583981 27972 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:07.584625 27972 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.586010 18841 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:27:07.586980 28177 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.587510 28267 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:27:07.587949 28267 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:07.555996 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:07.592227 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:07.592993 18841 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:07.591153 18845 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
W20260709 12:27:07.555361 28284 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 12:27:07.549836 28122 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:07.595705 28289 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:27:07.588832 28267 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.15, Last appended by leader: 15, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.637099 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:07.641444 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 98541.4us
I20260709 12:27:07.638206 28122 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:07.655206 28122 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.658571 28122 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:07.664304 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.582928 27793 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.699357 18841 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:07.639549 28120 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:07.640501 27789 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:07.706746 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 79240.9us
I20260709 12:27:07.686067 27728 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:07.716696 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:07.703995 27972 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.708410 28267 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:27:07.724205 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:07.723685 28209 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:07.728317 28274 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:07.729597 27793 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:07.733235 28176 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.739068 27789 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:07.760951 28274 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:07.768029 28290 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:27:07.771193 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 130263us
I20260709 12:27:07.724622 27728 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.778745 28288 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.779383 28288 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.781845 28288 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.786900 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.787727 19484 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:27:07.787817 27728 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.790509 27728 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:07.792095 27728 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.792708 18765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 3209) took 1061 ms. Trace:
I20260709 12:27:07.793227 28201 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.793123 18765 rpcz_store.cc:276] 0709 12:27:06.731302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.760369 (+ 29067us) service_pool.cc:224] Handling call
0709 12:27:06.776145 (+ 15776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.213859 (+437714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.792404 (+578545us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b540029d1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:07.792644 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898697984}
I20260709 12:27:07.794711 27728 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.747784 28088 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.770833 27789 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:07.800630 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:07.804041 28126 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.804621 28126 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.802191 28288 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 12:27:07.807821 28126 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.800995 27789 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:07.802825 28150 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:07.816632 19484 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
I20260709 12:27:07.818529 28126 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.819065 28127 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.819320 28126 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.819655 28127 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.820619 28088 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.821897 28127 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.821991 28126 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.811040 27728 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:07.827258 27825 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:07.832743 27825 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.841542 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:07.842720 28194 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:07.842520 27728 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.844936 27728 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:07.847152 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:07.848582 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:07.851094 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.855545 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.859939 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.864141 28088 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:27:07.871745 28176 consensus_queue.cc:1048] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:07.878928 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.882246 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.862989 27913 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:07.886581 27913 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:07.873186 28126 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 12:27:07.887532 27913 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.828289 28127 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.889269 28127 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.889781 28126 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.890821 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.891239 27825 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:07.880167 28266 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:07.907935 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.912665 18765 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:07.912492 28266 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.913807 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.907558 18771 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:27:07.892097 28126 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:07.916857 28149 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.917161 28126 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:07.917477 28149 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.918824 28266 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:07.916582 18771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3790) took 1977 ms (client timeout 1606 ms). Trace:
W20260709 12:27:07.919476 18771 rpcz_store.cc:269] 0709 12:27:05.939402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.939737 (+   335us) service_pool.cc:224] Handling call
0709 12:27:07.916348 (+1976611us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54001d5454. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:07.916472 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4511845248}
I20260709 12:27:07.918874 28148 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:07.920502 28148 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:07.920933 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.907193 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:07.925119 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.907193 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:07.894968 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.927878 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:07.900094 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.924656 18765 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:07.932862 18771 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 28: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:07.928020 18768 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:07.899364 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:07.935824 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.937048 19492 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:07.955258 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:07.956620 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.957572 18768 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 25: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:07.958536 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.959295 18771 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:27:07.960351 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:07.970584 18811 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.933045 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:07.956327 18840 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:07.980767 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.985098 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:07.981297 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:07.983346 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.982092 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:07.987265 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.987720 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:07.987205 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:07.981769 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.980939 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:07.923738 28124 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:07.908229 27789 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.011767 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.017453 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:08.021095 27837 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:08.021901 27837 consensus_queue.cc:1243] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer 1e2529a8cff04207bb1b07c108e16983 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:27:07.975282 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.019655 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:08.022943 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47754.9us
I20260709 12:27:08.023666 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.020080 28222 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.988821 28176 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.017874 28127 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.026201 28144 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:27:08.024631 28222 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.026932 28144 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:08.027103 28127 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:08.024632 18845 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 28: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:08.027993 28144 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.028659 27789 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:08.029211 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.029866 18845 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:27:07.987591 18840 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:08.030825 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.031154 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.031602 18845 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:08.032207 18840 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:08.023751 18812 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.033272 28127 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:08.033463 18918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3767) took 1756 ms (client timeout 1520 ms). Trace:
I20260709 12:27:07.993316 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.035379 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:08.036696 28222 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:08.037335 18843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3778) took 1487 ms (client timeout 1982 ms). Trace:
W20260709 12:27:08.037817 18843 rpcz_store.cc:269] 0709 12:27:06.550087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.550193 (+   106us) service_pool.cc:224] Handling call
0709 12:27:08.037157 (+1486964us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b5400285354. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:08.037272 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169338240}
I20260709 12:27:08.027014 28176 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.033774 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.044018 27793 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:08.039297 18768 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:27:08.062577 27793 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.065181 27793 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:08.066535 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.075309 28297 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:27:08.076572 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.078231 28127 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.078893 28127 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.080238 27793 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:08.081121 28127 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.080807 27793 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.073247 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.015599 28148 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.083364 18768 raft_consensus.cc:2393] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 21: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:27:08.044080 18917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3785) took 1671 ms (client timeout 1538 ms). Trace:
I20260709 12:27:08.049769 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:08.085451 18917 rpcz_store.cc:269] 0709 12:27:06.372446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.372630 (+   184us) service_pool.cc:224] Handling call
0709 12:27:08.043900 (+1671270us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400034dd4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:08.044007 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653160704}
I20260709 12:27:08.086640 18919 raft_consensus.cc:2410] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:27:08.044559 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3796) took 1421 ms. Trace:
I20260709 12:27:08.055154 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:08.052841 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.043120 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.089330 18922 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
W20260709 12:27:08.090265 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47225.4us
I20260709 12:27:08.090667 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.091326 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.050688 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:08.091760 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.051496 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.053987 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.085219 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:08.059173 18916 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 27. Current term is 28. Ops: []
I20260709 12:27:08.093609 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.094975 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:08.095389 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.095559 18920 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:08.085234 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.010437 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.087787 18770 rpcz_store.cc:276] 0709 12:27:06.622831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.626513 (+  3682us) service_pool.cc:224] Handling call
0709 12:27:08.044361 (+1417848us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540029d6d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:08.044487 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927065856}
I20260709 12:27:08.097447 18764 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 19.
I20260709 12:27:08.092875 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:08.100021 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:08.102924 18918 rpcz_store.cc:269] 0709 12:27:06.277462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.277831 (+   369us) service_pool.cc:224] Handling call
0709 12:27:08.033232 (+1755401us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400033ed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:08.033373 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809793280}
I20260709 12:27:08.105489 18917 raft_consensus.cc:2376] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28. Re-sending same reply.
I20260709 12:27:08.110837 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:07.962917 28126 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.024523 28205 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:08.043867 28222 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:08.114703 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:08.122049 18916 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:08.109154 27879 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:08.115818 18915 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:27:08.098878 28213 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:08.029071 28144 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:08.125774 18771 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 22.
I20260709 12:27:08.142639 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.120497 28101 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.146646 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.148273 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.111706 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.098940 28304 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:08.024502 27837 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:08.115325 28218 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:08.054440 28176 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:08.150280 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.130175 27879 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.158869 28218 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:08.139715 28054 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.153949 28194 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:08.135787 28127 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:08.176084 19492 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 18.
I20260709 12:27:08.173455 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:08.140081 27793 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.144985 28267 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:08.194958 28267 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.197418 28267 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.171466 28299 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:08.175679 28141 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:08.121237 28205 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.181782 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.170948 28101 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.184356 28266 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:08.178962 28054 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.179014 28120 consensus_queue.cc:1059] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:27:08.190622 28234 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:08.191826 18848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35888 (request call id 3779) took 1641 ms. Trace:
I20260709 12:27:08.223140 18848 rpcz_store.cc:276] 0709 12:27:06.550372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.550524 (+   152us) service_pool.cc:224] Handling call
0709 12:27:08.191614 (+1641090us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54003278d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:08.191758 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290546048}
I20260709 12:27:08.193687 18842 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:27:08.174922 27879 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:08.204706 18916 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:08.141269 28124 consensus_queue.cc:1048] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:27:08.207823 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.210932 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:08.259265 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51410.8us
I20260709 12:27:08.260385 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.120934 28126 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.217960 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.180068 28304 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:08.154496 28222 consensus_queue.cc:1059] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:27:08.243969 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.266667 18915 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:27:08.212603 28141 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:08.224754 19458 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:08.209995 28266 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.218969 28176 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.255230 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:08.275795 18913 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:08.262593 28120 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:08.269972 18739 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:08.278201 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 53526.7us
I20260709 12:27:08.282948 18739 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.268672 28277 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:08.293722 19458 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.299379 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:08.305225 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 156997us
I20260709 12:27:08.279600 28266 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:08.282857 28150 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:08.311143 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.315742 18812 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:08.286053 27913 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:08.317919 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:08.317566 28304 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:08.291043 28120 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:08.308135 28088 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:08.337145 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.330848 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:08.338976 18886 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:08.322216 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.340961 18772 raft_consensus.cc:2393] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 19: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:08.313933 28255 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:08.350664 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.282670 28176 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.346408 18886 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:08.320331 27913 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.354187 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:08.357095 18769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33308 (request call id 1707) took 3542 ms (client timeout 2902 ms). Trace:
I20260709 12:27:08.323628 28277 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:27:08.362649 18769 rpcz_store.cc:269] 0709 12:27:04.804389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.850465 (+ 46076us) service_pool.cc:224] Handling call
0709 12:27:08.346117 (+3495652us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540017b1d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:08.346243 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3439837056}
I20260709 12:27:08.363981 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:08.368546 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 99851.3us
I20260709 12:27:08.321612 28299 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:08.323658 28274 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:08.370486 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.337560 27789 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:08.372351 18887 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:08.375666 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.381494 18921 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 32.
I20260709 12:27:08.385385 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:08.390525 27728 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:08.366360 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.317389 28222 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 12:27:08.354185 28255 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.407927 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.322870 28139 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 12:27:08.358072 27793 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:08.352615 28267 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:08.399784 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.422245 18848 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 30.
I20260709 12:27:08.422344 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.409408 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.423442 18843 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 25.
I20260709 12:27:08.391381 28299 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.413196 18812 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.411510 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.366256 27913 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:08.373610 28213 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:08.438647 28213 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.439286 28213 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:08.440177 28176 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:08.442242 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.442965 18915 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:27:08.427412 27793 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.446868 27793 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:08.324378 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:08.393002 28205 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:08.429420 28304 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:08.428390 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:08.411927 28310 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:08.391518 28277 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:08.460991 28277 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:08.461957 28283 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 1.106s	user 0.004s	sys 0.001s
I20260709 12:27:08.463927 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33308 (request call id 1734) took 1245 ms. Trace:
I20260709 12:27:08.464306 18766 rpcz_store.cc:276] 0709 12:27:07.218053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.218179 (+   126us) service_pool.cc:224] Handling call
0709 12:27:07.218546 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.227481 (+  8935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.227512 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.228112 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.347929 (+119817us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:07.347989 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.348093 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.461358 (+1113265us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:27:08.463584 (+  2226us) raft_consensus.cc:1685] finished
0709 12:27:08.463609 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.463851 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13134,"raft.queue_time_us":29942,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11769,"spinlock_wait_cycles":3050368,"thread_start_us":116970,"threads_started":1,"wal-append.queue_time_us":124543}
I20260709 12:27:08.428150 28267 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:08.466138 28267 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:08.466580 28218 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:08.432540 28126 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:08.470315 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:08.434958 28308 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:27:08.435819 28309 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:27:08.429064 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 43737.4us
I20260709 12:27:08.449240 19458 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:08.408284 27789 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:08.453509 18666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 170) took 44040 ms (client timeout 15000 ms). Trace:
I20260709 12:27:08.400290 27728 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:08.410074 28255 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:08.468981 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.486152 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.471060 18770 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:27:08.433955 27879 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.426623 28243 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:08.478103 18765 pending_rounds.cc:85] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 13
W20260709 12:27:08.475914 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 103603us
I20260709 12:27:08.447692 28299 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:08.494804 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:08.495782 28322 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:08.496192 28322 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.496548 28322 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:08.507368 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:08.508440 28205 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:08.508867 28205 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:08.509229 28205 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:08.471415 28320 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:08.510739 28320 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.513161 28320 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.513731 28320 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:08.516336 27789 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.518800 28205 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.420149 28150 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:27:08.487823 18886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.459439 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:08.489100 18766 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:08.491670 18765 pending_rounds.cc:107] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 12:27:08.556602 18765 raft_consensus.cc:2889] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:08.475384 28319 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:08.493148 28090 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:08.487063 27728 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:08.480587 28317 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:08.521725 28194 raft_consensus.cc:3055] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:27:08.480814 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.470093 28266 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.529139 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:08.581681 19492 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:27:08.532153 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.533340 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1830) took 1091 ms. Trace:
I20260709 12:27:08.582551 18916 raft_consensus.cc:2468] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:08.532191 18847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45432 (request call id 1640) took 1785 ms. Trace:
I20260709 12:27:08.583006 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:08.539821 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:08.583628 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.540974 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:08.584762 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.585943 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.588241 28266 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:08.589114 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:08.590894 28150 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.592893 28322 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.583161 18847 rpcz_store.cc:276] 0709 12:27:06.746812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.960490 (+213678us) service_pool.cc:224] Handling call
0709 12:27:06.960818 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.065177 (+104359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.065228 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.065294 (+    66us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:27:07.065340 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.531962 (+1466622us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400071054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:08.532011 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.532129 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239349632}
I20260709 12:27:08.595956 18917 raft_consensus.cc:1240] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:08.545202 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:08.596604 18920 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 18.
I20260709 12:27:08.596730 18916 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:27:08.550366 18913 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
W20260709 12:27:08.557183 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 97829.7us
I20260709 12:27:08.488399 28176 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:08.514267 28320 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.570731 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:08.569948 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:08.562618 27793 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.576628 19483 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:08.571841 28222 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:08.563687 28310 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:08.613055 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.614135 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:08.614791 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.615942 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.630870 28322 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.638964 18845 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:27:08.639885 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.582472 19489 rpcz_store.cc:276] 0709 12:27:07.441664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.442768 (+  1104us) service_pool.cc:224] Handling call
0709 12:27:07.449380 (+  6612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.490560 (+ 41180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.490599 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.494657 (+  4058us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.648708 (+154051us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:27:07.648777 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.532899 (+884122us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400580054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:08.532947 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.532990 (+    43us) raft_consensus.cc:1685] finished
0709 12:27:08.533004 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.533271 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":698,"raft.queue_time_us":401,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2827,"spinlock_wait_cycles":46557440,"thread_start_us":107387,"threads_started":1,"wal-append.queue_time_us":256523}
I20260709 12:27:08.641412 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.616214 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.619470 19458 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:08.621919 18812 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:08.643481 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:08.642493 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.645128 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.624511 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.626731 19486 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:08.629855 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:08.574827 28317 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:08.648193 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.651680 18847 raft_consensus.cc:2468] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 17.
I20260709 12:27:08.649052 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:08.481444 18666 rpcz_store.cc:269] 0709 12:26:24.425885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.988564 (+13562679us) service_pool.cc:224] Handling call
0709 12:27:08.453387 (+30464823us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:03.114790 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:03.144438 (+ 29648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:03.144499 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:27:03.144538 (+    39us) tablet.cc:662] Decoding operations
0709 12:27:03.145397 (+   859us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:03.145495 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:03.145533 (+    38us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:27:03.146319 (+   786us) tablet.cc:701] Row locks acquired
0709 12:27:03.146380 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:27:03.195012 (+ 48632us) write_op.cc:270] Start()
0709 12:27:03.227801 (+ 32789us) write_op.cc:276] Timestamp: P: 1783600023189143 usec, L: 0
0709 12:27:03.244199 (+ 16398us) op_driver.cc:348] REPLICATION: starting
0709 12:27:03.335165 (+ 90966us) log.cc:844] Serialized 2039 byte log entry
0709 12:27:04.143582 (+808417us) op_driver.cc:464] REPLICATION: finished
0709 12:27:04.282505 (+138923us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335e9c1ef0
0709 12:27:04.379570 (+ 97065us) write_op.cc:301] APPLY: starting
0709 12:27:04.379688 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:04.577420 (+197732us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:04.583794 (+  6374us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:04.644963 (+ 61169us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:04.645274 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:27:04.645346 (+    72us) write_op.cc:312] APPLY: finished
0709 12:27:04.645687 (+   341us) log.cc:844] Serialized 57 byte log entry
0709 12:27:04.645896 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:04.646023 (+   127us) write_op.cc:454] Released schema lock
0709 12:27:04.646084 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:04.702531 (+ 56447us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:04.704688 (+  2157us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":242618,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":235660,"apply.run_cpu_time_us":11265,"apply.run_wall_time_us":288468,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":170834,"prepare.run_cpu_time_us":47196,"prepare.run_wall_time_us":449678,"raft.queue_time_us":181259,"raft.run_cpu_time_us":16382,"raft.run_wall_time_us":270842,"replication_time_us":899179,"spinlock_wait_cycles":67105664,"thread_start_us":599370,"threads_started":4,"wal-append.queue_time_us":190514,"wal-append.run_cpu_time_us":18474,"wal-append.run_wall_time_us":2114922}]]}
I20260709 12:27:08.650803 18845 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:08.579098 28194 raft_consensus.cc:740] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:08.623447 28124 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:08.656520 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:08.661245 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:08.675110 18839 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:27:08.625193 28176 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.650072 28257 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:08.653301 28310 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:27:08.653301 28304 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:08.651189 28126 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:08.683944 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:08.688649 18913 raft_consensus.cc:1240] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 27. Current term is 28. Ops: []
I20260709 12:27:08.653996 28317 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:08.691129 18887 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:08.674206 28322 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:27:08.641947 28222 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.676203 28243 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:08.679576 28176 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:27:08.697057 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 127238us
I20260709 12:27:08.708168 18886 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:08.705483 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:08.711726 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 2288) took 1840 ms. Trace:
I20260709 12:27:08.712313 18914 rpcz_store.cc:276] 0709 12:27:06.871672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.871844 (+   172us) service_pool.cc:224] Handling call
0709 12:27:06.872158 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.290612 (+418454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.711401 (+1420789us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b540027e2d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:08.711652 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960828800}
I20260709 12:27:08.685226 27837 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:08.716992 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:08.687052 28310 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.690207 28126 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.694429 27789 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:08.685071 28218 consensus_queue.cc:1059] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.035s
I20260709 12:27:08.694693 28257 raft_consensus.cc:697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:08.718957 28319 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:27:08.794544 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 77631.3us
I20260709 12:27:08.797127 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:08.720252 27837 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.730782 28126 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:08.751626 28243 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.731918 28310 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:27:08.842891 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 134861us
I20260709 12:27:08.844455 18886 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:08.731575 28234 consensus_queue.cc:1059] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.109s
I20260709 12:27:08.826561 28213 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.799346 28319 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:08.824529 27837 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:08.844519 27789 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:27:08.849746 27879 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:08.841948 28243 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.908078 27789 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:08.909003 27789 raft_consensus.cc:2804] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:08.909484 27789 raft_consensus.cc:697] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:08.909590 28243 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:08.754554 28194 consensus_queue.cc:260] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:08.915779 28312 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.462s	user 0.003s	sys 0.000s
I20260709 12:27:08.915993 28194 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:08.917266 28302 raft_consensus.cc:3055] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:08.917724 28302 raft_consensus.cc:740] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:08.919658 28304 raft_consensus.cc:3055] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:08.920127 28304 raft_consensus.cc:740] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:08.920156 28302 consensus_queue.cc:260] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.921587 28302 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:08.921264 28304 consensus_queue.cc:260] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.861146 28222 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:08.871160 28320 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:08.872095 28328 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:08.873561 28334 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:08.874356 19483 raft_consensus.cc:1240] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:08.926548 18766 raft_consensus.cc:1240] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:27:08.902912 28234 raft_consensus.cc:3055] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:27:08.928004 18842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35896 (request call id 3702) took 1857 ms. Trace:
I20260709 12:27:08.928257 28234 raft_consensus.cc:740] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:08.928534 18842 rpcz_store.cc:276] 0709 12:27:07.070944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.160637 (+ 89693us) service_pool.cc:224] Handling call
0709 12:27:08.193231 (+1032594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.224456 (+ 31225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.927776 (+703320us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003278d0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8a8ad 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:08.927935 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373746944}
I20260709 12:27:08.929277 28234 consensus_queue.cc:260] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 33.23, Last appended by leader: 23, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.930836 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.903226 28319 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:08.932704 18768 raft_consensus.cc:1240] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:27:08.934053 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.904261 28213 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:08.936035 28234 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:27:08.905934 28205 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:08.906175 18916 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:27:08.874207 28324 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:08.904335 27793 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:08.904628 28257 consensus_queue.cc:237] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.945142 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.943661 28255 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:08.942472 27789 consensus_queue.cc:237] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:08.977823 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.980590 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 183566us
I20260709 12:27:08.984469 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:08.948215 28304 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:08.990078 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:08.991288 18773 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:27:08.993880 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:09.022359 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.026088 18842 raft_consensus.cc:3060] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:09.031081 28218 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:09.031714 28218 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.033902 28218 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:09.035442 28315 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:27:09.038444 28149 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.038908 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3777) took 2490 ms. Trace:
I20260709 12:27:09.043532 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.044178 28090 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:09.044708 28090 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.051039 28255 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.051676 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.053246 28101 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.057181 28090 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:08.990058 28318 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.058224 28318 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.061565 28318 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.061736 28259 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:09.062547 28120 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.062412 28259 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.063047 28120 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.064646 28259 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.065008 28120 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.065676 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.066305 18773 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:08.989306 28222 consensus_queue.cc:1059] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.081s
I20260709 12:27:09.071579 28222 raft_consensus.cc:3055] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:09.072116 28222 raft_consensus.cc:740] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:09.076273 28319 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:08.969573 28299 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.081777 28259 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:09.082648 28277 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:09.082908 18771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33738 (request call id 3807) took 1183 ms. Trace:
I20260709 12:27:09.083284 28277 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.080916 28299 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.083595 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:09.085675 28277 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.086690 18841 raft_consensus.cc:2368] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20.
I20260709 12:27:09.087136 28054 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.082369 28259 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.083308 18771 rpcz_store.cc:276] 0709 12:27:07.899575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.011447 (+111872us) service_pool.cc:224] Handling call
0709 12:27:09.082736 (+1071289us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000af0d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:09.082846 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239631744}
I20260709 12:27:08.990427 28243 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:09.086120 28266 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:09.091399 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:09.093927 28150 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:09.093955 28126 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.039425 18846 rpcz_store.cc:276] 0709 12:27:06.549620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.549761 (+   141us) service_pool.cc:224] Handling call
0709 12:27:06.567384 (+ 17623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:06.644153 (+ 76769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.644184 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:06.644904 (+   720us) log.cc:844] Serialized 52 byte log entry
0709 12:27:08.328370 (+1683466us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b18001cada0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:27:08.475740 (+147370us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:08.490334 (+ 14594us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.490802 (+   468us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.491009 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.491098 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.591197 (+100099us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b18001cada0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:27:08.592040 (+   843us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18001cada0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:27:09.038509 (+446469us) raft_consensus.cc:1685] finished
0709 12:27:09.038549 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.038774 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5590,"prepare.queue_time_us":26450,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":15800,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":11450,"spinlock_wait_cycles":105957760,"thread_start_us":145544,"threads_started":1,"wal-append.queue_time_us":2021749}
W20260709 12:27:09.094928 27913 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.001s
I20260709 12:27:09.098311 27913 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.100732 27913 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.101348 28126 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:09.104132 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.109750 28126 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:09.110689 28126 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.113176 28126 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.120375 18846 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:27:09.073385 28222 consensus_queue.cc:260] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.122999 28222 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:09.124197 28317 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.125638 18841 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 31 index: 15. Preceding OpId from leader: term: 32 index: 16. (index mismatch)
I20260709 12:27:09.125896 28126 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:09.126653 28126 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.127403 28319 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:09.129261 28126 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.131160 28310 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.133598 28310 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.137352 28176 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.138850 18842 raft_consensus.cc:2468] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:27:09.062376 28318 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:09.173352 28318 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.173837 18843 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 19. (term mismatch)
I20260709 12:27:09.174535 18843 pending_rounds.cc:85] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 18
I20260709 12:27:09.174862 18843 pending_rounds.cc:107] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 25.19
I20260709 12:27:09.175194 18843 raft_consensus.cc:2889] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:09.175807 28318 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:09.139441 27728 consensus_meta.cc:287] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 12:27:09.140043 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:09.140304 28267 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.674s	user 0.013s	sys 0.000s
I20260709 12:27:09.141059 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:09.184181 18841 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:27:09.117170 28252 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Committing config change with OpId 21.14: config changed from index 4 to 14, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:09.146247 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:09.185220 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:09.146772 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:09.185968 18921 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:09.151207 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.186198 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:09.186687 18848 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:09.152010 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.187692 18839 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:09.089732 28259 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.153172 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.153889 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:09.153892 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.154944 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:09.155473 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.155673 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.191068 18773 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:09.157171 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.191478 18767 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:09.157399 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.191504 18768 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:09.157474 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.159116 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:09.163445 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.193315 18844 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:09.193619 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:09.194494 19490 raft_consensus.cc:3060] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:27:09.196228 19487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.007s	sys 0.007s
W20260709 12:27:09.196620 19487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.007s	sys 0.007s
I20260709 12:27:09.198596 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.178215 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:09.176579 28216 consensus_queue.cc:1059] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:27:09.156401 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.199672 19484 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:27:09.200801 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.198673 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.177165 28319 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.212795 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.210247 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:09.214042 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.214944 18769 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:09.202445 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.205356 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.218657 19490 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 31.
I20260709 12:27:09.218935 18887 leader_election.cc:400] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20.
I20260709 12:27:09.204960 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:09.219388 18887 leader_election.cc:403] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:09.219694 18920 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:27:09.117733 27837 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.222726 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:09.243848 18771 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:27:09.244612 18913 raft_consensus.cc:3060] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:09.244177 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:09.218866 18770 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:09.184638 28138 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 12:27:09.184470 28145 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:27:09.253656 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.261138 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:09.232565 18766 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 4 to 14, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:09.188736 27728 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.256307 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.272640 18917 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:27:09.273154 18848 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:09.188127 28267 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.264982 18839 raft_consensus.cc:2468] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
W20260709 12:27:09.266167 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 421845us
I20260709 12:27:09.267184 18914 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 31 index: 15. Preceding OpId from leader: term: 32 index: 16. (index mismatch)
I20260709 12:27:09.292788 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.270018 18767 raft_consensus.cc:2468] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 31.
I20260709 12:27:09.233403 28218 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:09.311648 18840 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 12:27:09.222126 28053 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:27:09.256822 18844 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:09.256945 18921 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:09.284855 18773 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:27:09.293443 18769 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:27:09.163493 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:09.357546 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.244493 28333 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.296830 18770 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
I20260709 12:27:09.298225 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:09.362877 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 199538us
I20260709 12:27:09.364283 18917 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 12:27:09.250797 28214 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:09.371287 28333 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.373775 28333 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.231930 28190 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 12:27:09.254565 28302 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:09.376502 28302 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.313234 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:09.366178 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:09.313690 18919 raft_consensus.cc:3060] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:09.314114 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:09.317567 18913 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:27:09.278199 18768 raft_consensus.cc:2468] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:27:09.342655 18922 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:09.344146 27728 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.222782 28319 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.344436 28267 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:09.310925 28317 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:09.350178 28255 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:27:09.385792 28176 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.352182 27837 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.352824 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.387409 18915 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:09.353515 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.268615 28310 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.389047 28310 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.268303 28150 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:09.382578 28222 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:09.390641 28150 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.391119 28218 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:09.391471 28144 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:09.391655 28218 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:09.392086 28218 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:27:09.390689 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 77547.3us
I20260709 12:27:09.393355 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:09.361306 18920 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:27:09.367497 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:09.379328 18812 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:09.380553 18814 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.395810 19490 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:09.397881 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.398814 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.398897 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:09.400207 18845 raft_consensus.cc:2393] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 23: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:09.368422 18887 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.398938 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:09.403965 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:09.395530 28222 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.407164 28222 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:09.408723 18846 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: [27.15-28.16]
I20260709 12:27:09.391034 28177 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:09.410099 28177 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.410629 28304 raft_consensus.cc:2804] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:27:09.411149 28304 raft_consensus.cc:697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:09.412396 28177 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.412063 28304 consensus_queue.cc:237] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.412920 28120 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:09.419970 28319 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:09.421025 18916 raft_consensus.cc:2410] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 29 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 14.
I20260709 12:27:09.423187 27793 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 19. Current term is 20.
I20260709 12:27:09.425727 28243 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:09.427057 18843 raft_consensus.cc:2368] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:09.405618 18814 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.428232 18917 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:27:09.431262 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:09.432919 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 118905us
I20260709 12:27:09.435141 18886 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:09.394245 28145 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:27:09.452622 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 84338.3us
W20260709 12:27:09.452739 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50958.6us
I20260709 12:27:09.474026 18919 raft_consensus.cc:2468] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
W20260709 12:27:09.479867 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50055us
I20260709 12:27:09.469686 19490 raft_consensus.cc:2468] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:27:09.391232 28150 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:09.481407 18887 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.436311 28243 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:27:09.485702 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50652us
I20260709 12:27:09.440076 28127 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:09.503049 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.505218 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.507652 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.508222 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.508561 18770 raft_consensus.cc:2393] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 27: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:09.509001 18773 raft_consensus.cc:2368] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:09.483717 18812 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:09.508328 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.509743 18768 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:09.509824 28299 raft_consensus.cc:2804] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:27:09.510708 28299 raft_consensus.cc:697] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:09.511895 28299 consensus_queue.cc:237] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.498840 28144 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:27:09.519485 28270 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.451164 28213 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:09.528012 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.520102 28270 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:09.529868 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 48562.4us
I20260709 12:27:09.432155 28126 raft_consensus.cc:2804] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:09.531330 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:09.485283 27728 raft_consensus.cc:2804] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:09.533638 18887 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.550959 18887 leader_election.cc:400] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:09.551658 18887 leader_election.cc:403] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:27:09.552553 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
W20260709 12:27:09.529439 28257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.018s	sys 0.059s
W20260709 12:27:09.545305 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 470931us
I20260709 12:27:09.561131 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:09.564157 18768 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:09.481462 28145 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.554054 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:09.500449 28205 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:09.554970 19484 raft_consensus.cc:2368] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:09.556365 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.592310 18770 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:09.556541 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:09.593412 19490 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:09.432309 27837 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:09.569073 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.595793 18769 raft_consensus.cc:2368] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:09.488706 28138 consensus_queue.cc:1059] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.072s
W20260709 12:27:09.560083 28257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.019s	sys 0.059s
I20260709 12:27:09.605203 18773 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:27:09.569790 28317 raft_consensus.cc:2804] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:27:09.587445 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:09.482664 28316 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:27:09.530009 28243 raft_consensus.cc:697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:09.548950 28335 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:09.591866 28145 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:09.559789 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:09.570333 28126 raft_consensus.cc:697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
W20260709 12:27:09.607998 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 417123us
I20260709 12:27:09.570272 28213 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:09.623977 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.590775 28234 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:09.636636 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:09.591799 27728 raft_consensus.cc:697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
W20260709 12:27:09.652911 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93245.1us
I20260709 12:27:09.654098 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:09.644771 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 333527us
I20260709 12:27:09.619272 28194 raft_consensus.cc:3055] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:09.636854 28310 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.670354 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:09.673760 27728 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.655136 28317 raft_consensus.cc:697] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:09.678642 28144 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:09.679280 28144 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.681444 28144 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.678644 28317 consensus_queue.cc:237] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.684566 19456 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:09.698750 28348 raft_consensus.cc:2804] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:09.699657 28348 raft_consensus.cc:697] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:09.701063 28348 consensus_queue.cc:237] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.671725 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.706276 28126 consensus_queue.cc:237] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.706089 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:09.708703 18919 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:09.651599 28347 raft_consensus.cc:2764] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Leader pre-election decision vote started in defunct term 30: won
I20260709 12:27:09.713961 18886 leader_election.cc:400] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:09.660938 28194 raft_consensus.cc:740] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:09.664110 28335 raft_consensus.cc:697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:09.720575 18919 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
W20260709 12:27:09.743139 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 106765us
I20260709 12:27:09.722945 18914 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
I20260709 12:27:09.723783 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:09.663336 28333 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:09.749038 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:09.667678 28302 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:09.672562 28213 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:09.756093 18845 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 12:27:09.762518 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 34 candidate_status { last_received { term: 33 index: 23 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.758267 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.763399 18919 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:09.766538 18915 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 34: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:09.714691 28317 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:09.742697 28345 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.098s	user 0.004s	sys 0.000s
I20260709 12:27:09.768360 18886 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:09.764815 18814 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.758989 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:09.773530 18842 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:27:09.706344 28255 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:27:09.745998 28216 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:09.775944 28124 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:09.776511 28124 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.747975 28310 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:09.777011 28124 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:09.791816 28335 consensus_queue.cc:237] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.792397 27913 raft_consensus.cc:3055] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:09.792860 27913 raft_consensus.cc:740] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:09.765729 28213 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:09.750273 28127 consensus_queue.cc:1059] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:27:09.793712 27913 consensus_queue.cc:260] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.796767 28317 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:27:09.800346 28213 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:09.798557 28270 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:09.799008 27837 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:09.751257 28333 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:09.753131 28243 consensus_queue.cc:237] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:09.772840 28222 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.841871 28190 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:09.868499 28353 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:27:09.896607 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:09.783138 28310 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:09.891597 28342 log.cc:927] Time spent T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:27:09.911939 19484 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 29: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:09.896273 27913 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:09.798709 28194 consensus_queue.cc:260] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.898453 28333 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:09.911791 28299 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:09.942169 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 209372us
W20260709 12:27:09.945550 28355 log.cc:927] Time spent T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:27:09.950538 28252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39122 (request call id 1) took 13792 ms. Trace:
I20260709 12:27:09.913187 28270 raft_consensus.cc:3055] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:27:09.964148 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:09.968001 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.979370 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:09.912310 28190 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.953430 28194 raft_consensus.cc:3060] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:09.997262 19458 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.963620 28255 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:09.999105 28234 raft_consensus.cc:2804] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:09.998837 28255 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:09.999699 28234 raft_consensus.cc:697] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:10.000890 28368 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:10.000675 28234 consensus_queue.cc:237] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.001453 28368 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:09.982336 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 231862us
I20260709 12:27:09.986248 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:10.014009 18919 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
W20260709 12:27:09.991778 28359 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:27:10.020808 28352 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:27:09.993208 28190 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:09.993584 28218 consensus_meta.cc:287] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.005s
I20260709 12:27:09.980098 28270 raft_consensus.cc:740] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:09.976441 28252 rpcz_store.cc:276] 0709 12:26:56.150223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.187741 (+ 37518us) service_pool.cc:224] Handling call
0709 12:26:56.296949 (+109208us) log.cc:844] Serialized 487 byte log entry
0709 12:26:57.250976 (+954027us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b18001f63c0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e9e3f3 00007f3357ea07c1 00007f3357ea0779 00007f3357ea0709 00007f3357ea06d1 00007f3357e9f9cd 0000000000388634 0000000000388479 00007f3357e8183a
0709 12:27:09.914439 (+12663463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16866,"raft.queue_time_us":159784,"raft.run_cpu_time_us":1211,"raft.run_wall_time_us":87317,"spinlock_wait_cycles":12568960,"thread_start_us":278490,"threads_started":1,"wal-append.queue_time_us":449870,"wal-append.run_cpu_time_us":1925,"wal-append.run_wall_time_us":1008043}
I20260709 12:27:10.013404 18917 raft_consensus.cc:1275] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
W20260709 12:27:09.990854 28351 log.cc:927] Time spent T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:27:10.025120 18766 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:27:10.026726 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 3225) took 1101 ms. Trace:
I20260709 12:27:10.024559 28222 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:10.036765 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 49852.1us
I20260709 12:27:10.063397 18739 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:09.998216 28124 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.065899 28124 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.049604 18764 rpcz_store.cc:276] 0709 12:27:08.924950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.929676 (+  4726us) service_pool.cc:224] Handling call
0709 12:27:08.930053 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:08.943512 (+ 13459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.943550 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:08.944067 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:27:09.314732 (+370665us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:09.562358 (+247626us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.563986 (+  1628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.564066 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:10.026468 (+462402us) raft_consensus.cc:1685] finished
0709 12:27:10.026495 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:10.026650 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13110,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":11317,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":22054,"thread_start_us":570587,"threads_started":2,"wal-append.queue_time_us":527128}
I20260709 12:27:10.066987 28368 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:10.067415 28259 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:10.067572 28053 consensus_queue.cc:1059] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 28.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:10.047470 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:09.980765 28299 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.067090 28369 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:10.070616 28369 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.071008 28369 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:10.071843 28299 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:10.072412 28299 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:10.068361 28371 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:10.054250 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.068427 28053 consensus_queue.cc:1243] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer 674d77fe8bcb4c768537ebae4be828bd log is divergent from this leader: its last log entry 29.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:27:10.086959 18770 raft_consensus.cc:2410] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
W20260709 12:27:10.087488 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49373.5us
I20260709 12:27:10.036528 28100 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.081008 28176 consensus_queue.cc:1048] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.034s
I20260709 12:27:10.115451 28145 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.086014 28348 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:10.072853 28299 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:10.132798 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:10.141680 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53244.8us
I20260709 12:27:10.146384 18656 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbadce60e960476289740ec2afd0a5c8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 12:27:10.149679 27793 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:10.150527 27793 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.153321 27793 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:10.048319 28218 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:10.170285 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 401952us
I20260709 12:27:10.080461 28371 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.175331 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:10.175953 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.177168 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.177783 28127 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:10.177913 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.178560 28365 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.171015 28370 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:10.181231 19487 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 12:27:10.181893 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.080986 28259 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:27:10.183671 28361 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:10.183423 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:10.184965 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.356884 18773 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:10.081856 28255 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:10.127302 28222 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:10.186347 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.188158 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:10.252578 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:10.248975 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:10.193219 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.361610 18848 raft_consensus.cc:3060] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:27:10.251370 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 63117.8us
W20260709 12:27:10.248023 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66635.4us
I20260709 12:27:10.331566 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:10.343246 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 137942us
I20260709 12:27:10.363521 18769 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:10.355783 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:10.356000 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 68378.9us
I20260709 12:27:10.360795 19486 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:10.364492 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:10.339846 18844 raft_consensus.cc:2955] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 4 to 14, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:10.131424 28100 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.130528 28374 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:10.370517 18737 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:10.379045 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:10.397519 18848 raft_consensus.cc:2468] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
W20260709 12:27:10.358373 28304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.005s	sys 0.007s
W20260709 12:27:10.418565 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54167.8us
W20260709 12:27:10.494604 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 221347us
I20260709 12:27:10.403287 18773 raft_consensus.cc:2468] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:27:10.495749 18886 leader_election.cc:400] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:10.188733 28214 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.188s
I20260709 12:27:10.360240 28177 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.497473 28177 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.500114 28177 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.500833 28177 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:10.416200 28304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.006s	sys 0.007s
I20260709 12:27:10.497135 18886 leader_election.cc:403] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:27:10.504303 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:10.377305 28310 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.185201 28270 consensus_queue.cc:260] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.172441 28348 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.339864 28127 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.549212 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 34 candidate_status { last_received { term: 33 index: 23 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:10.552361 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53002.2us
W20260709 12:27:10.531788 28363 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.483s	user 0.001s	sys 0.000s
I20260709 12:27:10.338860 28365 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.369550 28222 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.371558 28255 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.557225 19483 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 34.
I20260709 12:27:10.368022 28370 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.410354 28266 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.142s
I20260709 12:27:10.361291 28259 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.526067 28384 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:10.555742 28287 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:27:10.582617 18814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.027s	sys 0.050s
I20260709 12:27:10.574446 19485 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:27:10.543125 28382 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:10.589493 18814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.027s	sys 0.050s
I20260709 12:27:10.559950 28205 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
I20260709 12:27:10.592682 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:10.593566 18916 raft_consensus.cc:3060] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:10.594858 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:10.596292 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:10.596390 18812 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:10.597335 18917 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:27:10.598659 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.600135 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:10.604861 18769 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:10.601655 18917 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:10.446810 28374 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.611037 19484 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:10.614627 19490 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:10.575529 28373 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.586092 28384 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:10.609223 28150 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 1.084s	user 0.014s	sys 0.000s
I20260709 12:27:10.631752 18916 raft_consensus.cc:2468] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:10.613111 28304 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.647336 27728 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:10.652611 27728 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:10.655493 28387 log.cc:927] Time spent T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:27:10.656196 28374 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:10.656842 28374 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:10.657388 28374 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:10.658547 28381 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:27:10.659456 28378 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:27:10.661545 28222 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.663092 28222 raft_consensus.cc:2804] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:10.663208 27728 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:10.663626 28222 raft_consensus.cc:697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:10.664583 28222 consensus_queue.cc:237] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.666832 28374 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.668076 28374 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.671201 28371 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:10.675612 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 296624us
W20260709 12:27:10.679313 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 313495us
W20260709 12:27:10.680902 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.679965 19484 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 26 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
W20260709 12:27:10.682175 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.670846 28374 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.645244 28177 raft_consensus.cc:2764] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:27:10.602946 28287 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.646536 28384 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:27:10.681813 28213 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.000s
I20260709 12:27:10.722615 28213 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.738932 18769 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 12:27:10.679818 28145 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.749078 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.679662 28310 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:10.752007 18842 raft_consensus.cc:1240] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 25. Current term is 26. Ops: [25.18-25.18]
W20260709 12:27:10.752498 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 256911us
I20260709 12:27:10.753937 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:10.754469 28385 log.cc:927] Time spent T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:27:10.757256 18922 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:10.757302 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:10.754709 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:10.758431 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 162131us
I20260709 12:27:10.759092 18915 raft_consensus.cc:2410] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:27:10.609211 28382 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.773166 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:10.651582 28150 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.776878 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.777151 18839 raft_consensus.cc:1240] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
I20260709 12:27:10.681619 28304 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.646765 28373 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.716984 28100 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.769920 28299 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.772466 28213 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:10.779661 28205 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:27:10.777077 28388 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:27:10.774180 28398 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:10.790001 28392 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:10.770529 28310 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.823446 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.825627 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:10.823710 18919 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:27:10.804948 18922 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:10.830746 18812 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:10.836503 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.837316 18768 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 29.
I20260709 12:27:10.837721 28205 raft_consensus.cc:2764] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
I20260709 12:27:10.840297 18768 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:10.819006 28392 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.847606 28348 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.847609 27728 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:10.848533 27728 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.849828 28392 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:10.851261 28374 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:10.851738 28370 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.856227 28287 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.833057 28365 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:10.856662 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.864042 19488 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:27:10.864459 28373 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.866715 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:10.868609 18913 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:27:10.866374 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:10.875064 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:10.876627 18737 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:10.876657 28287 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:10.877782 28287 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:10.881234 18922 raft_consensus.cc:1275] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:10.882954 18737 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:10.884385 18737 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:10.890895 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.891664 18770 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:27:10.895195 18772 raft_consensus.cc:1275] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 12:27:10.895669 18772 pending_rounds.cc:85] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Aborting all ops after (but not including) 17
I20260709 12:27:10.895877 18772 pending_rounds.cc:107] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 12:27:10.896095 18772 raft_consensus.cc:2889] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:10.905929 18770 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:27:10.907694 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:10.909209 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 65021.7us
I20260709 12:27:10.910439 18886 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:10.858203 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.912537 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.914259 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:10.918147 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:10.876976 27913 consensus_meta.cc:287] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.935s	user 0.013s	sys 0.001s
I20260709 12:27:10.919574 18916 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:10.919700 18886 leader_election.cc:400] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 21. Current term is 22.
W20260709 12:27:10.924409 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 93185.2us
I20260709 12:27:10.844424 28259 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.919925 19489 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:10.922821 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:10.921458 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:10.844708 28127 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:10.811321 28398 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:10.919639 28369 consensus_meta.cc:287] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.848s	user 0.012s	sys 0.001s
I20260709 12:27:10.845192 28404 raft_consensus.cc:2804] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:10.939195 27728 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:10.940800 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:10.942795 28255 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:10.943544 28310 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:10.944151 28304 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.911617 28126 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:10.932947 18737 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:10.947000 28150 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:10.920095 28373 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:10.931438 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 100757us
I20260709 12:27:10.956037 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:10.923601 28322 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:10.959237 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.927093 28392 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:10.969939 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:10.965286 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:10.931612 28377 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:27:10.975616 28377 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:10.979766 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 57714.4us
I20260709 12:27:10.981415 28370 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:10.981943 28370 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.982352 28370 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:10.986796 28274 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:10.987462 28274 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.987944 28274 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:10.979108 28373 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.961939 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.963585 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:10.953261 28347 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.054s
I20260709 12:27:10.926203 28365 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.042s
I20260709 12:27:10.958745 28126 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:10.959559 28384 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:10.979447 27879 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:27:10.960881 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:11.064720 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 104103us
W20260709 12:27:11.065008 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 192904us
I20260709 12:27:11.066097 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:11.055068 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 68541.7us
I20260709 12:27:10.960043 28404 raft_consensus.cc:697] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:11.070794 18766 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 26: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
W20260709 12:27:11.057864 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 78359.6us
I20260709 12:27:10.918635 28410 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:10.974658 28412 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:11.075138 28398 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.075379 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.079859 28384 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.080040 28126 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:11.082008 28333 consensus_meta.cc:287] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 1.129s	user 0.013s	sys 0.000s
I20260709 12:27:11.082726 28333 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.084342 18917 raft_consensus.cc:1240] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:10.951359 28369 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.069172 28310 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:11.089124 28310 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:10.976320 28377 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:27:11.053417 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 72378.9us
I20260709 12:27:11.070215 28406 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.088675 28404 consensus_queue.cc:237] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.062597 28405 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:27:11.061970 18842 raft_consensus.cc:1240] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: [27.15-28.16]
I20260709 12:27:11.123826 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.124936 18841 raft_consensus.cc:2410] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:27:11.095395 28270 raft_consensus.cc:3060] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:11.126586 28406 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.129992 28406 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:11.096577 19490 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:27:11.134913 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:11.135788 18767 raft_consensus.cc:2368] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23.
I20260709 12:27:11.087653 28369 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.118335 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:11.136934 19487 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:11.105592 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:11.108891 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:11.114245 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48102.1us
I20260709 12:27:11.115429 28371 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:11.116168 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.116266 28412 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:27:11.118345 28234 raft_consensus.cc:3055] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:11.125972 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.138060 18848 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:11.142853 18842 raft_consensus.cc:3060] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:11.151162 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.146157 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:11.151942 18841 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 21.
I20260709 12:27:11.147629 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:11.154800 18841 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:27:11.156375 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:11.152985 19483 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:27:11.159230 18843 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:27:11.159575 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.161252 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:11.165374 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 50340.9us
I20260709 12:27:11.167229 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:11.111948 28310 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:11.173590 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.160236 18846 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:27:11.175007 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.175985 18846 raft_consensus.cc:1240] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 12:27:11.176786 18886 leader_election.cc:400] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23.
I20260709 12:27:11.177127 18886 leader_election.cc:403] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:27:11.184753 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:11.189098 28257 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:11.172128 28405 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:11.190874 28405 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.192786 28333 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.193629 28405 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.131295 28382 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.143882 28371 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:11.195904 28371 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:11.143666 28126 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:27:11.199183 28341 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:27:11.149266 28234 raft_consensus.cc:740] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:11.210194 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:11.216841 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:11.217365 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:11.210374 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:11.222968 18765 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 27: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:11.223518 18840 raft_consensus.cc:2393] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:11.221658 28366 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:11.237696 28190 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.237953 28194 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.244539 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.244665 18913 raft_consensus.cc:1275] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:27:11.248585 18848 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:11.249527 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:11.245227 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.250137 18848 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:11.244278 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.259073 18842 raft_consensus.cc:1275] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:27:11.264731 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:11.267741 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.250669 18846 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:11.272671 19487 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:11.273270 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.193807 28370 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.246863 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:11.289968 18846 raft_consensus.cc:1275] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:27:11.290761 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.219041 28333 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:27:11.293483 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.296639 18914 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 28: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:11.301082 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:11.301306 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.298035 18737 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:11.304791 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.305565 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:11.305804 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.307101 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:11.298640 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.312678 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:11.313555 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66750.6us
I20260709 12:27:11.183987 28406 consensus_queue.cc:1048] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.088s
I20260709 12:27:11.322157 18848 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:27:11.317605 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.326283 18772 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:11.317239 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.320894 18773 raft_consensus.cc:1275] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:27:11.328291 18846 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:11.329365 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.271605 28287 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:11.329609 18814 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.332561 18846 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:27:11.333300 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.334964 28390 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:11.342926 28390 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:11.343528 28390 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:11.343639 18922 raft_consensus.cc:1240] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:11.320832 28150 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:11.346638 28126 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:11.346992 28150 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.349421 28370 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:11.350907 28377 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.351334 28222 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:11.355216 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.370862 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:11.376122 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 56144.4us
I20260709 12:27:11.379369 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.380775 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:27:11.383617 18918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.035s	sys 0.033s
W20260709 12:27:11.384094 18918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.035s	sys 0.033s
I20260709 12:27:11.388247 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.331990 18848 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:27:11.238384 28190 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.238488 28194 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.316567 28337 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:27:11.392799 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:11.403249 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63359.4us
I20260709 12:27:11.336750 28410 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:11.330857 27728 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:11.424212 18887 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:11.416812 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.354562 28384 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:11.337039 28287 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.349364 28150 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.322327 28408 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:27:11.440346 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 62962.2us
I20260709 12:27:11.427474 18922 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 26: Already voted for candidate 1e2529a8cff04207bb1b07c108e16983 in this term.
I20260709 12:27:11.418354 18814 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.430276 18919 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:27:11.441370 18738 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.423403 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:11.396275 28398 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:27:11.440557 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45270.1us
I20260709 12:27:11.427423 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:11.449116 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:11.437783 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.443723 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.389309 28395 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:11.451691 18814 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.455528 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:11.459254 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 34 candidate_status { last_received { term: 33 index: 23 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
W20260709 12:27:11.489101 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57622.1us
I20260709 12:27:11.534250 28126 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:11.391673 28222 consensus_queue.cc:1048] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:27:11.421871 28382 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:11.432507 27793 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:11.428324 28335 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:11.439962 28287 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:27:11.515859 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 74574.4us
I20260709 12:27:11.445219 28304 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:11.421446 28216 consensus_queue.cc:1048] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 12:27:11.445863 28377 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 34 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.455852 28127 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:11.459097 27728 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:11.439990 28213 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 12:27:11.507455 28373 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.511226 28259 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:11.441233 28384 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.457110 28369 consensus_queue.cc:1059] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.078s
I20260709 12:27:11.293334 28234 consensus_queue.cc:260] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.537236 28318 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.531766 28408 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:27:11.547137 28274 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.002s
I20260709 12:27:11.517786 28365 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 12:27:11.596021 28259 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.616580 28365 consensus_queue.cc:1243] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 23.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:27:11.559868 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.617551 18768 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:27:11.618683 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.618806 28259 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.620010 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.621243 28349 raft_consensus.cc:2764] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:27:11.561111 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.621695 18768 raft_consensus.cc:1275] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:27:11.458962 28395 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.564317 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.627276 18769 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:11.627354 28304 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:11.564741 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.537600 28322 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:27:11.632259 19492 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 34.
I20260709 12:27:11.584357 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.586833 27728 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:11.591781 28190 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.639209 27728 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:11.607847 28390 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:11.592073 28415 log.cc:927] Time spent T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:27:11.642884 18812 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:11.644575 28389 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:11.645041 28389 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.645401 28389 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:11.593915 28384 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:11.595690 28145 raft_consensus.cc:3055] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:27:11.644068 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:11.648398 28274 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.651163 28274 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.654199 28218 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:11.604835 28373 consensus_queue.cc:1048] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
I20260709 12:27:11.655783 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:11.576735 28382 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.553208 28302 raft_consensus.cc:3055] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:11.634848 28194 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.645277 18764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:11.646672 28145 raft_consensus.cc:740] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:11.594521 18914 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:27:11.594496 28254 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:11.578567 28337 consensus_queue.cc:1048] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:27:11.659425 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:11.582085 28335 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:11.659152 28302 raft_consensus.cc:740] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:11.642264 28390 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.607431 28405 consensus_queue.cc:1059] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.069s
I20260709 12:27:11.674810 28194 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.671183 28254 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.683197 28404 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:27:11.611289 28318 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.689868 28335 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:11.706789 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.684216 28127 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:11.707782 28194 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:11.758950 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 307342us
I20260709 12:27:11.668043 27728 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.708086 28254 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:11.787590 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:11.787163 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 332239us
I20260709 12:27:11.850941 18773 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:27:11.851320 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 63847.4us
I20260709 12:27:11.852833 18814 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.706550 28405 consensus_queue.cc:1243] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Peer 47b48b5c69f245b79ecb292eff89927f log is divergent from this leader: its last log entry 27.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 12:27:11.851011 28408 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.854001 28390 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:11.858711 28390 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:11.870045 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:11.885154 18737 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
W20260709 12:27:11.885217 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 429420us
I20260709 12:27:11.890306 28190 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:27:11.890586 28252 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.891119 28252 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.893524 28252 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.897027 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.901840 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:11.902135 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:11.861730 28373 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:11.912022 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:11.913038 18848 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 22.
I20260709 12:27:11.917582 18848 raft_consensus.cc:1217] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Deduplicated request from leader. Original: 21.16->[22.17-26.19]   Dedup: 22.17->[24.18-26.19]
I20260709 12:27:11.918115 18848 pending_rounds.cc:85] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Aborting all ops after (but not including) 17
I20260709 12:27:11.918359 18848 pending_rounds.cc:107] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 12:27:11.918982 18848 raft_consensus.cc:2889] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.714599 28145 consensus_queue.cc:260] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:11.918691 28341 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:11.783231 28302 consensus_queue.cc:260] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.963228 28341 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:11.964704 28371 consensus_meta.cc:287] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.768s	user 0.014s	sys 0.000s
I20260709 12:27:11.965335 28371 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.942471 28222 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.782874 28127 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:11.947027 28422 log.cc:927] Time spent T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 12:27:11.949617 28194 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.879168 28218 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:11.958266 28382 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:11.961364 28318 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:11.965412 28404 consensus_queue.cc:1175] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "674d77fe8bcb4c768537ebae4be828bd" responder_term: 26 status { last_received { term: 25 index: 15 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47b48b5c69f245b79ecb292eff89927f for earlier term 25. Current term is 26. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:27:11.946646 28424 log.cc:927] Time spent T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:27:11.970191 18769 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:27:11.971086 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:11.976670 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:11.990547 19492 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 30: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:11.976974 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 57154.4us
I20260709 12:27:11.966549 28222 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:11.975260 28430 log.cc:927] Time spent T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.105s	user 0.001s	sys 0.001s
W20260709 12:27:11.986194 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 398670us
I20260709 12:27:11.944233 28190 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 34 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:11.990625 18917 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:27:11.991385 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:11.994758 18919 raft_consensus.cc:1275] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:27:11.996233 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:11.881562 28287 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:11.997824 18839 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:11.987545 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:11.987039 28213 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:12.001947 28413 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.425s	user 0.002s	sys 0.000s
I20260709 12:27:11.987223 28150 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:11.979967 27793 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:12.044305 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51648.7us
W20260709 12:27:12.086054 18812 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.003191 28304 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:12.054034 18738 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.047508 28190 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 33.23, Last appended by leader: 23, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.019698 28436 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:12.093848 27793 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:12.105623 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.103713 28437 log.cc:927] Time spent T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:27:12.104233 28310 consensus_meta.cc:287] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.916s	user 0.007s	sys 0.007s
W20260709 12:27:12.110460 19484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.012s	sys 0.047s
W20260709 12:27:12.111279 19484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.013s	sys 0.047s
I20260709 12:27:12.099915 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:12.108381 28222 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.035992 28389 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.086194 28218 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.045s
I20260709 12:27:12.054651 28213 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.112351 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45478 (request call id 1853) took 1934 ms. Trace:
W20260709 12:27:12.104534 28426 log.cc:927] Time spent T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:27:12.201493 19484 rpcz_store.cc:276] 0709 12:27:10.178193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.956563 (+778370us) service_pool.cc:224] Handling call
0709 12:27:10.956918 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:10.957641 (+   723us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:27:11.453605 (+495964us) log.cc:844] Serialized 14 byte log entry
0709 12:27:12.111869 (+658264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:12.111988 (+   119us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:27:12.112045 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.112130 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.112279 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":680923,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":185,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4925,"thread_start_us":1153328,"threads_started":2,"wal-append.queue_time_us":725727}
I20260709 12:27:12.132891 18738 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.148944 18918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54070 (request call id 3838) took 2427 ms. Trace:
I20260709 12:27:12.130631 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.098044 28341 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.100523 28266 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:12.179051 28444 log.cc:927] Time spent T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:27:12.206869 18918 rpcz_store.cc:276] 0709 12:27:09.719805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.726590 (+  6785us) service_pool.cc:224] Handling call
0709 12:27:09.727027 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:09.751418 (+ 24391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.751464 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:10.873823 (+1122359us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b180044d160. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a
0709 12:27:10.874940 (+  1117us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b2c001538c8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:27:10.875490 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.384555 (+509065us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:11.384619 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.384728 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.146969 (+762241us) raft_consensus.cc:1685] finished
0709 12:27:12.146995 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.147158 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23918,"raft.queue_time_us":27012,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1812,"spinlock_wait_cycles":29610624,"thread_start_us":508699,"threads_started":1,"wal-append.queue_time_us":666957}
W20260709 12:27:12.210983 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 78209us
W20260709 12:27:12.146222 28333 consensus_meta.cc:287] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.845s	user 0.013s	sys 0.003s
I20260709 12:27:12.108701 27793 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.109109 28436 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.225572 28335 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.138003 28318 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:12.224668 28373 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.240564 28318 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:12.241186 28318 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:12.240765 28373 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.215411 28407 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:12.231719 28436 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:12.223083 18814 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.243920 18814 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.245220 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.246605 28451 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:12.148954 28336 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.230284 18841 raft_consensus.cc:2368] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24.
I20260709 12:27:12.247367 28451 consensus_queue.cc:1048] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:12.204381 28287 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.195082 27728 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.230859 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.232342 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.248303 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:12.228835 28333 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 22. Current term is 23.
I20260709 12:27:12.253136 28218 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:12.232569 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:12.205591 28310 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.235526 28389 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.174903 28127 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.176429 28371 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.254256 18922 raft_consensus.cc:2393] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 28: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:12.256745 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.257683 18918 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:12.259443 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:12.260754 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:12.261375 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 34 candidate_status { last_received { term: 33 index: 23 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:12.262354 18922 raft_consensus.cc:2393] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 34: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:12.223127 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.266592 28407 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:12.263998 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.268672 18913 raft_consensus.cc:2393] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:12.268860 18921 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 22: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:27:12.273192 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50204.5us
I20260709 12:27:12.253679 28218 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:12.280936 18844 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:27:12.250164 28451 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:12.250577 28440 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:12.281352 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.283246 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:12.275605 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:12.264573 28222 consensus_queue.cc:1048] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:27:12.293064 28335 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.294265 28222 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:12.294718 28222 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:12.248660 28336 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.296787 28310 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.297010 28336 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.295094 28222 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:12.298027 19489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45466 (request call id 1558) took 1088 ms. Trace:
I20260709 12:27:12.298779 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.299467 18920 raft_consensus.cc:2468] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 20.
I20260709 12:27:12.300361 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.301517 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.306752 28408 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:12.307368 28408 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:12.308266 28408 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.252897 28254 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.311758 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:12.312449 18920 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:12.305115 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:12.298528 19489 rpcz_store.cc:276] 0709 12:27:11.209731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.211773 (+  2042us) service_pool.cc:224] Handling call
0709 12:27:11.212127 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:11.212518 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.212549 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:11.213143 (+   594us) log.cc:844] Serialized 52 byte log entry
0709 12:27:11.660333 (+447190us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:11.660399 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.660844 (+   445us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.297714 (+636870us) raft_consensus.cc:1685] finished
0709 12:27:12.297740 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.297956 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20140,"raft.queue_time_us":32429,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":36075,"thread_start_us":443312,"threads_started":1,"wal-append.queue_time_us":650085}
I20260709 12:27:12.316756 18918 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:27:12.255570 28287 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.322224 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.326689 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:12.319018 28333 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.274082 28127 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:12.329705 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:12.279971 28218 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:12.333469 18919 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:27:12.355756 18918 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:12.344226 18915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 2342) took 1174 ms. Trace:
I20260709 12:27:12.359728 18915 rpcz_store.cc:276] 0709 12:27:11.170168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.172395 (+  2227us) service_pool.cc:224] Handling call
0709 12:27:11.224738 (+ 52343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.225303 (+   565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.225349 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.226043 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.324898 (+1098855us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b18004a9680. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:27:12.341314 (+ 16416us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:27:12.341365 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.341438 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.343443 (+  2005us) raft_consensus.cc:1685] finished
0709 12:27:12.343464 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.344125 (+   661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":263,"raft.queue_time_us":197,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"spinlock_wait_cycles":42560256,"thread_start_us":16179,"threads_started":1,"wal-append.queue_time_us":1115275}
W20260709 12:27:12.364027 28453 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:27:12.327957 28333 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.370502 28459 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.358163 18814 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:12.371129 28459 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.356607 28274 raft_consensus.cc:2804] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:12.372437 28274 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:12.372869 28274 raft_consensus.cc:3060] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:12.373688 28459 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.374424 28254 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.331301 28287 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.319473 28336 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.377576 28336 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.331308 28335 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.379915 28336 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.380031 28335 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.331367 28190 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:12.383064 28436 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.359236 28144 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:12.386780 28425 log.cc:927] Time spent T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.604s	user 0.003s	sys 0.000s
I20260709 12:27:12.376757 28443 raft_consensus.cc:2804] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:12.387131 28144 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.387607 28443 raft_consensus.cc:697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:12.388634 28443 consensus_queue.cc:237] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.389664 28144 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.391076 28310 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:12.391654 28310 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.392653 28398 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.393157 28398 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:12.356415 28127 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.398557 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.399680 18920 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
W20260709 12:27:12.357831 28410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.023s	sys 0.015s
I20260709 12:27:12.393952 28310 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.403631 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 35 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:12.410688 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 54914.7us
I20260709 12:27:12.419178 18916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57874 (request call id 2346) took 1189 ms. Trace:
I20260709 12:27:12.401952 28341 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.419407 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.443089 19489 raft_consensus.cc:2410] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 35 because replica has last-logged OpId of term: 33 index: 23, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 22.
I20260709 12:27:12.386111 28436 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.370297 28407 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:12.401027 28335 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.370010 28222 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.401551 27793 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.401917 28336 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.442756 18916 rpcz_store.cc:276] 0709 12:27:11.229910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.230080 (+   170us) service_pool.cc:224] Handling call
0709 12:27:11.230572 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.231114 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.231155 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.231799 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.511085 (+279286us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:27:11.511131 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.511208 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.386165 (+874957us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:27:12.395308 (+  9143us) raft_consensus.cc:1685] finished
0709 12:27:12.395342 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.419098 (+ 23756us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":62028032,"thread_start_us":278600,"threads_started":1,"wal-append.queue_time_us":467880}
W20260709 12:27:12.436625 28410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.024s	sys 0.016s
I20260709 12:27:12.472620 28222 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.473656 28287 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.476589 18917 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:12.492718 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.477473 28410 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:12.450724 28341 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.454099 28318 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.508167 28127 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.511729 28398 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.459964 28213 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:12.512933 28468 log.cc:927] Time spent T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:27:12.469005 27793 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.513397 28333 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.524935 28410 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.525703 28318 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.486413 28336 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:12.575196 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 126097us
I20260709 12:27:12.578130 18739 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:12.575196 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 217414us
I20260709 12:27:12.584981 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.601063 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.603950 27879 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:27:12.605264 27879 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:12.605808 27793 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.528847 28336 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.522179 28274 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.619266 28274 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.620867 28218 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.624339 28218 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.530025 28395 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.625537 28377 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.660671 28377 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.628167 28398 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.630968 28410 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.633805 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.664806 28410 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.668082 28410 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.669493 28377 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.675602 18770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 3264) took 1104 ms. Trace:
W20260709 12:27:12.637373 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 52980.7us
I20260709 12:27:12.637660 28222 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:12.642659 28382 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:12.607394 27879 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.649354 28349 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:12.657104 28302 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:12.684129 28410 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:12.685212 28410 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.676367 18770 rpcz_store.cc:276] 0709 12:27:11.570768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.623762 (+ 52994us) service_pool.cc:224] Handling call
0709 12:27:11.624092 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.872323 (+248231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.872353 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.883534 (+ 11181us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.266660 (+383126us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:12.266702 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.674438 (+407736us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54001c2854. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:12.674534 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.674666 (+   132us) raft_consensus.cc:1685] finished
0709 12:27:12.674689 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.675298 (+   609us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50547,"raft.queue_time_us":4039,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8946,"spinlock_wait_cycles":561877248,"thread_start_us":290455,"threads_started":1,"wal-append.queue_time_us":332172}
I20260709 12:27:12.689790 28377 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.703275 28349 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.707894 28410 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.698945 28382 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:12.708120 18844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 3762) took 1637 ms (client timeout 1862 ms). Trace:
W20260709 12:27:12.710796 18844 rpcz_store.cc:269] 0709 12:27:11.070756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.070914 (+   158us) service_pool.cc:224] Handling call
0709 12:27:12.707661 (+1636747us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540041bed4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:12.707885 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2770822528}
I20260709 12:27:12.713922 28382 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.714282 28369 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.715560 28369 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.716570 28349 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.720386 28369 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.727011 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:12.727986 18844 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:12.728856 28373 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.729876 28412 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:12.730868 28412 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.732519 18844 raft_consensus.cc:1240] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:12.735741 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:12.736012 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.737983 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:12.742954 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:12.743501 28427 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.881s	user 0.000s	sys 0.005s
I20260709 12:27:12.744155 18841 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:12.746655 19490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1527) took 1253 ms. Trace:
I20260709 12:27:12.752499 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:12.753651 19489 raft_consensus.cc:2368] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 27. Current term is 28.
I20260709 12:27:12.758066 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.734143 28412 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.760396 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.762710 28377 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.764048 28481 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.764928 28481 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.765548 28377 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.764957 28341 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.767311 28341 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.768021 28341 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:12.758230 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.780676 18921 raft_consensus.cc:1240] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 28. Current term is 29. Ops: []
I20260709 12:27:12.781383 28341 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.786751 28333 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.788766 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 176164us
I20260709 12:27:12.788605 28333 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.787806 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.791692 28333 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:12.795809 28433 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.796113 28373 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.796674 28234 raft_consensus.cc:3060] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:12.797293 28373 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.798355 28382 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.798883 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:12.799592 18839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35896 (request call id 3764) took 1692 ms (client timeout 1969 ms). Trace:
I20260709 12:27:12.799270 28382 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.797633 28319 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:12.800086 18839 rpcz_store.cc:269] 0709 12:27:11.106746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.106900 (+   154us) service_pool.cc:224] Handling call
0709 12:27:12.798988 (+1692088us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54003be054. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:12.799387 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963077376}
I20260709 12:27:12.800822 28319 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.802209 28382 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.802659 28267 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.803586 28319 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.803835 28205 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.803597 28267 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.804762 28205 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.807590 28267 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.809154 28373 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.806047 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
W20260709 12:27:12.814105 28448 log.cc:927] Time spent T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.614s	user 0.000s	sys 0.002s
I20260709 12:27:12.819069 28145 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:12.818763 28412 consensus_queue.cc:1059] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 25.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:27:12.821805 28412 raft_consensus.cc:3055] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:12.776587 28481 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.747653 19490 rpcz_store.cc:276] 0709 12:27:11.407449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.407633 (+   184us) service_pool.cc:224] Handling call
0709 12:27:11.408132 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.408611 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.408653 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:12.479706 (+1071053us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b18000443e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e6c2a6 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a
0709 12:27:12.481345 (+  1639us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b2c00075be8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3359884a11 00007f3359894372 00007f335afc6a01 00007f335af8b43a 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2
0709 12:27:12.481955 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.645520 (+163565us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:27:12.645616 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.645768 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.645856 (+    88us) raft_consensus.cc:1685] finished
0709 12:27:12.645882 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.660364 (+ 14482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":971,"raft.queue_time_us":4554,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4645,"spinlock_wait_cycles":38086272,"thread_start_us":115931,"threads_started":1,"wal-append.queue_time_us":53846}
I20260709 12:27:12.822379 28412 raft_consensus.cc:740] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:12.827431 28481 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:12.858886 28481 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.829689 28465 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.860625 28465 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.862005 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.829409 28369 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.864208 18772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:12.864449 18773 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:27:12.864970 18772 raft_consensus.cc:3060] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:12.864684 28369 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.838169 28408 consensus_queue.cc:1059] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:27:12.867359 28377 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.868139 28377 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.868940 18769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:12.869253 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:12.871184 28270 raft_consensus.cc:3055] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:12.871731 28270 raft_consensus.cc:740] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:12.872758 18773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:12.831801 17568 tablet_server.cc:179] TabletServer@127.17.40.1:0 shutting down...
I20260709 12:27:12.834666 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.873184 28270 consensus_queue.cc:260] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.835409 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:12.872879 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
I20260709 12:27:12.873519 28377 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.839037 18770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983" is_pre_election: true
W20260709 12:27:12.878712 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60789.1us
W20260709 12:27:12.862773 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.838937 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:12.834457 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:12.845773 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:12.824227 18764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33742 (request call id 3268) took 1122 ms. Trace:
I20260709 12:27:12.896472 18769 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:27:12.851050 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:12.839118 18771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:12.853821 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.862576 28481 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.906828 19492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:12.868130 18765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "1e2529a8cff04207bb1b07c108e16983"
I20260709 12:27:12.890133 18764 rpcz_store.cc:276] 0709 12:27:11.701510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.701951 (+   441us) service_pool.cc:224] Handling call
0709 12:27:11.702486 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.709807 (+  7321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.709861 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.715491 (+  5630us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.039431 (+323940us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:27:12.039664 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.039934 (+   270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.812855 (+772921us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f335ab2686e 00007f335ab25bb6 00007f335ab257d8 00007f335ab2f221 00007f335ab2f1d9 00007f335ab2f169
0709 12:27:12.823652 (+ 10797us) raft_consensus.cc:1685] finished
0709 12:27:12.823677 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.824021 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8455,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":59304,"spinlock_wait_cycles":5040640,"thread_start_us":320175,"threads_started":1,"wal-append.queue_time_us":449429}
I20260709 12:27:12.911726 18839 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:12.844082 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:12.909178 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.841220 28205 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.918798 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.918754 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.848026 28337 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.924633 18841 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30.
I20260709 12:27:12.939546 19484 raft_consensus.cc:2368] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30.
I20260709 12:27:12.927059 18765 raft_consensus.cc:2368] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30.
I20260709 12:27:12.927222 18770 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:27:12.931896 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:12.934346 19490 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:12.934741 28373 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:12.935694 28369 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:12.936275 28433 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.940586 19492 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 28: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:12.948024 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:12.951081 18847 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:27:12.859205 28412 consensus_queue.cc:260] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.956079 28382 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:12.995783 28433 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.957446 19490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.958199 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:12.959072 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 115656us
I20260709 12:27:13.001008 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:12.848759 28459 consensus_queue.cc:1048] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.097s
I20260709 12:27:12.959117 28176 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:12.960348 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.961208 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:13.010066 18842 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:27:12.961731 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.962661 28373 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.963591 28465 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:12.965282 19485 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 33 index: 23. Preceding OpId from leader: term: 34 index: 24. (index mismatch)
I20260709 12:27:12.966248 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.968252 27879 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:12.969427 28270 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:12.969952 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:12.982051 18844 raft_consensus.cc:2393] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 28: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:12.982704 28214 consensus_queue.cc:1059] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:27:12.984710 18841 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:27:12.986920 28412 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:12.987218 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:12.987627 28337 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:12.990568 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:12.993511 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.994621 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:12.995519 28382 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:12.948048 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:13.011178 18920 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 23.
I20260709 12:27:13.024909 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:13.027571 18772 raft_consensus.cc:2468] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:13.028527 18840 raft_consensus.cc:2368] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 27. Current term is 28.
I20260709 12:27:13.034816 19488 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 12:27:13.036204 18737 leader_election.cc:400] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 27. Current term is 28.
I20260709 12:27:13.038457 18737 leader_election.cc:403] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 12:27:13.037418 28304 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:13.044647 18922 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:27:13.050361 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.055212 28302 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:13.054983 28304 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.055768 28373 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.055969 28302 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:13.064549 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:13.062492 18846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35888 (request call id 3824) took 1111 ms. Trace:
I20260709 12:27:13.068610 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.069670 18843 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 29: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:13.071107 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.072698 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.074734 19483 raft_consensus.cc:1275] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 19. (term mismatch)
I20260709 12:27:13.075171 19483 pending_rounds.cc:85] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Aborting all ops after (but not including) 18
I20260709 12:27:13.075413 19483 pending_rounds.cc:107] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: Aborting uncommitted NO_OP operation due to leader change: 26.19
I20260709 12:27:13.075700 19483 raft_consensus.cc:2889] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:13.079412 28349 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.080003 28349 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.049690 27879 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.058607 28304 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:13.096357 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 117645us
I20260709 12:27:13.058213 28302 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.114909 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.111732 28481 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:13.130125 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:13.065940 18846 rpcz_store.cc:276] 0709 12:27:11.907616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.907763 (+   147us) service_pool.cc:224] Handling call
0709 12:27:11.908183 (+   420us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:11.908599 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.908625 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:27:11.946253 (+ 37628us) log.cc:844] Serialized 78 byte log entry
0709 12:27:12.664559 (+718306us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b48000030d8. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335feb4aa1 00007f335feabb37 00007f335feab9ca 00007f335ffa326f 00007f335ffa2f37 00007f335ffb755c 00007f335ffb7508 00007f335ffb7488 00007f335ffb7443 00007f335ffb66ec 00007f335eee0a96
0709 12:27:12.749476 (+ 84917us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b18003b07a0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f3357e80e07 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9dc02 00007f335ab2520b 00007f335ab2ad23 00007f335ab2b0d1 00007f335af46a0f
0709 12:27:12.924021 (+174545us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:12.963611 (+ 39590us) log.cc:844] Serialized 14 byte log entry
0709 12:27:12.963963 (+   352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.964117 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:13.013445 (+ 49328us) raft_consensus.cc:1685] finished
0709 12:27:13.013467 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.018740 (+  5273us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23320,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":12193,"raft.run_cpu_time_us":9431,"raft.run_wall_time_us":744695,"spinlock_wait_cycles":103769600,"thread_start_us":130750,"threads_started":1,"wal-append.queue_time_us":1048863}
I20260709 12:27:13.124919 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.135124 18842 raft_consensus.cc:2468] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:27:13.132876 18666 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 20 to 26. New cstate: current_term: 26 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:13.141036 18847 raft_consensus.cc:1275] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:27:13.149183 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:13.136751 28302 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:13.152601 18843 raft_consensus.cc:2393] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 22: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:13.162900 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.187837 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.154498 28302 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:13.190771 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.191694 18844 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 32.
I20260709 12:27:13.189109 18847 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 12.
I20260709 12:27:13.193924 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.196732 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.193784 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45480 (request call id 1525) took 1811 ms. Trace:
I20260709 12:27:13.199359 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.204372 19483 rpcz_store.cc:276] 0709 12:27:11.382224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.382459 (+   235us) service_pool.cc:224] Handling call
0709 12:27:11.382867 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.076257 (+1693390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.175883 (+ 99626us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54006c1e54. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8be01 00007f335af8a83e 00007f335ff4f419 00007f33594c6bd4 00007f33594c6b62 00007f33594c6a91 00007f33594c6a0c 00007f33594c5cc2 00007f33592c648c 00007f33592c58c6
0709 12:27:13.193675 (+ 17792us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3889260800}
I20260709 12:27:13.197926 28302 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:13.222925 28150 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.223645 28150 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.226128 28214 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:13.226734 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:13.226887 28214 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.230739 28370 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:13.231410 28370 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.234004 28370 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:13.245222 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.239828 28214 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:13.225263 18666 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 24 to 25, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 25 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.248802 18666 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 24, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 24 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:13.251243 18666 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 21 to 24, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.252825 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.258443 28391 raft_consensus.cc:3055] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:27:13.260794 18848 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:13.202615 28382 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.211901 28337 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:13.183415 28369 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.033s
I20260709 12:27:13.278288 18839 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:27:13.264637 28391 raft_consensus.cc:740] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:13.287202 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.289011 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.283952 28382 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.290434 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.294319 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.298089 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:13.293326 28382 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.316013 18918 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:27:13.349006 28382 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:13.349808 28382 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:13.323580 28349 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:13.367076 28382 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:13.376394 28382 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.349833 27879 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:13.377213 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:13.381572 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:13.382658 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.383582 18917 raft_consensus.cc:2393] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 26: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:13.383705 28302 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.360455 28391 consensus_queue.cc:260] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.387229 28391 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:13.387666 28302 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:13.381773 28150 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:13.391063 28481 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 27. Current term is 28.
I20260709 12:27:13.395898 18666 catalog_manager.cc:5697] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 19 to 21, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 21 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.402419 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.403791 18922 raft_consensus.cc:1275] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:27:13.403703 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:13.406251 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:13.411240 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:13.411893 18843 raft_consensus.cc:1240] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:13.412055 19483 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:13.416422 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.417466 18843 raft_consensus.cc:2410] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 28 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260709 12:27:13.417271 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.416611 18848 raft_consensus.cc:1240] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 27. Current term is 28. Ops: []
I20260709 12:27:13.422662 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.424412 18737 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:13.430524 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:13.431634 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 186649us
I20260709 12:27:13.420579 28481 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:13.432114 28150 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:13.441250 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.460605 18848 raft_consensus.cc:2410] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
W20260709 12:27:13.436849 19456 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 26 similar messages]
I20260709 12:27:13.476096 18921 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 34 index: 24. (index mismatch)
I20260709 12:27:13.477231 18812 leader_election.cc:400] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30.
I20260709 12:27:13.477635 18812 leader_election.cc:403] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Cancelling election due to peer responding with higher term
I20260709 12:27:13.477747 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.478268 28302 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election lost for term 29. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30.
I20260709 12:27:13.478477 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.479493 28494 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:13.481120 28494 consensus_queue.cc:1048] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:27:13.438736 28337 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:27:13.487322 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:13.488294 28222 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:13.493153 28490 log.cc:927] Time spent T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.247s	user 0.000s	sys 0.005s
I20260709 12:27:13.496554 18913 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:27:13.496836 28222 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.497870 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.497649 28222 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.498690 18919 raft_consensus.cc:2468] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:13.461829 28150 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.500201 28481 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:13.510025 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.512179 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:13.515240 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.509150 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.522791 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.505899 28481 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.505450 28150 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:13.524422 18666 catalog_manager.cc:5697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 21 to 31. New cstate: current_term: 31 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:13.532232 18666 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.533527 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.534376 18847 raft_consensus.cc:2468] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:27:13.541805 18814 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.521315 28337 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.545606 18920 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:27:13.534003 18666 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 20, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 20 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.548098 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:13.552913 18843 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:27:13.547201 28494 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:13.561386 28382 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:13.561496 18666 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:13.569583 28382 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:13.573179 28382 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:13.554212 28337 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.582736 18921 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:27:13.602278 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:13.608803 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.608305 18666 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 20 to 24, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:13.651669 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 159935us
I20260709 12:27:13.619117 28304 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:13.668892 18666 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 17 to 18, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 18 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:13.652550 28222 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:13.685252 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 200711us
I20260709 12:27:13.652645 18812 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.698653 28459 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:13.702957 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:13.707163 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 200759us
I20260709 12:27:13.704068 18666 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:13.709972 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 275768us
I20260709 12:27:13.718786 27879 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:13.719089 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66531.2us
I20260709 12:27:13.720832 18812 leader_election.cc:400] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Vote denied by peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365) with higher term. Message: Invalid argument: T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30.
I20260709 12:27:13.709335 28373 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:27:13.724905 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 159419us
W20260709 12:27:13.752347 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 61655.1us
W20260709 12:27:13.748946 18667 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 270) took 123616 ms (client timeout 15000 ms). Trace:
I20260709 12:27:13.749604 18666 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 22 to 28, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 28 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:13.763352 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.768285 28150 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:13.756748 18667 rpcz_store.cc:269] 0709 12:25:10.064601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.064875 (+   274us) service_pool.cc:224] Handling call
0709 12:25:10.227981 (+163106us) spinlock_profiling.cc:243] Waited 958 us on lock 0x7b5400349328. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f336117d331 00007f33611783fc 00007f3360d49e84 00007f3360e4804e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc 00007f335f308392 00007f33592c648c 00007f33592c58c6
0709 12:25:11.552141 (+1324160us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b54003494d4. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef5090 00007f335af93f3a 00007f3360d49e9c 00007f3360e4804e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc 00007f335f308392 00007f33592c648c 00007f33592c58c6
0709 12:27:13.676110 (+122123969us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665537,"reported_tablets":49,"spinlock_wait_cycles":93401600}
I20260709 12:27:13.772725 19489 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:27:13.771580 18738 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.777455 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.797174 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.790331 28369 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:13.793192 28337 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:13.795131 18666 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 24 to 30. New cstate: current_term: 30 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.792312 28218 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:13.795753 28270 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:13.804837 28222 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:13.807181 28369 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:13.804597 28500 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:13.819548 28222 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:13.823120 28493 consensus_queue.cc:1048] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:27:13.826505 28213 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:13.827308 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 64219.7us
I20260709 12:27:13.837235 28218 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:13.802256 28481 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.020s
I20260709 12:27:13.846026 28369 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:13.847213 28222 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:27:13.871742 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 73548.8us
W20260709 12:27:13.878340 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.852676 28270 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:13.847038 28500 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:13.890328 18887 leader_election.cc:400] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24.
I20260709 12:27:13.892993 18887 leader_election.cc:403] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:13.879663 18666 catalog_manager.cc:5697] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 19 to 20, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 20 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:27:13.899278 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 98625.2us
I20260709 12:27:13.875986 28150 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:13.911922 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:13.892473 28408 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:13.899608 28234 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.875025 28213 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:13.923077 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 66425.2us
I20260709 12:27:13.918144 28459 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 23. Current term is 24.
W20260709 12:27:13.931237 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 134201us
I20260709 12:27:13.933914 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:13.937849 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 138078us
I20260709 12:27:13.929219 28234 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:13.931807 18666 catalog_manager.cc:5697] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:13.954872 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:13.955583 28270 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.956586 28500 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.958122 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.958914 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:13.959721 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:13.961122 28382 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:13.961614 18887 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:13.963653 28382 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.966054 28391 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:13.966627 28391 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:13.967047 28391 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:13.955026 28218 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:13.970846 28459 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:13.973126 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 72954.6us
I20260709 12:27:13.976331 19457 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.975328 18738 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:13.986339 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:13.925469 28150 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:13.975152 28234 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:13.993913 18666 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 19 to 25, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 25 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:14.015540 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:14.017284 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:14.018986 18738 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:14.019755 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 45281.4us
I20260709 12:27:14.016386 19483 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
I20260709 12:27:13.960101 28213 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:13.976341 28511 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:27:14.021970 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58814.2us
I20260709 12:27:14.035915 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:14.041872 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:14.039009 19485 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:27:14.047605 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.034708 28234 raft_consensus.cc:2804] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:14.058339 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.058997 18887 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:14.062093 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.062206 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.063697 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.069218 18840 raft_consensus.cc:2393] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:14.064507 18843 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:14.070114 18844 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:14.060992 18666 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 22 to 26, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 26 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:27:14.074002 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 55188.3us
I20260709 12:27:14.053956 28408 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:14.103166 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.104982 18666 catalog_manager.cc:5697] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 28 to 30, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 30 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:14.107242 28510 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:14.077584 28459 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:27:14.073378 28234 raft_consensus.cc:697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:14.127993 28234 consensus_queue.cc:237] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:14.130884 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 87885.6us
I20260709 12:27:14.134299 28369 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.135293 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:14.139391 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.139691 18666 catalog_manager.cc:5697] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:14.172726 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.144523 28150 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:27:14.189079 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:14.190019 19486 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
W20260709 12:27:14.195107 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 88056us
W20260709 12:27:14.172739 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 115430us
I20260709 12:27:14.211301 18738 leader_election.cc:400] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Vote denied by peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959) with higher term. Message: Invalid argument: T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 for earlier term 27. Current term is 28.
I20260709 12:27:14.211856 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:14.213357 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.213912 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:14.215255 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:14.202342 28150 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:14.197152 18666 catalog_manager.cc:5697] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 23, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 23 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.228039 27879 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:27:14.218233 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:14.197041 28459 consensus_queue.cc:1048] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:27:14.246083 18738 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:14.237838 28369 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:14.206838 28391 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.250114 28391 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:14.252364 28213 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:14.253402 28213 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:14.214463 28510 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:27:14.253808 28222 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.256454 28481 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:14.261310 28511 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:14.216673 28408 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:14.263022 28408 consensus_queue.cc:1059] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:14.263420 18738 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:14.264345 28408 raft_consensus.cc:3055] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:14.264792 28408 raft_consensus.cc:740] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:14.243258 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:14.247712 28218 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.265995 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:14.265677 28218 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.266611 18841 raft_consensus.cc:1240] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:14.267319 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:14.268256 28373 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:14.268479 28218 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:14.269094 28373 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:14.269524 28373 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.269917 28373 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:14.267360 28382 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:14.246832 28521 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:14.241976 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.273751 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:14.273933 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:14.269101 28514 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:27:14.308202 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:14.233623 18666 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 29 to 32, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 32 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:14.319064 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 115761us
I20260709 12:27:14.311141 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:14.265775 28408 consensus_queue.cc:260] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.253827 28213 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.320273 18913 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
W20260709 12:27:14.324409 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 50567.7us
I20260709 12:27:14.331265 18666 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.303759 28481 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:14.327927 28150 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.321343 27879 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:14.326661 28213 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:27:14.349844 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 131249us
I20260709 12:27:14.349797 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:14.330385 28382 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:14.375452 18666 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 13 to 21, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 21 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.320916 28270 consensus_queue.cc:1059] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:27:14.347705 28521 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:14.384282 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 62413.6us
I20260709 12:27:14.349124 28408 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:14.366683 28382 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.395735 18738 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:14.399212 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 69304.7us
I20260709 12:27:14.397497 18666 catalog_manager.cc:5697] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 24 to 28. New cstate: current_term: 28 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:14.375095 28507 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:14.408180 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:14.409783 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 194606us
I20260709 12:27:14.416416 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:14.422237 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 86826.2us
I20260709 12:27:14.406209 28382 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:14.406860 28507 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.427407 18666 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 20 to 23, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 23 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.443464 18666 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.445395 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:14.446026 28506 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:14.433454 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:14.433826 28218 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:14.447940 28218 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.437774 28369 raft_consensus.cc:3055] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:27:14.450217 28369 raft_consensus.cc:740] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:27:14.451046 28517 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:27:14.451467 28369 consensus_queue.cc:260] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.414580 28521 raft_consensus.cc:2804] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:14.452823 28521 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.453265 28521 raft_consensus.cc:3060] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:14.456310 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:14.456995 18887 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:14.428772 28529 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:27:14.457789 28529 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:14.458225 28529 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:14.446843 28506 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.423727 28222 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:14.458586 28337 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:14.459129 28337 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:14.459527 28337 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:14.460641 28506 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:14.460448 28530 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:14.461230 28506 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:14.458632 18887 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:14.463949 28218 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:14.461771 28506 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.469036 28506 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:14.471065 28515 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:14.480455 28515 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.481127 28515 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.474444 28522 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:14.482905 28522 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.483352 28522 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:14.487170 28213 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:14.489172 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 81093.3us
W20260709 12:27:14.490415 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 60411.1us
I20260709 12:27:14.491431 18666 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 23 to 26, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 26 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:27:14.506021 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 95482.5us
I20260709 12:27:14.466483 28507 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:27:14.544726 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 54603.8us
I20260709 12:27:14.540935 18666 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 16 to 24, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 24 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.536665 28511 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:14.568722 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 110165us
I20260709 12:27:14.573138 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:14.576529 18666 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.591153 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.594197 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.596141 18844 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:27:14.597513 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.598204 18847 raft_consensus.cc:2376] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30. Re-sending same reply.
I20260709 12:27:14.599309 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.599997 18841 raft_consensus.cc:2376] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29. Re-sending same reply.
I20260709 12:27:14.600911 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:14.601028 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:14.602114 18846 raft_consensus.cc:2393] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:14.602825 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:14.587579 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:14.611469 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 104155us
I20260709 12:27:14.559183 28506 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:14.582445 28304 raft_consensus.cc:493] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:14.558168 28534 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:14.625386 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.624765 28532 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.632640 18913 raft_consensus.cc:2393] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 29: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:14.638135 28481 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:14.638695 28304 raft_consensus.cc:515] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.638931 28481 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.641426 28304 leader_election.cc:290] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:14.634025 28412 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:14.642536 28412 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.643108 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:14.637683 28532 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.652302 28412 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:14.649214 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:14.655604 28481 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:14.657863 18666 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 24 to 29. New cstate: current_term: 29 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.663959 28537 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:14.668385 28481 raft_consensus.cc:2804] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:14.668913 28481 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:14.666018 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:14.673950 18887 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:14.675204 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:14.672871 28481 raft_consensus.cc:3060] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:14.627542 28506 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.671808 18666 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 23 to 27, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 27 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:14.724763 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 58613.3us
W20260709 12:27:14.752228 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.650647 28534 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.761555 28515 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:14.871059 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:14.896378 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:14.897522 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 461415us
I20260709 12:27:14.902721 18840 raft_consensus.cc:1240] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:14.912213 18666 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 20 to 26. New cstate: current_term: 26 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:14.915683 28373 consensus_meta.cc:287] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.637s	user 0.015s	sys 0.002s
I20260709 12:27:14.916214 28218 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:14.916877 28218 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.903007 28515 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:14.911350 28459 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:14.918504 28459 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.920677 28459 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:14.915570 28547 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.921453 28547 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.923707 28547 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:14.925865 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 310659us
I20260709 12:27:14.926936 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:14.930538 28391 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:14.931173 28391 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.932184 18921 raft_consensus.cc:3060] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:14.932289 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:14.933701 28515 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:14.934160 28515 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.934546 28515 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:14.935251 28511 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:14.936079 28511 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:14.936630 28369 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:14.938503 28337 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.916252 28373 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.939836 18919 raft_consensus.cc:1240] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Rejecting Update request from peer 43b520eabb65493abe84f4cf06806cba for earlier term 12. Current term is 13. Ops: []
W20260709 12:27:14.943248 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.947068 28218 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:14.947824 28218 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:14.948441 28218 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.907024 28521 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.951354 28521 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:14.952522 28539 log.cc:927] Time spent T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:27:14.954350 28481 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.957235 18921 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:27:14.901106 27879 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:14.958971 28408 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.564s	user 0.013s	sys 0.007s
I20260709 12:27:14.968921 28373 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:14.910635 28507 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.972146 18841 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:27:14.936090 18887 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:14.963461 28535 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:27:14.975498 28459 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:14.979939 18887 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:14.980998 18887 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:14.983943 28540 log.cc:927] Time spent T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:27:14.984113 28373 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.984735 28373 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:14.985311 28234 consensus_queue.cc:1059] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:14.986946 28234 raft_consensus.cc:3055] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:14.987386 28234 raft_consensus.cc:740] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:14.988230 28373 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:14.983964 28481 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:14.988399 28234 consensus_queue.cc:260] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:14.991250 28528 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:14.991809 28528 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.992213 28528 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:14.979010 18666 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.007896 18887 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:14.901857 28382 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.021265 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:14.961807 28522 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.027697 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.028707 19488 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:27:15.010591 28459 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:15.013418 28541 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:15.054968 18842 raft_consensus.cc:2393] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 30: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:27:15.057646 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 128374us
I20260709 12:27:15.060771 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1e9b0ef764c7a9e9a1470da4ccd66" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.024976 28542 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.063592 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:15.019033 28370 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:27:15.051848 28337 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.088661 28522 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:15.090430 28529 consensus_meta.cc:287] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.632s	user 0.015s	sys 0.005s
I20260709 12:27:15.090910 28529 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.093531 28529 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.071736 28541 consensus_queue.cc:1059] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 12:27:15.069756 28213 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.095456 28534 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.095885 28213 raft_consensus.cc:3055] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:15.096338 28213 raft_consensus.cc:740] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:15.097280 28213 consensus_queue.cc:260] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.097962 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:15.100378 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:15.101325 19486 raft_consensus.cc:3060] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:15.104355 28391 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.073518 28545 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.107797 28506 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.108589 28545 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.088706 28507 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.107846 28382 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.073480 27879 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:15.115172 27879 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.070336 28542 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:15.148360 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 124871us
I20260709 12:27:15.067960 28459 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.152506 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.153292 18919 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:15.170962 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:15.171648 18919 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:15.063580 28408 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 12:27:15.175012 28550 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.118178 27879 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.151268 28234 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:15.121472 28542 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.237432 28459 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.250717 28532 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:15.292109 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 238650us
I20260709 12:27:15.176069 28337 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.315635 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:15.175173 28382 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:15.178565 28530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.020s	sys 0.024s
I20260709 12:27:15.319165 19491 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:15.297755 19456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.298239 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.173426 28546 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.299783 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.249282 28218 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:15.306315 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.310865 19486 raft_consensus.cc:2468] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
W20260709 12:27:15.311425 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 134826us
I20260709 12:27:15.303066 28304 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.316522 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.322942 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.312917 28515 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.328722 28304 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.331081 28515 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.331260 28304 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.325230 18914 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:15.337381 18921 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 27: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:15.327381 19489 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
W20260709 12:27:15.339640 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 301483us
I20260709 12:27:15.339881 18919 raft_consensus.cc:2468] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:15.326581 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.342188 18918 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 29.
I20260709 12:27:15.344544 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.316640 28547 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:15.349995 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:15.353169 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:15.355453 19483 raft_consensus.cc:3060] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Advancing to term 30
I20260709 12:27:15.355720 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.357502 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.365854 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.368723 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.368963 28507 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:27:15.369470 28507 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.369853 18814 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:15.370824 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:15.372201 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.373404 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:15.376204 18843 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:15.336356 28382 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.302500 28550 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.380734 28382 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.374614 18814 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:15.381698 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:15.382365 18846 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:15.383787 18840 raft_consensus.cc:1275] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:27:15.385087 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.387717 28550 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.394570 28551 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.391011 28550 raft_consensus.cc:2804] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:15.396960 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.397682 18920 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:27:15.398361 28545 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.399785 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.400840 28542 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.401383 28542 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.402825 28368 consensus_queue.cc:1059] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.040s
I20260709 12:27:15.403333 28515 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.404043 28368 raft_consensus.cc:3055] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:15.403903 28515 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.404430 28368 raft_consensus.cc:740] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:15.407461 28541 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.408309 28541 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.408262 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:15.369854 28507 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:15.369486 18844 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:27:15.372785 18847 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
I20260709 12:27:15.419664 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:15.428580 18840 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 27: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:15.368002 18812 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:15.323884 28337 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.424417 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:15.450886 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.462733 18846 raft_consensus.cc:2468] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:27:15.466841 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:15.467787 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:15.470016 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45733.8us
W20260709 12:27:15.472977 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 105115us
I20260709 12:27:15.411669 28391 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:15.473961 18812 leader_election.cc:304] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:15.472182 19483 raft_consensus.cc:2468] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:15.413501 28550 raft_consensus.cc:697] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:15.411718 28459 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.444662 28506 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:15.343025 28546 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.491335 18886 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:15.482491 19456 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.565s (SENT)
I20260709 12:27:15.500373 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.405470 28368 consensus_queue.cc:260] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.406287 28515 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.508131 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:15.500396 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.511755 19483 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:15.515275 28521 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:15.523613 28521 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.526541 28543 raft_consensus.cc:2749] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:15.527107 28515 raft_consensus.cc:2804] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:15.527868 28515 raft_consensus.cc:697] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:15.528947 28515 consensus_queue.cc:237] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.530153 28218 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:15.477695 28534 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:15.485389 28500 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:15.479991 28391 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.411924 28547 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.537671 18812 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:15.410342 28528 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.533521 18843 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 33.
I20260709 12:27:15.469370 28511 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.052s
I20260709 12:27:15.526222 28521 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.395282 28551 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:15.555740 19456 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.625s (SENT)
I20260709 12:27:15.557698 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:15.538290 28534 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.545229 28391 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:15.537690 28500 raft_consensus.cc:493] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:15.583696 28500 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:15.579016 18920 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:15.587028 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.578430 28349 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:15.593526 28547 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:15.598097 19456 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.736s (SENT)
I20260709 12:27:15.598692 19456 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:15.556824 28543 raft_consensus.cc:2804] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:27:15.600869 18918 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 32. Current term is 33. Ops: []
W20260709 12:27:15.590826 18886 leader_election.cc:336] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.563s (SENT)
I20260709 12:27:15.601989 18886 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:15.598834 18845 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 23.
I20260709 12:27:15.581297 28534 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:15.580870 28382 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:15.614005 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:15.627898 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 67511us
I20260709 12:27:15.628155 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:15.642946 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:15.643414 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 52599.5us
I20260709 12:27:15.630831 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:15.661208 18918 raft_consensus.cc:1240] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 12:27:15.672143 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 74090.1us
I20260709 12:27:15.614903 28543 raft_consensus.cc:697] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:15.625941 28557 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:27:15.699774 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.658152 28532 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:27:15.604662 28550 consensus_queue.cc:237] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.672405 28529 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:15.678960 28382 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.728605 18843 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:15.733017 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.733425 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.777654 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.736698 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:15.769382 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.754343 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.730574 18844 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 32. Current term is 33. Ops: []
I20260709 12:27:15.755617 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:15.739420 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:15.780575 18915 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
W20260709 12:27:15.803894 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 64595.7us
I20260709 12:27:15.711019 28459 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.765563 28368 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:15.743770 28382 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.734690 28571 raft_consensus.cc:493] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:15.727468 28541 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.715279 28582 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:27:15.811836 18814 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:15.763046 28218 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.814932 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.768038 28551 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.835733 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:15.824715 28582 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.836580 18848 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:15.836690 28582 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:27:15.843153 28562 log.cc:927] Time spent T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:27:15.740780 28542 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.741671 28529 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.845788 28529 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:15.748584 28337 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.863435 28391 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.864274 28521 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.865085 28521 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.866698 28500 raft_consensus.cc:515] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.868927 28500 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.728904 28528 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.872871 28506 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.873539 28506 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:15.744117 28546 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.809603 18738 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:15.878676 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 69177.3us
I20260709 12:27:15.872812 28521 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.806799 28532 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:15.740706 28558 consensus_queue.cc:1048] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 12:27:15.880330 28536 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:15.880434 28408 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:27:15.881199 28234 consensus_meta.cc:287] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 12:27:15.882778 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:15.882557 28571 raft_consensus.cc:515] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.885102 28571 leader_election.cc:290] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.885339 28546 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:27:15.885702 28506 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.887040 19486 raft_consensus.cc:1240] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:15.888309 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.888286 28521 consensus_queue.cc:1059] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:27:15.891863 28571 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.892719 28537 raft_consensus.cc:3055] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:15.892511 28571 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.893128 28537 raft_consensus.cc:740] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:27:15.894086 28567 log.cc:927] Time spent T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
I20260709 12:27:15.894057 28537 consensus_queue.cc:260] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.895462 28537 raft_consensus.cc:3060] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:15.888654 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.897522 19489 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:15.900977 28481 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:27:15.903255 28521 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:15.903775 28521 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:15.903893 28582 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.905095 18847 raft_consensus.cc:1240] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 30. Current term is 31. Ops: []
I20260709 12:27:15.905709 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:15.820508 28459 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.907199 28521 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.909122 28571 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:15.909240 28459 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:15.909818 28481 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:15.912014 28546 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 32.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:27:15.912531 28213 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:15.913193 28481 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:27:15.913589 28481 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:15.913712 28391 leader_election.cc:290] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.861326 28581 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:15.914506 28481 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 32.16, Last appended by leader: 16, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.914978 28581 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:15.915518 28581 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:15.741425 28543 consensus_queue.cc:237] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:15.922384 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:15.931890 18737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.949028 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 335088us
I20260709 12:27:15.946064 18738 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:15.952064 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:15.952713 18921 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:15.887948 28506 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:15.964387 28408 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:15.989807 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:15.950276 28545 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.951041 28530 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:15.950860 18887 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:15.848476 28218 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:15.997712 19489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.999910 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:16.005765 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:15.988824 28408 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.007316 28408 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:27:16.010735 18812 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.567s (SENT)
I20260709 12:27:16.010864 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:16.013618 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:16.000913 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:16.000880 19483 raft_consensus.cc:2368] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30.
I20260709 12:27:16.053493 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c18380178684f0e93b10d0c7a912d02" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 22 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.062976 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.071134 18845 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:27:16.076386 28582 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:16.051098 28507 consensus_meta.cc:287] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
W20260709 12:27:16.084651 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 73932.2us
W20260709 12:27:16.112775 18812 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.609s (SENT)
I20260709 12:27:16.113409 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:16.091288 19458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.106184 28552 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:16.042506 28529 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:16.116930 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 349647us
W20260709 12:27:16.118140 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.158991 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 386420us
W20260709 12:27:16.160187 18886 leader_election.cc:336] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.710s (SENT)
I20260709 12:27:16.160828 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:16.161311 19456 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.810s (SENT)
I20260709 12:27:16.161887 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:15.996878 28545 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:16.163803 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 51079.6us
W20260709 12:27:16.165406 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 219403us
W20260709 12:27:16.166078 18812 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.785s (SENT)
I20260709 12:27:16.166625 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.177639 18922 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 24: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
W20260709 12:27:16.190685 18812 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.800s (SENT)
I20260709 12:27:16.191210 18812 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.191958 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:16.202750 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.086942 28576 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:16.161281 28511 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:16.204810 19487 raft_consensus.cc:2468] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 13.
I20260709 12:27:16.205806 18921 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 30.
W20260709 12:27:16.208389 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.209227 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.168684 28506 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:27:16.212441 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.203326 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.211521 18845 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:27:16.169301 28412 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:16.216548 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:16.220788 19458 leader_election.cc:304] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:16.228083 18812 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Timed out: RequestConsensusVote RPC to 127.17.40.1:46365 timed out after 1.802s (SENT)
I20260709 12:27:16.228808 18812 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.237761 28481 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:16.119885 28507 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.241003 18843 raft_consensus.cc:1240] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 30. Current term is 31. Ops: []
I20260709 12:27:16.243395 28529 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:16.246788 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 296003us
I20260709 12:27:16.247822 19487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45466 (request call id 1583) took 1150 ms. Trace:
I20260709 12:27:16.247941 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:16.248311 19487 rpcz_store.cc:276] 0709 12:27:15.097443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.097635 (+   192us) service_pool.cc:224] Handling call
0709 12:27:16.247600 (+1149965us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540044d754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:16.247709 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804418304}
I20260709 12:27:16.248886 19488 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 27.
I20260709 12:27:16.249426 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:16.249689 28530 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.250191 28530 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.250654 28542 raft_consensus.cc:2804] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:16.251196 28542 raft_consensus.cc:697] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:16.268215 18922 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:16.270009 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.272060 28576 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:27:16.277562 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.280179 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.281522 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:16.281883 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 121745us
I20260709 12:27:16.282354 18919 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
W20260709 12:27:16.284804 18886 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.285422 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.286742 28593 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:16.287387 28593 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.287842 28593 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:16.288391 28337 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:16.289016 28595 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:16.289378 28337 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:16.291590 28537 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:16.292299 28537 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.297209 18915 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 22.
I20260709 12:27:16.223278 28370 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:27:16.234872 28555 raft_consensus.cc:2804] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:27:16.235646 28580 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:16.289813 28595 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.177386 28552 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.299203 28541 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:16.306674 28541 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:16.310993 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.252293 28594 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:16.218562 28511 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.324419 28521 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:16.325498 28511 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.328461 28555 raft_consensus.cc:697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 30 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:16.329661 28555 consensus_queue.cc:237] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.334185 28218 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.296008 28515 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:27:16.214439 28546 consensus_queue.cc:1059] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.057s
I20260709 12:27:16.318560 28545 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.309764 28541 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:16.322968 28550 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:16.246516 28597 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:16.315019 28580 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:16.314093 28594 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.358733 18812 leader_election.cc:400] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30.
I20260709 12:27:16.252161 28542 consensus_queue.cc:237] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.370065 28530 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:16.380631 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 95868.1us
W20260709 12:27:16.415491 18886 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.416033 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:16.405718 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 202991us
W20260709 12:27:16.418004 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.374220 28515 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 33 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:16.407646 18812 leader_election.cc:403] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Cancelling election due to peer responding with higher term
W20260709 12:27:16.381650 28534 consensus_meta.cc:287] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.756s	user 0.007s	sys 0.005s
W20260709 12:27:16.422060 18886 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.424196 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.378831 28537 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.428658 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:16.405961 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 461920us
I20260709 12:27:16.422606 28579 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:16.367632 28408 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.431439 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:16.433703 18886 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:16.425550 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 66988.3us
I20260709 12:27:16.434849 18812 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:16.414826 28571 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:16.409917 28594 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:27:16.435163 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.439127 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.434770 28529 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:16.441711 28408 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.429205 28550 raft_consensus.cc:3060] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:27:16.450059 28600 log.cc:927] Time spent T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.003s
W20260709 12:27:16.450325 18886 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.450552 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.453755 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:16.455716 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:16.477231 19491 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:16.457893 28521 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:16.458905 28552 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.461184 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.479995 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:16.481527 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.422186 28580 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:16.462677 18812 consensus_peers.cc:597] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.463491 28595 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.429875 28534 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.433245 28537 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.503809 28537 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.471282 28606 consensus_queue.cc:1059] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:27:16.446853 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.506711 18846 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
W20260709 12:27:16.506834 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 62959.7us
W20260709 12:27:16.507777 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:16.508507 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:16.509419 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:16.510085 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.446606 28571 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.492260 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:16.492424 28546 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:16.492697 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:16.494563 28521 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:16.497840 28581 consensus_meta.cc:287] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: Time spent flushing consensus metadata: real 0.574s	user 0.004s	sys 0.004s
I20260709 12:27:16.447335 28597 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:16.502919 28607 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:27:16.486879 28515 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 32.16, Last appended by leader: 16, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.539624 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:16.512619 19456 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.541183 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:16.542680 19456 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.542939 28595 consensus_queue.cc:1059] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 30.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:27:16.510521 28536 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:16.544016 28519 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:16.544239 28536 raft_consensus.cc:3055] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:27:16.542984 18840 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:16.516641 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.519435 28537 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.505996 28534 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.546962 28594 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.547372 28537 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:27:16.547488 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:16.549347 28594 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.544646 28536 raft_consensus.cc:740] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:16.550559 28507 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.551455 28536 consensus_queue.cc:260] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.552202 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.552884 28536 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:16.553097 28546 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:27:16.554288 28521 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.554625 28546 consensus_queue.cc:1059] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:27:16.526641 28552 raft_consensus.cc:3055] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:27:16.555686 28552 raft_consensus.cc:740] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:16.556676 28552 consensus_queue.cc:260] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.557148 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.557942 28552 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:27:16.560425 18812 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.544560 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.535146 28581 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.532296 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:16.532481 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.533192 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:16.527627 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 77325.9us
I20260709 12:27:16.533885 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.535549 28597 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.573053 18847 raft_consensus.cc:2393] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:16.573099 28597 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:27:16.492097 28213 consensus_meta.cc:287] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.004s
I20260709 12:27:16.525089 28580 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.566499 18917 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
I20260709 12:27:16.554729 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:16.577546 18844 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:16.575232 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.560575 28545 raft_consensus.cc:3055] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:27:16.567324 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eda139ea8094bec9f34a061ca15f982" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:16.526237 28571 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.578009 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.564970 28581 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.567668 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:16.578547 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.582480 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:16.585781 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:16.567051 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.543111 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:16.588507 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:16.587250 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 69172.3us
I20260709 12:27:16.592540 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:16.593178 18843 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:16.594235 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:16.596899 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 54238.8us
I20260709 12:27:16.598444 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:16.600172 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:16.600518 18886 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:16.601550 18886 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.602434 18840 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:16.603941 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:16.596313 28481 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:16.599442 18814 leader_election.cc:304] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.579687 28594 raft_consensus.cc:3055] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Stepping down as leader of term 26
W20260709 12:27:16.633908 18886 leader_election.cc:336] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.634514 18886 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:16.630527 18914 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:16.586678 28545 raft_consensus.cc:740] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:16.619324 28575 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:16.633924 28594 raft_consensus.cc:740] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:16.624643 28530 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:27:16.637997 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:16.652675 19491 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
W20260709 12:27:16.651506 19456 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.654784 19456 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.655480 18737 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:16.655926 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.656782 18845 raft_consensus.cc:2393] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 24: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:16.656107 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.649843 28511 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:16.644162 28545 consensus_queue.cc:260] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.649660 28481 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.658680 28481 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.660367 28541 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.660912 28481 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:16.661616 18915 raft_consensus.cc:1240] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:16.662590 28575 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:27:16.649538 28594 consensus_queue.cc:260] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.662863 28541 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:16.635432 28581 raft_consensus.cc:2749] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:16.663661 28594 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:16.664608 18844 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
W20260709 12:27:16.655982 19456 leader_election.cc:336] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.672546 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:16.673765 18913 raft_consensus.cc:1275] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:27:16.668135 28542 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:16.668377 18886 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:16.675779 18886 leader_election.cc:336] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.676379 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:16.677412 18843 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
W20260709 12:27:16.677881 18886 leader_election.cc:336] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.672715 19456 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.658730 28545 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:16.669981 28597 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.679461 18886 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:16.683810 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:16.685256 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.685320 28493 raft_consensus.cc:2764] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:27:16.694274 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.696520 28550 raft_consensus.cc:2749] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election lost for term 29. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f for earlier term 29. Current term is 30.
I20260709 12:27:16.702512 28391 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:16.706964 18848 raft_consensus.cc:2468] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 30.
I20260709 12:27:16.680352 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.708566 18845 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:16.713701 28213 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:16.714576 18914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54070 (request call id 3906) took 1288 ms. Trace:
I20260709 12:27:16.714986 18914 rpcz_store.cc:276] 0709 12:27:15.418426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.418548 (+   122us) service_pool.cc:224] Handling call
0709 12:27:16.706993 (+1288445us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400100754. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f335aef4571 00007f335af8f2fa 00007f335ff50b17 00007f33594cb6d4 00007f33594cb662 00007f33594cb591 00007f33594cb50c 00007f33594ca7c2 00007f33592c648c 00007f33592c58c6 00007f33592c526f
0709 12:27:16.707125 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2619207936}
I20260709 12:27:16.717449 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.725263 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.728905 18919 raft_consensus.cc:1240] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 12:27:16.710723 28541 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:16.728726 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.730722 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:16.731361 18914 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:16.731484 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:16.732604 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 76648.2us
W20260709 12:27:16.733460 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.733927 19456 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:16.712186 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:16.737339 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.739642 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:16.739833 18839 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 28: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:16.743266 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:16.747602 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:16.741077 28346 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:27:16.752558 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58391.7us
I20260709 12:27:16.753392 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.757148 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:16.757186 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 101794us
I20260709 12:27:16.748437 28541 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:16.763329 19483 raft_consensus.cc:1275] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 12:27:16.765367 28605 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:16.765793 28597 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Requested vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.766500 28595 consensus_queue.cc:1059] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:16.766249 18738 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:16.756237 28546 consensus_queue.cc:1059] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:27:16.756096 28552 raft_consensus.cc:3060] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:16.762714 28481 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:27:16.736392 28493 consensus_queue.cc:1048] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:27:16.786593 28605 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:16.790912 28547 raft_consensus.cc:3055] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:16.798418 18886 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.791819 18914 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 23.
I20260709 12:27:16.792670 18738 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:16.797575 28337 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.815415 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:16.797690 28547 raft_consensus.cc:740] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:16.801016 28481 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:16.802675 28605 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:16.785735 28541 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.797421 28537 consensus_queue.cc:1059] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 28.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:27:16.805162 28529 raft_consensus.cc:2804] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:16.814632 28606 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:16.823634 28593 consensus_meta.cc:287] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.535s	user 0.014s	sys 0.000s
I20260709 12:27:16.812534 28542 consensus_queue.cc:1048] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.012s
I20260709 12:27:16.813632 28369 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:16.852839 28541 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:16.853379 18913 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 28
W20260709 12:27:16.850505 18886 leader_election.cc:336] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.860415 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.857260 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.858703 28369 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.876755 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.871178 28369 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:27:16.865854 18886 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:16.886965 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.862903 28529 raft_consensus.cc:697] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:16.854342 28605 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:16.864444 28581 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:16.847855 28337 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.857098 28606 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.859268 28593 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:16.889533 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.879760 28213 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:16.888769 28545 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:16.946246 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56782.1us
W20260709 12:27:16.956251 18886 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.883229 28537 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:16.956758 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.917043 28493 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:16.983340 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:16.984341 19483 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:16.995409 19491 raft_consensus.cc:1275] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
W20260709 12:27:16.999162 18886 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.999887 18886 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:17.001396 18886 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.002230 18886 leader_election.cc:336] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.003118 18886 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.003912 18886 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.004714 18886 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.005496 18886 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.005841 18886 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.932957 28536 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:17.013383 18886 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.015393 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:16.973131 28597 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:17.037228 18886 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.037937 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:17.010569 28579 raft_consensus.cc:2749] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:17.010246 28213 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:16.912550 28481 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:17.053730 18812 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.054553 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:16.981627 28545 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:16.893258 28547 consensus_queue.cc:260] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:17.047372 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 103075us
W20260709 12:27:17.058200 18812 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.994133 28537 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.070354 18812 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.048331 28608 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:17.025488 28536 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.071542 19483 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:27:17.087062 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.087993 18922 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:17.048838 28571 consensus_queue.cc:1048] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.030s
I20260709 12:27:17.062009 28553 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:17.063851 28580 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:17.047435 28597 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.109936 28624 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:17.110615 28606 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:17.045199 28529 consensus_queue.cc:237] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.114610 28521 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.115233 28521 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.116705 28213 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:17.155943 28521 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:17.097662 28382 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:27:17.159686 18738 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.197389 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:17.122480 28547 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:17.125417 28519 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:17.200860 18736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.224090 28616 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.459s	user 0.004s	sys 0.000s
I20260709 12:27:17.225548 28537 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:17.226962 28545 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:17.230927 28593 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:17.231880 28594 consensus_meta.cc:287] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.001s
I20260709 12:27:17.118989 28553 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.253057 28624 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:17.261104 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 45751.6us
W20260709 12:27:17.266911 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 229706us
W20260709 12:27:17.267766 18886 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.268859 18886 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.269307 18913 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:27:17.270012 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.276182 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:17.277722 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 219550us
W20260709 12:27:17.279049 18812 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.279557 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.269342 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:17.280198 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:17.285470 18812 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.286674 18812 consensus_peers.cc:597] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:17.287281 18812 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.288241 18812 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.288645 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:17.299173 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:17.300987 18886 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.301622 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:17.303426 18739 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.234977 28519 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.281873 28545 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.312254 28519 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:17.314196 28597 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:17.303550 28507 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:17.316109 28369 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.285187 28537 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:17.321058 28369 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:17.330646 28545 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.333123 28545 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:17.293669 28571 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:27:17.336535 28536 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:17.339422 28552 consensus_meta.cc:287] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.003s
I20260709 12:27:17.340384 28552 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:17.299957 18812 consensus_peers.cc:597] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:17.282902 28337 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:17.354950 18739 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:17.359130 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.360250 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:17.347267 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 46303.9us
W20260709 12:27:17.356431 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56562.1us
W20260709 12:27:17.364677 18812 consensus_peers.cc:597] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:17.301925 28624 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:17.328576 28606 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:17.342298 28634 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:17.372452 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:17.385463 19483 raft_consensus.cc:2368] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28.
I20260709 12:27:17.358228 28542 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:27:17.365429 18812 consensus_peers.cc:597] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:17.387248 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:17.389871 18812 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.366952 28511 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:27:17.391146 18812 consensus_peers.cc:597] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:17.392850 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.393168 18886 leader_election.cc:400] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28.
I20260709 12:27:17.394891 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:17.406927 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.407531 18886 leader_election.cc:403] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:17.411707 18812 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.414649 18886 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.414929 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.415159 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:17.392755 28553 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:17.413182 28593 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:17.418138 28493 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:17.413552 28630 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) with higher term. Message: Invalid argument: T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for earlier term 27. Current term is 28.
I20260709 12:27:17.428298 28617 raft_consensus.cc:3055] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:17.428845 28617 raft_consensus.cc:740] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:17.429842 28579 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:17.417589 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:17.431030 18812 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.431324 18886 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.431793 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.449445 28408 raft_consensus.cc:3055] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:27:17.415619 28511 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:17.444701 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.450102 28408 raft_consensus.cc:740] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:27:17.449628 19517 heartbeater.cc:646] Failed to heartbeat to 127.17.40.62:43633 (8 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.40.62:43633 timed out after 15.000s (SENT)
I20260709 12:27:17.399187 28594 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:17.454159 28511 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.455787 28213 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:17.457185 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:17.457810 28493 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:17.457881 18842 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:17.459214 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:17.459874 18843 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:17.465168 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:17.469777 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.472332 28408 consensus_queue.cc:260] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.431978 18886 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:17.476266 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45272.9us
W20260709 12:27:17.482740 18812 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.483726 18812 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.484304 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.477834 18842 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
W20260709 12:27:17.487498 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56207.8us
W20260709 12:27:17.488255 18886 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.488644 18886 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:17.488780 18812 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.489313 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.490876 18914 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:27:17.491938 28382 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:27:17.493218 28337 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:17.495124 28593 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:17.412037 28605 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:17.500862 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:17.497473 18812 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.497579 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:17.501488 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:17.498287 19456 leader_election.cc:336] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.502231 28571 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:17.502430 28593 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.503857 28370 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:17.504374 28370 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.504812 28593 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:17.500208 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:17.508975 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:17.509641 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:17.429822 28617 consensus_queue.cc:260] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:17.511452 17568 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 18798)
I20260709 12:27:17.522840 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.506100 28382 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:17.524652 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.526182 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.528108 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:17.528784 18920 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:17.529687 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:17.530320 18916 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:17.530557 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.531141 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:17.531746 18839 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:17.534226 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.506119 28337 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:17.537559 19458 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.541695 18916 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:27:17.542475 28234 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:27:17.542893 18913 raft_consensus.cc:1240] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:17.548985 28408 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:17.551592 28370 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:17.557327 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:17.552074 18814 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:17.552855 28617 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:17.557201 18739 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.559103 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:17.566862 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60014.8us
I20260709 12:27:17.568833 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.597960 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.562335 28636 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.601231 18842 raft_consensus.cc:1240] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
I20260709 12:27:17.604354 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.605300 18738 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:17.607412 18739 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
W20260709 12:27:17.562165 18812 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.595566 28382 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:17.614954 28369 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:17.625058 28382 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 28 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:17.626612 28382 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.620816 28636 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.606137 28536 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:17.647037 28636 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:17.654600 18920 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:27:17.616705 28634 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:17.717633 28558 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.718434 28558 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:17.569185 28346 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:17.722668 28558 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:17.739526 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 134295us
I20260709 12:27:17.740785 18738 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:17.741529 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 134189us
I20260709 12:27:17.573958 28546 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:27:17.620843 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 113980us
W20260709 12:27:17.747066 18812 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.763943 18812 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:17.764688 19487 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:17.771200 18839 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
W20260709 12:27:17.772305 18812 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.772547 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:17.772892 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:17.785967 18812 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.792906 18738 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:17.793587 18812 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.795030 18812 leader_election.cc:336] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.795727 18812 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.774818 28536 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:17.767215 28546 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.764240 28369 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:17.806524 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:17.775218 28493 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:27:17.799201 18812 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.770257 28593 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader election won for term 29
W20260709 12:27:17.813407 18812 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.790469 28550 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:17.790680 28617 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:17.816716 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.784085 28608 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:17.825549 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.804286 28580 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:17.805572 28546 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:17.814991 28553 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:17.808696 28636 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:17.834800 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.822999 28537 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:17.792457 28337 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:27:17.845844 28536 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:17.832986 28608 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.853448 28608 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:17.857942 28642 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:17.825476 28595 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.823341 28369 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:17.875619 18839 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 12:27:17.844378 28593 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:17.822876 28617 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:17.837440 18812 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.888145 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 50768.7us
W20260709 12:27:17.891481 18812 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.897986 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.875152 28595 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:17.907481 18812 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:17.908823 18812 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:17.909474 18812 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:17.917685 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:17.919633 19488 raft_consensus.cc:2393] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 13: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:17.922803 28581 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:17.923475 28581 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.914984 28632 raft_consensus.cc:2749] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:17.936043 18842 raft_consensus.cc:1275] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:27:17.913681 28580 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:17.943449 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:17.944393 18920 raft_consensus.cc:2393] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 27: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:17.951737 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:17.912590 28369 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:17.947304 28581 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:17.931216 28593 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:17.978314 28644 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:27:17.978485 28595 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:17.980090 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:17.983003 28649 log.cc:927] Time spent T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:27:17.990928 28617 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:17.993757 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 56072.6us
I20260709 12:27:17.996037 28546 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.005018 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:18.006057 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:18.013624 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.018605 28580 raft_consensus.cc:3060] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:18.019790 28617 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.020352 28617 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.022739 28617 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:18.024616 28595 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.025179 28595 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.026629 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.028203 28537 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.029124 28595 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:18.029801 28595 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.011562 28626 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:18.030299 28595 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.030867 28626 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.032513 28595 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:18.028771 28537 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.033107 28626 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:18.035697 28537 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:18.042918 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:18.048825 19487 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
W20260709 12:27:18.055671 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.056084 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 48005.5us
I20260709 12:27:18.058720 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.061182 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.062373 18846 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 27: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:18.064678 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.064771 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 34 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.066125 18845 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 33.
I20260709 12:27:18.067490 18839 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 31.
W20260709 12:27:18.068957 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.072419 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:18.070046 18886 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.089066 28595 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.096827 28595 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.097319 18846 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 32 index: 16. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
I20260709 12:27:18.098260 18843 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:27:18.099125 18846 raft_consensus.cc:1275] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:27:18.072036 28537 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.028s
I20260709 12:27:18.100401 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:18.101022 19487 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30.
I20260709 12:27:18.102125 28595 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:18.091255 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:18.087061 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.103241 28481 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:18.103796 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:18.104820 28595 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:18.105273 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:18.106174 28595 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:27:18.063464 28571 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:18.106350 18738 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:18.106676 28595 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.107126 28595 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:27:18.106869 28571 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.107195 18737 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:18.095558 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:18.099390 28546 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:18.111115 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:18.114778 18839 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:27:18.055205 28656 log.cc:927] Time spent T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:27:18.113356 19487 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
W20260709 12:27:18.072784 19456 leader_election.cc:336] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.122699 28369 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:27:18.123270 28369 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.123646 28369 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:27:18.117938 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:18.127274 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.128201 18844 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 31.
I20260709 12:27:18.133478 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:18.135587 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.136515 18848 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 31: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:27:18.143748 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 70996.1us
I20260709 12:27:18.113620 28507 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:18.118558 28580 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:18.116032 28552 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:27:18.116115 28213 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:18.149634 28634 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:18.146905 28546 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:27:18.147090 28537 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.015s
I20260709 12:27:18.149768 28519 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:18.162065 28571 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:18.153375 18812 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.188447 18846 raft_consensus.cc:1275] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:18.190282 18844 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:27:18.189383 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:18.191859 19456 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.180768 28552 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.204141 18839 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:18.179997 28337 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
W20260709 12:27:18.212967 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:18.223309 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 69964.4us
I20260709 12:27:18.223681 28580 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:27:18.180127 28507 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:18.231853 18812 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.233000 18812 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:18.183163 28542 consensus_queue.cc:1048] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:27:18.234236 28507 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:18.235188 28507 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
W20260709 12:27:18.234213 18812 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:18.239400 18812 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.239957 18812 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:18.240940 28507 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:27:18.241367 18812 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.242105 18812 consensus_peers.cc:597] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.189064 28515 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.246268 18812 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.246819 18812 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:18.247620 28580 raft_consensus.cc:2749] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:27:18.242660 28650 log.cc:927] Time spent T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:18.251627 28515 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.189465 28511 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:18.254802 28511 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.257126 28511 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:18.231295 28552 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:27:18.262028 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.254211 28515 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:18.268330 28369 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.269269 28511 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.270960 28369 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:18.269837 28511 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.271678 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:18.286113 18844 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:27:18.278561 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:18.276806 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82831.1us
I20260709 12:27:18.294955 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:18.295770 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:18.301880 18844 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 32.
I20260709 12:27:18.303944 18914 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:27:18.287786 28346 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.306615 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:18.315546 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:18.320776 18738 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:18.324199 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:18.332054 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 140294us
I20260709 12:27:18.317746 28659 consensus_queue.cc:1048] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.023s
I20260709 12:27:18.344099 28481 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:18.330315 28636 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:18.352689 19491 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
W20260709 12:27:18.355501 18886 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.331878 28369 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:27:18.316573 28546 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:27:18.337955 28234 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:18.323216 28346 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.322717 28382 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.040s
I20260709 12:27:18.379840 28511 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:18.381002 28595 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.383365 28511 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:18.384222 28511 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.383479 28595 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 34 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:18.390277 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 229278us
W20260709 12:27:18.391165 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 56856.8us
I20260709 12:27:18.393354 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 34 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:18.394025 18846 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:27:18.394258 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.396549 18839 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:18.371929 28536 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.402110 19487 raft_consensus.cc:2393] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 25: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:18.369740 28369 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
W20260709 12:27:18.406649 18886 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.393330 28547 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.387880 28511 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:18.410702 18738 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:18.376283 28636 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:18.415867 28369 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.416939 18846 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 34.
I20260709 12:27:18.419929 28346 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:18.408242 28547 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.452965 18738 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:18.458315 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 139211us
I20260709 12:27:18.459487 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:18.449337 28546 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:27:18.485316 19456 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 155 similar messages]
I20260709 12:27:18.409258 28536 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.482615 28346 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:18.487874 28546 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.489971 28511 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 34 FOLLOWER]: Leader election won for term 34
W20260709 12:27:18.511961 17568 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 18798)
I20260709 12:27:18.524027 28546 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:18.545131 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:18.549166 18920 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30.
I20260709 12:27:18.546334 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 34 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:18.547369 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:18.552778 18920 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:27:18.554059 28519 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:18.554710 28519 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.558240 18917 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:27:18.563531 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:18.564538 18921 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 27.
I20260709 12:27:18.567410 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 34 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:18.569279 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:18.570118 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:18.538723 28511 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 34 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:18.575979 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:18.496752 28636 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.575654 28626 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.586089 28669 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:18.587826 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:18.604195 19491 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Advancing to term 32
I20260709 12:27:18.590119 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:18.530951 28552 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.595733 18915 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:27:18.583428 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:18.611045 28552 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:18.618780 28547 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:18.596735 28667 log.cc:927] Time spent T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:27:18.628338 28595 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:27:18.629021 18914 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:27:18.653484 18737 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:18.639288 18739 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:18.658573 19491 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 32.
I20260709 12:27:18.672902 28594 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:18.676819 28669 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:18.620378 28626 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.685269 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:18.668367 28595 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:18.709023 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:18.710032 18914 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:27:18.689323 28617 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:18.717432 18915 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:18.694705 28553 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:27:18.689116 28552 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:27:18.706274 28536 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:18.667976 28511 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 32.16, Last appended by leader: 16, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:18.728046 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 71121.5us
I20260709 12:27:18.745946 19488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:18.746691 19488 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:27:18.771970 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:18.772763 18915 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:27:18.786918 18739 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:18.785322 18737 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:18.773875 28594 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.797111 18914 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 32.
I20260709 12:27:18.813102 18739 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:18.797600 28634 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:18.815677 28634 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.816062 28634 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:18.794013 28595 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:27:18.837635 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 514202us
I20260709 12:27:18.853389 28511 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Leader election won for term 32
W20260709 12:27:18.867262 18812 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.867841 18812 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:18.841609 28595 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.883414 18915 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:27:18.818292 28594 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:18.897792 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.898701 18839 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
I20260709 12:27:18.889956 28382 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:18.890108 28595 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:18.891719 28511 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:18.913962 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.905447 28626 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:18.894233 28213 consensus_queue.cc:1048] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:27:18.908603 28690 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.022s
I20260709 12:27:18.934413 28594 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:18.936286 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:18.941789 18666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47848 (request call id 295) took 14805 ms (client timeout 15000 ms). Trace:
I20260709 12:27:18.946718 28511 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:18.951781 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:18.952620 18844 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:27:18.955029 18842 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 33. Current term is 34. Ops: [33.17-33.17]
W20260709 12:27:18.956169 28664 log.cc:927] Time spent T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.548s	user 0.005s	sys 0.000s
W20260709 12:27:18.942260 18666 rpcz_store.cc:269] 0709 12:27:04.135955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.686537 (+4550582us) service_pool.cc:224] Handling call
0709 12:27:18.941691 (+10255154us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:15.693640 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:15.717206 (+ 23566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:15.717260 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:27:15.717296 (+    36us) tablet.cc:662] Decoding operations
0709 12:27:16.098544 (+381248us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:16.098659 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:16.098696 (+    37us) tablet.cc:685] Acquiring locks for 34 operations
0709 12:27:16.101694 (+  2998us) tablet.cc:701] Row locks acquired
0709 12:27:16.101753 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:27:16.101978 (+   225us) write_op.cc:270] Start()
0709 12:27:16.102157 (+   179us) write_op.cc:276] Timestamp: P: 1783600036101887 usec, L: 0
0709 12:27:16.102194 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:27:16.108083 (+  5889us) log.cc:844] Serialized 13135 byte log entry
0709 12:27:16.650520 (+542437us) op_driver.cc:464] REPLICATION: finished
0709 12:27:16.779131 (+128611us) write_op.cc:301] APPLY: starting
0709 12:27:16.779239 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:17.448751 (+669512us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:17.448876 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:17.672636 (+223760us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b180034f1e0. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3360d66ab1 00007f3360d73281 00007f335acca0ec 00007f335ad16c0a 00007f335ad164f7 00007f335ad16490 00007f335accdf48 00007f335e9e21bb 00007f335ea295d4 00007f335e8d58da 00007f335e8d83cb
0709 12:27:17.703536 (+ 30900us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:17.704045 (+   509us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=0,mrs_lookups=0
0709 12:27:17.704115 (+    70us) write_op.cc:312] APPLY: finished
0709 12:27:17.704820 (+   705us) log.cc:844] Serialized 292 byte log entry
0709 12:27:17.836841 (+132021us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:17.881383 (+ 44542us) write_op.cc:454] Released schema lock
0709 12:27:17.891291 (+  9908us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:17.898445 (+  7154us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:17.898474 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":276711,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":128275,"apply.run_cpu_time_us":77176,"apply.run_wall_time_us":1119279,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146451,"num_ops":34,"prepare.queue_time_us":273983,"prepare.run_cpu_time_us":56962,"prepare.run_wall_time_us":690133,"raft.queue_time_us":121013,"raft.run_cpu_time_us":27998,"raft.run_wall_time_us":106335,"replication_time_us":548099,"spinlock_wait_cycles":12631296,"thread_start_us":568721,"threads_started":5,"wal-append.queue_time_us":427392,"wal-append.run_cpu_time_us":13004,"wal-append.run_wall_time_us":2253812}]]}
I20260709 12:27:18.962993 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:18.984442 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 91585.8us
I20260709 12:27:18.999486 18847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.000553 18847 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:27:19.009219 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.011327 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:19.010030 18843 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
I20260709 12:27:18.924124 28546 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.017575 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:19.018303 18843 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:27:19.018671 18841 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:27:19.023280 18840 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:27:19.005138 28679 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.056764 18739 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:19.006954 28545 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.027606 28594 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:19.066249 28679 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.096618 28519 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:19.067651 28608 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:19.098063 28679 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.098414 28608 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.100796 28608 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:19.089825 28546 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.087391 28545 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:19.106253 28665 log.cc:927] Time spent T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:27:19.114952 28515 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.116953 28515 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.113543 18841 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 32.
W20260709 12:27:19.138881 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 107297us
I20260709 12:27:19.141419 28695 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:19.139943 28536 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.179452 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:19.175675 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.175781 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:19.183163 18919 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:19.183566 18844 raft_consensus.cc:2393] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 29: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:19.180931 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:19.184758 18914 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:19.112355 28594 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.142860 28545 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:19.202368 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114104us
W20260709 12:27:19.203504 19456 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.250532 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
W20260709 12:27:19.244637 28697 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:27:19.253319 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.254050 18843 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:27:19.250737 18842 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:27:19.241881 28571 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:19.187906 28636 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260709 12:27:19.265848 18919 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:19.245381 28696 raft_consensus.cc:493] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.192941 28536 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.194665 28634 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.269646 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:19.237643 28695 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:27:19.300256 28681 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:19.301014 28681 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.303756 28681 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:19.304853 28698 log.cc:927] Time spent T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:27:19.306932 28382 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:19.307739 18844 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:19.279000 28696 raft_consensus.cc:515] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.393550 28696 leader_election.cc:290] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:19.394063 28678 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:27:19.395076 28594 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.396526 28515 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:19.399973 28536 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.401520 17568 tablet_replica.cc:333] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:19.402761 28634 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:19.412883 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:19.398034 28595 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.421413 28595 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.422264 17568 raft_consensus.cc:2243] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.449855 18844 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 28.
I20260709 12:27:19.528784 28382 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:19.529544 28382 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.531859 28382 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:19.563705 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.568439 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:19.569201 18846 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:27:19.555856 28382 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:19.565310 18739 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:19.572781 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.570079 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:19.574381 18840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.574869 19491 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:27:19.570173 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 390364us
I20260709 12:27:19.560932 28595 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:19.583727 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:19.569586 28617 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.584750 18848 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:19.594890 19491 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:19.572460 28546 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:19.584810 28595 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.575070 28382 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.584437 28652 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.016s
I20260709 12:27:19.596764 28617 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.602363 28382 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.602608 28546 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.609444 28617 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.599797 28595 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.620090 18846 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 26.
I20260709 12:27:19.606768 28634 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:19.645713 18848 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
I20260709 12:27:19.651484 28608 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:19.652169 28608 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.655695 28546 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:19.655903 28608 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:19.657162 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:19.658511 18737 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba; no voters: 
I20260709 12:27:19.633301 28634 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.662946 28608 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.665499 28608 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:19.671030 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 92464.9us
I20260709 12:27:19.671089 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:19.670579 28608 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:19.663439 28634 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:19.664150 28617 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:27:19.679256 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 101734us
W20260709 12:27:19.679893 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 114654us
I20260709 12:27:19.680568 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:19.680718 18739 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:19.686712 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:19.687708 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:27:19.688988 18812 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.689570 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:19.690970 28710 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:19.693648 28691 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.628s	user 0.013s	sys 0.010s
I20260709 12:27:19.698009 17568 raft_consensus.cc:2272] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.707890 28717 raft_consensus.cc:2764] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:27:19.677412 28681 consensus_queue.cc:1059] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 32.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:27:19.721606 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.701575 28537 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.022s
I20260709 12:27:19.722434 18848 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:19.684044 28617 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:19.686093 28607 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:19.715791 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.703229 28595 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:19.720031 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:19.727880 28595 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:19.730894 28595 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.726346 28716 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:27:19.736042 19456 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.742424 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.743976 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:19.730871 28707 log.cc:927] Time spent T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:27:19.752450 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:19.755368 28595 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:19.757607 28681 raft_consensus.cc:3055] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:27:19.750708 28695 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:19.770650 28536 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.778555 28536 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.781291 28536 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.736104 28716 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.762841 28715 raft_consensus.cc:493] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:19.764497 28681 raft_consensus.cc:740] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:19.788504 17568 tablet_replica.cc:333] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
W20260709 12:27:19.796805 28689 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.736s	user 0.014s	sys 0.017s
I20260709 12:27:19.770418 28546 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:27:19.814445 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 122270us
I20260709 12:27:19.815403 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:19.823915 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:19.786307 28716 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.831921 28679 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:27:19.860199 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 101067us
I20260709 12:27:19.767609 28595 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.770987 28617 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.799363 28695 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.862696 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:19.828675 28546 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.809217 28715 raft_consensus.cc:515] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:19.869849 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:27:19.879777 28724 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:27:19.906590 18738 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:19.917434 17568 raft_consensus.cc:2243] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.911650 28677 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:19.888247 28722 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:27:19.914197 18738 raft_consensus.cc:2686] T a24ba3693ff3438f831ba2ec6a724700 P 1e2529a8cff04207bb1b07c108e16983: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:19.880697 28695 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:19.931186 28634 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.863580 28681 consensus_queue.cc:260] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.17, Last appended by leader: 17, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.924134 28677 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.951483 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:19.964535 28546 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:19.923790 28722 raft_consensus.cc:493] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.969048 28677 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:19.989409 19483 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:27:19.982458 28571 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:19.989303 28722 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:19.993296 28571 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:19.995991 28571 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:20.004578 28681 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:27:20.008224 18886 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.009739 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:20.010219 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:20.022337 28546 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:27:20.030007 28715 leader_election.cc:290] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:20.031025 28634 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:20.031975 17568 pending_rounds.cc:70] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:20.032332 17568 pending_rounds.cc:77] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 26 index: 18 } timestamp: 7305625720901885952 op_type: NO_OP noop_request { }
I20260709 12:27:20.032714 17568 raft_consensus.cc:2889] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:20.033128 17568 raft_consensus.cc:2272] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:20.033389 28734 log.cc:927] Time spent T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 12:27:20.041653 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd3ef9790a461facce64f14c3a5fce" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.043246 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.043397 28677 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:20.044757 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.055474 18845 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 32 index: 16. Preceding OpId from leader: term: 34 index: 17. (index mismatch)
I20260709 12:27:20.055461 18840 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 12:27:20.056545 18841 raft_consensus.cc:1240] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Rejecting Update request from peer 674d77fe8bcb4c768537ebae4be828bd for earlier term 33. Current term is 34. Ops: [33.17-33.17]
I20260709 12:27:20.056493 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:20.056545 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.058183 18843 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 24.
W20260709 12:27:20.065227 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 144619us
W20260709 12:27:20.065552 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57375us
W20260709 12:27:20.066627 18886 leader_election.cc:336] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.066308 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.067847 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.067113 18886 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:20.069921 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:20.070708 18919 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:20.077530 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.086258 18919 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 25.
W20260709 12:27:20.094610 18886 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.097218 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:20.100821 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.104254 28677 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:20.108000 28595 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:20.119329 17568 tablet_replica.cc:333] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:20.120544 17568 raft_consensus.cc:2243] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.121666 17568 pending_rounds.cc:70] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:20.121953 17568 pending_rounds.cc:77] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 28 index: 17 } timestamp: 7305625762751631360 op_type: NO_OP noop_request { }
I20260709 12:27:20.093122 28736 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:20.098532 28669 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:20.130427 18918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c18545306c9477ba3e214f788705644" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.130956 18922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.131587 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.140134 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:20.140857 18843 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:20.141712 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.143661 18917 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 12:27:20.147027 18848 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
W20260709 12:27:20.154918 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60564.7us
I20260709 12:27:20.133400 28722 raft_consensus.cc:515] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:20.159017 28722 leader_election.cc:290] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:20.162113 18916 raft_consensus.cc:2393] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 25: Already voted for candidate 674d77fe8bcb4c768537ebae4be828bd in this term.
I20260709 12:27:20.163882 18917 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:27:20.165757 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f0997197c4e63b1861b420a26416f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.122334 17568 raft_consensus.cc:2889] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:20.167589 17568 raft_consensus.cc:2272] T d486b285b7724e2b928affadfca2a6ec P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.175149 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.176438 18919 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 33 index: 17. Preceding OpId from leader: term: 34 index: 17. (term mismatch)
I20260709 12:27:20.176883 18919 pending_rounds.cc:85] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting all ops after (but not including) 16
I20260709 12:27:20.177137 18919 pending_rounds.cc:107] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: Aborting uncommitted NO_OP operation due to leader change: 33.17
I20260709 12:27:20.177403 18919 raft_consensus.cc:2889] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:20.085850 28728 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:20.207120 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.210078 18843 raft_consensus.cc:2468] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
I20260709 12:27:20.217465 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.225685 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9134ec4fb92645b28a9b4814179c1c7c" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.226902 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:20.227659 18844 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:20.198082 28719 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:20.228715 18812 leader_election.cc:336] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.232218 18812 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:20.231904 28607 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.235976 28607 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:20.252797 28580 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:20.253422 18812 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.265267 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:20.266426 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847dd0f72f3f4a6c8834194b02858750" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.267874 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.215853 28553 raft_consensus.cc:493] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:20.286913 28553 raft_consensus.cc:515] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:20.292364 17568 tablet_replica.cc:333] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:20.327700 17568 raft_consensus.cc:2243] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:20.337117 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.339308 17568 raft_consensus.cc:2272] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.304417 18843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f46e9bd70474bbc330c12a42a76f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.315369 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89cba94afb054c008d05b4ea99edd513" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:20.320544 18739 leader_election.cc:304] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.343051 18842 raft_consensus.cc:3060] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:20.289527 28553 leader_election.cc:290] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:20.314081 18738 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:20.293294 18814 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:20.358264 18738 raft_consensus.cc:2686] T 89cba94afb054c008d05b4ea99edd513 P 1e2529a8cff04207bb1b07c108e16983: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:27:20.358887 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 44907.7us
W20260709 12:27:20.360020 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 66831.1us
W20260709 12:27:20.364538 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44099.8us
I20260709 12:27:20.376471 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.380528 18842 raft_consensus.cc:2468] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:20.390106 18887 leader_election.cc:304] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:20.311996 28607 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:20.404907 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 258995us
I20260709 12:27:20.407095 18844 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30.
I20260709 12:27:20.409837 18739 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.374572 28553 raft_consensus.cc:2749] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:20.314805 28715 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.085s
I20260709 12:27:20.376101 28653 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:20.420292 28595 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:20.427870 28546 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:20.439152 28728 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:20.428053 28547 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 12:27:20.455470 18920 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:20.455675 17568 tablet_replica.cc:333] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:20.391543 28634 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:27:20.407907 28608 raft_consensus.cc:2804] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:20.463088 17568 raft_consensus.cc:2243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.468878 28608 raft_consensus.cc:697] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:20.470227 28608 consensus_queue.cc:237] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:20.494622 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 261455us
I20260709 12:27:20.498903 18920 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30.
W20260709 12:27:20.505838 18886 leader_election.cc:336] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.507562 18886 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:20.508596 28542 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:20.509027 18886 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.512298 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:20.514756 17568 raft_consensus.cc:2272] T 84ea4e9cc4d9482b920ad086bf4b1305 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.523023 28634 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:20.523744 28634 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:20.526175 28634 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:20.496536 28550 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:20.539132 28550 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:20.541522 28550 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:20.497506 28617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.029s	sys 0.001s
I20260709 12:27:20.545339 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:20.545502 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 318772us
I20260709 12:27:20.546550 28634 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:20.572124 28634 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:20.545756 28617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.029s	sys 0.001s
W20260709 12:27:20.585767 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 75606.1us
I20260709 12:27:20.591378 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:20.609566 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:20.613684 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 208542us
W20260709 12:27:20.615623 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 188416us
I20260709 12:27:20.604403 28634 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:20.621570 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:20.623829 28580 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.624469 28580 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:20.632014 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8499bcaf8d4fd3b0236d65471d7006" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:20.633347 17568 tablet_replica.cc:333] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:20.630148 19457 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:20.641412 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:20.645018 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57643.6us
I20260709 12:27:20.670145 28580 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:20.672346 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:20.673117 18920 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:27:20.666419 17568 raft_consensus.cc:2243] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.676898 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:20.675937 18886 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:20.664664 28677 raft_consensus.cc:2804] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:20.711428 18738 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:20.712220 18738 raft_consensus.cc:2686] T b37f46e9bd70474bbc330c12a42a76f5 P 1e2529a8cff04207bb1b07c108e16983: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:20.713400 18738 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:20.714473 28617 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:27:20.714996 28617 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: Becoming Leader. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:20.716025 28617 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:20.723407 17568 raft_consensus.cc:2272] T 3bac759d8cf2478e874f15f02c6c54fb P 1e2529a8cff04207bb1b07c108e16983 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.727443 28677 raft_consensus.cc:697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:20.729080 17568 tablet_replica.cc:333] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:20.706233 18739 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.683243 28719 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.701836 28542 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:20.744812 18738 leader_election.cc:304] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:20.746099 28693 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:20.746348 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.752233 18739 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.760407 18843 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 1e2529a8cff04207bb1b07c108e16983: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:27:20.764703 18739 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.730242 28749 raft_consensus.cc:493] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:20.734020 28715 raft_consensus.cc:493] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
W20260709 12:27:20.782418 19456 leader_election.cc:336] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.762173 28546 raft_consensus.cc:2749] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:20.767890 28634 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:20.805290 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 76919.4us
I20260709 12:27:20.728629 28677 consensus_queue.cc:237] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:20.813149 18737 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:20.769889 28369 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:20.809203 28715 raft_consensus.cc:515] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:20.746626 28719 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:20.779968 28748 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
I20260709 12:27:20.853528 17568 raft_consensus.cc:2243] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: Raft consensus shutting down.
W20260709 12:27:20.857447 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 91596us
I20260709 12:27:20.835781 28634 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:20.901935 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 49499.6us
I20260709 12:27:20.815421 28703 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
W20260709 12:27:20.912084 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 147451us
W20260709 12:27:20.912118 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 53894.6us
I20260709 12:27:20.918634 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:20.806912 28749 raft_consensus.cc:515] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:20.884943 28757 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:27:20.962570 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 47703.7us
I20260709 12:27:20.924497 28369 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
I20260709 12:27:20.957304 28580 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:20.957132 28765 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 12:27:20.925407 28617 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.001600 28719 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:21.005182 28760 log.cc:927] Time spent T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:27:21.008844 18668 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 271) took 107376 ms (client timeout 15000 ms). Trace:
W20260709 12:27:21.009399 18668 rpcz_store.cc:269] 0709 12:25:33.632146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.632510 (+   364us) service_pool.cc:224] Handling call
0709 12:25:34.159563 (+527053us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5400030890. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e670b2 00007f3360de0759 00007f3360d78a76 00007f3360d49d58 00007f3360e4804e 00007f335f3092a4 00007f335f309232 00007f335f309161 00007f335f3090dc
0709 12:27:21.008601 (+106849038us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6,"reported_tablets":49,"spinlock_wait_cycles":74749184}
I20260709 12:27:21.012677 28715 leader_election.cc:290] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:21.019348 28759 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:21.021426 28580 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:21.022138 28580 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:21.037405 17568 pending_rounds.cc:70] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:21.037979 17568 pending_rounds.cc:77] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 30 index: 15 } timestamp: 7305625766865641472 op_type: NO_OP noop_request { }
I20260709 12:27:21.038580 17568 raft_consensus.cc:2889] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 30 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:21.039109 17568 raft_consensus.cc:2272] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:21.047149 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 128612us
I20260709 12:27:21.048293 18739 leader_election.cc:304] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:21.056627 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 127944us
W20260709 12:27:21.062558 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 152544us
I20260709 12:27:21.055531 28547 raft_consensus.cc:2749] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:21.066591 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 142185us
I20260709 12:27:21.073069 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:21.073387 18739 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:21.087270 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:21.092352 18886 leader_election.cc:336] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:21.093588 18886 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:21.093778 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:21.094673 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:21.046505 28617 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:21.103511 28749 leader_election.cc:290] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:21.080878 28681 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.107445 28681 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:21.109956 28681 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:21.101503 28546 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:21.118223 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9168ac06d4b4b11ac8272d328166702" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:21.120358 18812 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.122476 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:21.123840 18812 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:21.138685 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 171016us
I20260709 12:27:21.138849 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbadce60e960476289740ec2afd0a5c8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:21.148327 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd048e748d347889eab552ac02ed00f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:21.131363 28753 raft_consensus.cc:2749] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:21.166018 28768 raft_consensus.cc:493] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:21.186030 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 59183.9us
I20260709 12:27:21.191942 17568 tablet_replica.cc:333] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:21.198422 17568 raft_consensus.cc:2243] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Raft consensus shutting down.
W20260709 12:27:21.234927 18656 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet bbadce60e960476289740ec2afd0a5c8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 14
I20260709 12:27:21.200284 28715 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.178704 28768 raft_consensus.cc:515] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:21.255131 17568 raft_consensus.cc:2272] T af66e45540ac4e07bf6fb0db4f2779d7 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:21.285614 28580 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:21.287058 18844 raft_consensus.cc:1240] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Rejecting Update request from peer 1e2529a8cff04207bb1b07c108e16983 for earlier term 28. Current term is 29. Ops: []
I20260709 12:27:21.290781 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:21.293102 28580 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:21.255970 28715 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:21.309067 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:21.296368 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 193098us
I20260709 12:27:21.322638 17568 tablet_replica.cc:333] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:21.326723 28715 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:21.329778 17568 raft_consensus.cc:2243] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:27:21.335021 18739 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:21.343572 28759 raft_consensus.cc:493] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.344264 28759 raft_consensus.cc:515] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:21.346933 28759 leader_election.cc:290] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:21.348846 28765 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:21.357227 28768 leader_election.cc:290] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:21.359910 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:21.362239 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:21.370225 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57893.9us
W20260709 12:27:21.390266 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 198312us
W20260709 12:27:21.370308 28756 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:27:21.400636 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 182455us
W20260709 12:27:21.411602 18737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 216658us
I20260709 12:27:21.415719 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a38dabcd47249aebb1f53168be39bbc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:21.418220 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d69daa256f430796196f10dfcaad2f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:21.395300 28681 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.420084 28681 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:21.431488 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 35 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:21.477054 18739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 45348.5us
I20260709 12:27:21.479691 18737 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:21.483423 18737 leader_election.cc:304] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:21.489171 18845 raft_consensus.cc:1275] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:27:21.492508 18737 leader_election.cc:304] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:21.510522 28757 raft_consensus.cc:2749] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:21.485359 28595 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:21.492036 28779 raft_consensus.cc:2749] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:21.579517 18738 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:21.579907 18812 leader_election.cc:336] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.584379 17568 raft_consensus.cc:2272] T bea8b759be0c4fc6a36e2b34c6d643ae P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:21.644536 18812 leader_election.cc:304] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:21.645448 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 66614.3us
I20260709 12:27:21.660979 28779 consensus_queue.cc:1059] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:21.662711 28369 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:27:21.663283 28369 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 1e2529a8cff04207bb1b07c108e16983, State: Running, Role: LEADER
I20260709 12:27:21.664280 28369 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:21.666884 28617 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:21.671478 28369 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:21.682341 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:21.684551 28703 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.685205 28703 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:21.688068 28703 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:21.583456 28759 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:27:21.694857 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114972us
W20260709 12:27:21.695664 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 122604us
W20260709 12:27:21.696785 18812 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:21.698246 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 271068us
I20260709 12:27:21.701979 28719 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:21.702618 28719 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:21.704444 28681 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:21.704883 28719 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:21.695785 28753 raft_consensus.cc:2749] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:21.699302 28759 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:21.712203 28759 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:21.717262 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:21.648155 28768 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:21.742825 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44905.3us
I20260709 12:27:21.755582 28729 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:21.756294 28729 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:21.759167 28729 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:21.759951 17568 tablet_replica.cc:333] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:21.760959 17568 raft_consensus.cc:2243] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:21.761528 17568 pending_rounds.cc:70] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:21.761788 17568 pending_rounds.cc:77] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7305625732345118720 op_type: NO_OP noop_request { }
I20260709 12:27:21.762157 17568 raft_consensus.cc:2889] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 12:27:21.764876 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 255318us
I20260709 12:27:21.770954 17568 raft_consensus.cc:2272] T 5c18545306c9477ba3e214f788705644 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:21.773561 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:21.775385 18739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:21.775544 18812 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.774302 18913 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:27:21.776868 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:21.778857 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b6876202964e0eae9e454d22ceab60" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:21.779106 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:21.772250 18886 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.779958 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:21.780493 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9317d76b36ff4814b60c58870accf4ec" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:21.778358 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:21.790643 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 35 candidate_status { last_received { term: 34 index: 24 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:21.792299 28717 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:21.792773 28717 raft_consensus.cc:493] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:21.793159 28717 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:21.789312 28744 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:27:21.780972 28773 consensus_queue.cc:1048] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:27:21.807405 28754 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:27:21.809234 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:21.813869 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:21.815356 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:21.830331 28789 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:21.831015 28789 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:21.832870 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccd682aee974b58818f7327974e2aa0" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:21.833657 28789 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:21.844189 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60880728ad4cb19bd4cb835996961f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:21.850031 17568 tablet_replica.cc:333] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:21.852209 28717 raft_consensus.cc:515] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:21.862226 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:21.879925 18738 leader_election.cc:304] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:21.885290 17568 raft_consensus.cc:2243] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:21.886059 18738 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:21.887975 28768 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:21.888010 17568 raft_consensus.cc:2272] T c1dd3ef9790a461facce64f14c3a5fce P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:21.890902 28785 raft_consensus.cc:2749] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:21.894188 28717 leader_election.cc:290] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:21.895612 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ea4e9cc4d9482b920ad086bf4b1305" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:21.896353 18913 raft_consensus.cc:3060] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:27:21.902050 18886 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.902709 18886 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:21.903630 28789 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:27:21.904381 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:21.906047 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:21.908767 18913 raft_consensus.cc:2468] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 28.
W20260709 12:27:21.911849 18886 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:21.931759 18886 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.932216 18886 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:21.933605 28789 raft_consensus.cc:2749] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:27:21.883962 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 96590.9us
W20260709 12:27:21.935004 18669 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 269) took 159760 ms (client timeout 15000 ms). Trace:
W20260709 12:27:21.935487 18669 rpcz_store.cc:269] 0709 12:24:42.265142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.294589 (+ 29447us) service_pool.cc:224] Handling call
0709 12:27:21.934769 (+159640180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1898046,"reported_tablets":49,"spinlock_wait_cycles":1063296}
I20260709 12:27:21.921553 17568 tablet_replica.cc:333] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:21.937366 17568 raft_consensus.cc:2243] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 23 LEADER]: Raft consensus shutting down.
W20260709 12:27:21.938082 19456 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.930591 18739 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:21.942582 28768 raft_consensus.cc:493] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:21.944056 28369 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:21.944029 28768 raft_consensus.cc:515] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:21.943568 17568 raft_consensus.cc:2272] T ace8753143e94362a855362c6b9f55e9 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:21.946507 28768 leader_election.cc:290] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:21.947640 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:21.949513 18886 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.953490 17568 tablet_replica.cc:333] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:21.956411 18739 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:21.957302 28768 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:21.966594 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:21.967290 19456 leader_election.cc:336] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.971112 19458 leader_election.cc:304] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:21.971679 17568 raft_consensus.cc:2243] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:27:21.972045 28677 raft_consensus.cc:2804] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:21.970197 18841 raft_consensus.cc:1275] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:27:21.976225 28677 raft_consensus.cc:697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:21.977695 28677 consensus_queue.cc:237] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:21.982470 17568 raft_consensus.cc:2272] T 8b5f0fdf96074deb816d2d3b27fe7143 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:21.993286 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:21.965018 18670 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 15 to 16, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 16 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:21.993948 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:21.994911 18670 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:21.995105 18841 raft_consensus.cc:2410] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd for term 29 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:27:21.985870 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fd9926cbc04b9b9436afef7b0d1f6f" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:22.004487 28369 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:22.005358 28369 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.009214 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:22.010877 28695 raft_consensus.cc:493] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.008298 28369 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:22.011523 28695 raft_consensus.cc:515] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:22.015709 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:22.016215 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987becbef0a24ee6a5e0c3eb9a3384cc" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:21.999368 18670 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 20 to 23, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 23 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:22.016633 18845 raft_consensus.cc:2393] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2529a8cff04207bb1b07c108e16983 in current term 28: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:22.018431 18738 leader_election.cc:304] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:22.018756 28695 leader_election.cc:290] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:22.019976 28695 raft_consensus.cc:3060] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:22.029683 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:22.030526 18841 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
I20260709 12:27:22.039477 17568 tablet_replica.cc:333] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.040731 17568 raft_consensus.cc:2243] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.041924 17568 raft_consensus.cc:2272] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 1e2529a8cff04207bb1b07c108e16983 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.042263 28737 consensus_queue.cc:1048] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:27:22.046448 18887 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:22.047902 28789 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:22.053238 28695 raft_consensus.cc:2749] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:22.054929 18739 leader_election.cc:304] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:22.056313 28369 raft_consensus.cc:2749] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:22.058183 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94efc7ae4146469f94df524ec5b89c77" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:22.068076 17568 tablet_replica.cc:333] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.069193 17568 raft_consensus.cc:2243] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.070848 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:22.071942 28542 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:22.072407 28542 raft_consensus.cc:493] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:22.072814 28542 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:22.079216 18739 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:22.079619 18886 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.084214 28542 raft_consensus.cc:515] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:22.085777 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.088917 28781 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:22.102619 17568 raft_consensus.cc:2272] T bf32cd3655eb4943abc0cdbf54a32206 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:22.119190 18886 leader_election.cc:336] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:22.125734 28542 leader_election.cc:290] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:22.127475 17568 tablet_replica.cc:333] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.133682 17568 raft_consensus.cc:2243] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.134667 17568 raft_consensus.cc:2272] T 0d8499bcaf8d4fd3b0236d65471d7006 P 1e2529a8cff04207bb1b07c108e16983 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.138716 17568 tablet_replica.cc:333] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.145404 17568 raft_consensus.cc:2243] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.146692 17568 raft_consensus.cc:2272] T 77b6876202964e0eae9e454d22ceab60 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.149714 17568 tablet_replica.cc:333] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.150571 17568 raft_consensus.cc:2243] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.151687 17568 raft_consensus.cc:2272] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.154716 28723 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:22.155349 28723 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:22.160615 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 35 candidate_status { last_received { term: 34 index: 24 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:22.161320 18920 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 34.
I20260709 12:27:22.163698 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:22.164631 28677 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:27:22.165050 28677 raft_consensus.cc:493] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:22.165421 28677 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:27:22.173182 19456 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:22.176342 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af66e45540ac4e07bf6fb0db4f2779d7" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:22.177173 18841 raft_consensus.cc:3060] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:22.170500 28723 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:22.188386 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:22.223790 18812 consensus_peers.cc:597] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.224148 28677 raft_consensus.cc:515] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:22.247838 18841 raft_consensus.cc:2468] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 30.
I20260709 12:27:22.250435 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bac759d8cf2478e874f15f02c6c54fb" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 35 candidate_status { last_received { term: 34 index: 24 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:22.263549 18920 raft_consensus.cc:3060] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:27:22.252770 28653 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:22.253708 28801 log.cc:927] Time spent T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:27:22.254179 19456 leader_election.cc:336] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:22.265476 28653 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.269059 28653 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:22.270876 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:22.271615 18913 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
I20260709 12:27:22.272826 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:22.261804 17568 tablet_replica.cc:333] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.262705 28677 leader_election.cc:290] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:22.274284 28653 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:22.274780 28653 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.275159 28653 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:22.277213 17568 raft_consensus.cc:2243] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.278431 17568 raft_consensus.cc:2272] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.281358 17568 tablet_replica.cc:333] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.282150 17568 raft_consensus.cc:2243] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.286947 18887 leader_election.cc:304] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:22.297585 17568 pending_rounds.cc:70] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:22.297927 17568 pending_rounds.cc:77] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 24 index: 15 } timestamp: 7305625727463616512 op_type: NO_OP noop_request { }
I20260709 12:27:22.301079 17568 raft_consensus.cc:2889] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:22.301523 17568 raft_consensus.cc:2272] T cf1f0997197c4e63b1861b420a26416f P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.300110 28789 raft_consensus.cc:2804] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:27:22.310607 28789 raft_consensus.cc:697] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 30 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:22.315449 18920 raft_consensus.cc:2468] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 35.
I20260709 12:27:22.318032 18671 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 17 to 18, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 18 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:22.320683 18812 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:22.326110 19458 leader_election.cc:304] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:22.330090 28769 raft_consensus.cc:2804] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 35 FOLLOWER]: Leader election won for term 35
W20260709 12:27:22.324167 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.330794 28769 raft_consensus.cc:697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 35 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:22.331923 28769 consensus_queue.cc:237] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 34.24, Last appended by leader: 24, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:22.333087 18670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 273) took 61514 ms (client timeout 15000 ms). Trace:
I20260709 12:27:22.334815 28789 consensus_queue.cc:237] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:22.334235 18670 rpcz_store.cc:269] 0709 12:26:20.818228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.138461 (+7320233us) service_pool.cc:224] Handling call
0709 12:27:22.333004 (+54194543us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:22.063824 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:22.064453 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:22.064495 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:27:22.064518 (+    23us) tablet.cc:662] Decoding operations
0709 12:27:22.065072 (+   554us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:22.065174 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:22.065200 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:27:22.065544 (+   344us) tablet.cc:701] Row locks acquired
0709 12:27:22.065566 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:27:22.065723 (+   157us) write_op.cc:270] Start()
0709 12:27:22.065840 (+   117us) write_op.cc:276] Timestamp: P: 1783600042065668 usec, L: 0
0709 12:27:22.065876 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:27:22.083577 (+ 17701us) log.cc:844] Serialized 1294 byte log entry
0709 12:27:22.185544 (+101967us) op_driver.cc:464] REPLICATION: finished
0709 12:27:22.248015 (+ 62471us) write_op.cc:301] APPLY: starting
0709 12:27:22.248109 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:22.250240 (+  2131us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:22.250355 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:22.268649 (+ 18294us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:22.268878 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:27:22.268927 (+    49us) write_op.cc:312] APPLY: finished
0709 12:27:22.269155 (+   228us) log.cc:844] Serialized 41 byte log entry
0709 12:27:22.269344 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.269445 (+   101us) write_op.cc:454] Released schema lock
0709 12:27:22.269487 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:22.293146 (+ 23659us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.293180 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":62174,"apply.run_cpu_time_us":5749,"apply.run_wall_time_us":21897,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":18688,"prepare.run_cpu_time_us":51237,"prepare.run_wall_time_us":94932,"raft.queue_time_us":40435,"raft.run_cpu_time_us":59442,"raft.run_wall_time_us":77240,"replication_time_us":119489,"thread_start_us":178501,"threads_started":4,"wal-append.queue_time_us":59187}]]}
I20260709 12:27:22.347348 28754 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.347921 28754 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.350131 28754 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:22.359323 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.360181 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:22.360879 18920 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:22.361992 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:22.362908 28754 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:27:22.363320 28754 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.363682 28754 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:27:22.378412 18812 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:22.409111 18671 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 169) took 77577 ms (client timeout 15000 ms). Trace:
I20260709 12:27:22.428691 28653 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.432569 28542 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.433279 28542 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.435854 28542 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:22.436412 17568 tablet_replica.cc:333] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
W20260709 12:27:22.437052 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.437382 17568 raft_consensus.cc:2243] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.438055 17568 raft_consensus.cc:2272] T 987becbef0a24ee6a5e0c3eb9a3384cc P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:22.445292 18886 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:22.448287 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:22.449038 18841 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:22.454862 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:22.456218 28542 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:27:22.409587 18671 rpcz_store.cc:269] 0709 12:26:04.917363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.425995 (+6508632us) service_pool.cc:224] Handling call
0709 12:27:22.409021 (+70983026us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:22.334603 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:22.335264 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:22.335306 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:27:22.335321 (+    15us) tablet.cc:662] Decoding operations
0709 12:27:22.335696 (+   375us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:22.335756 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:22.335787 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:22.335973 (+   186us) tablet.cc:701] Row locks acquired
0709 12:27:22.335990 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:27:22.336133 (+   143us) write_op.cc:270] Start()
0709 12:27:22.336251 (+   118us) write_op.cc:276] Timestamp: P: 1783600042336089 usec, L: 0
0709 12:27:22.336280 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:27:22.336959 (+   679us) log.cc:844] Serialized 530 byte log entry
0709 12:27:22.339328 (+  2369us) op_driver.cc:464] REPLICATION: finished
0709 12:27:22.342772 (+  3444us) write_op.cc:301] APPLY: starting
0709 12:27:22.342968 (+   196us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:22.344244 (+  1276us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:22.344389 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:22.345283 (+   894us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:22.345472 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:27:22.345561 (+    89us) write_op.cc:312] APPLY: finished
0709 12:27:22.345853 (+   292us) log.cc:844] Serialized 25 byte log entry
0709 12:27:22.346129 (+   276us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.346264 (+   135us) write_op.cc:454] Released schema lock
0709 12:27:22.346340 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:22.374790 (+ 28450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.374846 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2040,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":2961,"apply.run_cpu_time_us":3970,"apply.run_wall_time_us":31966,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":410,"prepare.run_cpu_time_us":2598,"prepare.run_wall_time_us":2665,"replication_time_us":2883,"spinlock_wait_cycles":2944}]]}
I20260709 12:27:22.456703 28542 raft_consensus.cc:493] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.463050 28542 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:22.435168 28754 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:22.459901 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.469033 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bc6f2b3fb14454abe2ad1ae89ea6e5" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:22.469677 18920 raft_consensus.cc:3060] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:22.472927 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486b285b7724e2b928affadfca2a6ec" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:22.473594 18916 raft_consensus.cc:3060] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:22.479897 18920 raft_consensus.cc:2468] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 31.
I20260709 12:27:22.480465 28781 raft_consensus.cc:493] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:22.481127 28781 raft_consensus.cc:515] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:22.485129 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:22.487087 28781 leader_election.cc:290] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:22.488929 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084cf9f30114499b94cf93587f0788f5" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:22.490806 18739 leader_election.cc:304] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:22.492156 28781 raft_consensus.cc:2749] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:22.495946 18916 raft_consensus.cc:2468] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:27:22.473594 18665 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 21 to 24, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 24 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.504520 28653 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:22.462455 17568 tablet_replica.cc:333] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.506138 18665 catalog_manager.cc:5697] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:22.509963 28754 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:22.511622 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.508554 17568 raft_consensus.cc:2243] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.511642 18665 catalog_manager.cc:5697] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:22.517473 18665 catalog_manager.cc:5697] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:22.518646 28542 raft_consensus.cc:515] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.519814 18665 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 24 to 25, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 25 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.514964 17568 raft_consensus.cc:2272] T e8038db5456b47f5af9508f8dcb3883b P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:22.527302 18886 leader_election.cc:336] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:22.539113 17568 tablet_replica.cc:333] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.527851 18814 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:22.540051 17568 raft_consensus.cc:2243] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.540580 28747 raft_consensus.cc:2804] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:27:22.541172 28747 raft_consensus.cc:697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:22.542137 28747 consensus_queue.cc:237] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.543645 18665 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:22.546113 18814 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:22.552009 28754 raft_consensus.cc:2804] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:27:22.552620 28754 raft_consensus.cc:697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:22.555728 28754 consensus_queue.cc:237] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.521245 28542 leader_election.cc:290] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:22.559324 18916 raft_consensus.cc:1275] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:27:22.561012 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ba3693ff3438f831ba2ec6a724700" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:22.561683 18844 raft_consensus.cc:3060] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:22.540686 17568 raft_consensus.cc:2272] T 0ccd682aee974b58818f7327974e2aa0 P 1e2529a8cff04207bb1b07c108e16983 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.562431 28769 consensus_queue.cc:1048] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.002s
I20260709 12:27:22.567684 28781 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:22.568406 28781 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.571380 17568 tablet_replica.cc:333] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
W20260709 12:27:22.563354 18812 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:22.572399 17568 raft_consensus.cc:2243] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:22.572911 18812 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:22.573868 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:22.574105 18812 consensus_peers.cc:597] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.577806 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:22.578527 28781 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:22.579770 18739 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:22.581171 28781 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:22.577819 18812 consensus_peers.cc:597] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.585964 18844 raft_consensus.cc:2468] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 26.
I20260709 12:27:22.587868 28781 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:22.588634 28781 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:22.590445 18887 leader_election.cc:304] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:22.573050 17568 raft_consensus.cc:2272] T 5a38dabcd47249aebb1f53168be39bbc P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.598606 28789 raft_consensus.cc:2804] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:27:22.610710 28789 raft_consensus.cc:697] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:22.611816 28789 consensus_queue.cc:237] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.600226 28781 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:22.601481 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:22.602288 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c5143fb3041fbbbae7d5f3d73f3c4" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:22.618755 18738 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:22.619714 28781 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:22.637475 17568 tablet_replica.cc:333] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.638607 17568 raft_consensus.cc:2243] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 26 LEADER]: Raft consensus shutting down.
W20260709 12:27:22.644480 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.668753 18663 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:22.671732 18663 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 19 to 22, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 22 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:22.675089 17568 raft_consensus.cc:2272] T 0adcb82468fe454b951282d52761a6c3 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.683851 17568 tablet_replica.cc:333] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.684808 17568 raft_consensus.cc:2243] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.685674 17568 raft_consensus.cc:2272] T e9168ac06d4b4b11ac8272d328166702 P 1e2529a8cff04207bb1b07c108e16983 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:22.692173 18665 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 275) took 19024 ms (client timeout 15000 ms). Trace:
I20260709 12:27:22.688798 18663 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:22.695801 18812 consensus_peers.cc:597] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:22.696615 18665 rpcz_store.cc:269] 0709 12:27:03.668116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.668549 (+   433us) service_pool.cc:224] Handling call
0709 12:27:22.692058 (+19023509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:22.554895 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:22.555517 (+   622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:22.555588 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:27:22.555606 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:22.556519 (+   913us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:22.556591 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:22.556629 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:27:22.557323 (+   694us) tablet.cc:701] Row locks acquired
0709 12:27:22.557343 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:27:22.557513 (+   170us) write_op.cc:270] Start()
0709 12:27:22.557653 (+   140us) write_op.cc:276] Timestamp: P: 1783600042557457 usec, L: 0
0709 12:27:22.557682 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:27:22.573607 (+ 15925us) log.cc:844] Serialized 2416 byte log entry
0709 12:27:22.578260 (+  4653us) op_driver.cc:464] REPLICATION: finished
0709 12:27:22.580836 (+  2576us) write_op.cc:301] APPLY: starting
0709 12:27:22.580935 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:22.585030 (+  4095us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:22.585155 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:22.606877 (+ 21722us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:22.607097 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:27:22.607151 (+    54us) write_op.cc:312] APPLY: finished
0709 12:27:22.607457 (+   306us) log.cc:844] Serialized 65 byte log entry
0709 12:27:22.608408 (+   951us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.608537 (+   129us) write_op.cc:454] Released schema lock
0709 12:27:22.608594 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:22.609014 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.609052 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":2300,"apply.run_cpu_time_us":10276,"apply.run_wall_time_us":28149,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25116,"num_ops":6,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":4142,"prepare.run_wall_time_us":23461,"replication_time_us":20402}]]}
W20260709 12:27:22.723670 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.734692 17568 tablet_replica.cc:333] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.738454 17568 raft_consensus.cc:2243] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.743568 17568 raft_consensus.cc:2272] T 34d2d90d352e40cb8b6cde778d729c24 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:22.745589 18812 consensus_peers.cc:597] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.751420 18844 raft_consensus.cc:1275] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
W20260709 12:27:22.752065 18663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 171) took 41883 ms (client timeout 15000 ms). Trace:
W20260709 12:27:22.754829 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:22.752559 18663 rpcz_store.cc:269] 0709 12:26:40.868997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.803800 (+5934803us) service_pool.cc:224] Handling call
0709 12:27:22.751992 (+35948192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:22.718244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:22.718991 (+   747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:22.719026 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:27:22.719044 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:22.719595 (+   551us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:22.719661 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:22.719696 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:27:22.720072 (+   376us) tablet.cc:701] Row locks acquired
0709 12:27:22.720093 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:27:22.720252 (+   159us) write_op.cc:270] Start()
0709 12:27:22.720383 (+   131us) write_op.cc:276] Timestamp: P: 1783600042720197 usec, L: 0
0709 12:27:22.720411 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:27:22.721221 (+   810us) log.cc:844] Serialized 1284 byte log entry
0709 12:27:22.723181 (+  1960us) op_driver.cc:464] REPLICATION: finished
0709 12:27:22.723659 (+   478us) write_op.cc:301] APPLY: starting
0709 12:27:22.723745 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:22.725636 (+  1891us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:22.725741 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:22.727626 (+  1885us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:22.727800 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:27:22.727843 (+    43us) write_op.cc:312] APPLY: finished
0709 12:27:22.728052 (+   209us) log.cc:844] Serialized 41 byte log entry
0709 12:27:22.733255 (+  5203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.733386 (+   131us) write_op.cc:454] Released schema lock
0709 12:27:22.733434 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:22.733825 (+   391us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.733855 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13069,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":243,"apply.run_cpu_time_us":5104,"apply.run_wall_time_us":10091,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":3331,"prepare.run_wall_time_us":4487,"replication_time_us":2615}]]}
I20260709 12:27:22.760370 28542 consensus_queue.cc:1048] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:27:22.794534 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.799301 18664 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 16 to 21, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 21 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:22.803855 17568 tablet_replica.cc:333] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.805338 17568 raft_consensus.cc:2243] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.817391 28781 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.818128 28781 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.821305 28781 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:22.823163 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:22.824219 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:22.827842 18839 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 29.
I20260709 12:27:22.830376 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:22.831471 28695 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:22.831940 28695 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.832345 28695 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:22.831808 18664 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 24 to 26, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 26 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:22.841564 18812 consensus_peers.cc:597] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.855383 28781 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.863296 28791 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:22.864094 28791 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.872467 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:22.873615 18839 raft_consensus.cc:2393] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 29: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:22.875818 28791 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:22.881771 28791 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:22.882771 28791 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.887967 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:22.856201 28781 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:22.902349 28781 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:22.903446 28791 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:22.905949 28695 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:22.910307 28695 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:22.806376 17568 raft_consensus.cc:2272] T bbadce60e960476289740ec2afd0a5c8 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.945993 17568 tablet_replica.cc:333] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.948590 17568 raft_consensus.cc:2243] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.949913 17568 raft_consensus.cc:2272] T 20fd9926cbc04b9b9436afef7b0d1f6f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.953756 17568 tablet_replica.cc:333] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.955968 17568 raft_consensus.cc:2243] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:27:22.959502 17568 raft_consensus.cc:2272] T 910a21b48434464ba8cc8f1f36ba2346 P 1e2529a8cff04207bb1b07c108e16983 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.834317 18664 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.963328 17568 tablet_replica.cc:333] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.965030 17568 raft_consensus.cc:2243] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.966298 17568 pending_rounds.cc:70] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:22.966814 17568 pending_rounds.cc:77] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 27 index: 19 } timestamp: 7305625725939363840 op_type: NO_OP noop_request { }
I20260709 12:27:22.967700 17568 raft_consensus.cc:2889] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:22.968379 17568 raft_consensus.cc:2272] T 9317d76b36ff4814b60c58870accf4ec P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.973145 17568 tablet_replica.cc:333] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.974823 17568 raft_consensus.cc:2243] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.976460 17568 raft_consensus.cc:2272] T a65d49b3134d46ba885c7513bd67571f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.981590 17568 tablet_replica.cc:333] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:22.983623 17568 raft_consensus.cc:2243] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.986142 17568 raft_consensus.cc:2272] T 084cf9f30114499b94cf93587f0788f5 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.990249 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:22.991636 18846 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:27:23.067629 18812 consensus_peers.cc:597] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:23.091156 18812 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:23.092095 18812 consensus_peers.cc:597] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:23.102442 28695 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:23.103760 28695 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:23.108966 28695 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:23.113605 18846 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30.
W20260709 12:27:23.116396 18738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 102568us
W20260709 12:27:23.117854 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 108406us
I20260709 12:27:23.123652 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:23.152240 17568 tablet_replica.cc:333] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:23.153702 17568 raft_consensus.cc:2243] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.158558 17568 raft_consensus.cc:2272] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:23.158627 18886 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:23.159363 18886 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:23.160564 28608 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:23.163194 17568 tablet_replica.cc:333] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
W20260709 12:27:23.166808 18886 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:23.167532 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:23.170549 28815 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:23.164494 17568 raft_consensus.cc:2243] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:27:23.179651 17568 raft_consensus.cc:2272] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 1e2529a8cff04207bb1b07c108e16983 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.191385 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:23.236363 18920 raft_consensus.cc:1275] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 35 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 34 index: 24. Preceding OpId from leader: term: 35 index: 25. (index mismatch)
W20260709 12:27:23.238516 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 157005us
I20260709 12:27:23.242420 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca478d842a8f406087ef2855fb0363a8" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.248803 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14b13acceee47439963d9c58e4b6d39" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.249994 18739 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:23.252066 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "1e2529a8cff04207bb1b07c108e16983" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:23.252367 28781 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:23.260877 18738 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f; no voters: 
W20260709 12:27:23.261813 18738 raft_consensus.cc:2686] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 1e2529a8cff04207bb1b07c108e16983: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:23.269841 28805 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.275631 18739 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2529a8cff04207bb1b07c108e16983; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:23.275871 28754 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.278703 28814 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.279685 28814 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:23.280551 28754 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.272408 28805 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.282517 28781 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:23.283427 28754 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.283631 28805 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.289156 17568 tablet_replica.cc:333] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:23.289505 28814 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:23.300037 17568 raft_consensus.cc:2243] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:23.301872 17568 raft_consensus.cc:2272] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.303737 18913 raft_consensus.cc:1275] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:27:23.278241 28608 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:23.272336 28817 consensus_queue.cc:1048] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.040s
I20260709 12:27:23.309072 18916 raft_consensus.cc:1275] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
I20260709 12:27:23.316828 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.328191 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.329759 18913 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:27:23.334457 28814 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.335371 28814 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.341890 28794 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.342222 28814 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.342873 28794 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:23.346726 28815 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.347532 28815 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.348605 28794 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.350622 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.358599 28580 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.359068 18846 raft_consensus.cc:1275] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:27:23.350149 28815 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:23.361577 18920 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:23.359601 28580 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.365454 28580 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.366099 28580 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.366890 28580 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.376691 18920 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2529a8cff04207bb1b07c108e16983 in term 30.
W20260709 12:27:23.402061 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:23.371594 28580 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.394726 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.372717 17568 tablet_replica.cc:333] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:23.374119 28805 consensus_queue.cc:1048] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 12:27:23.422446 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.422847 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.423327 18919 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 23.
I20260709 12:27:23.424117 28608 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.424280 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.424963 18917 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 25.
I20260709 12:27:23.424743 28608 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.391691 28754 consensus_queue.cc:1048] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:27:23.427037 28791 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.427788 28608 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:23.427757 28791 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.428339 17568 raft_consensus.cc:2243] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.428470 28608 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.429456 17568 raft_consensus.cc:2272] T d14b13acceee47439963d9c58e4b6d39 P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.429136 28608 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.427853 28754 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:23.435074 28754 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.431128 28791 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:23.435634 28754 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:23.443161 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.444412 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.444989 17568 tablet_replica.cc:333] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:23.440608 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.448004 28580 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:23.448513 28580 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.448926 28580 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:23.447419 18914 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 28.
W20260709 12:27:23.458590 18664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 172) took 20851 ms (client timeout 15000 ms). Trace:
I20260709 12:27:23.461057 28608 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:23.452127 28814 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:23.465590 28814 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.466141 28814 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:23.479228 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:23.480167 18845 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 24.
W20260709 12:27:23.487501 19456 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 189 similar messages]
W20260709 12:27:23.459158 18664 rpcz_store.cc:269] 0709 12:27:02.564657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.565759 (+  1102us) service_pool.cc:224] Handling call
0709 12:27:23.416193 (+20850434us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:23.014792 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:23.015702 (+   910us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:23.015770 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:27:23.015804 (+    34us) tablet.cc:662] Decoding operations
0709 12:27:23.030729 (+ 14925us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:23.030827 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:23.030862 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:27:23.031547 (+   685us) tablet.cc:701] Row locks acquired
0709 12:27:23.031600 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:27:23.031811 (+   211us) write_op.cc:270] Start()
0709 12:27:23.032037 (+   226us) write_op.cc:276] Timestamp: P: 1783600043031718 usec, L: 0
0709 12:27:23.032083 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:27:23.033317 (+  1234us) log.cc:844] Serialized 1284 byte log entry
0709 12:27:23.038760 (+  5443us) op_driver.cc:464] REPLICATION: finished
0709 12:27:23.039833 (+  1073us) write_op.cc:301] APPLY: starting
0709 12:27:23.039949 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:23.049300 (+  9351us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:23.049517 (+   217us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:23.056162 (+  6645us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:23.056614 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:27:23.056696 (+    82us) write_op.cc:312] APPLY: finished
0709 12:27:23.057125 (+   429us) log.cc:844] Serialized 41 byte log entry
0709 12:27:23.094568 (+ 37443us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:23.094700 (+   132us) write_op.cc:454] Released schema lock
0709 12:27:23.094767 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:23.095320 (+   553us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:23.095358 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13290,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":574,"apply.run_cpu_time_us":10045,"apply.run_wall_time_us":55478,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":44441,"prepare.run_cpu_time_us":5148,"prepare.run_wall_time_us":38337,"replication_time_us":6454}]]}
I20260709 12:27:23.496503 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.501223 17568 raft_consensus.cc:2243] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.502462 17568 pending_rounds.cc:70] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:23.502825 17568 pending_rounds.cc:77] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 28 index: 19 } timestamp: 7305625718544412672 op_type: NO_OP noop_request { }
I20260709 12:27:23.503271 17568 raft_consensus.cc:2889] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 12:27:23.504530 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:23.526453 17568 raft_consensus.cc:2272] T 38d69daa256f430796196f10dfcaad2f P 1e2529a8cff04207bb1b07c108e16983 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:23.524077 18886 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:23.527973 28653 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:23.530052 28653 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.530589 28653 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:23.532639 19491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:23.533439 19491 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
W20260709 12:27:23.553593 18886 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:23.547789 19456 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:23.560228 18886 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:23.566751 18886 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:23.563184 19456 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:23.579535 28717 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:23.583706 28814 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.585651 28791 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.586428 28791 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:23.587350 18914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:23.587955 18914 raft_consensus.cc:3060] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:23.593500 28754 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:23.594553 18886 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:23.596801 28814 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.597116 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea8b759be0c4fc6a36e2b34c6d643ae" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:23.597818 18916 raft_consensus.cc:3060] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:23.600497 17568 tablet_replica.cc:333] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:23.581954 28580 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.590265 28791 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:23.614012 18914 raft_consensus.cc:2468] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 24.
I20260709 12:27:23.604176 28754 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.611961 17568 raft_consensus.cc:2243] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.632366 18814 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.638445 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:23.639346 19483 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:23.641556 28580 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.651679 18916 raft_consensus.cc:2468] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:23.653275 18814 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.654770 28826 raft_consensus.cc:2804] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:27:23.655423 28826 raft_consensus.cc:697] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:23.656412 28653 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.656625 28826 consensus_queue.cc:237] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.658989 28653 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.659828 18916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:23.660974 18916 raft_consensus.cc:3060] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:27:23.718241 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 85127.9us
I20260709 12:27:23.723804 18916 raft_consensus.cc:2468] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 26.
W20260709 12:27:23.731737 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 96055.4us
W20260709 12:27:23.734901 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 165406us
I20260709 12:27:23.739049 18814 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.742548 17568 raft_consensus.cc:2272] T 9b54e62a509d44c3ae8c3e6c013db104 P 1e2529a8cff04207bb1b07c108e16983 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.744531 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:23.745321 18921 raft_consensus.cc:3060] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:23.719491 28815 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.753826 28747 raft_consensus.cc:2804] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:23.754861 28827 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.755748 28827 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:23.766180 28835 raft_consensus.cc:2804] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:27:23.766497 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:23.767035 28835 raft_consensus.cc:697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:23.768518 28835 consensus_queue.cc:237] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.770057 28653 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.770750 28747 raft_consensus.cc:697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:23.771054 28653 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.772625 28747 consensus_queue.cc:237] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.644263 18662 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 20 to 24, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 24 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.795794 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:23.796631 18917 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:27:23.774153 28653 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:23.808697 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.846846 18921 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 29.
I20260709 12:27:23.795047 28815 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:23.850809 18814 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:23.854657 18662 catalog_manager.cc:5697] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.813498 28827 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:23.857400 17568 tablet_replica.cc:333] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:23.858445 28744 consensus_queue.cc:1048] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.107s
I20260709 12:27:23.839835 28653 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:23.852219 28754 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.863305 28754 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:23.862432 28653 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
W20260709 12:27:23.894731 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44069.8us
I20260709 12:27:23.866231 28754 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:23.903939 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 162363us
I20260709 12:27:23.894423 28653 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:27:23.918265 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 85348.7us
W20260709 12:27:23.920646 18812 consensus_peers.cc:597] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:23.910712 17568 raft_consensus.cc:2243] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.923998 28830 raft_consensus.cc:2804] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:27:23.928930 17568 pending_rounds.cc:70] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:23.929368 17568 pending_rounds.cc:77] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 20 index: 11 } timestamp: 7305625723163652096 op_type: NO_OP noop_request { }
I20260709 12:27:23.929836 17568 raft_consensus.cc:2889] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:23.930341 17568 raft_consensus.cc:2272] T 5f60880728ad4cb19bd4cb835996961f P 1e2529a8cff04207bb1b07c108e16983 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.932528 28830 raft_consensus.cc:697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:23.933236 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e611ab2e6fe4fca8d3dd28957f1d17d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:23.935004 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace8753143e94362a855362c6b9f55e9" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:23.939810 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:23.939800 18848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:23.941378 18848 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:23.948355 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:23.933859 28830 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:23.953442 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 122804us
I20260709 12:27:23.964521 28815 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:23.973037 17568 tablet_replica.cc:333] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:23.974249 17568 raft_consensus.cc:2243] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.975615 17568 raft_consensus.cc:2272] T 2054e631aee84e6d9d5435f9031fec9e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.979315 28769 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:23.982278 28769 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:23.984817 28769 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:24.015080 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:24.017731 18886 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.020319 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:24.022262 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:24.024324 18887 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:24.025938 28747 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.026656 28747 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:24.028985 28747 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:24.025545 28791 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:24.033192 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:24.034811 28791 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:24.036150 28842 log.cc:927] Time spent T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
W20260709 12:27:24.036623 28848 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.003s
I20260709 12:27:24.039323 28653 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.037297 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:24.046492 18839 raft_consensus.cc:2393] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 30: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
W20260709 12:27:24.047849 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.056720 28608 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.057494 28608 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.047343 28791 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:24.060652 28838 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.101487 28653 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:24.103844 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92766f8c3c42b9aa8708c1d7d317c2" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:24.104535 18920 raft_consensus.cc:3060] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:27:24.115499 28849 log.cc:927] Time spent T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.153s	user 0.001s	sys 0.002s
I20260709 12:27:24.118057 28608 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:24.099553 28791 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.121886 28791 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:24.127776 28838 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:24.133719 28819 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.134663 28819 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:24.137991 28819 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:24.141492 28838 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:24.147447 28835 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.148528 28835 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.164254 28835 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:24.171665 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:24.172423 18839 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 32.
I20260709 12:27:24.174726 18920 raft_consensus.cc:2468] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:24.175752 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:24.177047 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:24.176726 18846 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 29.
I20260709 12:27:24.177701 18844 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 26.
I20260709 12:27:24.178970 18887 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:24.181241 18814 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:24.185156 28836 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:24.186007 18917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:24.186748 18917 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 32.
I20260709 12:27:24.191606 28791 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:24.194882 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:24.216250 28835 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:27:24.216763 28835 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.217206 28835 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:24.218346 28791 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:24.183910 28830 raft_consensus.cc:2804] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:27:24.208244 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:24.221936 19487 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 32.
I20260709 12:27:24.222170 28830 raft_consensus.cc:697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:24.219964 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:24.223671 28830 consensus_queue.cc:237] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.224521 28794 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:27:24.224992 28794 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.225422 28794 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:24.182757 17568 tablet_replica.cc:333] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:24.215795 18887 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:24.228741 19456 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.231077 19456 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.231115 28542 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:24.238502 17568 raft_consensus.cc:2243] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:24.241341 17568 raft_consensus.cc:2272] T 94efc7ae4146469f94df524ec5b89c77 P 1e2529a8cff04207bb1b07c108e16983 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:24.244890 17568 tablet_replica.cc:333] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:24.245755 17568 raft_consensus.cc:2243] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:24.246258 28794 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:24.251770 17568 pending_rounds.cc:70] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
W20260709 12:27:24.251969 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.252285 17568 pending_rounds.cc:77] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 22 index: 16 } timestamp: 7305625722042028032 op_type: NO_OP noop_request { }
I20260709 12:27:24.255029 17568 raft_consensus.cc:2889] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:24.259408 17568 raft_consensus.cc:2272] T 4cd048e748d347889eab552ac02ed00f P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:24.260509 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:24.261170 19487 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:24.260300 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:24.264609 28826 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:27:24.264827 28794 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:24.265141 28826 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.266491 28826 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:24.267061 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:24.267766 18846 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 24.
I20260709 12:27:24.270694 18846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
W20260709 12:27:24.274266 18886 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.275565 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:24.280283 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf32cd3655eb4943abc0cdbf54a32206" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:24.281030 18841 raft_consensus.cc:3060] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:24.290099 18917 raft_consensus.cc:1275] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:27:24.292212 17568 tablet_replica.cc:333] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:24.292445 28580 consensus_queue.cc:1048] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:27:24.293232 17568 raft_consensus.cc:2243] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:24.300956 19487 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:24.257992 28835 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.307516 18846 raft_consensus.cc:2393] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 674d77fe8bcb4c768537ebae4be828bd in current term 33: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:24.308822 28835 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:24.311372 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910a21b48434464ba8cc8f1f36ba2346" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:24.312345 18920 raft_consensus.cc:3060] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:27:24.316951 18841 raft_consensus.cc:2468] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:24.321120 18921 raft_consensus.cc:1275] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 12:27:24.331183 18886 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.333142 18914 raft_consensus.cc:1275] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:27:24.344275 17568 raft_consensus.cc:2272] T 1485e54f9795416785f4baf244599201 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:24.338763 28830 consensus_queue.cc:1048] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 12:27:24.331183 28580 consensus_queue.cc:1048] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
W20260709 12:27:24.362145 18812 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.361126 18920 raft_consensus.cc:2468] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 33.
I20260709 12:27:24.362759 18812 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:24.366323 18812 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.367924 18812 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.370002 18814 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:24.373454 28835 raft_consensus.cc:2749] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:24.389540 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:24.368641 18812 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:24.403630 28580 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:24.404549 18812 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.405611 18812 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.410784 18812 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.416559 17568 tablet_replica.cc:333] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:24.427640 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:24.417155 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:24.419728 28826 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:24.425343 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 60388.6us
I20260709 12:27:24.425451 28580 raft_consensus.cc:2804] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:27:24.432230 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
W20260709 12:27:24.427029 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:24.437059 18887 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:24.438856 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 65710.8us
I20260709 12:27:24.441046 18887 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:24.437804 17568 raft_consensus.cc:2243] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:24.435045 28836 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:24.438213 28832 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:24.451396 28791 raft_consensus.cc:2804] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:27:24.457217 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:24.441160 28580 raft_consensus.cc:697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 33 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:24.445622 28744 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:27:24.454813 28677 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:24.451964 28836 raft_consensus.cc:493] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.456552 28832 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.469465 28580 consensus_queue.cc:237] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.17, Last appended by leader: 17, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.472568 17568 pending_rounds.cc:70] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:24.472062 28836 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:24.480999 18844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:24.460862 28791 raft_consensus.cc:697] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:24.494555 28826 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:24.479272 17568 pending_rounds.cc:77] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 31 index: 19 } timestamp: 7305625720644382720 op_type: NO_OP noop_request { }
I20260709 12:27:24.464571 28677 raft_consensus.cc:493] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.518324 28677 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:24.519021 28791 consensus_queue.cc:237] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:24.519059 28857 log.cc:927] Time spent T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:27:24.523252 18921 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:27:24.516978 18844 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 33: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:24.525595 17568 raft_consensus.cc:2889] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 12:27:24.527276 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:24.478302 28832 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:24.535401 17568 raft_consensus.cc:2272] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 1e2529a8cff04207bb1b07c108e16983 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:24.535465 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:24.537242 19487 raft_consensus.cc:2393] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 33: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:24.540189 17568 tablet_replica.cc:333] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:24.541303 17568 raft_consensus.cc:2243] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:24.530349 28814 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.530308 28805 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.584448 17568 pending_rounds.cc:70] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Trying to abort 1 pending ops.
I20260709 12:27:24.584985 17568 pending_rounds.cc:77] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305625721686532096 op_type: NO_OP noop_request { }
I20260709 12:27:24.586455 17568 raft_consensus.cc:2889] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 12:27:24.587193 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 107544us
W20260709 12:27:24.589003 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55383.5us
I20260709 12:27:24.548769 28826 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 12:27:24.591274 17568 raft_consensus.cc:2272] T 847dd0f72f3f4a6c8834194b02858750 P 1e2529a8cff04207bb1b07c108e16983 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:24.590907 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 44831.2us
I20260709 12:27:24.575205 28814 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.584925 28805 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:24.645046 18812 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.647336 18812 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.648833 18812 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.649745 18812 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.651827 28805 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:24.654803 17568 tablet_replica.cc:333] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
W20260709 12:27:24.655794 18812 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.661271 18812 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:24.655827 17568 raft_consensus.cc:2243] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:24.667754 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 35 candidate_status { last_received { term: 34 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:24.684006 28814 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:24.686592 17568 raft_consensus.cc:2272] T 9134ec4fb92645b28a9b4814179c1c7c P 1e2529a8cff04207bb1b07c108e16983 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:24.689900 17568 tablet_replica.cc:333] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:24.691866 28832 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:24.701515 17568 raft_consensus.cc:2243] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:24.704499 17568 raft_consensus.cc:2272] T 3dca728d7de8469d95dbe82b045bf65e P 1e2529a8cff04207bb1b07c108e16983 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:24.714720 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 51766us
W20260709 12:27:24.715982 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60208.1us
W20260709 12:27:24.717092 18812 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.718189 28872 raft_consensus.cc:2749] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:24.720110 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:24.718138 18812 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.721493 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:24.722405 28814 raft_consensus.cc:2749] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:24.722858 18812 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.724134 18812 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.725297 18812 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.735252 18920 raft_consensus.cc:1275] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:27:24.737214 28873 consensus_queue.cc:1048] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:27:24.738821 28832 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:24.741603 19456 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.743376 28836 raft_consensus.cc:515] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.745069 28608 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.745682 28608 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.747443 28791 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.748222 28608 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:24.748045 28791 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.751493 28791 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:24.758982 17568 tablet_replica.cc:333] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983: stopping tablet replica
I20260709 12:27:24.760010 17568 raft_consensus.cc:2243] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:24.760946 17568 raft_consensus.cc:2272] T ca478d842a8f406087ef2855fb0363a8 P 1e2529a8cff04207bb1b07c108e16983 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:24.772199 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:24.748459 28677 raft_consensus.cc:515] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:24.774053 28794 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:27:24.777047 28677 leader_election.cc:290] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:24.778290 19456 leader_election.cc:336] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.784399 28836 leader_election.cc:290] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:24.790971 18666 catalog_manager.cc:5697] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 20 to 30. New cstate: current_term: 30 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:24.805388 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:24.807693 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:24.808599 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:24.822448 18886 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.823537 18886 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:24.824234 18886 leader_election.cc:336] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:24.807937 18666 catalog_manager.cc:5697] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 17 to 20, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 20 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:24.827304 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:24.837721 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:24.838539 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d2d90d352e40cb8b6cde778d729c24" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:24.841336 18845 raft_consensus.cc:3060] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:24.843567 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:24.844316 18842 raft_consensus.cc:3060] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:27:24.856824 18662 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 274) took 44173 ms (client timeout 15000 ms). Trace:
W20260709 12:27:24.862664 18662 rpcz_store.cc:269] 0709 12:26:40.684291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.915292 (+5231001us) service_pool.cc:224] Handling call
0709 12:27:24.856728 (+38941436us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:24.109813 (+     0us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b4400022b4c. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357dc4c85 00007f3357dc56a2 00007f335ab371db 00007f335ab32aaf 00007f3357e810ac 00007f3360cdb9a9 00007f3357e9d69b 00007f3357e9b93f 00007f3357e9b455 00007f335e9c016c
0709 12:27:24.202270 (+ 92457us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:24.203057 (+   787us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:24.203092 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:27:24.203112 (+    20us) tablet.cc:662] Decoding operations
0709 12:27:24.215858 (+ 12746us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:24.215955 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:24.215989 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:27:24.216309 (+   320us) tablet.cc:701] Row locks acquired
0709 12:27:24.216330 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:27:24.216479 (+   149us) write_op.cc:270] Start()
0709 12:27:24.216691 (+   212us) write_op.cc:276] Timestamp: P: 1783600044216432 usec, L: 0
0709 12:27:24.216712 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:27:24.217459 (+   747us) log.cc:844] Serialized 917 byte log entry
0709 12:27:24.358982 (+141523us) op_driver.cc:464] REPLICATION: finished
0709 12:27:24.582781 (+223799us) write_op.cc:301] APPLY: starting
0709 12:27:24.582878 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:24.653594 (+ 70716us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:24.653622 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:24.655328 (+  1706us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:24.655524 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:27:24.655566 (+    42us) write_op.cc:312] APPLY: finished
0709 12:27:24.655797 (+   231us) log.cc:844] Serialized 33 byte log entry
0709 12:27:24.669114 (+ 13317us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:24.672670 (+  3556us) write_op.cc:454] Released schema lock
0709 12:27:24.697081 (+ 24411us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:24.697723 (+   642us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:24.697773 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4831,"reported_tablets":49,"spinlock_wait_cycles":5376,"child_traces":[["op",{"apply.queue_time_us":223471,"apply.run_cpu_time_us":6413,"apply.run_wall_time_us":114897,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":226267,"prepare.run_cpu_time_us":7369,"prepare.run_wall_time_us":37371,"raft.queue_time_us":100004,"raft.run_cpu_time_us":51328,"raft.run_wall_time_us":173687,"replication_time_us":142091,"spinlock_wait_cycles":126620928,"thread_start_us":469103,"threads_started":4,"wal-append.queue_time_us":29105}]]}
I20260709 12:27:24.866472 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 35 candidate_status { last_received { term: 34 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:24.862088 18842 raft_consensus.cc:2468] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 27.
I20260709 12:27:24.857753 18666 catalog_manager.cc:5697] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 4 to 14, term changed from 19 to 23, VOTER 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) evicted. New cstate: current_term: 23 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.867547 18841 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 34.
I20260709 12:27:24.869117 18666 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:24.872829 18666 catalog_manager.cc:5697] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 12 to 13, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 13 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:24.875027 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:24.874531 18666 catalog_manager.cc:5697] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 18 to 19, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 19 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.875926 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:24.876632 18841 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 27.
I20260709 12:27:24.877935 18666 catalog_manager.cc:5697] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 22 to 27. New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:24.878937 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0939ca2ad5484a34aa9e9f7f8075cb2d" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:24.879621 18841 raft_consensus.cc:3060] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:24.880119 18666 catalog_manager.cc:5697] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 20 to 22, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 22 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.881928 18666 catalog_manager.cc:5697] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 21 to 24, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 24 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.883702 18666 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 28 to 30. New cstate: current_term: 30 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:24.885141 18666 catalog_manager.cc:5697] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:24.886524 18666 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 32 to 34. New cstate: current_term: 34 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:24.888156 18666 catalog_manager.cc:5697] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 29 to 31, leader changed from 43b520eabb65493abe84f4cf06806cba (127.17.40.4) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 31 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:24.890115 18666 catalog_manager.cc:5697] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 23 to 28, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 28 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.895139 18666 catalog_manager.cc:5697] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 26 to 30. New cstate: current_term: 30 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.896911 18666 catalog_manager.cc:5697] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:24.903805 18666 catalog_manager.cc:5697] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.900421 18845 raft_consensus.cc:2468] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 30.
I20260709 12:27:24.905531 18666 catalog_manager.cc:5697] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.902662 18841 raft_consensus.cc:2468] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 25.
I20260709 12:27:24.912002 18666 catalog_manager.cc:5697] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 15 to 18, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 18 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:24.913843 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:24.931926 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:24.933638 28879 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:27:24.935638 28875 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.936278 28875 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:24.939694 28875 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:24.944900 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:24.945719 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 30.
I20260709 12:27:24.947085 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:24.934223 28879 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.952045 28879 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:27:24.952555 28875 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:27:24.957896 28875 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.960817 28875 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:24.984598 19457 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:24.986421 28677 raft_consensus.cc:2804] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:24.987692 28677 raft_consensus.cc:697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 27 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
I20260709 12:27:24.989184 28677 consensus_queue.cc:237] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:24.993845 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:24.995461 28836 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:24.995993 28836 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:24.996405 28836 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:25.033339 28879 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:25.049401 28836 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:25.053433 28836 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:25.055167 18886 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:25.061622 18886 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:25.085517 28879 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:25.068624 18812 consensus_peers.cc:597] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:25.094635 18886 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:25.086473 28875 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:25.096939 18812 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:25.097612 28875 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:25.098089 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.102077 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
I20260709 12:27:25.102795 18921 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:27:25.103030 18812 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:25.105041 19483 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:27:25.111430 18919 raft_consensus.cc:1275] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 32 index: 17. Preceding OpId from leader: term: 33 index: 18. (index mismatch)
I20260709 12:27:25.113376 28840 consensus_queue.cc:1048] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:27:25.103492 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:25.120585 18812 consensus_peers.cc:597] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:25.178686 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 58158.7us
W20260709 12:27:25.179544 18812 consensus_peers.cc:597] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.121513 28791 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:27:25.126873 18886 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:25.182993 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 56171.2us
I20260709 12:27:25.130560 28875 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
W20260709 12:27:25.142670 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:25.189627 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47044.7us
I20260709 12:27:25.211314 18921 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 31.
W20260709 12:27:25.201210 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:25.213845 18814 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:25.219359 28875 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:27:25.249828 28875 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:25.251343 28875 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:25.262516 19457 leader_election.cc:304] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:25.265636 18887 leader_election.cc:304] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:25.273792 28791 raft_consensus.cc:2804] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:25.275978 28791 raft_consensus.cc:697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:25.277511 28791 consensus_queue.cc:237] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:25.296787 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 76837.5us
I20260709 12:27:25.298672 28794 raft_consensus.cc:2804] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader election won for term 30
W20260709 12:27:25.368659 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:25.350581 28794 raft_consensus.cc:697] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 30 LEADER]: Becoming Leader. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Running, Role: LEADER
W20260709 12:27:25.423478 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:25.424892 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:25.425513 28885 log.cc:927] Time spent T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:27:25.444893 18842 raft_consensus.cc:1275] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:27:25.447791 18845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 35 candidate_status { last_received { term: 34 index: 17 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:25.448523 18845 raft_consensus.cc:3060] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:27:25.454986 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:25.455744 18842 raft_consensus.cc:3060] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:25.430234 28794 consensus_queue.cc:237] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:25.475636 18845 raft_consensus.cc:2468] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 35.
W20260709 12:27:25.490805 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.499042 18842 raft_consensus.cc:2468] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
I20260709 12:27:25.502424 28608 consensus_queue.cc:1048] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
W20260709 12:27:25.544409 18812 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:25.544955 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:25.561348 18812 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:25.564059 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:25.561992 28872 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 35 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:27:25.572062 28872 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:25.576297 18812 consensus_peers.cc:597] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.598016 18887 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:25.600028 18887 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:25.601611 28836 raft_consensus.cc:2804] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:25.602553 28836 raft_consensus.cc:697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:25.603909 28836 consensus_queue.cc:237] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:25.608626 28608 raft_consensus.cc:2804] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:27:25.610363 28608 raft_consensus.cc:697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 35 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:25.611943 28608 consensus_queue.cc:237] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 34.17, Last appended by leader: 17, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:25.649794 18848 raft_consensus.cc:1275] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
W20260709 12:27:25.653761 18812 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:25.656646 18812 consensus_peers.cc:597] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:25.682533 18812 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:25.713984 28873 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:25.741300 18844 raft_consensus.cc:1275] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:27:25.748871 28838 consensus_queue.cc:1048] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260709 12:27:25.759877 18886 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.756577 28886 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:25.770661 28906 consensus_queue.cc:1048] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:25.774168 28886 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:25.758703 28873 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:25.785014 28886 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:25.797850 28873 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:25.806643 19456 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:25.824803 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50281.7us
I20260709 12:27:25.855391 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:25.856889 18812 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.857085 19483 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 20.
I20260709 12:27:25.877849 18842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f" is_pre_election: true
I20260709 12:27:25.878779 18842 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b520eabb65493abe84f4cf06806cba in term 20.
W20260709 12:27:25.893855 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:25.896605 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:25.897603 28896 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:25.898092 28896 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:25.902051 28896 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:25.930545 18919 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:27:25.935037 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:25.936151 28840 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:25.936637 28840 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e2529a8cff04207bb1b07c108e16983)
I20260709 12:27:25.937038 28840 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:25.959720 28891 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:27:26.003274 18812 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:25.948915 28840 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:26.014524 28840 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:26.020887 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:26.031973 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.040017 18886 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.027343 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:26.048978 18666 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52758 (request call id 173) took 7105 ms. Trace:
I20260709 12:27:26.049526 18666 rpcz_store.cc:276] 0709 12:27:18.943834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.980883 (+ 37049us) service_pool.cc:224] Handling call
0709 12:27:26.048878 (+7067995us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:25.069723 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:25.070305 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:25.070341 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:27:25.070358 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:25.072013 (+  1655us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:25.072104 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:25.072134 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:27:25.073658 (+  1524us) tablet.cc:701] Row locks acquired
0709 12:27:25.073675 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:27:25.073857 (+   182us) write_op.cc:270] Start()
0709 12:27:25.074035 (+   178us) write_op.cc:276] Timestamp: P: 1783600045073789 usec, L: 0
0709 12:27:25.074062 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:27:25.074841 (+   779us) log.cc:844] Serialized 7317 byte log entry
0709 12:27:25.350231 (+275390us) op_driver.cc:464] REPLICATION: finished
0709 12:27:25.515527 (+165296us) write_op.cc:301] APPLY: starting
0709 12:27:25.519082 (+  3555us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:25.615967 (+ 96885us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:25.616083 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:25.838308 (+222225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:25.838628 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 12:27:25.838674 (+    46us) write_op.cc:312] APPLY: finished
0709 12:27:25.899533 (+ 60859us) log.cc:844] Serialized 172 byte log entry
0709 12:27:25.899728 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:25.899929 (+   201us) write_op.cc:454] Released schema lock
0709 12:27:25.899985 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:25.900593 (+   608us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:25.900622 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50138,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":151502,"apply.run_cpu_time_us":29617,"apply.run_wall_time_us":393656,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83661,"num_ops":19,"prepare.queue_time_us":145686,"prepare.run_cpu_time_us":5465,"prepare.run_wall_time_us":5472,"replication_time_us":238378,"spinlock_wait_cycles":2432,"thread_start_us":164006,"threads_started":2}]]}
I20260709 12:27:26.059059 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet bbadce60e960476289740ec2afd0a5c8 with delete_type TABLET_DATA_TOMBSTONED (TS 674d77fe8bcb4c768537ebae4be828bd not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:60130
W20260709 12:27:26.078594 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:26.087775 18814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 55682.3us
I20260709 12:27:26.105875 18667 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 19 to 26, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 26 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:26.111837 28910 log.cc:927] Time spent T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:27:26.077764 28896 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:26.114761 19486 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 47b48b5c69f245b79ecb292eff89927f in current term 21: Already voted for candidate 43b520eabb65493abe84f4cf06806cba in this term.
I20260709 12:27:26.115790 28896 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:26.119326 19456 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:26.108908 18667 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 21 to 24, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 24 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.124130 18667 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.125914 28919 tablet_replica.cc:333] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
W20260709 12:27:26.134472 18812 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:26.137375 18843 raft_consensus.cc:1275] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 35 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 34 index: 17. Preceding OpId from leader: term: 35 index: 18. (index mismatch)
I20260709 12:27:26.144291 18842 raft_consensus.cc:1275] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
W20260709 12:27:26.142482 18812 consensus_peers.cc:597] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:26.147797 28905 consensus_queue.cc:1048] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:26.154898 28879 consensus_queue.cc:1048] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:27:26.161266 28919 raft_consensus.cc:2243] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.162850 28919 raft_consensus.cc:2272] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.167776 28919 ts_tablet_manager.cc:1916] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:26.171672 18841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:26.177527 18841 raft_consensus.cc:2393] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 43b520eabb65493abe84f4cf06806cba in current term 21: Already voted for candidate 47b48b5c69f245b79ecb292eff89927f in this term.
I20260709 12:27:26.180362 18845 raft_consensus.cc:1275] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Refusing update from remote peer 43b520eabb65493abe84f4cf06806cba: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:27:26.183895 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:26.185195 28917 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:27:26.205880 18812 connection.cc:573] client connection to 127.17.40.1:46365 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:27:26.212177 19457 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:26.213312 28915 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:26.216024 28915 consensus_queue.cc:1048] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:27:26.250605 18667 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 24 to 27, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.252987 18667 catalog_manager.cc:5697] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 21 to 23, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 23 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:26.273659 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.326224 28919 ts_tablet_manager.cc:1929] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
I20260709 12:27:26.333846 28919 log.cc:1199] T bbadce60e960476289740ec2afd0a5c8 P 674d77fe8bcb4c768537ebae4be828bd: Deleting WAL directory at /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/wals/bbadce60e960476289740ec2afd0a5c8
I20260709 12:27:26.339614 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet bbadce60e960476289740ec2afd0a5c8 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
W20260709 12:27:26.364320 18812 consensus_peers.cc:597] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:26.402875 18668 catalog_manager.cc:5697] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.405110 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet bbadce60e960476289740ec2afd0a5c8 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:60130
I20260709 12:27:26.405640 18668 catalog_manager.cc:5697] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 22 to 23, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 23 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.407401 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet bbadce60e960476289740ec2afd0a5c8 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:27:26.426366 18668 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 26 to 27, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 27 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:27:26.428761 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:26.443681 18812 consensus_peers.cc:597] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:26.445873 18667 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 285) took 21502 ms (client timeout 15000 ms). Trace:
I20260709 12:27:26.448731 18668 catalog_manager.cc:5697] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 21 to 24, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 24 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:26.449496 18667 rpcz_store.cc:269] 0709 12:27:04.943783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.774555 (+8830772us) service_pool.cc:224] Handling call
0709 12:27:26.445754 (+12671199us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:26.305695 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:26.306298 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:26.306339 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:27:26.306359 (+    20us) tablet.cc:662] Decoding operations
0709 12:27:26.307106 (+   747us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:26.307198 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:26.307227 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:27:26.315588 (+  8361us) tablet.cc:701] Row locks acquired
0709 12:27:26.315608 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:27:26.315788 (+   180us) write_op.cc:270] Start()
0709 12:27:26.315917 (+   129us) write_op.cc:276] Timestamp: P: 1783600046315729 usec, L: 0
0709 12:27:26.315938 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:27:26.316731 (+   793us) log.cc:844] Serialized 2059 byte log entry
0709 12:27:26.328191 (+ 11460us) op_driver.cc:464] REPLICATION: finished
0709 12:27:26.328749 (+   558us) write_op.cc:301] APPLY: starting
0709 12:27:26.328835 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:26.331618 (+  2783us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:26.331695 (+    77us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:26.334932 (+  3237us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:26.335136 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:27:26.335190 (+    54us) write_op.cc:312] APPLY: finished
0709 12:27:26.335457 (+   267us) log.cc:844] Serialized 57 byte log entry
0709 12:27:26.335657 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:26.335774 (+   117us) write_op.cc:454] Released schema lock
0709 12:27:26.335825 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:26.341191 (+  5366us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:26.341234 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1146,"reported_tablets":50,"spinlock_wait_cycles":16000,"child_traces":[["op",{"apply.queue_time_us":316,"apply.run_cpu_time_us":7500,"apply.run_wall_time_us":12363,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20930,"num_ops":5,"prepare.queue_time_us":2057,"prepare.run_cpu_time_us":3711,"prepare.run_wall_time_us":16057,"replication_time_us":12084,"thread_start_us":3616,"threads_started":1}]]}
I20260709 12:27:26.453442 18668 catalog_manager.cc:5697] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 22 to 24, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 24 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.467146 18668 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 26 to 29, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 29 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.477769 18668 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.484093 18668 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 27 to 28, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1). New cstate: current_term: 28 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.494062 18668 catalog_manager.cc:5697] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.496579 18668 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.506299 18668 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 24 to 28, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 28 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.510591 18668 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:26.534680 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:26.559001 18668 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "1e2529a8cff04207bb1b07c108e16983" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.560787 18668 catalog_manager.cc:5697] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.562173 18668 catalog_manager.cc:5697] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 21 to 24, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 24 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:26.596380 18812 consensus_peers.cc:597] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:26.604650 18668 catalog_manager.cc:5697] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.627676 18668 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 26 to 27, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.647419 18668 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:26.667057 18668 catalog_manager.cc:5697] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 20 to 27, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:27:26.682125 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:26.683975 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:26.786541 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:26.800870 28916 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.801517 28916 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:26.803880 28916 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:26.804087 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:26.812533 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:26.813315 19487 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 33.
I20260709 12:27:26.822347 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:26.826571 28928 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:27:26.833211 28928 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.834798 28928 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:27:26.850657 18812 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:26.859215 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:26.869032 18812 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:26.874881 28928 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:26.883329 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:26.894559 28928 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 34 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:26.898430 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8038db5456b47f5af9508f8dcb3883b" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:26.899192 19487 raft_consensus.cc:3060] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:27:26.907025 18812 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:26.910010 18669 catalog_manager.cc:5697] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 23 to 25, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 25 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.924355 19487 raft_consensus.cc:2468] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 34.
I20260709 12:27:26.922292 18668 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47856 (request call id 276) took 6880 ms. Trace:
I20260709 12:27:26.929955 18668 rpcz_store.cc:276] 0709 12:27:20.041861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.060246 (+1018385us) service_pool.cc:224] Handling call
0709 12:27:26.922212 (+5861966us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:26.731587 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:26.732349 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:26.732384 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:27:26.732408 (+    24us) tablet.cc:662] Decoding operations
0709 12:27:26.734361 (+  1953us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:26.734470 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:26.734511 (+    41us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:27:26.736619 (+  2108us) tablet.cc:701] Row locks acquired
0709 12:27:26.736643 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:27:26.736842 (+   199us) write_op.cc:270] Start()
0709 12:27:26.736983 (+   141us) write_op.cc:276] Timestamp: P: 1783600046736783 usec, L: 0
0709 12:27:26.737010 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:27:26.737939 (+   929us) log.cc:844] Serialized 7402 byte log entry
0709 12:27:26.744126 (+  6187us) op_driver.cc:464] REPLICATION: finished
0709 12:27:26.746913 (+  2787us) write_op.cc:301] APPLY: starting
0709 12:27:26.747032 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:26.784149 (+ 37117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:26.784263 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:26.853687 (+ 69424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:26.853992 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 12:27:26.854067 (+    75us) write_op.cc:312] APPLY: finished
0709 12:27:26.854548 (+   481us) log.cc:844] Serialized 172 byte log entry
0709 12:27:26.869640 (+ 15092us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:26.869838 (+   198us) write_op.cc:454] Released schema lock
0709 12:27:26.869900 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:26.870302 (+   402us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:26.877293 (+  6991us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8278,"reported_tablets":49,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":2485,"apply.run_cpu_time_us":26015,"apply.run_wall_time_us":123364,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79534,"num_ops":19,"prepare.queue_time_us":202,"prepare.run_cpu_time_us":6801,"prepare.run_wall_time_us":28889,"replication_time_us":6965}]]}
W20260709 12:27:26.948822 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:26.959146 18812 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:26.960246 28928 raft_consensus.cc:2804] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:27:26.960772 28928 raft_consensus.cc:697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 34 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:26.961695 28928 consensus_queue.cc:237] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:26.970973 18666 catalog_manager.cc:5697] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 24 to 27, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 27 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.972867 18666 catalog_manager.cc:5697] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 24 to 28, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 28 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.974902 18666 catalog_manager.cc:5697] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 29 to 30, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 30 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.976531 18666 catalog_manager.cc:5697] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 27 to 28, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 28 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.989118 18666 catalog_manager.cc:5697] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 24 to 25, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 25 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:26.990913 18666 catalog_manager.cc:5697] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba reported cstate change: term changed from 34 to 35, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 43b520eabb65493abe84f4cf06806cba (127.17.40.4). New cstate: current_term: 35 leader_uuid: "43b520eabb65493abe84f4cf06806cba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:26.996650 18812 consensus_peers.cc:597] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:26.997290 18812 consensus_peers.cc:597] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:27.040161 18669 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47866 (request call id 286) took 5940 ms. Trace:
I20260709 12:27:27.040378 18912 tablet_service.cc:1558] Processing DeleteTablet for tablet bbadce60e960476289740ec2afd0a5c8 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:60130
I20260709 12:27:27.044093 18658 catalog_manager.cc:5028] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): tablet bbadce60e960476289740ec2afd0a5c8 (table test-workload [id=899df26751aa4f5ba89c72213f4cea84]) successfully deleted
I20260709 12:27:27.040699 18669 rpcz_store.cc:276] 0709 12:27:21.099474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.937896 (+838422us) service_pool.cc:224] Handling call
0709 12:27:27.040089 (+5102193us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:26.938720 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:26.939340 (+   620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:26.939383 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:27:26.939400 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:26.939848 (+   448us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:26.939910 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:26.939938 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:26.940134 (+   196us) tablet.cc:701] Row locks acquired
0709 12:27:26.940153 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:27:26.940312 (+   159us) write_op.cc:270] Start()
0709 12:27:26.940441 (+   129us) write_op.cc:276] Timestamp: P: 1783600046940261 usec, L: 0
0709 12:27:26.940463 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:27:26.941103 (+   640us) log.cc:844] Serialized 535 byte log entry
0709 12:27:26.944402 (+  3299us) op_driver.cc:464] REPLICATION: finished
0709 12:27:26.945231 (+   829us) write_op.cc:301] APPLY: starting
0709 12:27:26.945337 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:26.946256 (+   919us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:26.946378 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:26.947167 (+   789us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:26.947346 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:27:26.947407 (+    61us) write_op.cc:312] APPLY: finished
0709 12:27:26.947610 (+   203us) log.cc:844] Serialized 25 byte log entry
0709 12:27:26.947792 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:26.947887 (+    95us) write_op.cc:454] Released schema lock
0709 12:27:26.947930 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:26.948346 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:26.948377 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11301,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":601,"apply.run_cpu_time_us":3069,"apply.run_wall_time_us":3071,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":10077,"prepare.run_cpu_time_us":2678,"prepare.run_wall_time_us":2679,"replication_time_us":3793}]]}
W20260709 12:27:27.110984 18812 consensus_peers.cc:597] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:27.119338 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:27.149528 18666 catalog_manager.cc:5697] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 24 to 29, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 29 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.168114 18666 catalog_manager.cc:5697] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 30 to 33, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 33 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.170251 18666 catalog_manager.cc:5697] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 24 to 25, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 25 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:27.171746 18666 catalog_manager.cc:5697] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 27 to 28, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 28 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:27:27.182235 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:27.202435 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:27.203907 18666 catalog_manager.cc:5697] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 29 to 30, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 30 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:27.205966 17568 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18794)
I20260709 12:27:27.207945 18666 catalog_manager.cc:5697] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 31 to 35. New cstate: current_term: 35 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:27.210291 18666 catalog_manager.cc:5697] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 30 to 34, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 34 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.243489 18666 catalog_manager.cc:5697] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 25 to 26, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 26 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:27.280025 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:27.257403 18666 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 26 to 31, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 31 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.294996 18666 catalog_manager.cc:5697] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 26 to 31, leader changed from 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 31 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.302829 18666 catalog_manager.cc:5697] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 29 to 30, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 30 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
I20260709 12:27:27.304563 18666 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 28 to 29, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 29 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.320154 18666 catalog_manager.cc:5697] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 29 to 30, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 30 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.322119 18666 catalog_manager.cc:5697] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 23 to 24, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 24 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:27.337339 18812 consensus_peers.cc:597] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:27.324193 18666 catalog_manager.cc:5697] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 23 to 26, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 26 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } }
W20260709 12:27:27.381037 18812 consensus_peers.cc:597] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:27.398013 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:27.415879 19487 raft_consensus.cc:1275] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
I20260709 12:27:27.436655 28916 consensus_queue.cc:1048] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
W20260709 12:27:27.445760 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:27.595726 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:27.596437 18812 consensus_peers.cc:597] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:27.608551 18812 consensus_peers.cc:597] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.691238 18916 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:27:27.724911 18886 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.730931 18886 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3dca728d7de8469d95dbe82b045bf65e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.733148 18843 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
W20260709 12:27:27.762598 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:27.765019 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:27.769708 28608 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:27:27.801901 18812 consensus_peers.cc:597] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:27.818940 18812 consensus_peers.cc:597] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:27.841526 28791 raft_consensus.cc:2955] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Committing config change with OpId 27.16: config changed from index -1 to 16, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:27:27.864432 18842 raft_consensus.cc:2955] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Committing config change with OpId 27.16: config changed from index -1 to 16, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:27:27.866596 18886 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:27.875905 18812 consensus_peers.cc:597] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:27.896505 18666 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 16, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:27:27.929001 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:27.939695 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:27.942031 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:27.945739 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:27.984452 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 68788.2us
I20260709 12:27:28.015472 28928 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.016042 28928 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:28.020253 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:28.021229 19486 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 21.
I20260709 12:27:28.023286 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 
I20260709 12:27:28.024093 28937 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:28.018276 28928 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:28.024500 28937 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.025036 28937 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:28.031234 18812 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:28.050041 28937 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:28.053738 28937 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:28.061501 18843 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:28.072340 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1485e54f9795416785f4baf244599201" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:28.073067 19486 raft_consensus.cc:3060] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:28.077448 18812 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:28.084595 18916 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:27:28.087258 28916 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:27:28.089890 19486 raft_consensus.cc:2468] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b48b5c69f245b79ecb292eff89927f in term 22.
W20260709 12:27:28.090231 18812 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99bb1352a2bd46e7bb08b8e1b6711fe1. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.092558 18812 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.093966 18812 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983
I20260709 12:27:28.094997 28928 raft_consensus.cc:2804] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:28.095715 28928 raft_consensus.cc:697] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Becoming Leader. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:28.096915 28928 consensus_queue.cc:237] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:28.132041 18886 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:28.135085 18666 catalog_manager.cc:5697] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: term changed from 20 to 22, leader changed from 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) to 47b48b5c69f245b79ecb292eff89927f (127.17.40.2). New cstate: current_term: 22 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.172194 18919 raft_consensus.cc:2955] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Committing config change with OpId 31.20: config changed from index -1 to 20, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:27:28.185508 28950 ts_tablet_manager.cc:933] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:28.206470 17568 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18794)
I20260709 12:27:28.208114 28950 tablet_copy_client.cc:323] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:27:28.213340 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet 3dca728d7de8469d95dbe82b045bf65e from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:27:28.214105 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet 3dca728d7de8469d95dbe82b045bf65e from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-3dca728d7de8469d95dbe82b045bf65e
W20260709 12:27:28.219645 18812 consensus_peers.cc:597] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:28.225082 28916 raft_consensus.cc:2955] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Committing config change with OpId 31.20: config changed from index -1 to 20, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:27:28.241945 18932 tablet_copy_source_session.cc:215] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:28.278416 28950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dca728d7de8469d95dbe82b045bf65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.295432 18666 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index -1 to 20, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 31 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:27:28.337744 18843 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:28.345500 28950 tablet_copy_client.cc:806] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:28.366852 28950 tablet_copy_client.cc:670] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:28.372350 28950 tablet_copy_client.cc:538] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:27:28.468189 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 88935.8us
I20260709 12:27:28.485070 28950 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
I20260709 12:27:28.490168 18916 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:27:28.496121 28937 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:27:28.499738 19456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260709 12:27:28.509922 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:28.519348 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:28.518345 28928 raft_consensus.cc:2955] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Committing config change with OpId 29.18: config changed from index -1 to 18, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:27:28.541822 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b5f0fdf96074deb816d2d3b27fe7143. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.543637 18914 raft_consensus.cc:2955] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Committing config change with OpId 29.18: config changed from index -1 to 18, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:27:28.554126 18919 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:28.554641 18666 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 18, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 29 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:28.565027 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.576413 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:28.576510 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:28.577265 19486 raft_consensus.cc:1275] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:27:28.595940 18812 consensus_peers.cc:597] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:28.597470 28954 consensus_queue.cc:1048] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:28.620643 18839 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:27:28.623242 28939 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:27:28.640275 18886 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:28.647007 28950 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=4 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:28.648280 28950 tablet_bootstrap.cc:492] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:27:28.649221 28950 ts_tablet_manager.cc:1403] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.170s	user 0.052s	sys 0.017s
I20260709 12:27:28.653949 28950 raft_consensus.cc:359] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:27:28.662681 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.663805 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937): Couldn't send request to peer 43b520eabb65493abe84f4cf06806cba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2054e631aee84e6d9d5435f9031fec9e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.659945 28950 raft_consensus.cc:740] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:27:28.665181 28950 consensus_queue.cc:260] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:28.668393 28950 ts_tablet_manager.cc:1434] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:27:28.670495 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-3dca728d7de8469d95dbe82b045bf65e received from {username='slave'} at 127.0.0.1:57874
I20260709 12:27:28.671092 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-3dca728d7de8469d95dbe82b045bf65e on tablet 3dca728d7de8469d95dbe82b045bf65e with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:28.673722 28939 raft_consensus.cc:2955] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Committing config change with OpId 27.15: config changed from index -1 to 15, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
W20260709 12:27:28.692237 18812 consensus_peers.cc:597] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.703326 18812 consensus_peers.cc:597] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:28.708998 18839 raft_consensus.cc:2955] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Committing config change with OpId 27.15: config changed from index -1 to 15, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:27:28.733219 28950 ts_tablet_manager.cc:933] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:28.755421 18669 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index -1 to 15, NON_VOTER 43b520eabb65493abe84f4cf06806cba (127.17.40.4) added. New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } } }
I20260709 12:27:28.787803 19487 raft_consensus.cc:1217] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 LEARNER]: Deduplicated request from leader. Original: 27.15->[27.16-27.16]   Dedup: 27.16->[]
I20260709 12:27:28.809942 28950 tablet_copy_client.cc:323] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:27:28.848742 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 99bb1352a2bd46e7bb08b8e1b6711fe1 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:27:28.849702 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 99bb1352a2bd46e7bb08b8e1b6711fe1 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-99bb1352a2bd46e7bb08b8e1b6711fe1
I20260709 12:27:28.864332 18858 tablet_copy_source_session.cc:215] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:27:28.888548 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:28.891029 18839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55874
I20260709 12:27:28.891991 18839 raft_consensus.cc:606] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Received request to transfer leadership
I20260709 12:27:28.904686 28950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bb1352a2bd46e7bb08b8e1b6711fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.918742 18839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55874
I20260709 12:27:28.919525 18839 raft_consensus.cc:606] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Received request to transfer leadership
W20260709 12:27:28.929728 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:28.973739 28950 tablet_copy_client.cc:806] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:28.974651 28950 tablet_copy_client.cc:670] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:28.984645 18839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1"
dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55874
I20260709 12:27:28.985343 18839 raft_consensus.cc:606] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Received request to transfer leadership
I20260709 12:27:29.001303 28950 tablet_copy_client.cc:538] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:27:29.005007 18719 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:27:29.005604 18719 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 99bb1352a2bd46e7bb08b8e1b6711fe1 already in progress
W20260709 12:27:29.005913 18719 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 99bb1352a2bd46e7bb08b8e1b6711fe1 already in progress
I20260709 12:27:29.027323 28950 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
W20260709 12:27:29.063625 18812 consensus_peers.cc:597] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:29.108619 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:29.111930 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:29.162765 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:29.181190 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:29.202021 28968 ts_tablet_manager.cc:933] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:29.207068 18812 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:29.207278 17568 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 18794)
I20260709 12:27:29.219729 28939 raft_consensus.cc:1064] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:27:29.226008 28928 raft_consensus.cc:993] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: : Instructing follower 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:27:29.226670 28928 raft_consensus.cc:1081] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Signalling peer 674d77fe8bcb4c768537ebae4be828bd to start an election
I20260709 12:27:29.226903 28968 tablet_copy_client.cc:323] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.2:36959
I20260709 12:27:29.232215 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1"
dest_uuid: "674d77fe8bcb4c768537ebae4be828bd"
 from {username='slave'} at 127.0.0.1:54084
I20260709 12:27:29.232923 18919 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:29.233340 18919 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:27:29.235930 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:29.236611 28969 ts_tablet_manager.cc:933] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: Initiating tablet copy from peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:29.237694 28939 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 14, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:29.250860 18858 tablet_copy_service.cc:140] P 47b48b5c69f245b79ecb292eff89927f: Received BeginTabletCopySession request for tablet 8b5f0fdf96074deb816d2d3b27fe7143 from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:45432)
I20260709 12:27:29.251533 18858 tablet_copy_service.cc:161] P 47b48b5c69f245b79ecb292eff89927f: Beginning new tablet copy session on tablet 8b5f0fdf96074deb816d2d3b27fe7143 from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:45432: session id = 43b520eabb65493abe84f4cf06806cba-8b5f0fdf96074deb816d2d3b27fe7143
I20260709 12:27:29.261696 18858 tablet_copy_source_session.cc:215] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:27:29.268529 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:29.312494 18812 consensus_peers.cc:597] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:29.294723 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5f0fdf96074deb816d2d3b27fe7143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.313612 28950 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:29.294466 18839 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:27:29.287142 19487 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 12:27:29.321928 18886 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:29.326432 28950 tablet_bootstrap.cc:492] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:27:29.327350 28950 ts_tablet_manager.cc:1403] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.302s	user 0.068s	sys 0.003s
I20260709 12:27:29.277366 18919 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Starting forced leader election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:27:29.324144 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:29.331561 18919 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 election: Requested vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:29.332998 28969 tablet_copy_client.cc:323] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Beginning tablet copy session from remote peer at address 127.17.40.3:41535
I20260709 12:27:29.340088 18932 tablet_copy_service.cc:140] P 674d77fe8bcb4c768537ebae4be828bd: Received BeginTabletCopySession request for tablet 2054e631aee84e6d9d5435f9031fec9e from peer 43b520eabb65493abe84f4cf06806cba ({username='slave'} at 127.0.0.1:57874)
I20260709 12:27:29.340757 18932 tablet_copy_service.cc:161] P 674d77fe8bcb4c768537ebae4be828bd: Beginning new tablet copy session on tablet 2054e631aee84e6d9d5435f9031fec9e from peer 43b520eabb65493abe84f4cf06806cba at {username='slave'} at 127.0.0.1:57874: session id = 43b520eabb65493abe84f4cf06806cba-2054e631aee84e6d9d5435f9031fec9e
I20260709 12:27:29.341089 18839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: true dest_uuid: "47b48b5c69f245b79ecb292eff89927f"
I20260709 12:27:29.341755 18839 raft_consensus.cc:3055] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:27:29.342072 18839 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 47b48b5c69f245b79ecb292eff89927f, State: Running, Role: LEADER
I20260709 12:27:29.332392 28939 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 12:27:29.343947 18839 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:29.344931 28791 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:27:29.346180 18839 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:27:29.362929 18839 raft_consensus.cc:2468] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 32.
I20260709 12:27:29.377333 28950 raft_consensus.cc:359] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 31 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:29.381263 18887 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:29.406579 28950 raft_consensus.cc:740] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 31 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:27:29.407814 28939 raft_consensus.cc:2804] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:27:29.407459 28950 consensus_queue.cc:260] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:29.410210 28950 ts_tablet_manager.cc:1434] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.082s	user 0.002s	sys 0.003s
I20260709 12:27:29.435621 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-99bb1352a2bd46e7bb08b8e1b6711fe1 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:27:29.434036 28939 raft_consensus.cc:697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 32 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:29.436241 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-99bb1352a2bd46e7bb08b8e1b6711fe1 on tablet 99bb1352a2bd46e7bb08b8e1b6711fe1 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:29.437033 28939 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
W20260709 12:27:29.497836 18886 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:29.509855 18932 tablet_copy_source_session.cc:215] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:29.512411 18669 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 31 to 32, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 32 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.514216 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2054e631aee84e6d9d5435f9031fec9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.546650 28969 tablet_copy_client.cc:806] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:29.558837 28969 tablet_copy_client.cc:670] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:29.580873 28969 tablet_copy_client.cc:538] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:29.591445 28969 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
W20260709 12:27:29.637567 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:29.636852 28945 raft_consensus.cc:2955] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:29.645709 19487 raft_consensus.cc:2955] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:29.663753 18812 consensus_peers.cc:597] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:29.664806 28968 tablet_copy_client.cc:806] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:29.665490 28968 tablet_copy_client.cc:670] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:29.665598 18843 raft_consensus.cc:2955] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index 16 to 17, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:29.689028 18666 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 16 to 17, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:29.697306 28968 tablet_copy_client.cc:538] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:27:29.697191 18812 consensus_peers.cc:597] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:29.771136 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:29.781034 28968 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: Bootstrap starting.
W20260709 12:27:29.827232 18812 consensus_peers.cc:597] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:29.847980 18812 consensus_peers.cc:597] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:29.852274 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:29.856225 18812 consensus_peers.cc:597] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:29.874439 18919 consensus_queue.cc:237] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:29.877583 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:29.902535 19487 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:27:29.910506 28976 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:29.932904 18848 raft_consensus.cc:1275] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:27:29.939750 19483 raft_consensus.cc:3060] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 31 LEARNER]: Advancing to term 32
I20260709 12:27:29.950240 28791 consensus_queue.cc:1048] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:27:29.952729 19483 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 32 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
W20260709 12:27:29.939777 18886 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:29.965360 28976 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:27:29.968307 28939 raft_consensus.cc:2955] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Committing config change with OpId 27.18: config changed from index 17 to 18, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:29.988850 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:29.989914 18843 raft_consensus.cc:2955] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Committing config change with OpId 27.18: config changed from index 17 to 18, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:29.998329 18658 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3dca728d7de8469d95dbe82b045bf65e with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:30.004120 19483 raft_consensus.cc:2955] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Committing config change with OpId 27.18: config changed from index 17 to 18, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:30.006659 18669 catalog_manager.cc:5697] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 17 to 18, VOTER 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1) evicted. New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:30.032472 18812 consensus_peers.cc:597] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:30.055260 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:30.080340 28791 raft_consensus.cc:1064] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
W20260709 12:27:30.080855 28791 raft_consensus.cc:1068] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: Unable to promote non-voter 43b520eabb65493abe84f4cf06806cba: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:27:30.090291 18845 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:27:30.097193 28969 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:30.098268 28969 tablet_bootstrap.cc:492] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:27:30.099135 28969 ts_tablet_manager.cc:1403] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.508s	user 0.061s	sys 0.011s
I20260709 12:27:30.106015 28976 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:27:30.128036 18812 consensus_peers.cc:597] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:30.132318 28969 raft_consensus.cc:359] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:30.133322 28969 raft_consensus.cc:740] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:27:30.134030 28969 consensus_queue.cc:260] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:30.157133 28969 ts_tablet_manager.cc:1434] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:27:30.159097 18932 tablet_copy_service.cc:342] P 674d77fe8bcb4c768537ebae4be828bd: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-2054e631aee84e6d9d5435f9031fec9e received from {username='slave'} at 127.0.0.1:57874
I20260709 12:27:30.159569 18932 tablet_copy_service.cc:434] P 674d77fe8bcb4c768537ebae4be828bd: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-2054e631aee84e6d9d5435f9031fec9e on tablet 2054e631aee84e6d9d5435f9031fec9e with peer 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:30.176759 18656 catalog_manager.cc:4755] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3dca728d7de8469d95dbe82b045bf65e: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:30.204120 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:30.208264 17568 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 18794)
W20260709 12:27:30.221164 18812 consensus_peers.cc:597] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:30.233753 28968 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=2 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:27:30.234964 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 50134.4us
I20260709 12:27:30.238833 28968 tablet_bootstrap.cc:492] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: Bootstrap complete.
I20260709 12:27:30.239799 28968 ts_tablet_manager.cc:1403] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: Time spent bootstrapping tablet: real 0.459s	user 0.055s	sys 0.020s
W20260709 12:27:30.289142 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:30.317675 19483 raft_consensus.cc:1217] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 LEARNER]: Deduplicated request from leader. Original: 27.14->[27.15-27.15]   Dedup: 27.15->[]
I20260709 12:27:30.320497 28968 raft_consensus.cc:359] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:30.321498 28968 raft_consensus.cc:740] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 LEARNER]: Becoming Follower/Learner. State: Replica: 43b520eabb65493abe84f4cf06806cba, State: Initialized, Role: LEARNER
I20260709 12:27:30.322309 28968 consensus_queue.cc:260] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: NON_VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: true } }
I20260709 12:27:30.324913 28968 ts_tablet_manager.cc:1434] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
W20260709 12:27:30.343183 18886 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:30.352962 18858 tablet_copy_service.cc:342] P 47b48b5c69f245b79ecb292eff89927f: Request end of tablet copy session 43b520eabb65493abe84f4cf06806cba-8b5f0fdf96074deb816d2d3b27fe7143 received from {username='slave'} at 127.0.0.1:45432
I20260709 12:27:30.353484 18858 tablet_copy_service.cc:434] P 47b48b5c69f245b79ecb292eff89927f: ending tablet copy session 43b520eabb65493abe84f4cf06806cba-8b5f0fdf96074deb816d2d3b27fe7143 on tablet 8b5f0fdf96074deb816d2d3b27fe7143 with peer 43b520eabb65493abe84f4cf06806cba
I20260709 12:27:30.366696 19483 raft_consensus.cc:1217] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 LEARNER]: Deduplicated request from leader. Original: 29.17->[29.18-29.18]   Dedup: 29.18->[]
W20260709 12:27:30.398650 18812 consensus_peers.cc:597] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:30.399191 18812 consensus_peers.cc:597] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:30.415347 28791 raft_consensus.cc:1064] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:27:30.418465 28791 consensus_queue.cc:237] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 20, Current term: 32, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:30.429145 18839 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:27:30.431973 28988 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
W20260709 12:27:30.452654 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:30.476850 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:30.477502 19487 raft_consensus.cc:1275] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 32 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:27:30.492528 28791 consensus_queue.cc:1048] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
W20260709 12:27:30.500370 18886 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:30.517112 18886 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:30.516446 28791 raft_consensus.cc:2955] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 32 LEADER]: Committing config change with OpId 32.22: config changed from index 20 to 22, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:30.519500 19487 raft_consensus.cc:2955] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Committing config change with OpId 32.22: config changed from index 20 to 22, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:30.548321 18668 catalog_manager.cc:5697] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba reported cstate change: config changed from index 20 to 22, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 32 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:30.551752 18839 raft_consensus.cc:2955] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Committing config change with OpId 32.22: config changed from index 20 to 22, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:30.611251 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:30.706630 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:30.801252 28991 raft_consensus.cc:1064] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:27:30.804767 28991 consensus_queue.cc:237] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 16, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:30.838807 18914 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:27:30.840495 28991 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:27:30.855664 19487 raft_consensus.cc:1275] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 LEARNER]: Refusing update from remote peer 47b48b5c69f245b79ecb292eff89927f: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:27:30.859349 28955 consensus_queue.cc:1048] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:27:30.880357 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:30.881932 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:30.922662 28976 raft_consensus.cc:1064] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: attempting to promote NON_VOTER 43b520eabb65493abe84f4cf06806cba to VOTER
I20260709 12:27:30.929128 28976 consensus_queue.cc:237] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 13, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:30.947849 28954 raft_consensus.cc:2955] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Committing config change with OpId 29.19: config changed from index 18 to 19, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:30.964330 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:30.967082 19487 raft_consensus.cc:2955] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Committing config change with OpId 29.19: config changed from index 18 to 19, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:31.011264 18916 raft_consensus.cc:2955] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Committing config change with OpId 29.19: config changed from index 18 to 19, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
I20260709 12:27:31.055253 18666 catalog_manager.cc:5697] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f reported cstate change: config changed from index 18 to 19, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 29 leader_uuid: "47b48b5c69f245b79ecb292eff89927f" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:31.146745 18812 consensus_peers.cc:597] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.172133 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:31.175290 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 86073.8us
I20260709 12:27:31.178505 18848 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:27:31.206743 28988 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:27:31.208765 17568 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 18794)
W20260709 12:27:31.220168 18812 consensus_peers.cc:597] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:31.224833 19487 raft_consensus.cc:1275] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 LEARNER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:27:31.233701 28791 consensus_queue.cc:1048] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:27:31.239784 18886 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.246855 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:31.270467 18812 consensus_peers.cc:597] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:31.288340 28791 raft_consensus.cc:2955] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Committing config change with OpId 27.16: config changed from index 15 to 16, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:31.295080 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:31.290462 19487 raft_consensus.cc:2955] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Committing config change with OpId 27.16: config changed from index 15 to 16, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:31.299469 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:31.300261 18812 consensus_peers.cc:597] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:31.308718 18845 raft_consensus.cc:2955] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Committing config change with OpId 27.16: config changed from index 15 to 16, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } } }
W20260709 12:27:31.319689 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:31.319183 18666 catalog_manager.cc:5697] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: config changed from index 15 to 16, 43b520eabb65493abe84f4cf06806cba (127.17.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 27 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:31.448503 18812 consensus_peers.cc:597] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:31.449180 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:31.452533 18656 catalog_manager.cc:4755] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3dca728d7de8469d95dbe82b045bf65e: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:31.455758 18812 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.554625 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.628485 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:31.632084 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:31.634356 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.665468 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.762365 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:31.929049 18812 consensus_peers.cc:597] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.945588 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:32.092592 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:32.209255 17568 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 18794)
W20260709 12:27:32.298524 18812 consensus_peers.cc:597] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:32.331918 18812 consensus_peers.cc:597] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:32.332450 18812 consensus_peers.cc:597] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:32.338053 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:32.419330 18812 consensus_peers.cc:597] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:32.430944 18812 consensus_peers.cc:597] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:32.466327 18812 consensus_peers.cc:597] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:32.491914 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:32.562444 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:32.575511 18812 consensus_peers.cc:597] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.596938 18812 consensus_peers.cc:597] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:32.653594 18886 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:32.663067 18656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 114766us
W20260709 12:27:32.669973 18656 catalog_manager.cc:4755] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3dca728d7de8469d95dbe82b045bf65e: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:32.691511 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:32.825736 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:32.945134 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:32.958676 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:33.119043 18886 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.241294 17568 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 18794)
W20260709 12:27:33.262465 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:33.263816 18886 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:33.334715 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:33.426793 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 47830.3us
W20260709 12:27:33.503129 19456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111) [suppressed 462 similar messages]
W20260709 12:27:33.510227 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.518069 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:33.596508 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.749102 18886 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.873291 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.891595 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:33.894481 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:33.913017 18812 consensus_peers.cc:597] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.913707 18812 consensus_peers.cc:597] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.995268 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:34.005685 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.025518 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:34.088758 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:34.092301 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.183100 18812 consensus_peers.cc:597] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.184103 18812 consensus_peers.cc:597] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.191133 18812 consensus_peers.cc:597] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.192099 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:34.197389 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:34.230576 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:34.243088 17568 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 18794)
W20260709 12:27:34.247437 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:34.258867 18812 consensus_peers.cc:597] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.375885 18812 consensus_peers.cc:597] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:34.576845 18812 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.702109 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 99984us
W20260709 12:27:34.748425 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 114293us
W20260709 12:27:34.782641 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 47189.5us
W20260709 12:27:34.786563 19456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 53039.7us
W20260709 12:27:34.802659 18656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45129.8us
W20260709 12:27:34.838554 18656 catalog_manager.cc:4755] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3dca728d7de8469d95dbe82b045bf65e: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:34.859881 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:34.894606 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:35.083858 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 88039.7us
W20260709 12:27:35.103667 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:35.107175 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.158962 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.217944 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:35.219913 18886 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:35.233700 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.245484 17568 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 18794)
W20260709 12:27:35.530230 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:35.530936 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.614871 18886 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:35.684181 18812 consensus_peers.cc:597] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.707929 18812 consensus_peers.cc:597] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.709793 18812 consensus_peers.cc:597] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:35.710419 18812 consensus_peers.cc:597] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:35.711004 18812 consensus_peers.cc:597] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:35.714342 18812 consensus_peers.cc:597] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.762746 18812 consensus_peers.cc:597] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:35.770588 18812 consensus_peers.cc:597] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.779037 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.844462 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:35.854723 18886 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:35.887001 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:35.976150 18812 consensus_peers.cc:597] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.089718 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:36.146101 18812 consensus_peers.cc:597] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.213836 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:36.246109 17568 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 18794)
W20260709 12:27:36.254896 18886 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.276767 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:36.283195 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.287024 18812 consensus_peers.cc:597] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.448115 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.478523 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.540503 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:36.546463 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800376000 after lost signal to thread 17571
W20260709 12:27:36.547874 18869 debug-util.cc:398] Leaking SignalData structure 0x7b08003763c0 after lost signal to thread 18705
W20260709 12:27:36.549424 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800165740 after lost signal to thread 18872
W20260709 12:27:36.550793 18869 debug-util.cc:398] Leaking SignalData structure 0x7b0800163ea0 after lost signal to thread 18946
W20260709 12:27:36.552181 18869 debug-util.cc:398] Leaking SignalData structure 0x7b080025f060 after lost signal to thread 19516
W20260709 12:27:36.555770 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:36.613260 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:36.692104 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:36.696139 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:36.711648 18812 consensus_peers.cc:597] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.745589 18812 consensus_peers.cc:597] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.911795 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:36.946470 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:37.006538 19457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 203424us
W20260709 12:27:37.007411 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:37.041819 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:37.063647 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.112578 18812 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:37.129824 18812 consensus_peers.cc:597] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:37.438916 18812 consensus_peers.cc:597] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:37.508790 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:37.509527 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:37.510010 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:37.561110 17568 tablet_server.cc:196] TabletServer@127.17.40.1:0 shutdown complete.
W20260709 12:27:37.608965 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:37.618556 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 70464.7us
W20260709 12:27:37.641628 18812 consensus_peers.cc:597] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:37.903134 18812 consensus_peers.cc:597] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:37.903887 18812 consensus_peers.cc:597] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:37.936123 18812 consensus_peers.cc:597] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:38.050873 18812 consensus_peers.cc:597] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:38.054287 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:38.055644 18812 consensus_peers.cc:597] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:38.056450 18812 consensus_peers.cc:597] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:38.124194 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:38.125164 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:38.188511 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08001440e0 after lost signal to thread 17571
W20260709 12:27:38.189729 18702 debug-util.cc:398] Leaking SignalData structure 0x7b08003c49e0 after lost signal to thread 18705
W20260709 12:27:38.191283 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800165580 after lost signal to thread 18872
W20260709 12:27:38.192453 18702 debug-util.cc:398] Leaking SignalData structure 0x7b0800376ac0 after lost signal to thread 18946
W20260709 12:27:38.193655 18702 debug-util.cc:398] Leaking SignalData structure 0x7b080032cd60 after lost signal to thread 19516
W20260709 12:27:38.195235 18812 consensus_peers.cc:597] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:38.216032 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 78711.3us
W20260709 12:27:38.262238 18886 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:38.263141 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:38.263964 18886 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:38.399094 18812 consensus_peers.cc:597] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:38.461083 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:38.525625 18812 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111) [suppressed 458 similar messages]
W20260709 12:27:38.554286 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:38.623517 18886 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:38.663482 18812 consensus_peers.cc:597] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:38.673584 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:38.716034 17568 tablet_server.cc:179] TabletServer@127.17.40.2:0 shutting down...
W20260709 12:27:38.715986 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:38.737327 18887 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.753463 18887 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.768577 19457 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.773154 19457 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.781368 19457 consensus_peers.cc:597] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.799392 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:38.830991 19457 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.832000 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:38.896873 18887 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.906940 18887 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.934106 19513 debug-util.cc:398] Leaking SignalData structure 0x7b0800331640 after lost signal to thread 17571
W20260709 12:27:38.935604 19513 debug-util.cc:398] Leaking SignalData structure 0x7b0800227f20 after lost signal to thread 18705
W20260709 12:27:38.937182 19513 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9da0 after lost signal to thread 18872
W20260709 12:27:38.938659 19513 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9540 after lost signal to thread 18946
W20260709 12:27:38.945127 19457 consensus_peers.cc:597] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.949020 19513 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2a60 after lost signal to thread 19516
W20260709 12:27:38.997028 19457 consensus_peers.cc:597] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.998165 18887 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.999562 18887 consensus_peers.cc:597] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.000273 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:39.022224 18656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57812.6us
W20260709 12:27:39.023577 19457 consensus_peers.cc:597] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:39.037494 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:27:39.038771 18886 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:39.039041 17568 tablet_replica.cc:333] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.040366 17568 raft_consensus.cc:2243] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:39.042129 18656 catalog_manager.cc:4755] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3dca728d7de8469d95dbe82b045bf65e: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:39.059064 17568 raft_consensus.cc:2272] T a24ba3693ff3438f831ba2ec6a724700 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.062620 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:39.063812 17568 tablet_replica.cc:333] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.070307 17568 raft_consensus.cc:2243] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Raft consensus shutting down.
W20260709 12:27:39.072566 18887 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.073315 18887 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.073280 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:39.076399 18812 consensus_peers.cc:597] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:39.080651 17568 raft_consensus.cc:2272] T b37f46e9bd70474bbc330c12a42a76f5 P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.084141 17568 tablet_replica.cc:333] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.086552 17568 raft_consensus.cc:2243] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.087414 17568 raft_consensus.cc:2272] T 89cba94afb054c008d05b4ea99edd513 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.093523 17568 tablet_replica.cc:333] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.094736 17568 raft_consensus.cc:2243] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Raft consensus shutting down.
W20260709 12:27:39.096105 18887 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.102612 18812 consensus_peers.cc:597] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:39.096581 17568 raft_consensus.cc:2272] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.104792 18887 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:39.106832 17568 tablet_replica.cc:333] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.107924 17568 raft_consensus.cc:2243] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.109476 17568 raft_consensus.cc:2272] T d486b285b7724e2b928affadfca2a6ec P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.118819 19457 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:39.125252 17568 tablet_replica.cc:333] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.128319 17568 raft_consensus.cc:2243] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.129310 17568 raft_consensus.cc:2272] T af66e45540ac4e07bf6fb0db4f2779d7 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.125967 18812 consensus_peers.cc:597] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:39.135808 17568 tablet_replica.cc:333] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
W20260709 12:27:39.140205 18887 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.143270 18887 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.141960 19457 consensus_peers.cc:597] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:39.144930 17568 raft_consensus.cc:2243] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.146524 17568 raft_consensus.cc:2272] T bea8b759be0c4fc6a36e2b34c6d643ae P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.156643 17568 tablet_replica.cc:333] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.157775 17568 raft_consensus.cc:2243] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.159026 17568 raft_consensus.cc:2272] T 77b6876202964e0eae9e454d22ceab60 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.162191 17568 tablet_replica.cc:333] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.168578 17568 raft_consensus.cc:2243] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.170200 17568 raft_consensus.cc:2272] T 5c18545306c9477ba3e214f788705644 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.172385 18887 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.173185 18887 consensus_peers.cc:597] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.208019 18887 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.218566 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:39.222255 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:39.229615 17568 tablet_replica.cc:333] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.230749 17568 raft_consensus.cc:2243] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.231545 17568 raft_consensus.cc:2272] T c1dd3ef9790a461facce64f14c3a5fce P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.254021 18887 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:39.261030 17568 tablet_replica.cc:333] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.262241 17568 raft_consensus.cc:2243] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.263957 17568 raft_consensus.cc:2272] T ace8753143e94362a855362c6b9f55e9 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.267947 17568 tablet_replica.cc:333] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.268970 17568 raft_consensus.cc:2243] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.269685 17568 raft_consensus.cc:2272] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.272812 17568 tablet_replica.cc:333] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.273692 17568 raft_consensus.cc:2243] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.275110 17568 raft_consensus.cc:2272] T cf1f0997197c4e63b1861b420a26416f P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.279861 19457 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.284653 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:39.291680 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:39.295298 17568 tablet_replica.cc:333] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.296407 17568 raft_consensus.cc:2243] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.297564 17568 raft_consensus.cc:2272] T 987becbef0a24ee6a5e0c3eb9a3384cc P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.304183 17568 tablet_replica.cc:333] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.305192 17568 raft_consensus.cc:2243] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.306833 17568 raft_consensus.cc:2272] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.310246 17568 tablet_replica.cc:333] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.312407 17568 raft_consensus.cc:2243] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.313354 17568 raft_consensus.cc:2272] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.316602 17568 tablet_replica.cc:333] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.317627 17568 raft_consensus.cc:2243] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.318573 17568 raft_consensus.cc:2272] T 4eda139ea8094bec9f34a061ca15f982 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.320952 19457 consensus_peers.cc:597] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.321658 19457 consensus_peers.cc:597] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.323031 18812 consensus_peers.cc:597] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:39.346817 17568 tablet_replica.cc:333] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.356899 17568 raft_consensus.cc:2243] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.358976 17568 raft_consensus.cc:2272] T 34d2d90d352e40cb8b6cde778d729c24 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.493685 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:39.502339 18812 consensus_peers.cc:597] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:39.503240 17568 tablet_replica.cc:333] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.505733 17568 raft_consensus.cc:2243] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.523334 17568 raft_consensus.cc:2272] T bbadce60e960476289740ec2afd0a5c8 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:39.528636 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:39.558686 17568 tablet_replica.cc:333] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.564800 17568 raft_consensus.cc:2243] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 29 LEADER]: Raft consensus shutting down.
W20260709 12:27:39.563201 18812 consensus_peers.cc:597] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:39.584199 17568 raft_consensus.cc:2272] T 8b5f0fdf96074deb816d2d3b27fe7143 P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.595775 17568 tablet_replica.cc:333] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
W20260709 12:27:39.588407 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:39.611308 18812 consensus_peers.cc:597] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:39.617040 17568 raft_consensus.cc:2243] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.627977 17568 raft_consensus.cc:2272] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 47b48b5c69f245b79ecb292eff89927f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.639737 29055 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:39.640451 29055 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:39.643123 29030 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:39.643828 29030 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:39.644590 17568 tablet_replica.cc:333] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.656320 17568 raft_consensus.cc:2243] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.660265 18921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:39.660702 29055 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:39.664316 29030 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:39.667037 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:39.683127 17568 raft_consensus.cc:2272] T bf32cd3655eb4943abc0cdbf54a32206 P 47b48b5c69f245b79ecb292eff89927f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.686507 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bb1352a2bd46e7bb08b8e1b6711fe1" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:39.689105 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dca728d7de8469d95dbe82b045bf65e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:39.701459 18812 consensus_peers.cc:597] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:39.707655 17568 tablet_replica.cc:333] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.713598 17568 raft_consensus.cc:2243] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.714434 17568 raft_consensus.cc:2272] T 0d8499bcaf8d4fd3b0236d65471d7006 P 47b48b5c69f245b79ecb292eff89927f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.715375 18812 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:39.734876 29065 raft_consensus.cc:493] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:39.777621 29065 raft_consensus.cc:515] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:39.780635 29065 leader_election.cc:290] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:39.760823 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:39.792430 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 77148.6us
I20260709 12:27:39.793227 18812 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:39.794550 29055 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:39.796319 29030 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:27:39.798444 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:39.802858 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2498b4d0a8462b860b1e4040e4e5bc" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:39.805184 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:39.808261 18812 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:39.834676 18812 leader_election.cc:304] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:39.840806 29030 raft_consensus.cc:2749] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:39.889685 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:39.891386 17568 tablet_replica.cc:333] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:39.893240 17568 raft_consensus.cc:2243] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.904872 17568 raft_consensus.cc:2272] T e8038db5456b47f5af9508f8dcb3883b P 47b48b5c69f245b79ecb292eff89927f [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.933143 29030 raft_consensus.cc:493] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:39.942695 29065 raft_consensus.cc:493] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:39.954519 29030 raft_consensus.cc:515] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:39.954543 29065 raft_consensus.cc:515] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:39.957435 29030 leader_election.cc:290] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:39.959195 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ce381c67cd4b4a8dc16ebe1f6527a0" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:39.957578 29065 leader_election.cc:290] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:39.960181 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65d49b3134d46ba885c7513bd67571f" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
W20260709 12:27:39.949043 18812 consensus_peers.cc:597] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.971577 18812 leader_election.cc:336] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:39.972047 18812 leader_election.cc:304] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:39.974316 29065 raft_consensus.cc:2749] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:27:39.975371 18812 leader_election.cc:336] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:39.975814 18812 leader_election.cc:304] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:39.981520 29065 raft_consensus.cc:2749] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:39.999145 17568 tablet_replica.cc:333] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.010443 29030 raft_consensus.cc:493] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:40.058863 29030 raft_consensus.cc:515] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.061395 29030 leader_election.cc:290] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:40.062635 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b54e62a509d44c3ae8c3e6c013db104" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.064265 29065 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:40.065699 29065 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.068033 29065 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:40.071532 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.069483 17568 raft_consensus.cc:2243] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.075121 17568 raft_consensus.cc:2272] T 6c18380178684f0e93b10d0c7a912d02 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.085837 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d5f339cce949e5b5159e03d3d9f348" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:40.087646 18812 leader_election.cc:336] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.088227 18812 leader_election.cc:304] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:40.089028 29065 raft_consensus.cc:2749] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:40.094005 29065 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:40.094631 29065 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.096890 29065 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:40.098449 29065 raft_consensus.cc:493] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:40.098613 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.099211 29065 raft_consensus.cc:515] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.102855 17568 tablet_replica.cc:333] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.110087 17568 raft_consensus.cc:2243] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.104684 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.105330 29065 leader_election.cc:290] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:40.103310 18812 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:40.119197 29065 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:40.121985 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:40.120628 17568 raft_consensus.cc:2272] T 0ccd682aee974b58818f7327974e2aa0 P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.124522 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bf73a138f349e787495351ffd803b7" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:40.131357 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73828daf5c2b417fb99b9a563c19c850" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
W20260709 12:27:40.143384 18812 consensus_peers.cc:597] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:40.160064 18812 leader_election.cc:304] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:40.151414 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:40.162669 29065 raft_consensus.cc:2749] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:40.162969 29060 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.163739 29060 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.168223 18812 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:40.169183 29065 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:40.178385 29030 raft_consensus.cc:493] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:40.179003 29030 raft_consensus.cc:515] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.181950 29030 leader_election.cc:290] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:40.183527 29065 raft_consensus.cc:493] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:40.182770 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.185338 29065 raft_consensus.cc:515] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.187654 29065 leader_election.cc:290] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:40.189569 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:40.190547 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c1ae2a327b421383ffacb5d5831a0e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:40.190892 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cbcb3f54b5453eaa89ac9bf8859e93" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.197111 29060 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:40.274457 17568 tablet_replica.cc:333] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.275152 29064 raft_consensus.cc:493] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 43b520eabb65493abe84f4cf06806cba)
I20260709 12:27:40.201071 18812 leader_election.cc:304] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:40.307092 29064 raft_consensus.cc:515] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.283311 29065 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:40.308195 29065 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.309595 29064 leader_election.cc:290] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:40.310222 29064 raft_consensus.cc:2749] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:40.311067 29065 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:40.307521 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 106544us
I20260709 12:27:40.312950 18812 leader_election.cc:304] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:40.313072 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.316536 29030 raft_consensus.cc:2749] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:40.318665 29065 raft_consensus.cc:493] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:40.319376 29065 raft_consensus.cc:515] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.323092 29065 leader_election.cc:290] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:40.323836 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e216d91bdc543ad8e4ba4e9346f7b3a" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 36 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.320977 17568 raft_consensus.cc:2243] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 30 LEADER]: Raft consensus shutting down.
W20260709 12:27:40.298120 18886 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.350915 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcb82468fe454b951282d52761a6c3" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:40.351565 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2054e631aee84e6d9d5435f9031fec9e" candidate_uuid: "47b48b5c69f245b79ecb292eff89927f" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:40.354507 29060 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.371670 29060 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.374328 29061 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.375005 29061 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.375905 29060 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:40.377151 29061 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:40.335561 18812 leader_election.cc:336] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:40.380384 18812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 44858.9us
W20260709 12:27:40.380955 18812 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.381420 18812 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:40.382652 29065 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:40.355391 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 57307.5us
I20260709 12:27:40.334345 17568 raft_consensus.cc:2272] T 5a38dabcd47249aebb1f53168be39bbc P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.395159 29061 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.395744 29061 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.398756 29061 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:40.403139 29070 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.403702 29070 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:40.406502 18812 leader_election.cc:336] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.407014 18812 leader_election.cc:304] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:40.408885 29070 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:40.423671 17568 tablet_replica.cc:333] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.424741 17568 raft_consensus.cc:2243] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.434579 29065 raft_consensus.cc:2749] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:27:40.436709 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.437234 18887 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:40.437460 17568 raft_consensus.cc:2272] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.440268 29070 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:40.440580 17568 tablet_replica.cc:333] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.441636 17568 raft_consensus.cc:2243] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.459146 18812 leader_election.cc:304] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47b48b5c69f245b79ecb292eff89927f; no voters: 1e2529a8cff04207bb1b07c108e16983, 43b520eabb65493abe84f4cf06806cba
W20260709 12:27:40.471275 18812 raft_consensus.cc:2686] T 0adcb82468fe454b951282d52761a6c3 P 47b48b5c69f245b79ecb292eff89927f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:40.442296 17568 raft_consensus.cc:2272] T b7d5f339cce949e5b5159e03d3d9f348 P 47b48b5c69f245b79ecb292eff89927f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.491657 17568 tablet_replica.cc:333] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.496524 17568 raft_consensus.cc:2243] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.498014 17568 raft_consensus.cc:2272] T 910a21b48434464ba8cc8f1f36ba2346 P 47b48b5c69f245b79ecb292eff89927f [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.501533 17568 tablet_replica.cc:333] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
W20260709 12:27:40.504937 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:40.510016 18886 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:40.514664 18812 consensus_peers.cc:597] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:40.520380 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.506148 17568 raft_consensus.cc:2243] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 27 LEADER]: Raft consensus shutting down.
W20260709 12:27:40.521831 18812 consensus_peers.cc:597] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:40.523424 17568 raft_consensus.cc:2272] T 9317d76b36ff4814b60c58870accf4ec P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.526726 17568 tablet_replica.cc:333] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.534510 18887 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:40.536110 29070 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:40.520433 18886 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:40.539103 18887 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.540017 18887 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:40.540992 29070 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:40.536187 17568 raft_consensus.cc:2243] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.550534 17568 raft_consensus.cc:2272] T a65d49b3134d46ba885c7513bd67571f P 47b48b5c69f245b79ecb292eff89927f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.554664 17568 tablet_replica.cc:333] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.556623 17568 raft_consensus.cc:2243] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.557763 17568 raft_consensus.cc:2272] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 47b48b5c69f245b79ecb292eff89927f [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:40.547323 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.559275 29068 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.559875 29068 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.560953 17568 tablet_replica.cc:333] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
W20260709 12:27:40.558801 18886 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.561836 17568 raft_consensus.cc:2243] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.562356 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:40.563023 29070 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.564517 29070 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.565336 17568 raft_consensus.cc:2272] T 9b54e62a509d44c3ae8c3e6c013db104 P 47b48b5c69f245b79ecb292eff89927f [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.566772 29070 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:40.567025 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:40.567695 19456 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.567795 29070 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:40.568147 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:40.563884 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.569100 29035 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:40.569581 18886 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.570199 29068 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:40.575212 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:40.576028 29070 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:40.577273 18886 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:40.578117 17568 tablet_replica.cc:333] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.586537 29070 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.586830 17568 raft_consensus.cc:2243] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.587162 29070 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.588011 17568 raft_consensus.cc:2272] T 5f60880728ad4cb19bd4cb835996961f P 47b48b5c69f245b79ecb292eff89927f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.589754 29070 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:40.591053 17568 tablet_replica.cc:333] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.592089 17568 raft_consensus.cc:2243] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.595293 17568 raft_consensus.cc:2272] T 2054e631aee84e6d9d5435f9031fec9e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.603956 17568 tablet_replica.cc:333] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.612403 17568 raft_consensus.cc:2243] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.613745 17568 raft_consensus.cc:2272] T 94efc7ae4146469f94df524ec5b89c77 P 47b48b5c69f245b79ecb292eff89927f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:40.611340 18887 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:40.618054 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:40.619351 18886 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:40.620473 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:40.624740 17568 tablet_replica.cc:333] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
W20260709 12:27:40.628155 18886 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.630592 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:40.629768 17568 raft_consensus.cc:2243] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.631587 29051 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:40.632756 18886 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.638622 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:40.640764 29051 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:40.641892 17568 raft_consensus.cc:2272] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.646178 17568 tablet_replica.cc:333] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.647130 17568 raft_consensus.cc:2243] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.647987 17568 raft_consensus.cc:2272] T d6c1ae2a327b421383ffacb5d5831a0e P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.650911 17568 tablet_replica.cc:333] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.655845 17568 raft_consensus.cc:2243] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.656772 17568 raft_consensus.cc:2272] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.661545 17568 tablet_replica.cc:333] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.667133 17568 raft_consensus.cc:2243] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.668340 17568 raft_consensus.cc:2272] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 47b48b5c69f245b79ecb292eff89927f [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.683665 17568 tablet_replica.cc:333] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
W20260709 12:27:40.686115 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:40.691725 17568 raft_consensus.cc:2243] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.693284 17568 raft_consensus.cc:2272] T 1485e54f9795416785f4baf244599201 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.696481 17568 tablet_replica.cc:333] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.701938 29035 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.707806 29035 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:40.715543 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "43b520eabb65493abe84f4cf06806cba" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "674d77fe8bcb4c768537ebae4be828bd" is_pre_election: true
I20260709 12:27:40.716257 29035 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:40.717541 17568 raft_consensus.cc:2243] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 31 LEADER]: Raft consensus shutting down.
W20260709 12:27:40.718967 19457 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:40.720836 19457 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
W20260709 12:27:40.721791 19456 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.722076 17568 raft_consensus.cc:2272] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 47b48b5c69f245b79ecb292eff89927f [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.723752 29035 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:27:40.732949 17568 tablet_replica.cc:333] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.733997 17568 raft_consensus.cc:2243] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.744709 17568 raft_consensus.cc:2272] T 847dd0f72f3f4a6c8834194b02858750 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.749244 17568 tablet_replica.cc:333] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.750226 17568 raft_consensus.cc:2243] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.754431 17568 raft_consensus.cc:2272] T 91bf73a138f349e787495351ffd803b7 P 47b48b5c69f245b79ecb292eff89927f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.757697 17568 tablet_replica.cc:333] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.765566 17568 raft_consensus.cc:2243] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.771303 17568 raft_consensus.cc:2272] T 3dca728d7de8469d95dbe82b045bf65e P 47b48b5c69f245b79ecb292eff89927f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.782127 17568 tablet_replica.cc:333] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.782886 17568 raft_consensus.cc:2243] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.787492 17568 raft_consensus.cc:2272] T 73828daf5c2b417fb99b9a563c19c850 P 47b48b5c69f245b79ecb292eff89927f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.801486 17568 tablet_replica.cc:333] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.802464 17568 raft_consensus.cc:2243] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.803855 17568 raft_consensus.cc:2272] T 0406e95e375e45c495fe295f541d7cd4 P 47b48b5c69f245b79ecb292eff89927f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.806881 17568 tablet_replica.cc:333] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f: stopping tablet replica
I20260709 12:27:40.807655 17568 raft_consensus.cc:2243] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.808414 17568 raft_consensus.cc:2272] T 5a2498b4d0a8462b860b1e4040e4e5bc P 47b48b5c69f245b79ecb292eff89927f [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:40.841183 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:40.927217 29061 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.927856 29061 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:40.931598 29061 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:40.942684 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:40.951638 18886 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:40.952637 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:40.953516 29051 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:40.991493 29061 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:40.992076 29061 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:40.993531 18886 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:41.003448 29061 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:41.006806 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:41.008112 19486 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
W20260709 12:27:41.006947 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:41.028311 18886 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:41.031433 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:41.034534 29061 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:41.049988 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:41.089329 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:41.162062 18887 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.187328 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:41.215807 19457 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.218040 18887 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.258738 18887 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.283104 18887 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.310561 29068 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.311194 29068 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:41.313462 29068 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:41.326881 19457 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:41.345920 19457 consensus_peers.cc:597] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.358814 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:41.359395 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:41.365744 29058 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:27:41.375687 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:41.381116 18886 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:41.386118 19457 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.394114 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:41.404594 19457 consensus_peers.cc:597] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.405170 18887 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.412904 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:41.447081 19457 consensus_peers.cc:597] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.466077 19457 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.501312 18887 consensus_peers.cc:597] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.517488 18887 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.519467 18887 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.522353 29068 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.523025 29068 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:41.524530 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:41.525223 29068 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:41.532720 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:41.537451 19456 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:41.538074 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:41.539017 29068 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:41.540428 29061 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.541189 29061 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:41.546002 29068 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.546626 29068 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:41.567883 29068 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:41.569921 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:41.572671 29061 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:41.576857 19457 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:41.577708 18887 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.582820 19457 consensus_peers.cc:597] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.582384 19456 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:41.584136 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:41.585652 29068 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:41.589515 19457 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.600028 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:41.607707 18886 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:41.608397 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:41.609299 29075 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:41.612051 19457 consensus_peers.cc:597] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.613660 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:41.627624 18887 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.697664 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:41.701159 18887 consensus_peers.cc:597] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.781283 29051 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.781841 29051 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:41.784343 19457 consensus_peers.cc:597] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.784950 29075 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.785496 29075 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:41.787744 29075 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:41.807739 18887 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:41.814694 29051 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:41.822098 18887 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:41.880215 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 58149.1us
W20260709 12:27:41.874891 19457 consensus_peers.cc:597] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.858887 29068 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.895057 29068 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:41.895435 29051 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.896157 29051 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:41.897766 29068 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:41.898241 29051 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:41.921452 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:41.888221 18886 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:41.928306 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:41.933254 19457 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:41.938216 29051 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:41.938938 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 60112.1us
W20260709 12:27:41.941354 18886 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:41.947575 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:41.945465 19456 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:41.954265 29058 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.956652 29058 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:41.959976 29058 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:41.962412 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:41.964672 29051 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:27:41.967796 29076 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:41.969293 29076 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:41.971700 29076 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:41.975147 29068 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:27:41.988119 19457 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.999854 18887 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:42.004894 18887 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:42.015586 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:42.016378 19486 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 28.
W20260709 12:27:42.013434 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.037583 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.041594 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:42.055404 19456 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.059037 19456 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.062623 29068 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:27:42.067999 17568 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18869)
I20260709 12:27:42.088639 29051 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.089242 29051 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.091518 29051 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:42.092362 29076 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.093026 29076 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.095615 29076 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:42.122262 29061 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.122946 29061 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.125676 29061 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:42.128623 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 
I20260709 12:27:42.131207 29051 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.133116 29051 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.140349 29051 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:42.132409 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:42.144014 29076 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:27:42.144583 29076 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Starting leader election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.145056 29076 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:27:42.130621 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:42.164494 18886 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.193845 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.205927 29051 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:42.208909 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:42.212329 18887 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:42.240658 18887 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:42.241720 18887 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:42.176766 29076 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:42.275411 29076 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Requested vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
W20260709 12:27:42.285569 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.303897 18887 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.304657 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.306923 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:42.325053 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0406e95e375e45c495fe295f541d7cd4" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba"
I20260709 12:27:42.325824 19483 raft_consensus.cc:3060] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:27:42.370359 18886 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.380286 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:42.372977 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 49431.5us
W20260709 12:27:42.385913 18887 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:42.378715 19483 raft_consensus.cc:2468] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
I20260709 12:27:42.386615 29051 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:42.387370 18886 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.389909 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.390834 29051 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:27:42.398701 18886 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.402349 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.406456 29051 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:42.407696 18886 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.408584 18886 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.409412 29051 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:42.499447 29051 raft_consensus.cc:493] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.500015 29051 raft_consensus.cc:515] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.502259 29051 leader_election.cc:290] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:42.510134 29058 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.511310 29058 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:42.513940 29058 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:42.529812 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:42.527300 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.536113 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.543596 19456 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.545954 19456 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:42.549149 18887 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:42.552582 29058 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:42.560323 18886 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.566984 29051 raft_consensus.cc:2804] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:27:42.568714 29051 raft_consensus.cc:697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Becoming Leader. State: Replica: 674d77fe8bcb4c768537ebae4be828bd, State: Running, Role: LEADER
I20260709 12:27:42.569918 29051 consensus_queue.cc:237] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:42.640439 29076 raft_consensus.cc:493] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.641155 29076 raft_consensus.cc:515] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.643786 29076 leader_election.cc:290] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:42.646915 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:42.665529 18669 catalog_manager.cc:5697] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd reported cstate change: term changed from 28 to 29, leader changed from 47b48b5c69f245b79ecb292eff89927f (127.17.40.2) to 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3). New cstate: current_term: 29 leader_uuid: "674d77fe8bcb4c768537ebae4be828bd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:42.692004 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 45136.4us
W20260709 12:27:42.697990 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:42.724159 29051 raft_consensus.cc:493] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.724941 29051 raft_consensus.cc:515] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.727622 29051 leader_election.cc:290] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:42.760210 18887 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.780257 18887 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.781533 18886 leader_election.cc:336] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.782202 18886 leader_election.cc:304] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.784349 29061 raft_consensus.cc:2749] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:42.809824 18886 leader_election.cc:336] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.811231 18886 leader_election.cc:304] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.812124 29075 raft_consensus.cc:2749] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:42.813452 18886 leader_election.cc:336] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.814025 18886 leader_election.cc:304] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.814895 29075 raft_consensus.cc:2749] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:27:42.849498 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:42.853343 29075 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.853940 29075 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.855686 29075 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:42.861428 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.862620 18886 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:42.869685 18886 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.870260 18886 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.871089 29075 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:42.882257 29075 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:42.883278 29075 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:42.889779 29075 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:42.890376 18887 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:42.927698 18886 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:42.928638 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:42.929548 29080 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:42.934756 18886 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:42.989470 19483 raft_consensus.cc:1275] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Refusing update from remote peer 674d77fe8bcb4c768537ebae4be828bd: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 12:27:42.991207 29080 consensus_queue.cc:1048] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:27:43.015872 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:43.068571 17568 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18869)
W20260709 12:27:43.096547 18887 consensus_peers.cc:597] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:43.135710 29058 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.136385 29058 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:43.143289 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:43.149652 19457 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:43.150502 19457 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:43.154663 29074 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:27:43.147357 29058 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.168992 18886 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:43.273092 29080 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.273746 29080 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:43.281636 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:43.287021 29080 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:43.289126 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:43.291919 19483 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
W20260709 12:27:43.294466 18886 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:43.295053 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:43.295907 29075 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:43.304096 18887 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:43.309871 29075 raft_consensus.cc:493] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.310483 29075 raft_consensus.cc:515] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:43.312493 29075 leader_election.cc:290] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.408890 18887 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:43.417155 18886 leader_election.cc:336] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:43.462014 18886 leader_election.cc:304] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:43.463212 29080 raft_consensus.cc:2749] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:43.464735 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 47790.5us
I20260709 12:27:43.459236 29074 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.467254 29074 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:43.476800 29074 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.485682 19457 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:43.488673 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:43.525749 19456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111) [suppressed 671 similar messages]
W20260709 12:27:43.528383 19458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:41535, user_credentials={real_user=slave}} blocked reactor thread for 44912.3us
I20260709 12:27:43.531929 29091 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.533139 29091 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:43.542079 19457 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:43.543226 29091 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.551151 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:43.552008 19456 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:43.552389 19456 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:43.584434 29094 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:43.590183 18886 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:43.590912 18886 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:43.591463 18886 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:43.595052 19456 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:43.595659 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:43.596522 29074 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:27:43.597743 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:43.673436 19457 consensus_peers.cc:597] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:43.709100 29051 raft_consensus.cc:493] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
W20260709 12:27:43.709816 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:43.709911 29051 raft_consensus.cc:515] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:43.713682 29051 leader_election.cc:290] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.719926 18887 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:43.726027 18886 leader_election.cc:336] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:43.726613 18886 leader_election.cc:304] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:43.734738 29051 raft_consensus.cc:2749] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:43.742313 19457 consensus_peers.cc:597] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:43.748661 29074 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.749409 29074 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:43.753278 29074 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.760914 19456 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:43.765677 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:43.766288 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:43.768888 29074 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:43.781809 29074 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.782673 29074 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:43.792133 19456 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:43.798170 29074 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.800187 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:43.801098 19457 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:43.802537 29074 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:43.813840 18886 consensus_peers.cc:597] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:43.819242 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:27:43.852114 29080 raft_consensus.cc:493] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.853000 29080 raft_consensus.cc:515] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:43.853868 19457 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:43.856506 29080 leader_election.cc:290] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.857067 19457 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:43.884064 18887 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:43.885398 29080 raft_consensus.cc:493] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:43.886272 29080 raft_consensus.cc:515] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:43.889039 29080 leader_election.cc:290] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:43.889189 18886 leader_election.cc:336] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:43.893400 18886 leader_election.cc:304] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:43.885632 19457 consensus_peers.cc:597] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:43.898329 19457 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:43.899899 29075 raft_consensus.cc:2749] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:27:43.904748 18887 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:43.935423 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:43.996661 18886 leader_election.cc:336] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:44.011617 19457 consensus_peers.cc:597] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:44.013739 18886 leader_election.cc:304] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:44.017632 29075 raft_consensus.cc:2749] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:44.031154 18887 consensus_peers.cc:597] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.035326 18887 consensus_peers.cc:597] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.055738 19457 consensus_peers.cc:597] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.087188 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:44937, user_credentials={real_user=slave}} blocked reactor thread for 47988.3us
W20260709 12:27:44.089069 18886 consensus_peers.cc:597] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:44.089931 18887 consensus_peers.cc:597] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.093739 18887 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:44.111129 29075 raft_consensus.cc:493] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:44.111831 29075 raft_consensus.cc:515] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:44.114331 29075 leader_election.cc:290] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:44.119491 18886 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:44.126055 18887 consensus_peers.cc:597] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.142902 18887 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:44.145445 18887 consensus_peers.cc:597] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.145910 18886 leader_election.cc:336] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:44.147096 18886 leader_election.cc:304] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:44.149075 29075 raft_consensus.cc:2749] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:27:44.160089 18886 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:44.181816 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:44.188769 18887 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.226284 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:44.234056 18887 consensus_peers.cc:597] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.270783 19457 consensus_peers.cc:597] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.282537 18887 consensus_peers.cc:597] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.322579 19457 consensus_peers.cc:597] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.352196 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:44.358371 18887 consensus_peers.cc:597] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.415225 19457 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.418932 19457 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:44.437690 29074 raft_consensus.cc:493] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:44.438557 29074 raft_consensus.cc:515] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:44.447731 29074 leader_election.cc:290] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:44.455257 19456 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:44.457492 19457 leader_election.cc:336] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:44.457967 19457 leader_election.cc:304] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:44.461072 29074 raft_consensus.cc:2749] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:44.513245 29075 raft_consensus.cc:493] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:44.514135 29075 raft_consensus.cc:515] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:44.521407 29075 leader_election.cc:290] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:44.523120 18886 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:44.526522 18887 leader_election.cc:336] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:44.527030 18887 leader_election.cc:304] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:44.530119 29099 raft_consensus.cc:2749] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:44.536249 18886 consensus_peers.cc:597] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:44.579895 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:44.580729 18887 consensus_peers.cc:597] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:44.591678 29099 raft_consensus.cc:493] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:44.592381 29099 raft_consensus.cc:515] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:44.594925 29099 leader_election.cc:290] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:44.605844 18886 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:44.606633 18887 leader_election.cc:336] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:44.607285 18887 leader_election.cc:304] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:44.609387 29075 raft_consensus.cc:2749] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:44.615600 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:44.634639 18887 consensus_peers.cc:597] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.635373 18887 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.652781 18887 consensus_peers.cc:597] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:44.718521 18886 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:44.818744 29080 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:44.819600 29080 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:44.823186 29080 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 43b520eabb65493abe84f4cf06806cba (127.17.40.4:44937)
I20260709 12:27:44.825914 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5f0fdf96074deb816d2d3b27fe7143" candidate_uuid: "674d77fe8bcb4c768537ebae4be828bd" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "43b520eabb65493abe84f4cf06806cba" is_pre_election: true
I20260709 12:27:44.827000 19483 raft_consensus.cc:2468] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674d77fe8bcb4c768537ebae4be828bd in term 29.
I20260709 12:27:44.829646 17568 tablet_server.cc:196] TabletServer@127.17.40.2:0 shutdown complete.
W20260709 12:27:44.847038 18887 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:44.847811 18887 consensus_peers.cc:597] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:44.853986 29080 raft_consensus.cc:493] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:44.859406 29080 raft_consensus.cc:515] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:44.864770 18886 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:44.866466 29080 leader_election.cc:290] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:44.871179 18887 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:44.953516 18887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:36959, user_credentials={real_user=slave}} blocked reactor thread for 82367.3us
I20260709 12:27:44.950080 18886 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba, 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:44.956244 29080 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:44.966372 18886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:46365, user_credentials={real_user=slave}} blocked reactor thread for 101626us
I20260709 12:27:45.126820 17568 tablet_server.cc:179] TabletServer@127.17.40.3:0 shutting down...
W20260709 12:27:45.136792 19458 consensus_peers.cc:597] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.143797 29103 raft_consensus.cc:493] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:45.144583 29103 raft_consensus.cc:515] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
I20260709 12:27:45.151899 29080 raft_consensus.cc:493] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:45.152467 29080 raft_consensus.cc:515] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } }
W20260709 12:27:45.153012 18887 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:45.153944 29103 leader_election.cc:290] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
I20260709 12:27:45.155023 29080 leader_election.cc:290] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:45.162426 18886 leader_election.cc:336] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:45.163008 18886 leader_election.cc:304] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
W20260709 12:27:45.165944 18886 consensus_peers.cc:597] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:27:45.166942 29103 raft_consensus.cc:2749] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:45.171044 18886 consensus_peers.cc:597] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:45.179242 18887 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:45.193038 19458 consensus_peers.cc:597] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:45.202726 18886 leader_election.cc:336] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:45.203281 18886 leader_election.cc:304] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:45.206494 29080 raft_consensus.cc:2749] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:45.207590 18886 leader_election.cc:336] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:45.208040 18886 leader_election.cc:304] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 674d77fe8bcb4c768537ebae4be828bd; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:45.208730 29099 raft_consensus.cc:2749] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:27:45.214854 18886 consensus_peers.cc:597] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.218303 18886 consensus_peers.cc:597] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:45.221125 19458 consensus_peers.cc:597] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.259367 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:45.260699 17568 tablet_replica.cc:333] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.261998 17568 raft_consensus.cc:2243] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.263684 17568 raft_consensus.cc:2272] T a24ba3693ff3438f831ba2ec6a724700 P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.267773 17568 tablet_replica.cc:333] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.269313 17568 raft_consensus.cc:2243] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.271199 17568 raft_consensus.cc:2272] T 89cba94afb054c008d05b4ea99edd513 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.274468 17568 tablet_replica.cc:333] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.275732 17568 raft_consensus.cc:2243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.276425 17568 raft_consensus.cc:2272] T 84ea4e9cc4d9482b920ad086bf4b1305 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.279867 17568 tablet_replica.cc:333] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.281352 17568 raft_consensus.cc:2243] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.282284 17568 raft_consensus.cc:2272] T d486b285b7724e2b928affadfca2a6ec P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.286168 17568 tablet_replica.cc:333] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.287200 17568 raft_consensus.cc:2243] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.288045 17568 raft_consensus.cc:2272] T 3bac759d8cf2478e874f15f02c6c54fb P 674d77fe8bcb4c768537ebae4be828bd [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.291121 17568 tablet_replica.cc:333] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.292121 17568 raft_consensus.cc:2243] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.293092 17568 raft_consensus.cc:2272] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.296273 17568 tablet_replica.cc:333] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.297214 17568 raft_consensus.cc:2243] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.300966 17568 raft_consensus.cc:2272] T 8b5f0fdf96074deb816d2d3b27fe7143 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.304177 17568 tablet_replica.cc:333] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.305387 17568 raft_consensus.cc:2243] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.306680 17568 raft_consensus.cc:2272] T 7e611ab2e6fe4fca8d3dd28957f1d17d P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.309679 17568 tablet_replica.cc:333] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.310647 17568 raft_consensus.cc:2243] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.314772 17568 raft_consensus.cc:2272] T bf32cd3655eb4943abc0cdbf54a32206 P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.318182 17568 tablet_replica.cc:333] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.320540 17568 raft_consensus.cc:2243] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.321671 17568 raft_consensus.cc:2272] T ace8753143e94362a855362c6b9f55e9 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:45.323997 19458 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.324780 17568 tablet_replica.cc:333] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.325822 17568 raft_consensus.cc:2243] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.326627 17568 raft_consensus.cc:2272] T 5c18545306c9477ba3e214f788705644 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.329866 17568 tablet_replica.cc:333] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.330817 17568 raft_consensus.cc:2243] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.332907 17568 raft_consensus.cc:2272] T c1dd3ef9790a461facce64f14c3a5fce P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.336714 17568 tablet_replica.cc:333] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.337777 17568 raft_consensus.cc:2243] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.339413 17568 raft_consensus.cc:2272] T 77b6876202964e0eae9e454d22ceab60 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.342998 17568 tablet_replica.cc:333] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.344012 17568 raft_consensus.cc:2243] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.345036 17568 raft_consensus.cc:2272] T cf1f0997197c4e63b1861b420a26416f P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.348479 17568 tablet_replica.cc:333] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.349457 17568 raft_consensus.cc:2243] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.350643 17568 raft_consensus.cc:2272] T 7d92766f8c3c42b9aa8708c1d7d317c2 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.353935 17568 tablet_replica.cc:333] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.355013 17568 raft_consensus.cc:2243] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.358327 17568 raft_consensus.cc:2272] T 0939ca2ad5484a34aa9e9f7f8075cb2d P 674d77fe8bcb4c768537ebae4be828bd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.362911 17568 tablet_replica.cc:333] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.363883 17568 raft_consensus.cc:2243] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.365897 17568 raft_consensus.cc:2272] T 4eda139ea8094bec9f34a061ca15f982 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.369328 17568 tablet_replica.cc:333] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.370244 17568 raft_consensus.cc:2243] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.371264 17568 raft_consensus.cc:2272] T 6c18380178684f0e93b10d0c7a912d02 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.378666 17568 tablet_replica.cc:333] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.379654 17568 raft_consensus.cc:2243] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.380848 17568 raft_consensus.cc:2272] T 0ccd682aee974b58818f7327974e2aa0 P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.384290 17568 tablet_replica.cc:333] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.385326 17568 raft_consensus.cc:2243] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.386806 17568 raft_consensus.cc:2272] T e9168ac06d4b4b11ac8272d328166702 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.391232 17568 tablet_replica.cc:333] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.392156 17568 raft_consensus.cc:2243] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.393643 17568 raft_consensus.cc:2272] T b7d5f339cce949e5b5159e03d3d9f348 P 674d77fe8bcb4c768537ebae4be828bd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.396946 17568 tablet_replica.cc:333] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.397902 17568 raft_consensus.cc:2243] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.400225 17568 raft_consensus.cc:2272] T a65d49b3134d46ba885c7513bd67571f P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.404721 17568 tablet_replica.cc:333] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.405872 17568 raft_consensus.cc:2243] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.406665 17568 raft_consensus.cc:2272] T 20fd9926cbc04b9b9436afef7b0d1f6f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.410096 17568 tablet_replica.cc:333] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.411000 17568 raft_consensus.cc:2243] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.412446 17568 raft_consensus.cc:2272] T 910a21b48434464ba8cc8f1f36ba2346 P 674d77fe8bcb4c768537ebae4be828bd [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.415870 17568 tablet_replica.cc:333] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.416793 17568 raft_consensus.cc:2243] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.417573 17568 raft_consensus.cc:2272] T 084cf9f30114499b94cf93587f0788f5 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:45.419683 19458 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.420729 17568 tablet_replica.cc:333] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.421752 17568 raft_consensus.cc:2243] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.424691 17568 raft_consensus.cc:2272] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 674d77fe8bcb4c768537ebae4be828bd [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.428021 17568 tablet_replica.cc:333] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.428931 17568 raft_consensus.cc:2243] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.430302 17568 raft_consensus.cc:2272] T 0e216d91bdc543ad8e4ba4e9346f7b3a P 674d77fe8bcb4c768537ebae4be828bd [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.433637 17568 tablet_replica.cc:333] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.434785 17568 raft_consensus.cc:2243] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 28 LEADER]: Raft consensus shutting down.
W20260709 12:27:45.435317 19458 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.436395 17568 raft_consensus.cc:2272] T c6ce381c67cd4b4a8dc16ebe1f6527a0 P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.440044 17568 tablet_replica.cc:333] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.440964 17568 raft_consensus.cc:2243] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.441732 17568 raft_consensus.cc:2272] T d6c1ae2a327b421383ffacb5d5831a0e P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.444892 17568 tablet_replica.cc:333] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.445812 17568 raft_consensus.cc:2243] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.446640 17568 raft_consensus.cc:2272] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.449879 17568 tablet_replica.cc:333] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.450850 17568 raft_consensus.cc:2243] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Raft consensus shutting down.
W20260709 12:27:45.451414 19458 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.452309 17568 raft_consensus.cc:2272] T d14b13acceee47439963d9c58e4b6d39 P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.455360 17568 tablet_replica.cc:333] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.456279 17568 raft_consensus.cc:2243] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.457033 17568 raft_consensus.cc:2272] T 38d69daa256f430796196f10dfcaad2f P 674d77fe8bcb4c768537ebae4be828bd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.460250 17568 tablet_replica.cc:333] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.461095 17568 raft_consensus.cc:2243] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.462639 17568 raft_consensus.cc:2272] T 9b54e62a509d44c3ae8c3e6c013db104 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.467684 17568 tablet_replica.cc:333] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.468605 17568 raft_consensus.cc:2243] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.469791 17568 raft_consensus.cc:2272] T 5f60880728ad4cb19bd4cb835996961f P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:45.471292 19458 consensus_peers.cc:597] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.472752 17568 tablet_replica.cc:333] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
W20260709 12:27:45.473311 19458 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.473722 17568 raft_consensus.cc:2243] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.475806 17568 raft_consensus.cc:2272] T 2054e631aee84e6d9d5435f9031fec9e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:45.476306 19458 consensus_peers.cc:597] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.478359 17568 tablet_replica.cc:333] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.479101 17568 raft_consensus.cc:2243] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.479753 17568 raft_consensus.cc:2272] T 94efc7ae4146469f94df524ec5b89c77 P 674d77fe8bcb4c768537ebae4be828bd [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.481881 17568 tablet_replica.cc:333] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.482504 17568 raft_consensus.cc:2243] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.483139 17568 raft_consensus.cc:2272] T 4cd048e748d347889eab552ac02ed00f P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.485267 17568 tablet_replica.cc:333] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.486043 17568 raft_consensus.cc:2243] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.487324 17568 raft_consensus.cc:2272] T 73828daf5c2b417fb99b9a563c19c850 P 674d77fe8bcb4c768537ebae4be828bd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.489867 17568 tablet_replica.cc:333] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.490712 17568 raft_consensus.cc:2243] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.491587 17568 raft_consensus.cc:2272] T 93bc6f2b3fb14454abe2ad1ae89ea6e5 P 674d77fe8bcb4c768537ebae4be828bd [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.494481 17568 tablet_replica.cc:333] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.495280 17568 raft_consensus.cc:2243] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.496382 17568 raft_consensus.cc:2272] T bea8b759be0c4fc6a36e2b34c6d643ae P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.499289 17568 tablet_replica.cc:333] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.500087 17568 raft_consensus.cc:2243] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.501585 17568 raft_consensus.cc:2272] T af66e45540ac4e07bf6fb0db4f2779d7 P 674d77fe8bcb4c768537ebae4be828bd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.504621 17568 tablet_replica.cc:333] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.505442 17568 raft_consensus.cc:2243] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.506760 17568 raft_consensus.cc:2272] T 0406e95e375e45c495fe295f541d7cd4 P 674d77fe8bcb4c768537ebae4be828bd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.509619 17568 tablet_replica.cc:333] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.510380 17568 raft_consensus.cc:2243] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.511101 17568 raft_consensus.cc:2272] T 847dd0f72f3f4a6c8834194b02858750 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.513844 17568 tablet_replica.cc:333] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.514695 17568 raft_consensus.cc:2243] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.515345 17568 raft_consensus.cc:2272] T 9134ec4fb92645b28a9b4814179c1c7c P 674d77fe8bcb4c768537ebae4be828bd [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.518144 17568 tablet_replica.cc:333] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.518963 17568 raft_consensus.cc:2243] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.519726 17568 raft_consensus.cc:2272] T 91bf73a138f349e787495351ffd803b7 P 674d77fe8bcb4c768537ebae4be828bd [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:45.519938 19458 consensus_peers.cc:597] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:45.521507 19456 consensus_peers.cc:597] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:27:45.522810 17568 tablet_replica.cc:333] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.523435 17568 raft_consensus.cc:2243] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.524493 17568 raft_consensus.cc:2272] T 3dca728d7de8469d95dbe82b045bf65e P 674d77fe8bcb4c768537ebae4be828bd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.526731 17568 tablet_replica.cc:333] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.527261 17568 raft_consensus.cc:2243] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.528172 17568 raft_consensus.cc:2272] T 5a2498b4d0a8462b860b1e4040e4e5bc P 674d77fe8bcb4c768537ebae4be828bd [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.530334 17568 tablet_replica.cc:333] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd: stopping tablet replica
I20260709 12:27:45.530929 17568 raft_consensus.cc:2243] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.531947 17568 raft_consensus.cc:2272] T ca478d842a8f406087ef2855fb0363a8 P 674d77fe8bcb4c768537ebae4be828bd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.605753 29094 raft_consensus.cc:493] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:45.606346 29094 raft_consensus.cc:515] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:45.611580 29094 leader_election.cc:290] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:45.629105 19457 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:45.640453 19456 leader_election.cc:336] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:45.641039 19456 leader_election.cc:304] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:45.641933 29102 raft_consensus.cc:2749] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:27:45.658141 19458 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:45.671211 19458 consensus_peers.cc:597] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:45.689610 19458 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Couldn't send request to peer 674d77fe8bcb4c768537ebae4be828bd. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:45.798132 29102 raft_consensus.cc:493] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:45.798753 29102 raft_consensus.cc:515] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:45.801064 29102 leader_election.cc:290] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:45.806268 19456 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:45.807055 19457 leader_election.cc:336] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:45.807547 19457 leader_election.cc:304] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:45.808339 29074 raft_consensus.cc:2749] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:27:45.965823 29074 raft_consensus.cc:493] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:45.966411 29074 raft_consensus.cc:515] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:45.968757 29074 leader_election.cc:290] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:45.974294 19457 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:45.975317 19456 leader_election.cc:336] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:45.975775 19456 leader_election.cc:304] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:45.976586 29074 raft_consensus.cc:2749] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:46.051364 19456 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:46.080757 29074 raft_consensus.cc:493] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:46.081393 29074 raft_consensus.cc:515] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:46.082042 19457 consensus_peers.cc:597] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:46.083834 29074 leader_election.cc:290] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:46.095021 19457 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:46.103205 19456 leader_election.cc:336] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:46.103850 19456 leader_election.cc:304] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:46.104750 29094 raft_consensus.cc:2749] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:27:46.106848 19456 consensus_peers.cc:597] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:46.197180 19457 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:46.200290 19456 consensus_peers.cc:597] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:46.286561 19457 consensus_peers.cc:597] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:46.298744 29074 raft_consensus.cc:493] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:46.299454 29074 raft_consensus.cc:515] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.302086 29074 leader_election.cc:290] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959)
W20260709 12:27:46.306561 19456 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:46.307869 19457 leader_election.cc:336] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:46.308319 19457 leader_election.cc:304] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 47b48b5c69f245b79ecb292eff89927f
I20260709 12:27:46.309105 29074 raft_consensus.cc:2749] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:27:46.358539 19457 consensus_peers.cc:597] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:46.382704 19457 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:46.409726 19456 consensus_peers.cc:597] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:46.457942 19456 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:27:46.479014 29074 raft_consensus.cc:493] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.479599 29074 raft_consensus.cc:515] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.481863 29074 leader_election.cc:290] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:46.487041 29074 raft_consensus.cc:493] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.487672 29074 raft_consensus.cc:515] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:46.489503 19458 leader_election.cc:336] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
I20260709 12:27:46.490665 29074 leader_election.cc:290] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:46.490732 19456 leader_election.cc:336] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:46.494203 19456 leader_election.cc:304] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.496487 29074 raft_consensus.cc:2749] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:46.497012 19458 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
W20260709 12:27:46.499013 19457 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:46.500752 19457 leader_election.cc:304] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.501732 29074 raft_consensus.cc:2749] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:27:46.501799 19456 leader_election.cc:336] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:46.507571 19457 consensus_peers.cc:597] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:46.515673 29094 raft_consensus.cc:493] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.516324 29094 raft_consensus.cc:515] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.518741 29094 leader_election.cc:290] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:46.529428 19458 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
W20260709 12:27:46.535658 19456 consensus_peers.cc:597] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:27:46.536290 19457 leader_election.cc:336] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:46.539064 19457 leader_election.cc:304] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.540709 29074 raft_consensus.cc:2749] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:46.546669 29074 raft_consensus.cc:493] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.547269 29074 raft_consensus.cc:515] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
W20260709 12:27:46.555262 19458 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
W20260709 12:27:46.556474 19457 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:46.556994 19457 leader_election.cc:304] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.557793 29094 raft_consensus.cc:2749] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:46.557962 29074 leader_election.cc:290] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:46.559599 19456 leader_election.cc:336] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:46.598286 19457 consensus_peers.cc:597] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:46.626711 29074 raft_consensus.cc:493] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.627339 29074 raft_consensus.cc:515] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.630095 29074 leader_election.cc:290] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:46.634136 29074 raft_consensus.cc:493] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.634724 29074 raft_consensus.cc:515] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.638255 29074 leader_election.cc:290] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:46.636515 19458 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
W20260709 12:27:46.639168 19457 leader_election.cc:336] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:46.640094 19457 leader_election.cc:304] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.641402 29074 raft_consensus.cc:2749] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:46.645021 19458 leader_election.cc:336] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
W20260709 12:27:46.647390 19456 leader_election.cc:336] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:46.649040 19456 leader_election.cc:304] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.649838 29074 raft_consensus.cc:2749] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:27:46.665102 19457 consensus_peers.cc:597] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:46.671919 17568 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18943)
W20260709 12:27:46.676608 19457 consensus_peers.cc:597] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:46.681206 19456 consensus_peers.cc:597] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:46.702797 29074 raft_consensus.cc:493] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.703399 29074 raft_consensus.cc:515] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } attrs { replace: true } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.710645 29074 leader_election.cc:290] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
I20260709 12:27:46.711213 29102 raft_consensus.cc:493] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
W20260709 12:27:46.711653 19457 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:46.711848 29102 raft_consensus.cc:515] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.714167 29102 leader_election.cc:290] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:46.716171 19458 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
I20260709 12:27:46.716668 19458 leader_election.cc:304] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.717486 29102 raft_consensus.cc:2749] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:27:46.721436 19458 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
W20260709 12:27:46.722301 19456 leader_election.cc:336] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:46.722671 19457 leader_election.cc:336] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:46.723238 19457 leader_election.cc:304] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.723991 29102 raft_consensus.cc:2749] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:46.815104 29102 raft_consensus.cc:493] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.815721 29102 raft_consensus.cc:515] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.817893 29102 leader_election.cc:290] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:46.823467 19457 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
W20260709 12:27:46.823993 19458 leader_election.cc:336] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
I20260709 12:27:46.824425 19458 leader_election.cc:304] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.825186 29102 raft_consensus.cc:2749] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:46.871948 19457 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:46.877669 29102 raft_consensus.cc:493] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 674d77fe8bcb4c768537ebae4be828bd)
I20260709 12:27:46.878412 29102 raft_consensus.cc:515] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:46.880738 29102 leader_election.cc:290] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:46.885000 19456 leader_election.cc:336] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:27:46.885874 19458 leader_election.cc:336] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
I20260709 12:27:46.886294 19458 leader_election.cc:304] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 1e2529a8cff04207bb1b07c108e16983, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:46.887060 29102 raft_consensus.cc:2749] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:46.908215 19457 consensus_peers.cc:597] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:46.972595 19456 consensus_peers.cc:597] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:27:46.984941 19456 consensus_peers.cc:597] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:27:47.014729 29074 raft_consensus.cc:493] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 47b48b5c69f245b79ecb292eff89927f)
I20260709 12:27:47.015401 29074 raft_consensus.cc:515] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e2529a8cff04207bb1b07c108e16983" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 46365 } } peers { permanent_uuid: "47b48b5c69f245b79ecb292eff89927f" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 36959 } } peers { permanent_uuid: "674d77fe8bcb4c768537ebae4be828bd" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 41535 } attrs { replace: true } } peers { permanent_uuid: "43b520eabb65493abe84f4cf06806cba" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 44937 } attrs { promote: false } }
I20260709 12:27:47.018185 29074 leader_election.cc:290] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365), 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959), 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535)
W20260709 12:27:47.023890 19458 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
W20260709 12:27:47.024737 19457 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111)
I20260709 12:27:47.025230 19457 leader_election.cc:304] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 43b520eabb65493abe84f4cf06806cba; no voters: 47b48b5c69f245b79ecb292eff89927f, 674d77fe8bcb4c768537ebae4be828bd
I20260709 12:27:47.026168 29074 raft_consensus.cc:2749] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:47.026453 19456 leader_election.cc:336] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:47.125645 17568 tablet_server.cc:196] TabletServer@127.17.40.3:0 shutdown complete.
W20260709 12:27:47.139642 19457 consensus_peers.cc:597] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba -> Peer 47b48b5c69f245b79ecb292eff89927f (127.17.40.2:36959): Couldn't send request to peer 47b48b5c69f245b79ecb292eff89927f. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:36959: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:47.269471 17568 tablet_server.cc:179] TabletServer@127.17.40.4:0 shutting down...
W20260709 12:27:47.283407 19456 consensus_peers.cc:597] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:27:47.318989 18656 catalog_manager.cc:4755] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3dca728d7de8469d95dbe82b045bf65e: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:27:47.333925 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:47.335018 17568 tablet_replica.cc:333] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.335875 17568 raft_consensus.cc:2243] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.336755 17568 raft_consensus.cc:2272] T 2054e631aee84e6d9d5435f9031fec9e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.339377 17568 tablet_replica.cc:333] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.340106 17568 raft_consensus.cc:2243] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.340878 17568 raft_consensus.cc:2272] T 99bb1352a2bd46e7bb08b8e1b6711fe1 P 43b520eabb65493abe84f4cf06806cba [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.343468 17568 tablet_replica.cc:333] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.344174 17568 raft_consensus.cc:2243] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.344945 17568 raft_consensus.cc:2272] T 3dca728d7de8469d95dbe82b045bf65e P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.347458 17568 tablet_replica.cc:333] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.348129 17568 raft_consensus.cc:2243] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.349135 17568 raft_consensus.cc:2272] T 3bac759d8cf2478e874f15f02c6c54fb P 43b520eabb65493abe84f4cf06806cba [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.351549 17568 tablet_replica.cc:333] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.352212 17568 raft_consensus.cc:2243] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.353328 17568 raft_consensus.cc:2272] T 6fc1e9b0ef764c7a9e9a1470da4ccd66 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.356356 17568 tablet_replica.cc:333] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.357195 17568 raft_consensus.cc:2243] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.357818 17568 raft_consensus.cc:2272] T 1485e54f9795416785f4baf244599201 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.360394 17568 tablet_replica.cc:333] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.361296 17568 raft_consensus.cc:2243] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.362032 17568 raft_consensus.cc:2272] T cb6c5143fb3041fbbbae7d5f3d73f3c4 P 43b520eabb65493abe84f4cf06806cba [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.365304 17568 tablet_replica.cc:333] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.366235 17568 raft_consensus.cc:2243] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.367615 17568 raft_consensus.cc:2272] T 38d69daa256f430796196f10dfcaad2f P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.370165 17568 tablet_replica.cc:333] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.370864 17568 raft_consensus.cc:2243] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.371578 17568 raft_consensus.cc:2272] T b7d5f339cce949e5b5159e03d3d9f348 P 43b520eabb65493abe84f4cf06806cba [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.373843 17568 tablet_replica.cc:333] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.374574 17568 raft_consensus.cc:2243] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.375571 17568 raft_consensus.cc:2272] T 084cf9f30114499b94cf93587f0788f5 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.378005 17568 tablet_replica.cc:333] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.378693 17568 raft_consensus.cc:2243] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.379699 17568 raft_consensus.cc:2272] T 20fd9926cbc04b9b9436afef7b0d1f6f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.382350 17568 tablet_replica.cc:333] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.383281 17568 raft_consensus.cc:2243] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.384105 17568 raft_consensus.cc:2272] T 8b5f0fdf96074deb816d2d3b27fe7143 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.387243 17568 tablet_replica.cc:333] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.387931 17568 raft_consensus.cc:2243] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.388659 17568 raft_consensus.cc:2272] T 9317d76b36ff4814b60c58870accf4ec P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.390883 17568 tablet_replica.cc:333] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.391502 17568 raft_consensus.cc:2243] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.392103 17568 raft_consensus.cc:2272] T bf32cd3655eb4943abc0cdbf54a32206 P 43b520eabb65493abe84f4cf06806cba [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.394470 17568 tablet_replica.cc:333] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.395119 17568 raft_consensus.cc:2243] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.395635 17568 raft_consensus.cc:2272] T d14b13acceee47439963d9c58e4b6d39 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.398252 17568 tablet_replica.cc:333] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.398909 17568 raft_consensus.cc:2243] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.399955 17568 raft_consensus.cc:2272] T 9134ec4fb92645b28a9b4814179c1c7c P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:47.401820 19456 consensus_peers.cc:597] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba -> Peer 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): Couldn't send request to peer 1e2529a8cff04207bb1b07c108e16983. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:27:47.402606 17568 tablet_replica.cc:333] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.403281 17568 raft_consensus.cc:2243] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.404309 17568 raft_consensus.cc:2272] T bbadce60e960476289740ec2afd0a5c8 P 43b520eabb65493abe84f4cf06806cba [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.406713 17568 tablet_replica.cc:333] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.407429 17568 raft_consensus.cc:2243] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.408767 17568 raft_consensus.cc:2272] T 34d2d90d352e40cb8b6cde778d729c24 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.411527 17568 tablet_replica.cc:333] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.412134 17568 raft_consensus.cc:2243] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.412688 17568 raft_consensus.cc:2272] T 73828daf5c2b417fb99b9a563c19c850 P 43b520eabb65493abe84f4cf06806cba [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.414844 17568 tablet_replica.cc:333] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.415416 17568 raft_consensus.cc:2243] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.416407 17568 raft_consensus.cc:2272] T 84ea4e9cc4d9482b920ad086bf4b1305 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.418639 17568 tablet_replica.cc:333] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.419232 17568 raft_consensus.cc:2243] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.419739 17568 raft_consensus.cc:2272] T 0406e95e375e45c495fe295f541d7cd4 P 43b520eabb65493abe84f4cf06806cba [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.422153 17568 tablet_replica.cc:333] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.422772 17568 raft_consensus.cc:2243] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.423720 17568 raft_consensus.cc:2272] T 5a2498b4d0a8462b860b1e4040e4e5bc P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.425905 17568 tablet_replica.cc:333] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.426590 17568 raft_consensus.cc:2243] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.427589 17568 raft_consensus.cc:2272] T 4cd048e748d347889eab552ac02ed00f P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.429949 17568 tablet_replica.cc:333] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.430676 17568 raft_consensus.cc:2243] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.431667 17568 raft_consensus.cc:2272] T 4eda139ea8094bec9f34a061ca15f982 P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.433918 17568 tablet_replica.cc:333] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.434608 17568 raft_consensus.cc:2243] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.435285 17568 raft_consensus.cc:2272] T b37f46e9bd70474bbc330c12a42a76f5 P 43b520eabb65493abe84f4cf06806cba [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.437523 17568 tablet_replica.cc:333] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.438176 17568 raft_consensus.cc:2243] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.438957 17568 raft_consensus.cc:2272] T e8038db5456b47f5af9508f8dcb3883b P 43b520eabb65493abe84f4cf06806cba [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.441310 17568 tablet_replica.cc:333] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.441915 17568 raft_consensus.cc:2243] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.442935 17568 raft_consensus.cc:2272] T 6c18380178684f0e93b10d0c7a912d02 P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.445236 17568 tablet_replica.cc:333] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.445852 17568 raft_consensus.cc:2243] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.446936 17568 raft_consensus.cc:2272] T 0adcb82468fe454b951282d52761a6c3 P 43b520eabb65493abe84f4cf06806cba [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.449116 17568 tablet_replica.cc:333] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.449685 17568 raft_consensus.cc:2243] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.450344 17568 raft_consensus.cc:2272] T e9168ac06d4b4b11ac8272d328166702 P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.452569 17568 tablet_replica.cc:333] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.453130 17568 raft_consensus.cc:2243] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.454094 17568 raft_consensus.cc:2272] T 987becbef0a24ee6a5e0c3eb9a3384cc P 43b520eabb65493abe84f4cf06806cba [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.456204 17568 tablet_replica.cc:333] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.456759 17568 raft_consensus.cc:2243] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.457659 17568 raft_consensus.cc:2272] T d6c1ae2a327b421383ffacb5d5831a0e P 43b520eabb65493abe84f4cf06806cba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.459918 17568 tablet_replica.cc:333] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.460489 17568 raft_consensus.cc:2243] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.461382 17568 raft_consensus.cc:2272] T 91bf73a138f349e787495351ffd803b7 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.463405 17568 tablet_replica.cc:333] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.463928 17568 raft_consensus.cc:2243] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.464588 17568 raft_consensus.cc:2272] T 5a38dabcd47249aebb1f53168be39bbc P 43b520eabb65493abe84f4cf06806cba [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.466723 17568 tablet_replica.cc:333] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.467255 17568 raft_consensus.cc:2243] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.468150 17568 raft_consensus.cc:2272] T 0d8499bcaf8d4fd3b0236d65471d7006 P 43b520eabb65493abe84f4cf06806cba [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.470285 17568 tablet_replica.cc:333] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.470840 17568 raft_consensus.cc:2243] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.471741 17568 raft_consensus.cc:2272] T f5cbcb3f54b5453eaa89ac9bf8859e93 P 43b520eabb65493abe84f4cf06806cba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.473776 17568 tablet_replica.cc:333] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba: stopping tablet replica
I20260709 12:27:47.474269 17568 raft_consensus.cc:2243] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.474802 17568 raft_consensus.cc:2272] T ca478d842a8f406087ef2855fb0363a8 P 43b520eabb65493abe84f4cf06806cba [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.880121 17568 tablet_server.cc:196] TabletServer@127.17.40.4:0 shutdown complete.
I20260709 12:27:47.948455 17568 master.cc:562] Master@127.17.40.62:43633 shutting down...
W20260709 12:27:47.983635 18719 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:27:47.984016 18719 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:27:47.984285 18719 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:27:54.490708 18658 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111) [suppressed 430 similar messages]
W20260709 12:27:54.495957 18658 catalog_manager.cc:4755] TS 674d77fe8bcb4c768537ebae4be828bd (127.17.40.3:41535): ChangeConfig:REMOVE_PEER RPC failed for tablet bf32cd3655eb4943abc0cdbf54a32206: Network error: Client connection negotiation failed: client connection to 127.17.40.3:41535: connect: Connection refused (error 111)
W20260709 12:28:03.722643 18656 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
W20260709 12:28:03.727706 18656 catalog_manager.cc:4755] TS 1e2529a8cff04207bb1b07c108e16983 (127.17.40.1:46365): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3dca728d7de8469d95dbe82b045bf65e: Network error: Client connection negotiation failed: client connection to 127.17.40.1:46365: connect: Connection refused (error 111)
I20260709 12:28:04.995625 17568 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:04.996773 17568 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:04.997411 17568 tablet_replica.cc:333] T 00000000000000000000000000000000 P bcc1b451ad6147bd802f7cd458a81a5c: stopping tablet replica
I20260709 12:28:05.266616 17568 master.cc:584] Master@127.17.40.62:43633 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (333724 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:28:05.385450 17568 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.40.62:38223
I20260709 12:28:05.387336 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:05.394717 29114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:05.394843 29115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:05.396499 29117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:05.396636 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:05.401192 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:05.401436 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:05.401556 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600085401543 us; error 0 us; skew 500 ppm
I20260709 12:28:05.402031 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:05.405676 17568 webserver.cc:533] Webserver started at http://127.17.40.62:36503/ using document root <none> and password file <none>
I20260709 12:28:05.406173 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:05.406340 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:05.406693 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:05.408015 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/master-0-root/instance:
uuid: "9b91969329c8415c8123d6ccc8dca653"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.412873 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:05.416560 29122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.417346 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:28:05.417698 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/master-0-root
uuid: "9b91969329c8415c8123d6ccc8dca653"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.417964 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:05.436640 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:05.437992 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:05.481207 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.62:38223
I20260709 12:28:05.481340 29173 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.62:38223 every 8 connection(s)
I20260709 12:28:05.485803 29174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:05.498919 29174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653: Bootstrap starting.
I20260709 12:28:05.504262 29174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.509164 29174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653: No bootstrap required, opened a new log
I20260709 12:28:05.511742 29174 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b91969329c8415c8123d6ccc8dca653" member_type: VOTER }
I20260709 12:28:05.512247 29174 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.512538 29174 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b91969329c8415c8123d6ccc8dca653, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.513238 29174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b91969329c8415c8123d6ccc8dca653" member_type: VOTER }
I20260709 12:28:05.513772 29174 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:05.514055 29174 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:05.514369 29174 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.520087 29174 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b91969329c8415c8123d6ccc8dca653" member_type: VOTER }
I20260709 12:28:05.520715 29174 leader_election.cc:304] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b91969329c8415c8123d6ccc8dca653; no voters: 
I20260709 12:28:05.522073 29174 leader_election.cc:290] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:05.522666 29177 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.524214 29177 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 1 LEADER]: Becoming Leader. State: Replica: 9b91969329c8415c8123d6ccc8dca653, State: Running, Role: LEADER
I20260709 12:28:05.525070 29177 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b91969329c8415c8123d6ccc8dca653" member_type: VOTER }
I20260709 12:28:05.525388 29174 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:05.533481 29178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b91969329c8415c8123d6ccc8dca653" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b91969329c8415c8123d6ccc8dca653" member_type: VOTER } }
I20260709 12:28:05.534523 29178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:05.535333 29179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b91969329c8415c8123d6ccc8dca653. Latest consensus state: current_term: 1 leader_uuid: "9b91969329c8415c8123d6ccc8dca653" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b91969329c8415c8123d6ccc8dca653" member_type: VOTER } }
I20260709 12:28:05.536267 29179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:05.539995 29187 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:05.547880 29187 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:05.549089 17568 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:05.558239 29187 catalog_manager.cc:1383] Generated new cluster ID: ae5ea35083434fd391f00667af1c050c
I20260709 12:28:05.558640 29187 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:05.594739 29187 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:05.596184 29187 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:05.610549 29187 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653: Generated new TSK 0
I20260709 12:28:05.611176 29187 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:05.616046 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:05.623464 29195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:05.624795 29196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:05.627521 17568 server_base.cc:1061] running on GCE node
W20260709 12:28:05.628099 29198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:05.630241 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:05.630545 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:05.630700 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600085630686 us; error 0 us; skew 500 ppm
I20260709 12:28:05.631345 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:05.633909 17568 webserver.cc:533] Webserver started at http://127.17.40.1:44187/ using document root <none> and password file <none>
I20260709 12:28:05.634498 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:05.634709 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:05.635011 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:05.636358 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/instance:
uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.641317 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:28:05.645157 29203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.646045 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:28:05.646445 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.646781 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:05.659961 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:05.661296 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:05.662974 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:05.665532 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:05.665792 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.666060 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:05.666270 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.715695 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:35813
I20260709 12:28:05.715826 29265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:35813 every 8 connection(s)
I20260709 12:28:05.721673 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:05.733275 29271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:05.736564 29270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:05.739781 29273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:05.741649 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:05.742941 29266 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38223
I20260709 12:28:05.743443 29266 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:05.744567 29266 heartbeater.cc:507] Master 127.17.40.62:38223 requested a full tablet report, sending...
I20260709 12:28:05.745290 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:05.745599 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:05.745815 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600085745765 us; error 0 us; skew 500 ppm
I20260709 12:28:05.746726 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:05.747331 29139 ts_manager.cc:194] Registered new tserver with Master: 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:05.749565 29139 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46588
I20260709 12:28:05.752862 17568 webserver.cc:533] Webserver started at http://127.17.40.2:43187/ using document root <none> and password file <none>
I20260709 12:28:05.753548 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:05.753780 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:05.754094 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:05.755543 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/instance:
uuid: "c098fe137f19465bb9f67dbd64763b72"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.760438 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:28:05.764127 29278 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.764930 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:28:05.765264 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-1-root
uuid: "c098fe137f19465bb9f67dbd64763b72"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.765538 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:05.776803 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:05.778203 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:05.779810 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:05.782260 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:05.782536 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:28:05.782824 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:05.783021 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.829869 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.2:42675
I20260709 12:28:05.829974 29340 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.2:42675 every 8 connection(s)
I20260709 12:28:05.835558 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:05.843490 29344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:05.845564 29345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:05.847932 17568 server_base.cc:1061] running on GCE node
W20260709 12:28:05.850049 29347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:05.850346 29341 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38223
I20260709 12:28:05.850865 29341 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:05.851397 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:05.851676 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:05.851747 29341 heartbeater.cc:507] Master 127.17.40.62:38223 requested a full tablet report, sending...
I20260709 12:28:05.851899 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600085851877 us; error 0 us; skew 500 ppm
I20260709 12:28:05.852674 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:05.854157 29139 ts_manager.cc:194] Registered new tserver with Master: c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:05.855775 29139 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46590
I20260709 12:28:05.856132 17568 webserver.cc:533] Webserver started at http://127.17.40.3:37555/ using document root <none> and password file <none>
I20260709 12:28:05.856879 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:05.857144 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:05.857496 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:05.859025 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/instance:
uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.864086 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:05.868243 29352 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.869098 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:28:05.869475 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-2-root
uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.869796 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:05.891940 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:05.893309 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:05.895061 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:05.897579 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:05.897782 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.898065 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:05.898211 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.944875 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.3:45901
I20260709 12:28:05.944986 29414 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.3:45901 every 8 connection(s)
I20260709 12:28:05.950369 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:05.959455 29418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:05.961328 29419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:05.964231 17568 server_base.cc:1061] running on GCE node
W20260709 12:28:05.964926 29421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:05.966113 29415 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38223
I20260709 12:28:05.966217 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:05.966662 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:05.966754 29415 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:05.966922 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600085966901 us; error 0 us; skew 500 ppm
I20260709 12:28:05.967947 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:05.968065 29415 heartbeater.cc:507] Master 127.17.40.62:38223 requested a full tablet report, sending...
I20260709 12:28:05.971065 17568 webserver.cc:533] Webserver started at http://127.17.40.4:45699/ using document root <none> and password file <none>
I20260709 12:28:05.971261 29139 ts_manager.cc:194] Registered new tserver with Master: 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:05.971822 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:05.972126 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:05.972484 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:05.973469 29139 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46600
I20260709 12:28:05.974332 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-3-root/instance:
uuid: "8dbe6e4429184e5fb137cae093024bce"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.980418 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:05.984478 29426 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:05.985507 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:28:05.985822 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-3-root
uuid: "8dbe6e4429184e5fb137cae093024bce"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
I20260709 12:28:05.986088 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:05.996663 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:05.998014 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:05.999747 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:06.002480 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:06.002756 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:06.003054 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:06.003201 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:06.050470 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.4:34741
I20260709 12:28:06.050578 29488 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.4:34741 every 8 connection(s)
I20260709 12:28:06.066015 29489 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38223
I20260709 12:28:06.066534 29489 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:06.067437 29489 heartbeater.cc:507] Master 127.17.40.62:38223 requested a full tablet report, sending...
I20260709 12:28:06.069628 29139 ts_manager.cc:194] Registered new tserver with Master: 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:06.069759 17568 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01564945s
I20260709 12:28:06.071341 29139 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46616
I20260709 12:28:06.100358 29139 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46630:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:06.537134 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:06.626907 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 884c1fec4f1f4f7db0bf24665b7826c5 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:06.628746 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884c1fec4f1f4f7db0bf24665b7826c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.641031 29453 tablet_service.cc:1511] Processing CreateTablet for tablet b010149f21014bed809737f86f527ccc (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:06.642787 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b010149f21014bed809737f86f527ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.642530 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 884c1fec4f1f4f7db0bf24665b7826c5 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:06.644065 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884c1fec4f1f4f7db0bf24665b7826c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.645648 29452 tablet_service.cc:1511] Processing CreateTablet for tablet 643c24bf9c694736abe899bcaa6e99f0 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:06.647413 29452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643c24bf9c694736abe899bcaa6e99f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.652093 29451 tablet_service.cc:1511] Processing CreateTablet for tablet 2db86f70e69d430d914533e9338966da (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:06.653795 29451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db86f70e69d430d914533e9338966da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.663250 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 91c3c65a128840b8a030ea09d702ead4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:06.663756 29450 tablet_service.cc:1511] Processing CreateTablet for tablet 552b1f2771eb4fcb81923b5712b47b2f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:06.665019 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c3c65a128840b8a030ea09d702ead4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.665601 29450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552b1f2771eb4fcb81923b5712b47b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.663758 29378 tablet_service.cc:1511] Processing CreateTablet for tablet 643c24bf9c694736abe899bcaa6e99f0 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:06.668054 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643c24bf9c694736abe899bcaa6e99f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.668617 29377 tablet_service.cc:1511] Processing CreateTablet for tablet bbc799754b16428a9fd044cbd3073a05 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:06.670081 29377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc799754b16428a9fd044cbd3073a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.675242 29449 tablet_service.cc:1511] Processing CreateTablet for tablet c08ab113fecb4c37adc9b881aa73cd06 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:06.677039 29449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08ab113fecb4c37adc9b881aa73cd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.684403 29376 tablet_service.cc:1511] Processing CreateTablet for tablet 552b1f2771eb4fcb81923b5712b47b2f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:06.686275 29376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552b1f2771eb4fcb81923b5712b47b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.693238 29375 tablet_service.cc:1511] Processing CreateTablet for tablet c08ab113fecb4c37adc9b881aa73cd06 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:06.695344 29373 tablet_service.cc:1511] Processing CreateTablet for tablet 84317ec210984cb490e9b8af0ddf23ff (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:06.696848 29375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08ab113fecb4c37adc9b881aa73cd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.695537 29374 tablet_service.cc:1511] Processing CreateTablet for tablet 634977a6ff1244a3a46eb6a9b9ceb36a (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:06.698143 29373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84317ec210984cb490e9b8af0ddf23ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.699214 29374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634977a6ff1244a3a46eb6a9b9ceb36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.704114 29448 tablet_service.cc:1511] Processing CreateTablet for tablet f63924737d2d47bf8921d8c66bb9967e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:06.705899 29448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f63924737d2d47bf8921d8c66bb9967e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.707401 29372 tablet_service.cc:1511] Processing CreateTablet for tablet a2f77efefeec49378e0c4347125ef945 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:06.709177 29372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f77efefeec49378e0c4347125ef945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.716603 29509 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:06.724056 29447 tablet_service.cc:1511] Processing CreateTablet for tablet 84317ec210984cb490e9b8af0ddf23ff (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:06.725841 29447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84317ec210984cb490e9b8af0ddf23ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.747377 29510 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:06.752395 29451 tablet_service.cc:1511] Processing CreateTablet for tablet a2f77efefeec49378e0c4347125ef945 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:06.753031 29306 tablet_service.cc:1511] Processing CreateTablet for tablet 884c1fec4f1f4f7db0bf24665b7826c5 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:06.753548 29305 tablet_service.cc:1511] Processing CreateTablet for tablet 91c3c65a128840b8a030ea09d702ead4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:06.754112 29451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f77efefeec49378e0c4347125ef945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.754671 29306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884c1fec4f1f4f7db0bf24665b7826c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.755244 29266 heartbeater.cc:499] Master 127.17.40.62:38223 was elected leader, sending a full tablet report...
I20260709 12:28:06.757493 29305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c3c65a128840b8a030ea09d702ead4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.766019 29304 tablet_service.cc:1511] Processing CreateTablet for tablet b010149f21014bed809737f86f527ccc (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:06.766292 29303 tablet_service.cc:1511] Processing CreateTablet for tablet bbc799754b16428a9fd044cbd3073a05 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:06.767913 29303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc799754b16428a9fd044cbd3073a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.771209 29304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b010149f21014bed809737f86f527ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.773677 29446 tablet_service.cc:1511] Processing CreateTablet for tablet a7afb986dea142578781a4b0902cf6b8 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:06.775512 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7afb986dea142578781a4b0902cf6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.782001 29302 tablet_service.cc:1511] Processing CreateTablet for tablet 2db86f70e69d430d914533e9338966da (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:06.784080 29302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db86f70e69d430d914533e9338966da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.784965 29371 tablet_service.cc:1511] Processing CreateTablet for tablet f8adbb821c8c4e11ad628089fc00d166 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:06.786546 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8adbb821c8c4e11ad628089fc00d166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.795564 29379 tablet_service.cc:1511] Processing CreateTablet for tablet c59b9f4048214a868afee18cf9e843fd (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:06.797220 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59b9f4048214a868afee18cf9e843fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.795564 29510 tablet_bootstrap.cc:654] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.805384 29301 tablet_service.cc:1511] Processing CreateTablet for tablet c08ab113fecb4c37adc9b881aa73cd06 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:06.807346 29301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08ab113fecb4c37adc9b881aa73cd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.823354 29300 tablet_service.cc:1511] Processing CreateTablet for tablet 634977a6ff1244a3a46eb6a9b9ceb36a (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:06.825126 29300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634977a6ff1244a3a46eb6a9b9ceb36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.825404 29298 tablet_service.cc:1511] Processing CreateTablet for tablet a2f77efefeec49378e0c4347125ef945 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:06.824652 29297 tablet_service.cc:1511] Processing CreateTablet for tablet c59b9f4048214a868afee18cf9e843fd (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:06.826956 29298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f77efefeec49378e0c4347125ef945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.827621 29297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59b9f4048214a868afee18cf9e843fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.829336 29509 tablet_bootstrap.cc:654] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.823554 29299 tablet_service.cc:1511] Processing CreateTablet for tablet f63924737d2d47bf8921d8c66bb9967e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:06.832018 29299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f63924737d2d47bf8921d8c66bb9967e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.858872 29341 heartbeater.cc:499] Master 127.17.40.62:38223 was elected leader, sending a full tablet report...
I20260709 12:28:06.876688 29445 tablet_service.cc:1511] Processing CreateTablet for tablet f8adbb821c8c4e11ad628089fc00d166 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:06.878449 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8adbb821c8c4e11ad628089fc00d166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.896101 29372 tablet_service.cc:1511] Processing CreateTablet for tablet 995ae76c376541159f0e79e554e34cd2 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:06.897812 29372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995ae76c376541159f0e79e554e34cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.909858 29375 tablet_service.cc:1511] Processing CreateTablet for tablet ae09303fa81d45f086eec87509b6e72b (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:06.910727 29510 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:06.911401 29510 ts_tablet_manager.cc:1403] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.164s	user 0.023s	sys 0.006s
I20260709 12:28:06.911587 29375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae09303fa81d45f086eec87509b6e72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.920636 29452 tablet_service.cc:1511] Processing CreateTablet for tablet ae09303fa81d45f086eec87509b6e72b (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:06.921633 29376 tablet_service.cc:1511] Processing CreateTablet for tablet b49d0ab7da7f4218a16f383088db71d3 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:06.923321 29376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49d0ab7da7f4218a16f383088db71d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.926112 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 4d66330581c44f65ab1e6c89c0da8053 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:06.930728 29452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae09303fa81d45f086eec87509b6e72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.934984 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d66330581c44f65ab1e6c89c0da8053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.940609 29450 tablet_service.cc:1511] Processing CreateTablet for tablet 995ae76c376541159f0e79e554e34cd2 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:06.944960 29298 tablet_service.cc:1511] Processing CreateTablet for tablet a7afb986dea142578781a4b0902cf6b8 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:06.947455 29298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7afb986dea142578781a4b0902cf6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.949070 29301 tablet_service.cc:1511] Processing CreateTablet for tablet ae09303fa81d45f086eec87509b6e72b (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:06.952749 29305 tablet_service.cc:1511] Processing CreateTablet for tablet b49d0ab7da7f4218a16f383088db71d3 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:06.967005 29297 tablet_service.cc:1511] Processing CreateTablet for tablet 47d481b0699148d0a3874c922f9faa21 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:06.966648 29378 tablet_service.cc:1511] Processing CreateTablet for tablet e123d694327a439f955f8e8831cbbfef (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:06.975934 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e123d694327a439f955f8e8831cbbfef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.942260 29450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995ae76c376541159f0e79e554e34cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.976331 29377 tablet_service.cc:1511] Processing CreateTablet for tablet fb406a0615254e56b17f64445f811223 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:06.972314 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 86e528a3aa1c4b73a3f5dad737cf41a4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:06.973421 29451 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef042d8e1fa4cb7bc3d1fbe923b826c (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:28:06.977233 29415 heartbeater.cc:499] Master 127.17.40.62:38223 was elected leader, sending a full tablet report...
I20260709 12:28:06.976344 29303 tablet_service.cc:1511] Processing CreateTablet for tablet fb406a0615254e56b17f64445f811223 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:06.979126 29451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef042d8e1fa4cb7bc3d1fbe923b826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:06.971349 29510 raft_consensus.cc:359] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:06.982641 29510 raft_consensus.cc:385] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.983039 29510 raft_consensus.cc:740] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.984094 29510 consensus_queue.cc:260] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:06.993256 29453 tablet_service.cc:1511] Processing CreateTablet for tablet e123d694327a439f955f8e8831cbbfef (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:06.998513 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e528a3aa1c4b73a3f5dad737cf41a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.003535 29374 tablet_service.cc:1511] Processing CreateTablet for tablet 47d481b0699148d0a3874c922f9faa21 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:07.005424 29374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d481b0699148d0a3874c922f9faa21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.007951 29304 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef042d8e1fa4cb7bc3d1fbe923b826c (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:28:07.020669 29448 tablet_service.cc:1511] Processing CreateTablet for tablet 86e528a3aa1c4b73a3f5dad737cf41a4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:07.022470 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e123d694327a439f955f8e8831cbbfef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.022658 29447 tablet_service.cc:1511] Processing CreateTablet for tablet 884f2ad3d291412691e9a8815a9d7838 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:07.024251 29447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884f2ad3d291412691e9a8815a9d7838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.027822 29449 tablet_service.cc:1511] Processing CreateTablet for tablet 47d481b0699148d0a3874c922f9faa21 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:07.030903 29377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb406a0615254e56b17f64445f811223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.031431 29301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae09303fa81d45f086eec87509b6e72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.035600 29306 tablet_service.cc:1511] Processing CreateTablet for tablet 86e528a3aa1c4b73a3f5dad737cf41a4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:07.044735 29302 tablet_service.cc:1511] Processing CreateTablet for tablet 32ff10fa1089410688f12362821cc67f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:07.046470 29302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ff10fa1089410688f12362821cc67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.046602 29448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e528a3aa1c4b73a3f5dad737cf41a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.047210 29303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb406a0615254e56b17f64445f811223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.049957 29371 tablet_service.cc:1511] Processing CreateTablet for tablet 884f2ad3d291412691e9a8815a9d7838 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:07.051818 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884f2ad3d291412691e9a8815a9d7838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.051983 29445 tablet_service.cc:1511] Processing CreateTablet for tablet 305487a552d34f96a1555a8d55564031 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:07.058858 29300 tablet_service.cc:1511] Processing CreateTablet for tablet 4d66330581c44f65ab1e6c89c0da8053 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:07.061937 29449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d481b0699148d0a3874c922f9faa21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.063508 29446 tablet_service.cc:1511] Processing CreateTablet for tablet 85f3994d7ed94748b84df1afd9e331fd (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:07.065187 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f3994d7ed94748b84df1afd9e331fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.069837 29305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49d0ab7da7f4218a16f383088db71d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.071566 29304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef042d8e1fa4cb7bc3d1fbe923b826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.075006 29489 heartbeater.cc:499] Master 127.17.40.62:38223 was elected leader, sending a full tablet report...
I20260709 12:28:07.072734 29373 tablet_service.cc:1511] Processing CreateTablet for tablet 32ff10fa1089410688f12362821cc67f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:07.092094 29513 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:07.101626 29300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d66330581c44f65ab1e6c89c0da8053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.103509 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 91c3c65a128840b8a030ea09d702ead4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:07.104625 29297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d481b0699148d0a3874c922f9faa21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.105054 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c3c65a128840b8a030ea09d702ead4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.107744 29230 tablet_service.cc:1511] Processing CreateTablet for tablet b010149f21014bed809737f86f527ccc (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:07.110694 29306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e528a3aa1c4b73a3f5dad737cf41a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.110287 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 643c24bf9c694736abe899bcaa6e99f0 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:07.112938 29228 tablet_service.cc:1511] Processing CreateTablet for tablet bbc799754b16428a9fd044cbd3073a05 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:07.115880 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 2db86f70e69d430d914533e9338966da (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:07.116483 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 552b1f2771eb4fcb81923b5712b47b2f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:07.118043 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db86f70e69d430d914533e9338966da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.118790 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc799754b16428a9fd044cbd3073a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.129362 29450 tablet_service.cc:1511] Processing CreateTablet for tablet b7e6ef31c2e34233803b7c52b878c0ef (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:07.130048 29509 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:07.130718 29509 ts_tablet_manager.cc:1403] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.415s	user 0.064s	sys 0.058s
I20260709 12:28:07.131001 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552b1f2771eb4fcb81923b5712b47b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.133325 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 305487a552d34f96a1555a8d55564031 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:07.071609 29299 tablet_service.cc:1511] Processing CreateTablet for tablet 85f3994d7ed94748b84df1afd9e331fd (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:07.143410 29299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f3994d7ed94748b84df1afd9e331fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.146288 29513 tablet_bootstrap.cc:654] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:07.131001 29450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e6ef31c2e34233803b7c52b878c0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.156694 29373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ff10fa1089410688f12362821cc67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.156881 29224 tablet_service.cc:1511] Processing CreateTablet for tablet f63924737d2d47bf8921d8c66bb9967e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:07.159461 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 634977a6ff1244a3a46eb6a9b9ceb36a (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:07.170992 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305487a552d34f96a1555a8d55564031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.184124 29223 tablet_service.cc:1511] Processing CreateTablet for tablet 84317ec210984cb490e9b8af0ddf23ff (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:07.187954 29222 tablet_service.cc:1511] Processing CreateTablet for tablet c59b9f4048214a868afee18cf9e843fd (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:07.134086 29509 raft_consensus.cc:359] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:07.189570 29509 raft_consensus.cc:385] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:07.189987 29509 raft_consensus.cc:740] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.155175 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643c24bf9c694736abe899bcaa6e99f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.200608 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305487a552d34f96a1555a8d55564031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.205524 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634977a6ff1244a3a46eb6a9b9ceb36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.214897 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f63924737d2d47bf8921d8c66bb9967e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.228001 29372 tablet_service.cc:1511] Processing CreateTablet for tablet 0f041c0e08404949a06ddbd74b8d2ab0 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:07.229592 29372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f041c0e08404949a06ddbd74b8d2ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.235067 29510 ts_tablet_manager.cc:1434] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.323s	user 0.023s	sys 0.011s
I20260709 12:28:07.236356 29510 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:07.238647 29378 tablet_service.cc:1511] Processing CreateTablet for tablet b7e6ef31c2e34233803b7c52b878c0ef (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:07.255287 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e6ef31c2e34233803b7c52b878c0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.247561 29451 tablet_service.cc:1511] Processing CreateTablet for tablet 182ad32890aa4949b7f06c2dae04a331 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:28:07.248184 29453 tablet_service.cc:1511] Processing CreateTablet for tablet a5bc94f78eb745a8ae182fa765caf007 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:28:07.212613 29509 consensus_queue.cc:260] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:07.275645 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 93ebdc5d6e304383b31da2f9f039a2fb (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:07.291390 29298 tablet_service.cc:1511] Processing CreateTablet for tablet 109246823e454b4ea19cff032f7345a3 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:07.292870 29298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109246823e454b4ea19cff032f7345a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.276870 29375 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6367cd0a53431592b263b9893fe688 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:07.294028 29375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6367cd0a53431592b263b9893fe688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.280894 29445 tablet_service.cc:1511] Processing CreateTablet for tablet 070e1d9927ae4642bb5c37d25f11c996 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:07.285462 29376 tablet_service.cc:1511] Processing CreateTablet for tablet 109246823e454b4ea19cff032f7345a3 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:07.286528 29510 tablet_bootstrap.cc:654] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:07.246106 29452 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6367cd0a53431592b263b9893fe688 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:07.288851 29451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182ad32890aa4949b7f06c2dae04a331. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:07.339810 29490 tablet.cc:2406] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:07.340204 29514 raft_consensus.cc:493] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.357846 29452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6367cd0a53431592b263b9893fe688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.357576 29514 raft_consensus.cc:515] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:07.358692 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070e1d9927ae4642bb5c37d25f11c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.341462 29300 tablet_service.cc:1511] Processing CreateTablet for tablet 305487a552d34f96a1555a8d55564031 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:07.305439 29223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84317ec210984cb490e9b8af0ddf23ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.361244 29300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305487a552d34f96a1555a8d55564031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.343605 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 93ebdc5d6e304383b31da2f9f039a2fb (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:07.363560 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ebdc5d6e304383b31da2f9f039a2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.370100 29513 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:07.371960 29513 ts_tablet_manager.cc:1403] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.280s	user 0.051s	sys 0.076s
I20260709 12:28:07.371191 29222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59b9f4048214a868afee18cf9e843fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.382746 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b010149f21014bed809737f86f527ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.383322 29513 raft_consensus.cc:359] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:07.384153 29513 raft_consensus.cc:385] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:07.384485 29513 raft_consensus.cc:740] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.385347 29513 consensus_queue.cc:260] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:07.387718 29514 leader_election.cc:290] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:07.388499 29449 tablet_service.cc:1511] Processing CreateTablet for tablet 719834bbc8ea4a43a3fcf5ccbd9aab62 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:28:07.439707 29228 tablet_service.cc:1511] Processing CreateTablet for tablet a7afb986dea142578781a4b0902cf6b8 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:07.441360 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7afb986dea142578781a4b0902cf6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.443802 29377 tablet_service.cc:1511] Processing CreateTablet for tablet 49368782c45545549da92ef0b10a987e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:07.446444 29509 ts_tablet_manager.cc:1434] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.315s	user 0.016s	sys 0.023s
I20260709 12:28:07.447992 29509 tablet_bootstrap.cc:492] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:07.449882 29305 tablet_service.cc:1511] Processing CreateTablet for tablet 0f041c0e08404949a06ddbd74b8d2ab0 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:07.431273 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bc94f78eb745a8ae182fa765caf007. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:07.465267 29262 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec360 after lost signal to thread 17571
W20260709 12:28:07.466524 29262 debug-util.cc:398] Leaking SignalData structure 0x7b08002eca40 after lost signal to thread 29173
I20260709 12:28:07.470472 29376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109246823e454b4ea19cff032f7345a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.470873 29449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719834bbc8ea4a43a3fcf5ccbd9aab62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.466004 29373 tablet_service.cc:1511] Processing CreateTablet for tablet 070e1d9927ae4642bb5c37d25f11c996 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:07.475363 29373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070e1d9927ae4642bb5c37d25f11c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.476380 29517 raft_consensus.cc:493] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.476972 29517 raft_consensus.cc:515] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:07.477885 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ebdc5d6e304383b31da2f9f039a2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.484652 29306 tablet_service.cc:1511] Processing CreateTablet for tablet 182ad32890aa4949b7f06c2dae04a331 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:28:07.487051 29516 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:07.501868 29299 tablet_service.cc:1511] Processing CreateTablet for tablet 070e1d9927ae4642bb5c37d25f11c996 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:07.513759 29299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070e1d9927ae4642bb5c37d25f11c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.526086 29374 tablet_service.cc:1511] Processing CreateTablet for tablet e2dd764d395b4a1db1fa0542bad9979b (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:07.531034 29377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49368782c45545549da92ef0b10a987e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.532414 29448 tablet_service.cc:1511] Processing CreateTablet for tablet e2dd764d395b4a1db1fa0542bad9979b (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:07.539346 29372 tablet_service.cc:1511] Processing CreateTablet for tablet 28d6a39a3308459fa622a39fb1bf5dad (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:28:07.549049 29375 tablet_service.cc:1511] Processing CreateTablet for tablet e09b1a02c21b411f97bf8eeb736a44ea (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:07.549809 29304 tablet_service.cc:1511] Processing CreateTablet for tablet 49368782c45545549da92ef0b10a987e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:07.559520 29225 tablet_service.cc:1511] Processing CreateTablet for tablet f8adbb821c8c4e11ad628089fc00d166 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:07.583675 29513 ts_tablet_manager.cc:1434] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.211s	user 0.013s	sys 0.017s
I20260709 12:28:07.584229 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8adbb821c8c4e11ad628089fc00d166. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:07.560846 29126 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 59513.9us
W20260709 12:28:07.590107 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:07.563356 29302 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6367cd0a53431592b263b9893fe688 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:07.596940 29518 raft_consensus.cc:493] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.597236 29509 tablet_bootstrap.cc:654] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:07.603044 29518 raft_consensus.cc:515] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:07.619510 29297 tablet_service.cc:1511] Processing CreateTablet for tablet 719834bbc8ea4a43a3fcf5ccbd9aab62 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:28:07.621173 29513 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:07.621321 29297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719834bbc8ea4a43a3fcf5ccbd9aab62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.622543 29302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6367cd0a53431592b263b9893fe688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.629462 29516 tablet_bootstrap.cc:654] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:07.631548 29231 tablet_service.cc:1511] Processing CreateTablet for tablet b49d0ab7da7f4218a16f383088db71d3 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:07.633793 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49d0ab7da7f4218a16f383088db71d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.639031 29306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182ad32890aa4949b7f06c2dae04a331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.643678 29513 tablet_bootstrap.cc:654] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:07.646209 29374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dd764d395b4a1db1fa0542bad9979b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.631781 29303 tablet_service.cc:1511] Processing CreateTablet for tablet 28d6a39a3308459fa622a39fb1bf5dad (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:28:07.570575 29517 leader_election.cc:290] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:07.506994 29301 tablet_service.cc:1511] Processing CreateTablet for tablet a5bc94f78eb745a8ae182fa765caf007 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:28:07.672760 29304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49368782c45545549da92ef0b10a987e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.703435 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 995ae76c376541159f0e79e554e34cd2 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:07.704975 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995ae76c376541159f0e79e554e34cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.698038 29448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dd764d395b4a1db1fa0542bad9979b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.706664 29375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09b1a02c21b411f97bf8eeb736a44ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.724120 29227 tablet_service.cc:1511] Processing CreateTablet for tablet fb406a0615254e56b17f64445f811223 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:07.725675 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb406a0615254e56b17f64445f811223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.722517 29305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f041c0e08404949a06ddbd74b8d2ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.740346 29380 tablet_service.cc:1511] Processing CreateTablet for tablet a4bb3ad82b4543fb90ad68213c62327e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:28:07.742559 29223 tablet_service.cc:1511] Processing CreateTablet for tablet e123d694327a439f955f8e8831cbbfef (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:07.743084 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 6a89b86cbfd049bb9445919c85a2a661 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:07.744451 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 4d66330581c44f65ab1e6c89c0da8053 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:07.740899 29510 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:07.750510 29510 ts_tablet_manager.cc:1403] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.514s	user 0.016s	sys 0.013s
I20260709 12:28:07.757998 29446 tablet_service.cc:1511] Processing CreateTablet for tablet 28d6a39a3308459fa622a39fb1bf5dad (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:28:07.778909 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d6a39a3308459fa622a39fb1bf5dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.782689 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 32ff10fa1089410688f12362821cc67f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:07.774726 29301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bc94f78eb745a8ae182fa765caf007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.804589 29453 tablet_service.cc:1511] Processing CreateTablet for tablet a4bb3ad82b4543fb90ad68213c62327e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:28:07.805406 29372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d6a39a3308459fa622a39fb1bf5dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.806097 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bb3ad82b4543fb90ad68213c62327e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.793697 29373 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd8b20a4d4149f2aefaf5d791c65c89 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:07.812222 29513 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:07.814237 29509 tablet_bootstrap.cc:492] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:07.814895 29223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e123d694327a439f955f8e8831cbbfef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.835961 29378 tablet_service.cc:1511] Processing CreateTablet for tablet 013bc4e256b44d7bad8a2915325ebf16 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:07.862775 29509 ts_tablet_manager.cc:1403] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.415s	user 0.023s	sys 0.019s
I20260709 12:28:07.849663 29222 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef042d8e1fa4cb7bc3d1fbe923b826c (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:28:07.866613 29513 ts_tablet_manager.cc:1403] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.246s	user 0.035s	sys 0.027s
I20260709 12:28:07.836319 29450 tablet_service.cc:1511] Processing CreateTablet for tablet 6a89b86cbfd049bb9445919c85a2a661 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:07.817708 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 85f3994d7ed94748b84df1afd9e331fd (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:07.813789 29376 tablet_service.cc:1511] Processing CreateTablet for tablet 18cc57e0ce6841219ed37c3d7d5a70be (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:07.846132 29300 tablet_service.cc:1511] Processing CreateTablet for tablet e09b1a02c21b411f97bf8eeb736a44ea (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:07.842108 29451 tablet_service.cc:1511] Processing CreateTablet for tablet 18cc57e0ce6841219ed37c3d7d5a70be (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:07.855619 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 39b597f990ad43f0b26beedf929c6aff (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:07.856187 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a89b86cbfd049bb9445919c85a2a661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.856241 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ff10fa1089410688f12362821cc67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.871178 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f3994d7ed94748b84df1afd9e331fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.859591 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db86f70e69d430d914533e9338966da" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:07.873478 29510 raft_consensus.cc:359] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
W20260709 12:28:07.873481 29427 leader_election.cc:343] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:07.874738 29373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd8b20a4d4149f2aefaf5d791c65c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.875304 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d66330581c44f65ab1e6c89c0da8053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.894681 29222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef042d8e1fa4cb7bc3d1fbe923b826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.883422 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c3c65a128840b8a030ea09d702ead4" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:07.903995 29353 leader_election.cc:343] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:07.828199 29518 leader_election.cc:290] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:07.884474 29306 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 22) took 1008 ms. Trace:
I20260709 12:28:07.895555 29376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cc57e0ce6841219ed37c3d7d5a70be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.911088 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bb3ad82b4543fb90ad68213c62327e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.913493 29306 rpcz_store.cc:276] 0709 12:28:06.875778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.481440 (+605662us) service_pool.cc:224] Handling call
0709 12:28:07.566299 (+ 84859us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.604269 (+ 37970us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.789423 (+185154us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:07.883771 (+ 94348us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:07.884393 (+   622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:07.877130 29447 tablet_service.cc:1511] Processing CreateTablet for tablet cc0ac53345b44e3abcf7fd2b8a8e4518 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:07.927016 29451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cc57e0ce6841219ed37c3d7d5a70be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.932695 29306 tablet_service.cc:1511] Processing CreateTablet for tablet cc0ac53345b44e3abcf7fd2b8a8e4518 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:07.936193 29445 tablet_service.cc:1511] Processing CreateTablet for tablet 013bc4e256b44d7bad8a2915325ebf16 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:07.938468 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013bc4e256b44d7bad8a2915325ebf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.943020 29371 tablet_service.cc:1511] Processing CreateTablet for tablet af5e140659184a569b1e220d086f4b63 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:28:07.945488 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e140659184a569b1e220d086f4b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.947288 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b597f990ad43f0b26beedf929c6aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.950773 29447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0ac53345b44e3abcf7fd2b8a8e4518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.955924 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013bc4e256b44d7bad8a2915325ebf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.958688 29450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a89b86cbfd049bb9445919c85a2a661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.978350 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db86f70e69d430d914533e9338966da" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:07.979106 29298 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 24) took 1102 ms. Trace:
I20260709 12:28:07.979262 29316 raft_consensus.cc:2468] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:07.979750 29298 rpcz_store.cc:276] 0709 12:28:06.876534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.197304 (+320770us) service_pool.cc:224] Handling call
0709 12:28:07.292351 (+ 95047us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.292459 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.787033 (+494574us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:07.948918 (+161885us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:07.978925 (+ 30007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:07.981150 29430 leader_election.cc:304] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:07.892729 29510 raft_consensus.cc:385] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:07.987299 29510 raft_consensus.cc:740] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.988730 29510 consensus_queue.cc:260] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:07.930842 29513 raft_consensus.cc:359] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.014753 29513 raft_consensus.cc:385] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.015123 29513 raft_consensus.cc:740] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.016084 29513 consensus_queue.cc:260] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.001439 29303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d6a39a3308459fa622a39fb1bf5dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.028034 29300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09b1a02c21b411f97bf8eeb736a44ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:07.866374 29509 raft_consensus.cc:359] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.057979 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 884f2ad3d291412691e9a8815a9d7838 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:08.059571 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884f2ad3d291412691e9a8815a9d7838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.056376 29509 raft_consensus.cc:385] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.062929 29509 raft_consensus.cc:740] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.063563 29298 tablet_service.cc:1511] Processing CreateTablet for tablet 6a89b86cbfd049bb9445919c85a2a661 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:08.063977 29509 consensus_queue.cc:260] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.062954 29533 raft_consensus.cc:2804] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:08.065348 29533 raft_consensus.cc:493] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:08.065706 29533 raft_consensus.cc:3060] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:08.067276 29301 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 25) took 1190 ms. Trace:
I20260709 12:28:08.070183 29306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0ac53345b44e3abcf7fd2b8a8e4518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.070250 29301 rpcz_store.cc:276] 0709 12:28:06.876868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.493481 (+616613us) service_pool.cc:224] Handling call
0709 12:28:07.707166 (+213685us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.714360 (+  7194us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.030777 (+316417us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.066619 (+ 35842us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.067203 (+   584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.083681 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60418 (request call id 27) took 1007 ms. Trace:
I20260709 12:28:08.083511 29301 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd8b20a4d4149f2aefaf5d791c65c89 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:08.084061 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 0f041c0e08404949a06ddbd74b8d2ab0 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:08.085776 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f041c0e08404949a06ddbd74b8d2ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.085840 29449 tablet_service.cc:1511] Processing CreateTablet for tablet 52884fe0058e4164905c706a05528483 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:08.087343 29449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52884fe0058e4164905c706a05528483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.084185 29377 rpcz_store.cc:276] 0709 12:28:07.076458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.442762 (+366304us) service_pool.cc:224] Handling call
0709 12:28:07.444847 (+  2085us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.444962 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.802245 (+357283us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.083083 (+280838us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.083600 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.093073 29302 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 23) took 1217 ms. Trace:
I20260709 12:28:08.093734 29302 rpcz_store.cc:276] 0709 12:28:06.876169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.492710 (+616541us) service_pool.cc:224] Handling call
0709 12:28:07.619336 (+126626us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800000998. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66e9c 00007f3357e66a5b 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffbf831 00007f335ff9cac3 00007f335ff4b400 00007f33593d0af4 00007f33593d0a82 00007f33593d09b1
0709 12:28:07.622057 (+  2721us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.622165 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.750630 (+128465us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.056691 (+306061us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.092987 (+ 36296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32647936}
I20260709 12:28:08.096520 29302 tablet_service.cc:1511] Processing CreateTablet for tablet 39b597f990ad43f0b26beedf929c6aff (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:08.097906 29374 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60418 (request call id 28) took 1021 ms. Trace:
I20260709 12:28:08.140205 29377 tablet_service.cc:1511] Processing CreateTablet for tablet 6796c6bbe9b6429daa40ed2fdb2529a5 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:08.140856 29374 rpcz_store.cc:276] 0709 12:28:07.077012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.524664 (+447652us) service_pool.cc:224] Handling call
0709 12:28:07.598380 (+ 73716us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.645652 (+ 47272us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.864666 (+219014us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.097283 (+232617us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.097831 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.141743 29377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6796c6bbe9b6429daa40ed2fdb2529a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.098912 29452 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58372 (request call id 23) took 1059 ms. Trace:
I20260709 12:28:08.099439 29372 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60418 (request call id 29) took 1021 ms. Trace:
I20260709 12:28:08.142495 29452 rpcz_store.cc:276] 0709 12:28:07.042119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.245063 (+202944us) service_pool.cc:224] Handling call
0709 12:28:07.357276 (+112213us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.357389 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.796651 (+439262us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.079063 (+282412us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.098834 (+ 19771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.142673 29372 rpcz_store.cc:276] 0709 12:28:07.090468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.538077 (+447609us) service_pool.cc:224] Handling call
0709 12:28:07.627018 (+ 88941us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b5800106598. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffbf831 00007f335ff9cac3 00007f335ff4b400 00007f33593d0af4 00007f33593d0a82 00007f33593d09b1
0709 12:28:07.671300 (+ 44282us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.684317 (+ 13017us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.878516 (+194199us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.098795 (+220279us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.099366 (+   571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12590464}
I20260709 12:28:08.146241 29452 tablet_service.cc:1511] Processing CreateTablet for tablet 6796c6bbe9b6429daa40ed2fdb2529a5 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:08.103186 29513 ts_tablet_manager.cc:1434] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.236s	user 0.005s	sys 0.004s
I20260709 12:28:08.107599 29516 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:08.147737 29516 ts_tablet_manager.cc:1403] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.661s	user 0.069s	sys 0.082s
I20260709 12:28:08.117357 29298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a89b86cbfd049bb9445919c85a2a661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.119766 29510 ts_tablet_manager.cc:1434] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.369s	user 0.015s	sys 0.005s
I20260709 12:28:08.151238 29302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b597f990ad43f0b26beedf929c6aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.151366 29513 tablet_bootstrap.cc:492] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:08.153110 29301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd8b20a4d4149f2aefaf5d791c65c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.101876 29509 ts_tablet_manager.cc:1434] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.239s	user 0.005s	sys 0.003s
I20260709 12:28:08.157590 29509 tablet_bootstrap.cc:492] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:08.164693 29452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6796c6bbe9b6429daa40ed2fdb2529a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.188786 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 182ad32890aa4949b7f06c2dae04a331 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:28:08.221457 29297 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 28) took 1343 ms. Trace:
I20260709 12:28:08.232440 29305 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 21) took 1357 ms. Trace:
I20260709 12:28:08.232941 29305 rpcz_store.cc:276] 0709 12:28:06.875443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.393439 (+517996us) service_pool.cc:224] Handling call
0709 12:28:07.588766 (+195327us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5800000998. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffbf831 00007f335ff9cac3 00007f335ff4b400 00007f33593d0af4 00007f33593d0a82 00007f33593d09b1
0709 12:28:07.620088 (+ 31322us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800000998. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66e9c 00007f3357e66a5b 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffbf831 00007f335ff9cac3 00007f335ff4b400 00007f33593d0af4 00007f33593d0a82 00007f33593d09b1
0709 12:28:07.622719 (+  2631us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.622829 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.952515 (+329686us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.231738 (+279223us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.232362 (+   624us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30566912}
I20260709 12:28:08.235832 29299 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 26) took 1358 ms. Trace:
I20260709 12:28:08.236671 29533 raft_consensus.cc:515] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.238292 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c3c65a128840b8a030ea09d702ead4" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:08.239578 29516 raft_consensus.cc:359] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.240427 29516 raft_consensus.cc:385] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.240765 29516 raft_consensus.cc:740] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.241144 29380 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60418 (request call id 31) took 1129 ms. Trace:
I20260709 12:28:08.241757 29380 rpcz_store.cc:276] 0709 12:28:07.111789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.714356 (+602567us) service_pool.cc:224] Handling call
0709 12:28:07.741498 (+ 27142us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.741620 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.991696 (+250076us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.239486 (+247790us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.241000 (+  1514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.244454 29230 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 14) took 1008 ms. Trace:
I20260709 12:28:08.287097 29230 rpcz_store.cc:276] 0709 12:28:07.235948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.702362 (+466414us) service_pool.cc:224] Handling call
0709 12:28:07.704456 (+  2094us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.704560 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.974908 (+270348us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.243873 (+268965us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.244388 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.287920 29227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 15) took 1051 ms. Trace:
I20260709 12:28:08.247237 29226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 13) took 1011 ms. Trace:
I20260709 12:28:08.236346 29299 rpcz_store.cc:276] 0709 12:28:06.877212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.500760 (+623548us) service_pool.cc:224] Handling call
0709 12:28:07.509119 (+  8359us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.513050 (+  3931us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.967814 (+454764us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.235292 (+267478us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.235768 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.250630 29510 tablet_bootstrap.cc:492] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
W20260709 12:28:08.241789 29123 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 59905.9us
I20260709 12:28:08.256960 29533 leader_election.cc:290] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:08.241582 29516 consensus_queue.cc:260] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.258900 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db86f70e69d430d914533e9338966da" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:08.260545 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db86f70e69d430d914533e9338966da" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:08.268502 29509 tablet_bootstrap.cc:654] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:08.271911 29517 raft_consensus.cc:493] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.272260 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182ad32890aa4949b7f06c2dae04a331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.241066 29222 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 16) took 1004 ms. Trace:
I20260709 12:28:08.274575 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db86f70e69d430d914533e9338966da" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:08.282214 29356 leader_election.cc:343] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.283812 29229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 19) took 1046 ms. Trace:
I20260709 12:28:08.221994 29297 rpcz_store.cc:276] 0709 12:28:06.878011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.561959 (+683948us) service_pool.cc:224] Handling call
0709 12:28:07.620735 (+ 58776us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.620855 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.969089 (+348234us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.220844 (+251755us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.221380 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.295342 29316 raft_consensus.cc:3060] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:08.295549 29517 raft_consensus.cc:515] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.302536 29450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58372 (request call id 32) took 1136 ms. Trace:
I20260709 12:28:08.303030 29450 rpcz_store.cc:276] 0709 12:28:07.166286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.835372 (+669086us) service_pool.cc:224] Handling call
0709 12:28:07.868474 (+ 33102us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.868650 (+   176us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.067750 (+199100us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.293926 (+226176us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.302469 (+  8543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.291333 29299 tablet_service.cc:1511] Processing CreateTablet for tablet af5e140659184a569b1e220d086f4b63 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:28:08.296218 29427 leader_election.cc:343] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.300803 29464 raft_consensus.cc:2393] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c098fe137f19465bb9f67dbd64763b72 in current term 1: Already voted for candidate 8dbe6e4429184e5fb137cae093024bce in this term.
I20260709 12:28:08.301599 29356 leader_election.cc:304] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:08.304420 29517 leader_election.cc:290] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:08.325575 29517 raft_consensus.cc:2749] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:08.296800 29222 rpcz_store.cc:276] 0709 12:28:07.236540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.720877 (+484337us) service_pool.cc:224] Handling call
0709 12:28:07.865600 (+144723us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.865749 (+   149us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.957292 (+ 91543us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.240491 (+283199us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.240995 (+   504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.328073 29222 tablet_service.cc:1511] Processing CreateTablet for tablet 109246823e454b4ea19cff032f7345a3 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:08.329352 29533 raft_consensus.cc:493] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.330003 29533 raft_consensus.cc:515] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:08.330636 29222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109246823e454b4ea19cff032f7345a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.277055 29451 tablet_service.cc:1511] Processing CreateTablet for tablet e3b328ca221d47f2a2ce812ca6545c69 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:08.333751 29451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b328ca221d47f2a2ce812ca6545c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.312350 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db86f70e69d430d914533e9338966da" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:08.336789 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c24bf9c694736abe899bcaa6e99f0" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:08.337347 29223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 17) took 1100 ms. Trace:
I20260709 12:28:08.312038 29297 tablet_service.cc:1511] Processing CreateTablet for tablet 52884fe0058e4164905c706a05528483 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:08.291333 29305 tablet_service.cc:1511] Processing CreateTablet for tablet 013bc4e256b44d7bad8a2915325ebf16 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:08.270174 29304 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 27) took 1392 ms. Trace:
I20260709 12:28:08.339291 29304 rpcz_store.cc:276] 0709 12:28:06.877672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.525357 (+647685us) service_pool.cc:224] Handling call
0709 12:28:07.621743 (+ 96386us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.621849 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.936827 (+314978us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.269642 (+332815us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.270109 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:08.341434 29279 leader_election.cc:343] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:08.341785 29427 leader_election.cc:343] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.342510 29279 leader_election.cc:304] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:08.342844 29450 tablet_service.cc:1511] Processing CreateTablet for tablet ae36f5a0ab77484ba95cc4f091a975c4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:08.344349 29450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae36f5a0ab77484ba95cc4f091a975c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.341480 29533 leader_election.cc:290] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:08.341570 29304 tablet_service.cc:1511] Processing CreateTablet for tablet e3b328ca221d47f2a2ce812ca6545c69 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:08.323923 29513 tablet_bootstrap.cc:654] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:08.324206 29299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e140659184a569b1e220d086f4b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.350826 29305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013bc4e256b44d7bad8a2915325ebf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.299906 29229 rpcz_store.cc:276] 0709 12:28:07.237509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.801341 (+563832us) service_pool.cc:224] Handling call
0709 12:28:07.867439 (+ 66098us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.867551 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.020331 (+152780us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.283223 (+262892us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.283744 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.289492 29230 tablet_service.cc:1511] Processing CreateTablet for tablet b7e6ef31c2e34233803b7c52b878c0ef (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:08.371451 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e6ef31c2e34233803b7c52b878c0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.288352 29227 rpcz_store.cc:276] 0709 12:28:07.236248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.706565 (+470317us) service_pool.cc:224] Handling call
0709 12:28:07.725111 (+ 18546us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.725230 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.096491 (+371261us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.287312 (+190821us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.287845 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.375751 29297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52884fe0058e4164905c706a05528483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.376256 29227 tablet_service.cc:1511] Processing CreateTablet for tablet a4bb3ad82b4543fb90ad68213c62327e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:28:08.377763 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4bb3ad82b4543fb90ad68213c62327e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.377979 29300 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 30) took 1499 ms. Trace:
I20260709 12:28:08.361771 29447 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58372 (request call id 30) took 1232 ms. Trace:
I20260709 12:28:08.378756 29304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b328ca221d47f2a2ce812ca6545c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.289800 29226 rpcz_store.cc:276] 0709 12:28:07.235590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.676509 (+440919us) service_pool.cc:224] Handling call
0709 12:28:07.774293 (+ 97784us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.777852 (+  3559us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.001108 (+223256us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.246693 (+245585us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.247170 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.388976 29448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58372 (request call id 28) took 1301 ms. Trace:
I20260709 12:28:08.337863 29316 raft_consensus.cc:2468] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:08.401846 29518 raft_consensus.cc:2749] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:08.409651 29224 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 18) took 1172 ms. Trace:
I20260709 12:28:08.410138 29224 rpcz_store.cc:276] 0709 12:28:07.237190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.781623 (+544433us) service_pool.cc:224] Handling call
0709 12:28:07.783701 (+  2078us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.783805 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.268100 (+484295us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.382161 (+114061us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.409578 (+ 27417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.411316 29228 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 21) took 1173 ms. Trace:
I20260709 12:28:08.337738 29223 rpcz_store.cc:276] 0709 12:28:07.236869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.741512 (+504643us) service_pool.cc:224] Handling call
0709 12:28:07.743723 (+  2211us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.766249 (+ 22526us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.104100 (+337851us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.336680 (+232580us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.337280 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.411768 29228 rpcz_store.cc:276] 0709 12:28:07.238150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.082957 (+844807us) service_pool.cc:224] Handling call
0709 12:28:08.085180 (+  2223us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.085319 (+   139us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.327039 (+241720us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.410742 (+ 83703us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.411256 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.402266 29446 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58372 (request call id 29) took 1314 ms. Trace:
I20260709 12:28:08.412904 29225 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 20) took 1175 ms. Trace:
I20260709 12:28:08.396739 29447 rpcz_store.cc:276] 0709 12:28:07.129911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.737774 (+607863us) service_pool.cc:224] Handling call
0709 12:28:07.920215 (+182441us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.920378 (+   163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.282663 (+362285us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.353828 (+ 71165us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.354380 (+   552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.415027 29453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58372 (request call id 31) took 1284 ms. Trace:
I20260709 12:28:08.413789 29430 leader_election.cc:304] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:08.414975 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 93ebdc5d6e304383b31da2f9f039a2fb (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:08.452783 29533 raft_consensus.cc:2804] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:08.452642 29229 tablet_service.cc:1511] Processing CreateTablet for tablet a5bc94f78eb745a8ae182fa765caf007 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:28:08.453258 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ebdc5d6e304383b31da2f9f039a2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.453353 29533 raft_consensus.cc:697] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:08.454578 29533 consensus_queue.cc:237] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.412279 29224 tablet_service.cc:1511] Processing CreateTablet for tablet e2dd764d395b4a1db1fa0542bad9979b (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:08.456842 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dd764d395b4a1db1fa0542bad9979b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.395602 29300 rpcz_store.cc:276] 0709 12:28:06.899827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.845031 (+945204us) service_pool.cc:224] Handling call
0709 12:28:07.869566 (+ 24535us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.869672 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.246203 (+376531us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.377388 (+131185us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.377913 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.445039 29518 raft_consensus.cc:493] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.441522 29446 rpcz_store.cc:276] 0709 12:28:07.087554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.714542 (+626988us) service_pool.cc:224] Handling call
0709 12:28:07.778379 (+ 63837us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.778499 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.129948 (+351449us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.359438 (+229490us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.400565 (+ 41127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.463469 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bc94f78eb745a8ae182fa765caf007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.465534 29447 tablet_service.cc:1511] Processing CreateTablet for tablet 805181416bfb47f0a641552cee55b488 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:08.467142 29447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805181416bfb47f0a641552cee55b488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.466825 29518 raft_consensus.cc:515] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.468103 29446 tablet_service.cc:1511] Processing CreateTablet for tablet 9a087124d7b34efe966b79089d1ec64f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:28:08.461045 29510 tablet_bootstrap.cc:654] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:08.469568 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a087124d7b34efe966b79089d1ec64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.470468 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59b9f4048214a868afee18cf9e843fd" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:08.471366 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 719834bbc8ea4a43a3fcf5ccbd9aab62 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:28:08.472345 29279 leader_election.cc:343] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.424456 29223 tablet_service.cc:1511] Processing CreateTablet for tablet 49368782c45545549da92ef0b10a987e (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:08.446612 29225 rpcz_store.cc:276] 0709 12:28:07.237839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.027014 (+789175us) service_pool.cc:224] Handling call
0709 12:28:08.059058 (+ 32044us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.059166 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.265871 (+206705us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.412340 (+146469us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.412836 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.474655 29537 raft_consensus.cc:493] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.474925 29225 tablet_service.cc:1511] Processing CreateTablet for tablet e09b1a02c21b411f97bf8eeb736a44ea (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:08.475265 29537 raft_consensus.cc:515] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.399866 29448 rpcz_store.cc:276] 0709 12:28:07.087231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.531369 (+444138us) service_pool.cc:224] Handling call
0709 12:28:07.651835 (+120466us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.655842 (+  4007us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.214605 (+558763us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.388383 (+173778us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.388885 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.448875 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60418 (request call id 30) took 1338 ms. Trace:
I20260709 12:28:08.461853 29379 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60418 (request call id 32) took 1293 ms. Trace:
I20260709 12:28:08.473902 29223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49368782c45545549da92ef0b10a987e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:08.448657 29356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 166643us
I20260709 12:28:08.494062 29518 leader_election.cc:290] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:08.478210 29537 leader_election.cc:290] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:08.499694 29303 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 29) took 1613 ms. Trace:
I20260709 12:28:08.448076 29453 rpcz_store.cc:276] 0709 12:28:07.130268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.803591 (+673323us) service_pool.cc:224] Handling call
0709 12:28:07.805575 (+  1984us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.805684 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.214411 (+408727us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.397507 (+183096us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.414957 (+ 17450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.527249 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09b1a02c21b411f97bf8eeb736a44ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.548434 29378 tablet_service.cc:1511] Processing CreateTablet for tablet e3b328ca221d47f2a2ce812ca6545c69 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:08.550129 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b328ca221d47f2a2ce812ca6545c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.551429 29509 tablet_bootstrap.cc:492] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:08.552168 29509 ts_tablet_manager.cc:1403] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.395s	user 0.018s	sys 0.018s
I20260709 12:28:08.486084 29379 rpcz_store.cc:276] 0709 12:28:07.166801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.714157 (+547356us) service_pool.cc:224] Handling call
0709 12:28:07.744176 (+ 30019us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.744294 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.024516 (+280222us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.405529 (+381013us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.460199 (+ 54670us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.557969 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884c1fec4f1f4f7db0bf24665b7826c5" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:08.559125 29513 tablet_bootstrap.cc:492] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:08.559758 29513 ts_tablet_manager.cc:1403] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.409s	user 0.017s	sys 0.018s
I20260709 12:28:08.559490 29139 catalog_manager.cc:5697] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:08.561132 29353 leader_election.cc:343] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.562934 29300 tablet_service.cc:1511] Processing CreateTablet for tablet ae36f5a0ab77484ba95cc4f091a975c4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:08.564486 29300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae36f5a0ab77484ba95cc4f091a975c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.531605 29298 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 32) took 1430 ms. Trace:
I20260709 12:28:08.532914 29299 tablet_service.cc:1511] Processing CreateTablet for tablet f31ecc85ad2246b194eb65cbc188a663 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:08.568557 29513 raft_consensus.cc:359] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:08.569403 29513 raft_consensus.cc:385] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.569763 29513 raft_consensus.cc:740] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.570041 29299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31ecc85ad2246b194eb65cbc188a663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.568111 29298 rpcz_store.cc:276] 0709 12:28:07.101219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.981842 (+880623us) service_pool.cc:224] Handling call
0709 12:28:08.064543 (+ 82701us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.064659 (+   116us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.382531 (+317872us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.477636 (+ 95105us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.526986 (+ 49350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.530418 29303 rpcz_store.cc:276] 0709 12:28:06.878376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.630887 (+752511us) service_pool.cc:224] Handling call
0709 12:28:07.666365 (+ 35478us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.677649 (+ 11284us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.376527 (+698878us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.476953 (+100426us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.491839 (+ 14886us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:08.593227 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:08.592865 29509 raft_consensus.cc:359] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:08.593775 29509 raft_consensus.cc:385] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.594730 29303 tablet_service.cc:1511] Processing CreateTablet for tablet 861e1b95735b4e49a7d677502df85d2c (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:08.596175 29303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861e1b95735b4e49a7d677502df85d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.485188 29375 rpcz_store.cc:276] 0709 12:28:07.110335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.547988 (+437653us) service_pool.cc:224] Handling call
0709 12:28:07.619838 (+ 71850us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5800106598. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e66a22 00007f3360d7f8d9 00007f335fed9ee0 00007f335ffbf831 00007f335ff9cac3 00007f335ff4b400 00007f33593d0af4 00007f33593d0a82 00007f33593d09b1
0709 12:28:07.653288 (+ 33450us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.658944 (+  5656us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.129823 (+470879us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.404457 (+274634us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.447443 (+ 42986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11621,"spinlock_wait_cycles":32528256}
I20260709 12:28:08.600144 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc799754b16428a9fd044cbd3073a05" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:08.602878 29207 leader_election.cc:343] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.575637 29302 tablet_service.cc:1511] Processing CreateTablet for tablet 9a087124d7b34efe966b79089d1ec64f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:28:08.607662 29302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a087124d7b34efe966b79089d1ec64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.607328 29453 tablet_service.cc:1511] Processing CreateTablet for tablet ffee763875334a56886a8163b24992db (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:08.608893 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffee763875334a56886a8163b24992db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.620332 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 805181416bfb47f0a641552cee55b488 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:08.621760 29298 tablet_service.cc:1511] Processing CreateTablet for tablet ffee763875334a56886a8163b24992db (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:08.622689 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884c1fec4f1f4f7db0bf24665b7826c5" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:08.622982 29371 tablet_service.cc:1511] Processing CreateTablet for tablet 9a087124d7b34efe966b79089d1ec64f (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:28:08.625288 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 861e1b95735b4e49a7d677502df85d2c (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:08.594146 29509 raft_consensus.cc:740] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.623411 29298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffee763875334a56886a8163b24992db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.621846 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805181416bfb47f0a641552cee55b488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.630990 29375 tablet_service.cc:1511] Processing CreateTablet for tablet f31ecc85ad2246b194eb65cbc188a663 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:08.631739 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861e1b95735b4e49a7d677502df85d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.632531 29375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31ecc85ad2246b194eb65cbc188a663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.634871 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a087124d7b34efe966b79089d1ec64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.643981 29231 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 22) took 1405 ms. Trace:
I20260709 12:28:08.644611 29231 rpcz_store.cc:276] 0709 12:28:07.306805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.187600 (+880795us) service_pool.cc:224] Handling call
0709 12:28:08.189830 (+  2230us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.189955 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.368752 (+178797us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.643366 (+274614us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.643903 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.634829 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719834bbc8ea4a43a3fcf5ccbd9aab62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.658608 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59b9f4048214a868afee18cf9e843fd" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:08.659029 29513 consensus_queue.cc:260] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:08.661667 29516 ts_tablet_manager.cc:1434] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.514s	user 0.011s	sys 0.012s
W20260709 12:28:08.668391 29279 leader_election.cc:343] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.671103 29301 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 33) took 1443 ms. Trace:
W20260709 12:28:08.673044 29356 leader_election.cc:343] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:08.685928 29516 ts_tablet_manager.cc:1467] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Tablet startup took 537ms
I20260709 12:28:08.693471 29356 leader_election.cc:304] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:08.673861 29377 tablet_service.cc:1511] Processing CreateTablet for tablet 21efe1fe062e4b28bbfa5e3832bb2df9 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:28:08.695261 29377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21efe1fe062e4b28bbfa5e3832bb2df9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:08.693732 29516 ts_tablet_manager.cc:1469] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Trace:
0709 12:28:07.102076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.111758 (+  9682us) service_pool.cc:224] Handling call
0709 12:28:07.114009 (+  2251us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.114121 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:07.239706 (+125585us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:07.253432 (+ 13726us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:07.438123 (+184691us) inbound_call.cc:177] Queueing success response
0709 12:28:07.486382 (+ 48259us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:28:08.148098 (+661716us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:28:08.148718 (+   620us) tablet_replica.cc:261] Starting instrumentation
0709 12:28:08.149379 (+   661us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":149598,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":13478,"tablet-open.queue_time_us":232445,"thread_start_us":276565,"threads_started":2}
I20260709 12:28:08.696553 29516 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:08.698865 29540 raft_consensus.cc:2749] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:08.674976 29231 tablet_service.cc:1511] Processing CreateTablet for tablet cc0ac53345b44e3abcf7fd2b8a8e4518 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:08.687163 29279 leader_election.cc:304] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:08.701495 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0ac53345b44e3abcf7fd2b8a8e4518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.660983 29306 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55210 (request call id 31) took 1687 ms. Trace:
I20260709 12:28:08.707682 29518 raft_consensus.cc:2749] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:08.708422 29513 ts_tablet_manager.cc:1434] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.148s	user 0.004s	sys 0.007s
I20260709 12:28:08.709661 29513 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:08.705989 29306 rpcz_store.cc:276] 0709 12:28:06.973367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.928514 (+955147us) service_pool.cc:224] Handling call
0709 12:28:07.935804 (+  7290us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:07.935922 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.296751 (+360829us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.563691 (+266940us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.630089 (+ 66398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8960}
I20260709 12:28:08.693284 29301 rpcz_store.cc:276] 0709 12:28:07.227610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.082435 (+854825us) service_pool.cc:224] Handling call
0709 12:28:08.099383 (+ 16948us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.099506 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.391559 (+292053us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.665548 (+273989us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.671033 (+  5485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.725704 29227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 32) took 1338 ms. Trace:
I20260709 12:28:08.726353 29227 rpcz_store.cc:276] 0709 12:28:07.387021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.375103 (+988082us) service_pool.cc:224] Handling call
0709 12:28:08.377247 (+  2144us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.377357 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.644410 (+267053us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.678283 (+ 33873us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.725628 (+ 47345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.748565 29516 tablet_bootstrap.cc:654] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:08.663244 29509 consensus_queue.cc:260] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:08.753396 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd8b20a4d4149f2aefaf5d791c65c89 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:08.755020 29509 ts_tablet_manager.cc:1434] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.202s	user 0.011s	sys 0.000s
I20260709 12:28:08.759464 29509 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:08.759545 29231 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 31) took 1373 ms. Trace:
I20260709 12:28:08.761406 29231 rpcz_store.cc:276] 0709 12:28:07.386653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.673577 (+1286924us) service_pool.cc:224] Handling call
0709 12:28:08.700565 (+ 26988us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.700670 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.731367 (+ 30697us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.758883 (+ 27516us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.759466 (+   583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.764351 29513 tablet_bootstrap.cc:654] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:08.767508 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd8b20a4d4149f2aefaf5d791c65c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.766047 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 39b597f990ad43f0b26beedf929c6aff (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:08.780543 29229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 25) took 1441 ms. Trace:
I20260709 12:28:08.781101 29229 rpcz_store.cc:276] 0709 12:28:07.369815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.398859 (+1029044us) service_pool.cc:224] Handling call
0709 12:28:08.462906 (+ 64047us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.463029 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.656580 (+193551us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.779930 (+123350us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.780462 (+   532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.781936 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc799754b16428a9fd044cbd3073a05" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:08.702845 29451 tablet_service.cc:1511] Processing CreateTablet for tablet 21efe1fe062e4b28bbfa5e3832bb2df9 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:28:08.783476 29451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21efe1fe062e4b28bbfa5e3832bb2df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.771525 29224 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 29) took 1400 ms. Trace:
I20260709 12:28:08.775982 29225 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 30) took 1389 ms. Trace:
I20260709 12:28:08.785421 29230 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 23) took 1471 ms. Trace:
I20260709 12:28:08.801614 29230 rpcz_store.cc:276] 0709 12:28:07.307365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.288468 (+981103us) service_pool.cc:224] Handling call
0709 12:28:08.370895 (+ 82427us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.371014 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.638100 (+267086us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.691061 (+ 52961us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.778588 (+ 87527us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:08.794090 29204 leader_election.cc:343] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.803517 29204 leader_election.cc:304] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:08.804791 29543 raft_consensus.cc:2749] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:08.803881 29230 tablet_service.cc:1511] Processing CreateTablet for tablet af5e140659184a569b1e220d086f4b63 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:28:08.810158 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e140659184a569b1e220d086f4b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.819322 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 18cc57e0ce6841219ed37c3d7d5a70be (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:08.819933 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b597f990ad43f0b26beedf929c6aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.833302 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c24bf9c694736abe899bcaa6e99f0" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:08.835709 29427 leader_election.cc:343] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.836231 29427 leader_election.cc:304] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:08.837144 29533 raft_consensus.cc:2749] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:08.837559 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 52884fe0058e4164905c706a05528483 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:08.794697 29224 rpcz_store.cc:276] 0709 12:28:07.371323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.411195 (+1039872us) service_pool.cc:224] Handling call
0709 12:28:08.456330 (+ 45135us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.456432 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.666712 (+210280us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.770329 (+103617us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.771422 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6101}
I20260709 12:28:08.793547 29225 rpcz_store.cc:276] 0709 12:28:07.386204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.473683 (+1087479us) service_pool.cc:224] Handling call
0709 12:28:08.476060 (+  2377us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.476174 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.754438 (+278264us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.775235 (+ 20797us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.775887 (+   652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.844159 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52884fe0058e4164905c706a05528483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.848757 29510 tablet_bootstrap.cc:492] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:08.849399 29510 ts_tablet_manager.cc:1403] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.695s	user 0.020s	sys 0.010s
I20260709 12:28:08.810307 29226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 26) took 1440 ms. Trace:
I20260709 12:28:08.850623 29226 rpcz_store.cc:276] 0709 12:28:07.370270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.413472 (+1043202us) service_pool.cc:224] Handling call
0709 12:28:08.452710 (+ 39238us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.452818 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.710096 (+257278us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.809716 (+ 99620us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.810237 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:08.796156 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 127831us
I20260709 12:28:08.853440 29226 tablet_service.cc:1511] Processing CreateTablet for tablet f31ecc85ad2246b194eb65cbc188a663 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:08.853724 29510 raft_consensus.cc:359] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.854641 29510 raft_consensus.cc:385] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.854996 29510 raft_consensus.cc:740] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.855800 29510 consensus_queue.cc:260] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.864916 29225 tablet_service.cc:1511] Processing CreateTablet for tablet ae36f5a0ab77484ba95cc4f091a975c4 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:08.874989 29509 tablet_bootstrap.cc:654] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:08.880117 29222 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 24) took 1572 ms. Trace:
I20260709 12:28:08.880645 29222 rpcz_store.cc:276] 0709 12:28:07.307790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.327008 (+1019218us) service_pool.cc:224] Handling call
0709 12:28:08.329970 (+  2962us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.330160 (+   190us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.698736 (+368576us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.856245 (+157509us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.879652 (+ 23407us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b5800004e98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e671a2 00007f3360da8889 00007f335fed9d88 00007f335ffa0973 00007f335ff9c70f 00007f335ff9cecd 00007f335ff4b400 00007f33593d0af4 00007f33593d0a82
0709 12:28:08.880042 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51052928}
I20260709 12:28:08.881719 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae36f5a0ab77484ba95cc4f091a975c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.883219 29222 tablet_service.cc:1511] Processing CreateTablet for tablet 805181416bfb47f0a641552cee55b488 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:08.884800 29222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805181416bfb47f0a641552cee55b488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.885332 29510 ts_tablet_manager.cc:1434] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:28:08.885960 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31ecc85ad2246b194eb65cbc188a663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.896466 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cc57e0ce6841219ed37c3d7d5a70be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:08.904090 29427 consensus_peers.cc:597] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.909037 29516 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:08.909787 29516 ts_tablet_manager.cc:1403] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.213s	user 0.040s	sys 0.025s
I20260709 12:28:08.853440 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 6796c6bbe9b6429daa40ed2fdb2529a5 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:08.916932 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6796c6bbe9b6429daa40ed2fdb2529a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.917063 29513 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:08.917794 29513 ts_tablet_manager.cc:1403] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.208s	user 0.010s	sys 0.010s
I20260709 12:28:08.920311 29533 raft_consensus.cc:493] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.921087 29533 raft_consensus.cc:515] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.921444 29513 raft_consensus.cc:359] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.922371 29513 raft_consensus.cc:385] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.922727 29513 raft_consensus.cc:740] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.923979 29533 leader_election.cc:290] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:08.924731 29228 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 28) took 1553 ms. Trace:
I20260709 12:28:08.925330 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884c1fec4f1f4f7db0bf24665b7826c5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:08.927966 29223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 27) took 1557 ms. Trace:
I20260709 12:28:08.928133 29390 raft_consensus.cc:2468] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:08.928399 29223 rpcz_store.cc:276] 0709 12:28:07.370703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.423404 (+1052701us) service_pool.cc:224] Handling call
0709 12:28:08.473368 (+ 49964us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.473472 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.757850 (+284378us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.874026 (+116176us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.927551 (+ 53525us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800004e98. stack: 00007f3357e6c343 00007f3357e6c240 00007f33577fb1d4 00007f3361539304 00007f3361539299 00007f3357d26db1 00007f3357e66b71 00007f3357e671a2 00007f3360da8889 00007f335fed9d88 00007f335ffa0973 00007f335ff9c70f 00007f335ff9cecd 00007f335ff4b400 00007f33593d0af4 00007f33593d0a82
0709 12:28:08.927902 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28239744}
I20260709 12:28:08.929934 29427 leader_election.cc:304] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:08.930845 29228 rpcz_store.cc:276] 0709 12:28:07.371017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.444900 (+1073883us) service_pool.cc:224] Handling call
0709 12:28:08.472342 (+ 27442us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.472448 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.747336 (+274888us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.924113 (+176777us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.924655 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.926671 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884c1fec4f1f4f7db0bf24665b7826c5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:08.931803 29533 raft_consensus.cc:2804] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:08.932715 29533 raft_consensus.cc:493] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:08.933084 29533 raft_consensus.cc:3060] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:08.933564 29430 leader_election.cc:343] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.933465 29230 tablet_service.cc:1511] Processing CreateTablet for tablet ffee763875334a56886a8163b24992db (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:08.936319 29510 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:08.926987 29513 consensus_queue.cc:260] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.937817 29223 tablet_service.cc:1511] Processing CreateTablet for tablet 21efe1fe062e4b28bbfa5e3832bb2df9 (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:28:08.925938 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 861e1b95735b4e49a7d677502df85d2c (DEFAULT_TABLE table=test-workload [id=e90bfea55835478fadd6e823883c2685]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:08.946381 29516 raft_consensus.cc:359] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.947307 29516 raft_consensus.cc:385] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.947660 29516 raft_consensus.cc:740] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.948349 29509 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:08.948976 29509 ts_tablet_manager.cc:1403] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.190s	user 0.014s	sys 0.010s
I20260709 12:28:08.952662 29509 raft_consensus.cc:359] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:08.944460 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffee763875334a56886a8163b24992db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.953517 29509 raft_consensus.cc:385] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:08.953931 29551 raft_consensus.cc:493] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.954026 29509 raft_consensus.cc:740] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.954702 29551 raft_consensus.cc:515] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.955438 29509 consensus_queue.cc:260] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:08.960825 29509 ts_tablet_manager.cc:1434] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:28:08.961066 29551 leader_election.cc:290] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:08.954180 29223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21efe1fe062e4b28bbfa5e3832bb2df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.959779 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c3c65a128840b8a030ea09d702ead4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:08.968364 29390 raft_consensus.cc:2468] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:08.970180 29279 leader_election.cc:304] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:08.971517 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c3c65a128840b8a030ea09d702ead4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:08.973981 29279 leader_election.cc:343] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.974691 29509 tablet_bootstrap.cc:492] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:08.971868 29551 raft_consensus.cc:2804] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:08.975265 29551 raft_consensus.cc:493] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:08.975759 29551 raft_consensus.cc:3060] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:08.980652 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861e1b95735b4e49a7d677502df85d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:08.980631 29227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 33) took 1544 ms. Trace:
I20260709 12:28:08.984803 29231 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 34) took 1454 ms. Trace:
I20260709 12:28:08.985054 29518 raft_consensus.cc:493] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.997424 29518 raft_consensus.cc:515] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:08.999750 29518 leader_election.cc:290] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:09.000922 29229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35702 (request call id 35) took 1391 ms. Trace:
I20260709 12:28:09.001720 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f77efefeec49378e0c4347125ef945" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:09.002126 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f77efefeec49378e0c4347125ef945" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:09.002506 29390 raft_consensus.cc:2468] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
W20260709 12:28:09.003965 29279 leader_election.cc:343] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:08.988957 29513 ts_tablet_manager.cc:1434] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.071s	user 0.002s	sys 0.009s
I20260709 12:28:08.979488 29516 consensus_queue.cc:260] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:08.996889 29231 rpcz_store.cc:276] 0709 12:28:07.530865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.764930 (+1234065us) service_pool.cc:224] Handling call
0709 12:28:08.791431 (+ 26501us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.797015 (+  5584us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.924852 (+127837us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.984202 (+ 59350us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.984735 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:09.008074 29551 raft_consensus.cc:515] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.001399 29229 rpcz_store.cc:276] 0709 12:28:07.609259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.782270 (+1173011us) service_pool.cc:224] Handling call
0709 12:28:08.821984 (+ 39714us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.822107 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.948826 (+126719us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:09.000281 (+ 51455us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:09.000853 (+   572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:09.010362 29551 leader_election.cc:290] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:09.011345 29533 raft_consensus.cc:515] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:08.984465 29227 rpcz_store.cc:276] 0709 12:28:07.480252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.739232 (+1258980us) service_pool.cc:224] Handling call
0709 12:28:08.766948 (+ 27716us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:28:08.767062 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:28:08.894759 (+127697us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:08.947309 (+ 52550us) tablet_replica.cc:206] Creating consensus instance
0709 12:28:08.979997 (+ 32688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:09.004707 29279 leader_election.cc:304] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.021700 29509 tablet_bootstrap.cc:654] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.021922 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c3c65a128840b8a030ea09d702ead4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:09.023352 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c3c65a128840b8a030ea09d702ead4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:09.023851 29390 raft_consensus.cc:3060] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.027410 29551 raft_consensus.cc:2804] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.027921 29551 raft_consensus.cc:493] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.028280 29551 raft_consensus.cc:3060] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.016345 29513 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:08.992780 29510 tablet_bootstrap.cc:654] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.011945 29516 ts_tablet_manager.cc:1434] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.102s	user 0.002s	sys 0.007s
W20260709 12:28:09.028187 29279 leader_election.cc:343] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.035701 29516 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:09.038596 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884c1fec4f1f4f7db0bf24665b7826c5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:09.039697 29389 raft_consensus.cc:3060] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.043285 29551 raft_consensus.cc:515] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.045735 29551 leader_election.cc:290] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:09.046778 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f77efefeec49378e0c4347125ef945" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:09.047541 29388 raft_consensus.cc:3060] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.048069 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f77efefeec49378e0c4347125ef945" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
W20260709 12:28:09.049732 29279 leader_election.cc:343] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.033977 29390 raft_consensus.cc:2468] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:09.058149 29388 raft_consensus.cc:2468] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:09.059671 29389 raft_consensus.cc:2468] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:09.059193 29533 leader_election.cc:290] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:09.060613 29279 leader_election.cc:304] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.060652 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884c1fec4f1f4f7db0bf24665b7826c5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:09.062247 29427 leader_election.cc:304] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
W20260709 12:28:09.064466 29430 leader_election.cc:343] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.064881 29279 leader_election.cc:304] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:09.065867 29518 raft_consensus.cc:2804] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.066792 29551 raft_consensus.cc:2804] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.067490 29513 tablet_bootstrap.cc:654] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.069376 29509 tablet_bootstrap.cc:492] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.069988 29509 ts_tablet_manager.cc:1403] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.096s	user 0.007s	sys 0.006s
I20260709 12:28:09.070619 29533 raft_consensus.cc:2804] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.084393 29509 raft_consensus.cc:359] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.085451 29509 raft_consensus.cc:385] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.085853 29509 raft_consensus.cc:740] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.094126 29510 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:09.095018 29510 ts_tablet_manager.cc:1403] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.159s	user 0.007s	sys 0.008s
I20260709 12:28:09.086833 29551 raft_consensus.cc:697] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:09.089442 29533 raft_consensus.cc:697] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:09.100662 29540 raft_consensus.cc:493] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.099601 29518 raft_consensus.cc:697] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:09.106348 29513 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:09.106055 29518 consensus_queue.cc:237] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.106987 29513 ts_tablet_manager.cc:1403] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.007s
I20260709 12:28:09.108350 29510 raft_consensus.cc:359] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.109189 29510 raft_consensus.cc:385] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.087739 29509 consensus_queue.cc:260] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.109540 29510 raft_consensus.cc:740] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.113397 29560 consensus_queue.cc:1048] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:28:09.104592 29540 raft_consensus.cc:515] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.115382 29509 ts_tablet_manager.cc:1434] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 12:28:09.116451 29540 leader_election.cc:290] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:09.118315 29551 consensus_queue.cc:237] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.120095 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:09.119153 29533 consensus_queue.cc:237] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.112996 29513 raft_consensus.cc:359] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.121379 29513 raft_consensus.cc:385] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.121753 29513 raft_consensus.cc:740] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.122282 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:09.123049 29513 consensus_queue.cc:260] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
W20260709 12:28:09.124294 29353 leader_election.cc:343] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.124966 29513 ts_tablet_manager.cc:1434] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:28:09.118566 29510 consensus_queue.cc:260] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.126837 29513 tablet_bootstrap.cc:492] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:09.127552 29510 ts_tablet_manager.cc:1434] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:28:09.128798 29510 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
W20260709 12:28:09.131045 29353 leader_election.cc:343] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.131597 29353 leader_election.cc:304] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.136088 29540 raft_consensus.cc:2749] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:09.138214 29516 tablet_bootstrap.cc:654] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.134924 29509 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:09.165560 29513 tablet_bootstrap.cc:654] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.169878 29543 raft_consensus.cc:493] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.170770 29543 raft_consensus.cc:515] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.173202 29543 leader_election.cc:290] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:09.175591 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634977a6ff1244a3a46eb6a9b9ceb36a" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:09.177026 29139 catalog_manager.cc:5697] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.183701 29510 tablet_bootstrap.cc:654] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.184122 29137 catalog_manager.cc:5697] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.186247 29137 catalog_manager.cc:5697] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.187582 29551 raft_consensus.cc:493] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:09.188231 29204 leader_election.cc:343] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.188349 29551 raft_consensus.cc:515] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.192337 29509 tablet_bootstrap.cc:654] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.194440 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:09.196201 29279 leader_election.cc:343] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.199617 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634977a6ff1244a3a46eb6a9b9ceb36a" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:09.202795 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:09.203397 29551 leader_election.cc:290] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
W20260709 12:28:09.204455 29207 leader_election.cc:343] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.204996 29207 leader_election.cc:304] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
W20260709 12:28:09.207937 29279 leader_election.cc:343] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.208634 29279 leader_election.cc:304] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.206874 29543 raft_consensus.cc:2749] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:09.210132 29551 raft_consensus.cc:2749] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:09.220155 29516 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:09.220957 29516 ts_tablet_manager.cc:1403] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.185s	user 0.022s	sys 0.006s
I20260709 12:28:09.222831 29513 tablet_bootstrap.cc:492] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:09.223505 29513 ts_tablet_manager.cc:1403] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.098s	user 0.027s	sys 0.034s
I20260709 12:28:09.226984 29513 raft_consensus.cc:359] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.227887 29513 raft_consensus.cc:385] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.228282 29513 raft_consensus.cc:740] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.227963 29516 raft_consensus.cc:359] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.229302 29516 raft_consensus.cc:385] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.229775 29516 raft_consensus.cc:740] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.232260 29516 consensus_queue.cc:260] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.233659 29509 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.234315 29509 ts_tablet_manager.cc:1403] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.009s
I20260709 12:28:09.235409 29516 ts_tablet_manager.cc:1434] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 12:28:09.237914 29516 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:09.237970 29509 raft_consensus.cc:359] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.238883 29509 raft_consensus.cc:385] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.239187 29509 raft_consensus.cc:740] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.240007 29509 consensus_queue.cc:260] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.242180 29567 raft_consensus.cc:493] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.242861 29509 ts_tablet_manager.cc:1434] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:28:09.242789 29567 raft_consensus.cc:515] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.244081 29509 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:09.246073 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08ab113fecb4c37adc9b881aa73cd06" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:09.249155 29516 tablet_bootstrap.cc:654] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.252265 29509 tablet_bootstrap.cc:654] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.235450 29513 consensus_queue.cc:260] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.252961 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08ab113fecb4c37adc9b881aa73cd06" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:09.256090 29353 leader_election.cc:343] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.256805 29316 raft_consensus.cc:2468] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:09.257201 29513 ts_tablet_manager.cc:1434] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 12:28:09.259320 29513 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:09.259509 29356 leader_election.cc:304] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.260660 29540 raft_consensus.cc:2804] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.261066 29540 raft_consensus.cc:493] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.261408 29540 raft_consensus.cc:3060] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.253747 29567 leader_election.cc:290] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:09.269445 29513 tablet_bootstrap.cc:654] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.282963 29510 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:09.285759 29540 raft_consensus.cc:515] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.288358 29540 leader_election.cc:290] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:09.288914 29510 ts_tablet_manager.cc:1403] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.160s	user 0.017s	sys 0.008s
I20260709 12:28:09.293023 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08ab113fecb4c37adc9b881aa73cd06" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:09.293745 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08ab113fecb4c37adc9b881aa73cd06" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:09.294090 29316 raft_consensus.cc:3060] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:09.295379 29353 leader_election.cc:343] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.300920 29316 raft_consensus.cc:2468] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:09.304291 29513 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:09.304423 29509 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.304549 29356 leader_election.cc:304] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.305009 29509 ts_tablet_manager.cc:1403] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.029s
I20260709 12:28:09.305001 29513 ts_tablet_manager.cc:1403] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.011s
I20260709 12:28:09.302739 29510 raft_consensus.cc:359] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.305907 29510 raft_consensus.cc:385] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.305184 29516 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:09.306242 29540 raft_consensus.cc:2804] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.306782 29516 ts_tablet_manager.cc:1403] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.019s
I20260709 12:28:09.307780 29540 raft_consensus.cc:697] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:09.306257 29510 raft_consensus.cc:740] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.311199 29540 consensus_queue.cc:237] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.311404 29510 consensus_queue.cc:260] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.308766 29509 raft_consensus.cc:359] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.314901 29509 raft_consensus.cc:385] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.314879 29510 ts_tablet_manager.cc:1434] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:28:09.315455 29509 raft_consensus.cc:740] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.316411 29510 tablet_bootstrap.cc:492] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:09.316455 29509 consensus_queue.cc:260] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.318588 29509 ts_tablet_manager.cc:1434] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:28:09.319605 29509 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:09.309707 29513 raft_consensus.cc:359] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.330641 29513 raft_consensus.cc:385] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.331197 29513 raft_consensus.cc:740] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.330103 29516 raft_consensus.cc:359] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.333473 29516 raft_consensus.cc:385] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.333642 29510 tablet_bootstrap.cc:654] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.332922 29513 consensus_queue.cc:260] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.335633 29509 tablet_bootstrap.cc:654] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.334342 29516 raft_consensus.cc:740] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.336650 29516 consensus_queue.cc:260] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.339625 29513 ts_tablet_manager.cc:1434] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.005s
I20260709 12:28:09.341262 29513 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:09.350416 29516 ts_tablet_manager.cc:1434] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 12:28:09.352276 29516 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:09.353930 29138 catalog_manager.cc:5697] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.373310 29509 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.373970 29509 ts_tablet_manager.cc:1403] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.023s
I20260709 12:28:09.374768 29513 tablet_bootstrap.cc:654] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.374919 29510 tablet_bootstrap.cc:492] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:09.376668 29564 raft_consensus.cc:493] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.377302 29564 raft_consensus.cc:515] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.379691 29510 ts_tablet_manager.cc:1403] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.018s
I20260709 12:28:09.380528 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:09.381342 29390 raft_consensus.cc:2468] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:09.382849 29427 leader_election.cc:304] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:09.383605 29516 tablet_bootstrap.cc:654] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.383724 29533 raft_consensus.cc:2804] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.384199 29533 raft_consensus.cc:493] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.384537 29533 raft_consensus.cc:3060] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.384927 29509 raft_consensus.cc:359] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.385852 29564 leader_election.cc:290] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:09.385710 29509 raft_consensus.cc:385] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.387110 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:09.388280 29509 raft_consensus.cc:740] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.388561 29240 raft_consensus.cc:2468] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:09.391161 29509 consensus_queue.cc:260] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.394007 29509 ts_tablet_manager.cc:1434] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 12:28:09.395344 29509 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:09.398033 29533 raft_consensus.cc:515] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.400486 29533 leader_election.cc:290] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:09.383316 29510 raft_consensus.cc:359] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.401777 29510 raft_consensus.cc:385] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.401748 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:09.402540 29240 raft_consensus.cc:3060] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.402451 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:09.403326 29390 raft_consensus.cc:3060] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.406006 29510 raft_consensus.cc:740] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.407306 29510 consensus_queue.cc:260] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.410002 29510 ts_tablet_manager.cc:1434] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:28:09.411211 29510 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:09.413302 29390 raft_consensus.cc:2468] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:09.414968 29427 leader_election.cc:304] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:09.416388 29533 raft_consensus.cc:2804] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.416957 29533 raft_consensus.cc:697] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:09.417861 29533 consensus_queue.cc:237] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.419659 29509 tablet_bootstrap.cc:654] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.429054 29240 raft_consensus.cc:2468] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:09.434288 29509 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.435039 29509 ts_tablet_manager.cc:1403] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.011s
I20260709 12:28:09.436664 29510 tablet_bootstrap.cc:654] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.437583 29513 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:09.438138 29513 ts_tablet_manager.cc:1403] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.013s
I20260709 12:28:09.438306 29509 raft_consensus.cc:359] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.439527 29509 raft_consensus.cc:385] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.439811 29509 raft_consensus.cc:740] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.440568 29509 consensus_queue.cc:260] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.441257 29513 raft_consensus.cc:359] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.442022 29513 raft_consensus.cc:385] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.442780 29509 ts_tablet_manager.cc:1434] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:28:09.444037 29509 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:09.444150 29516 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:09.444681 29516 ts_tablet_manager.cc:1403] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.006s
I20260709 12:28:09.444350 29139 catalog_manager.cc:5697] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.442283 29513 raft_consensus.cc:740] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.449102 29513 consensus_queue.cc:260] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.451607 29509 tablet_bootstrap.cc:654] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.455457 29513 ts_tablet_manager.cc:1434] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:28:09.456931 29513 tablet_bootstrap.cc:492] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:09.458689 29516 raft_consensus.cc:359] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.459924 29516 raft_consensus.cc:385] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.460307 29516 raft_consensus.cc:740] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.463433 29509 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.464084 29509 ts_tablet_manager.cc:1403] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:28:09.467337 29509 raft_consensus.cc:359] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.468118 29509 raft_consensus.cc:385] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.468420 29509 raft_consensus.cc:740] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.469372 29509 consensus_queue.cc:260] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.470489 29516 consensus_queue.cc:260] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.471890 29509 ts_tablet_manager.cc:1434] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:28:09.473075 29509 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:09.475939 29540 raft_consensus.cc:493] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.476560 29540 raft_consensus.cc:515] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.478109 29513 tablet_bootstrap.cc:654] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.479893 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c24bf9c694736abe899bcaa6e99f0" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:09.480420 29516 ts_tablet_manager.cc:1434] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:28:09.482173 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c24bf9c694736abe899bcaa6e99f0" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:09.481480 29540 leader_election.cc:290] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:09.482934 29464 raft_consensus.cc:2468] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:09.483170 29516 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:09.482944 29353 leader_election.cc:343] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.485327 29353 leader_election.cc:304] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:09.486755 29540 raft_consensus.cc:2804] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.487234 29540 raft_consensus.cc:493] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.487425 29509 tablet_bootstrap.cc:654] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.487733 29540 raft_consensus.cc:3060] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.496085 29543 raft_consensus.cc:493] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.496770 29543 raft_consensus.cc:515] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.499445 29540 raft_consensus.cc:515] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.500586 29516 tablet_bootstrap.cc:654] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.502916 29551 consensus_queue.cc:1048] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:09.504868 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c24bf9c694736abe899bcaa6e99f0" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:09.506829 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c24bf9c694736abe899bcaa6e99f0" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:09.507552 29464 raft_consensus.cc:3060] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.510713 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59b9f4048214a868afee18cf9e843fd" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:09.511196 29533 raft_consensus.cc:493] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.511842 29533 raft_consensus.cc:515] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.512599 29513 tablet_bootstrap.cc:492] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:09.513283 29513 ts_tablet_manager.cc:1403] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.001s
W20260709 12:28:09.512564 29204 leader_election.cc:343] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.499120 29543 leader_election.cc:290] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:09.514873 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59b9f4048214a868afee18cf9e843fd" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:09.515646 29316 raft_consensus.cc:2468] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
W20260709 12:28:09.506851 29353 leader_election.cc:343] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.518821 29513 raft_consensus.cc:359] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.519107 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f77efefeec49378e0c4347125ef945" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:09.519620 29513 raft_consensus.cc:385] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.519972 29513 raft_consensus.cc:740] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.520673 29513 consensus_queue.cc:260] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.514353 29533 leader_election.cc:290] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:09.522312 29207 leader_election.cc:304] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:09.524569 29240 raft_consensus.cc:3060] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.524793 29516 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:09.525384 29516 ts_tablet_manager.cc:1403] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 12:28:09.526683 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f77efefeec49378e0c4347125ef945" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:09.527624 29388 raft_consensus.cc:2393] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dbe6e4429184e5fb137cae093024bce in current term 1: Already voted for candidate c098fe137f19465bb9f67dbd64763b72 in this term.
I20260709 12:28:09.527997 29464 raft_consensus.cc:2468] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:09.528949 29427 leader_election.cc:304] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:09.529448 29353 leader_election.cc:304] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:09.530371 29567 raft_consensus.cc:2804] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.531785 29513 ts_tablet_manager.cc:1434] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:28:09.533249 29513 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:09.535204 29540 leader_election.cc:290] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:09.534808 29533 raft_consensus.cc:3060] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.537266 29543 raft_consensus.cc:2804] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.537731 29516 raft_consensus.cc:359] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.538630 29516 raft_consensus.cc:385] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.538269 29543 raft_consensus.cc:493] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.539661 29543 raft_consensus.cc:3060] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.541510 29509 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.538969 29516 raft_consensus.cc:740] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.542292 29509 ts_tablet_manager.cc:1403] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.004s
I20260709 12:28:09.551059 29561 consensus_queue.cc:1048] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:09.547109 29567 raft_consensus.cc:697] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:09.556730 29513 tablet_bootstrap.cc:654] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.556293 29567 consensus_queue.cc:237] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.544310 29516 consensus_queue.cc:260] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.563316 29509 raft_consensus.cc:359] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.564150 29509 raft_consensus.cc:385] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.564440 29509 raft_consensus.cc:740] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.565192 29509 consensus_queue.cc:260] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.568212 29533 raft_consensus.cc:2749] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:09.571566 29510 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:09.572250 29510 ts_tablet_manager.cc:1403] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.161s	user 0.019s	sys 0.015s
I20260709 12:28:09.560670 29540 raft_consensus.cc:493] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.574539 29540 raft_consensus.cc:515] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.577235 29509 ts_tablet_manager.cc:1434] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:28:09.577517 29561 consensus_queue.cc:1048] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:09.578466 29509 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:09.579855 29510 raft_consensus.cc:359] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.580716 29510 raft_consensus.cc:385] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.581050 29510 raft_consensus.cc:740] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.583389 29510 consensus_queue.cc:260] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.597682 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8adbb821c8c4e11ad628089fc00d166" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:09.601485 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:28:09.605512 29353 leader_election.cc:343] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.611716 29564 raft_consensus.cc:493] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.616703 29564 raft_consensus.cc:515] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.617798 29135 catalog_manager.cc:5697] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.619128 29564 leader_election.cc:290] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:09.621106 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:09.623553 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:09.625531 29427 leader_election.cc:343] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:09.626364 29430 leader_election.cc:343] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.626837 29430 leader_election.cc:304] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:09.628089 29564 raft_consensus.cc:2749] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:09.631799 29513 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:09.634861 29513 ts_tablet_manager.cc:1403] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.102s	user 0.023s	sys 0.014s
I20260709 12:28:09.634979 29509 tablet_bootstrap.cc:654] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.638070 29513 raft_consensus.cc:359] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.638918 29513 raft_consensus.cc:385] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.639257 29513 raft_consensus.cc:740] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.639979 29516 ts_tablet_manager.cc:1434] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.114s	user 0.016s	sys 0.008s
I20260709 12:28:09.640210 29513 consensus_queue.cc:260] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.641624 29516 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:09.643833 29510 ts_tablet_manager.cc:1434] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.003s
I20260709 12:28:09.645100 29510 tablet_bootstrap.cc:492] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:09.646551 29540 leader_election.cc:290] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:09.648386 29513 ts_tablet_manager.cc:1434] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:28:09.649500 29513 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:09.649278 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8adbb821c8c4e11ad628089fc00d166" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:09.651549 29353 leader_election.cc:343] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.652042 29353 leader_election.cc:304] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.652875 29560 consensus_queue.cc:1048] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:09.654816 29540 raft_consensus.cc:2749] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:09.656711 29513 tablet_bootstrap.cc:654] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.654578 29561 consensus_queue.cc:1048] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:09.659158 29543 raft_consensus.cc:515] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.661576 29510 tablet_bootstrap.cc:654] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.661892 29516 tablet_bootstrap.cc:654] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.671329 29540 raft_consensus.cc:493] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.672394 29540 raft_consensus.cc:515] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.699797 29551 raft_consensus.cc:493] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.703044 29518 raft_consensus.cc:493] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.709024 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59b9f4048214a868afee18cf9e843fd" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:09.711913 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc799754b16428a9fd044cbd3073a05" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:09.712378 29389 raft_consensus.cc:3060] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.712731 29241 raft_consensus.cc:2468] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:09.714255 29540 leader_election.cc:290] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:09.714345 29353 leader_election.cc:304] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:09.715441 29540 raft_consensus.cc:2804] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.715837 29540 raft_consensus.cc:493] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.706539 29543 leader_election.cc:290] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:09.716202 29540 raft_consensus.cc:3060] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.709782 29551 raft_consensus.cc:515] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.711907 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59b9f4048214a868afee18cf9e843fd" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:09.722237 29316 raft_consensus.cc:3060] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.722764 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc799754b16428a9fd044cbd3073a05" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:09.723519 29315 raft_consensus.cc:2468] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:09.711449 29518 raft_consensus.cc:515] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.728741 29551 leader_election.cc:290] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:09.736162 29513 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:09.737015 29513 ts_tablet_manager.cc:1403] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.028s
I20260709 12:28:09.738101 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63924737d2d47bf8921d8c66bb9967e" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:09.742883 29510 tablet_bootstrap.cc:492] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:09.743532 29510 ts_tablet_manager.cc:1403] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.009s
I20260709 12:28:09.747030 29509 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.747650 29509 ts_tablet_manager.cc:1403] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.008s
I20260709 12:28:09.749786 29315 raft_consensus.cc:3060] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.754022 29543 raft_consensus.cc:493] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.754650 29543 raft_consensus.cc:515] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.759683 29518 leader_election.cc:290] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:09.760203 29567 raft_consensus.cc:493] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.760962 29567 raft_consensus.cc:515] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
W20260709 12:28:09.761932 29279 leader_election.cc:343] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.731487 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63924737d2d47bf8921d8c66bb9967e" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:09.763540 29464 raft_consensus.cc:2468] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:09.763970 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634977a6ff1244a3a46eb6a9b9ceb36a" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:09.765020 29241 raft_consensus.cc:2468] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:09.766718 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634977a6ff1244a3a46eb6a9b9ceb36a" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:09.767788 29390 raft_consensus.cc:2468] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:09.770908 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:09.771752 29314 raft_consensus.cc:2468] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:09.773394 29207 leader_election.cc:304] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:09.774577 29596 raft_consensus.cc:2804] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.775019 29596 raft_consensus.cc:493] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.774780 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:09.775492 29596 raft_consensus.cc:3060] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.776696 29279 leader_election.cc:304] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:09.778930 29279 leader_election.cc:304] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:09.779439 29316 raft_consensus.cc:2468] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:09.778070 29562 raft_consensus.cc:2804] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.780216 29562 raft_consensus.cc:493] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.780696 29207 leader_election.cc:304] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:09.780988 29561 raft_consensus.cc:2804] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.781567 29561 raft_consensus.cc:493] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.781965 29597 raft_consensus.cc:2804] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.782037 29561 raft_consensus.cc:3060] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.780714 29562 raft_consensus.cc:3060] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.790756 29567 leader_election.cc:290] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:09.787567 29509 raft_consensus.cc:359] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.792353 29509 raft_consensus.cc:385] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.792830 29509 raft_consensus.cc:740] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.795086 29509 consensus_queue.cc:260] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.797202 29567 consensus_queue.cc:1048] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:09.800036 29543 leader_election.cc:290] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:09.792132 29513 raft_consensus.cc:359] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.805063 29513 raft_consensus.cc:385] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.805435 29513 raft_consensus.cc:740] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.812445 29510 raft_consensus.cc:359] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.813278 29510 raft_consensus.cc:385] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.813560 29510 raft_consensus.cc:740] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.819345 29510 consensus_queue.cc:260] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:09.820544 29389 raft_consensus.cc:2468] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:09.824936 29510 ts_tablet_manager.cc:1434] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.002s
I20260709 12:28:09.826100 29510 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:09.814064 29513 consensus_queue.cc:260] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.845571 29509 ts_tablet_manager.cc:1434] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.002s
I20260709 12:28:09.847029 29513 ts_tablet_manager.cc:1434] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.109s	user 0.013s	sys 0.000s
I20260709 12:28:09.847380 29509 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:09.850090 29510 tablet_bootstrap.cc:654] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.851068 29516 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:09.851715 29516 ts_tablet_manager.cc:1403] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.210s	user 0.029s	sys 0.053s
I20260709 12:28:09.849678 29596 raft_consensus.cc:515] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.857118 29513 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:09.863278 29564 consensus_queue.cc:1048] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:09.865937 29464 raft_consensus.cc:3060] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:09.863487 29353 leader_election.cc:343] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.868641 29509 tablet_bootstrap.cc:654] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.871400 29540 raft_consensus.cc:515] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.875355 29516 raft_consensus.cc:359] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.876271 29516 raft_consensus.cc:385] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.876590 29516 raft_consensus.cc:740] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.855351 29597 raft_consensus.cc:697] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:09.891073 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:09.891817 29314 raft_consensus.cc:3060] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.879819 29596 leader_election.cc:290] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:09.902994 29540 leader_election.cc:290] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:09.904429 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc799754b16428a9fd044cbd3073a05" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:09.904434 29597 consensus_queue.cc:237] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.905493 29313 raft_consensus.cc:3060] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.877370 29516 consensus_queue.cc:260] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.912864 29516 ts_tablet_manager.cc:1434] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:28:09.914294 29516 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:09.901494 29561 raft_consensus.cc:515] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.917562 29540 consensus_queue.cc:1048] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:09.918011 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:09.918437 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc799754b16428a9fd044cbd3073a05" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:09.920332 29240 raft_consensus.cc:3060] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.922699 29561 leader_election.cc:290] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:09.923164 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:09.925081 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63924737d2d47bf8921d8c66bb9967e" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:09.930316 29463 raft_consensus.cc:3060] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.934993 29533 consensus_queue.cc:1048] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:09.935608 29462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
W20260709 12:28:09.936080 29204 leader_election.cc:343] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.937292 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63924737d2d47bf8921d8c66bb9967e" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
W20260709 12:28:09.940182 29353 leader_election.cc:343] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.941859 29353 leader_election.cc:304] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.945070 29313 raft_consensus.cc:2468] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:09.945598 29594 raft_consensus.cc:2749] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:09.914206 29314 raft_consensus.cc:2468] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
W20260709 12:28:09.946925 29204 leader_election.cc:343] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.955921 29516 tablet_bootstrap.cc:654] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.959561 29356 leader_election.cc:304] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:09.960615 29540 raft_consensus.cc:2804] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.960969 29207 leader_election.cc:304] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:09.961166 29540 raft_consensus.cc:697] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:09.962185 29540 consensus_queue.cc:237] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.965842 29597 raft_consensus.cc:2804] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.937650 29562 raft_consensus.cc:515] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:09.967145 29510 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:09.970788 29510 ts_tablet_manager.cc:1403] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.015s
W20260709 12:28:09.970939 29279 leader_election.cc:343] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.973759 29560 consensus_queue.cc:1048] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:09.976012 29509 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:09.976606 29509 ts_tablet_manager.cc:1403] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.001s
I20260709 12:28:09.980309 29562 leader_election.cc:290] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:09.981501 29594 raft_consensus.cc:493] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.982107 29594 raft_consensus.cc:515] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.984581 29594 leader_election.cc:290] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:09.985142 29509 raft_consensus.cc:359] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.985916 29509 raft_consensus.cc:385] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.986194 29509 raft_consensus.cc:740] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.986748 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ae76c376541159f0e79e554e34cd2" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:09.986948 29509 consensus_queue.cc:260] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:09.967607 29597 raft_consensus.cc:697] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
W20260709 12:28:09.989744 29353 leader_election.cc:343] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.984814 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634977a6ff1244a3a46eb6a9b9ceb36a" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:09.990378 29597 consensus_queue.cc:237] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.990985 29389 raft_consensus.cc:3060] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.992355 29138 catalog_manager.cc:5697] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.993682 29510 raft_consensus.cc:359] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.994447 29510 raft_consensus.cc:385] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.994665 29510 raft_consensus.cc:740] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.995303 29510 consensus_queue.cc:260] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:09.996978 29510 ts_tablet_manager.cc:1434] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 12:28:09.997725 29510 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:09.984814 29240 raft_consensus.cc:2468] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:10.003427 29463 raft_consensus.cc:2468] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:10.010669 29279 leader_election.cc:304] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:10.012118 29562 raft_consensus.cc:2804] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.013562 29562 raft_consensus.cc:697] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:10.007606 29139 catalog_manager.cc:5697] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:10.014644 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ae76c376541159f0e79e554e34cd2" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.008688 29389 raft_consensus.cc:2468] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:10.015110 29562 consensus_queue.cc:237] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.009390 29510 tablet_bootstrap.cc:654] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.020444 29279 leader_election.cc:304] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:10.006565 29513 tablet_bootstrap.cc:654] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.027912 29561 raft_consensus.cc:2804] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.028545 29561 raft_consensus.cc:697] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:10.029493 29561 consensus_queue.cc:237] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.039610 29510 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:10.040249 29510 ts_tablet_manager.cc:1403] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.011s
I20260709 12:28:10.045326 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634977a6ff1244a3a46eb6a9b9ceb36a" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:10.046350 29241 raft_consensus.cc:3060] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.048579 29510 raft_consensus.cc:359] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.049396 29510 raft_consensus.cc:385] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.049679 29510 raft_consensus.cc:740] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.053603 29510 consensus_queue.cc:260] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.057078 29510 ts_tablet_manager.cc:1434] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:28:10.059451 29516 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:10.060014 29516 ts_tablet_manager.cc:1403] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.007s
I20260709 12:28:10.060781 29510 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:10.056514 29139 catalog_manager.cc:5697] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:10.064642 29513 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:10.066849 29513 ts_tablet_manager.cc:1403] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.015s
I20260709 12:28:10.069967 29513 raft_consensus.cc:359] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.070874 29513 raft_consensus.cc:385] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.073199 29516 raft_consensus.cc:359] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.074321 29509 ts_tablet_manager.cc:1434] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:28:10.077567 29509 tablet_bootstrap.cc:492] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:10.071246 29513 raft_consensus.cc:740] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.065960 29241 raft_consensus.cc:2468] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:10.078768 29239 raft_consensus.cc:3060] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.074591 29139 catalog_manager.cc:5697] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:10.080355 29353 leader_election.cc:343] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.074252 29516 raft_consensus.cc:385] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.081998 29516 raft_consensus.cc:740] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.082782 29516 consensus_queue.cc:260] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.084903 29516 ts_tablet_manager.cc:1434] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:28:10.085932 29516 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:10.086529 29353 leader_election.cc:304] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:10.088171 29594 raft_consensus.cc:2749] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.092005 29516 tablet_bootstrap.cc:654] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.080688 29513 consensus_queue.cc:260] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.081434 29510 tablet_bootstrap.cc:654] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.096947 29513 ts_tablet_manager.cc:1434] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:28:10.098292 29513 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:10.105135 29513 tablet_bootstrap.cc:654] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:10.106271 29353 consensus_peers.cc:597] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:10.115116 29138 catalog_manager.cc:5697] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.119769 29594 consensus_queue.cc:1048] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.141738 29509 tablet_bootstrap.cc:654] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.154700 29594 raft_consensus.cc:493] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.155370 29594 raft_consensus.cc:515] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.158550 29594 leader_election.cc:290] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.159392 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:10.162058 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:10.164328 29353 leader_election.cc:343] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.164940 29513 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
W20260709 12:28:10.165163 29353 leader_election.cc:343] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.165580 29513 ts_tablet_manager.cc:1403] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.012s
I20260709 12:28:10.165706 29353 leader_election.cc:304] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:10.167222 29594 raft_consensus.cc:2749] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.184235 29513 raft_consensus.cc:359] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.185094 29513 raft_consensus.cc:385] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.185388 29513 raft_consensus.cc:740] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.188537 29516 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:10.189136 29516 ts_tablet_manager.cc:1403] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.019s
I20260709 12:28:10.192210 29516 raft_consensus.cc:359] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.193204 29516 raft_consensus.cc:385] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.193508 29516 raft_consensus.cc:740] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.194490 29510 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:10.201290 29510 ts_tablet_manager.cc:1403] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.143s	user 0.027s	sys 0.017s
I20260709 12:28:10.202405 29561 raft_consensus.cc:493] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.203323 29561 raft_consensus.cc:515] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.204645 29510 raft_consensus.cc:359] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.205608 29510 raft_consensus.cc:385] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.205966 29510 raft_consensus.cc:740] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.186084 29513 consensus_queue.cc:260] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.209517 29509 tablet_bootstrap.cc:492] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:10.209898 29513 ts_tablet_manager.cc:1434] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.044s	user 0.013s	sys 0.005s
I20260709 12:28:10.210258 29509 ts_tablet_manager.cc:1403] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.133s	user 0.007s	sys 0.006s
I20260709 12:28:10.210721 29510 consensus_queue.cc:260] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.213196 29510 ts_tablet_manager.cc:1434] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:28:10.213793 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:10.214619 29463 raft_consensus.cc:2468] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:10.214749 29561 leader_election.cc:290] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.215503 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.216185 29513 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:10.215961 29279 leader_election.cc:304] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
W20260709 12:28:10.217187 29279 leader_election.cc:343] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.217311 29509 raft_consensus.cc:359] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.218140 29509 raft_consensus.cc:385] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.218266 29561 raft_consensus.cc:2804] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.218498 29509 raft_consensus.cc:740] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.219061 29561 raft_consensus.cc:493] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.219575 29561 raft_consensus.cc:3060] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.220124 29509 consensus_queue.cc:260] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.194320 29516 consensus_queue.cc:260] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.224502 29516 ts_tablet_manager.cc:1434] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:28:10.225554 29510 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:10.227557 29509 ts_tablet_manager.cc:1434] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 12:28:10.229465 29516 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:10.231125 29562 raft_consensus.cc:493] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.242249 29562 raft_consensus.cc:515] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.244614 29562 leader_election.cc:290] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.246675 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.247328 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:10.247903 29516 tablet_bootstrap.cc:654] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:10.248425 29279 leader_election.cc:343] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:10.249219 29279 leader_election.cc:343] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.249678 29279 leader_election.cc:304] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:10.228726 29509 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:10.250880 29562 raft_consensus.cc:2749] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.230376 29513 tablet_bootstrap.cc:654] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:10.254099 29632 log.cc:927] Time spent T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:28:10.241372 29510 tablet_bootstrap.cc:654] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.257500 29509 tablet_bootstrap.cc:654] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.264684 29594 raft_consensus.cc:493] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.265347 29594 raft_consensus.cc:515] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.237411 29561 raft_consensus.cc:515] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.269168 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae09303fa81d45f086eec87509b6e72b" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:10.271413 29353 leader_election.cc:343] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.272109 29594 leader_election.cc:290] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:10.273481 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae09303fa81d45f086eec87509b6e72b" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:10.274886 29510 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
W20260709 12:28:10.275401 29356 leader_election.cc:343] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.276116 29561 leader_election.cc:290] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.275944 29356 leader_election.cc:304] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:10.275441 29510 ts_tablet_manager.cc:1403] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.009s
I20260709 12:28:10.277506 29594 raft_consensus.cc:2749] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.277729 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:10.278426 29463 raft_consensus.cc:3060] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.279716 29239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:10.280521 29510 raft_consensus.cc:359] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.281210 29510 raft_consensus.cc:385] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:28:10.281380 29279 leader_election.cc:343] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.284039 29513 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:10.284924 29513 ts_tablet_manager.cc:1403] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.003s
I20260709 12:28:10.286767 29516 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:10.287117 29463 raft_consensus.cc:2468] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:10.287374 29516 ts_tablet_manager.cc:1403] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.002s
I20260709 12:28:10.288290 29513 raft_consensus.cc:359] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.288614 29279 leader_election.cc:304] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:10.289065 29513 raft_consensus.cc:385] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.281512 29510 raft_consensus.cc:740] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.290128 29561 raft_consensus.cc:2804] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.290692 29561 raft_consensus.cc:697] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:10.291599 29561 consensus_queue.cc:237] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.291728 29516 raft_consensus.cc:359] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.292536 29516 raft_consensus.cc:385] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.292857 29516 raft_consensus.cc:740] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.293622 29516 consensus_queue.cc:260] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.294725 29510 consensus_queue.cc:260] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.289392 29513 raft_consensus.cc:740] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.296079 29516 ts_tablet_manager.cc:1434] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:28:10.296324 29513 consensus_queue.cc:260] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.298895 29509 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:10.299521 29509 ts_tablet_manager.cc:1403] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.071s	user 0.005s	sys 0.007s
I20260709 12:28:10.301156 29513 ts_tablet_manager.cc:1434] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:28:10.302381 29513 tablet_bootstrap.cc:492] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:10.303066 29509 raft_consensus.cc:359] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.298938 29510 ts_tablet_manager.cc:1434] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:28:10.306665 29509 raft_consensus.cc:385] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.307070 29509 raft_consensus.cc:740] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.307730 29510 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:10.315817 29516 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:10.318183 29509 consensus_queue.cc:260] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.321028 29509 ts_tablet_manager.cc:1434] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:28:10.325127 29510 tablet_bootstrap.cc:654] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.325526 29509 tablet_bootstrap.cc:492] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:10.324430 29513 tablet_bootstrap.cc:654] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.333753 29139 catalog_manager.cc:5697] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:10.343933 29509 tablet_bootstrap.cc:654] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.340703 29516 tablet_bootstrap.cc:654] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.350178 29597 raft_consensus.cc:493] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.351011 29597 raft_consensus.cc:515] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.352281 29513 tablet_bootstrap.cc:492] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:10.352963 29513 ts_tablet_manager.cc:1403] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.006s
I20260709 12:28:10.355403 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:10.356499 29388 raft_consensus.cc:2468] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:10.356997 29513 raft_consensus.cc:359] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.360412 29597 leader_election.cc:290] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:10.361194 29204 leader_election.cc:304] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:10.357988 29513 raft_consensus.cc:385] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.364868 29513 raft_consensus.cc:740] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.365849 29513 consensus_queue.cc:260] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.373733 29516 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:10.374647 29516 ts_tablet_manager.cc:1403] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.006s
I20260709 12:28:10.374951 29597 raft_consensus.cc:2804] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.375406 29597 raft_consensus.cc:493] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.375759 29597 raft_consensus.cc:3060] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.374600 29561 raft_consensus.cc:493] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.376384 29561 raft_consensus.cc:515] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.378664 29561 leader_election.cc:290] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.378937 29516 raft_consensus.cc:359] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.380625 29516 raft_consensus.cc:385] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.380909 29516 raft_consensus.cc:740] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.381057 29239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.382932 29594 consensus_queue.cc:1048] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.383242 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:10.382864 29516 consensus_queue.cc:260] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.383910 29463 raft_consensus.cc:2468] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
W20260709 12:28:10.385133 29279 leader_election.cc:343] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.385645 29516 ts_tablet_manager.cc:1434] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:28:10.386799 29516 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:10.390203 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:10.392943 29516 tablet_bootstrap.cc:654] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.395052 29513 ts_tablet_manager.cc:1434] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 12:28:10.396502 29513 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
W20260709 12:28:10.408423 29279 leader_election.cc:343] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.409250 29279 leader_election.cc:304] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:10.410368 29561 raft_consensus.cc:2749] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.414848 29621 raft_consensus.cc:493] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.415566 29621 raft_consensus.cc:515] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.430375 29510 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:10.433717 29510 ts_tablet_manager.cc:1403] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.126s	user 0.052s	sys 0.030s
I20260709 12:28:10.433916 29509 tablet_bootstrap.cc:492] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:10.434461 29509 ts_tablet_manager.cc:1403] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.109s	user 0.020s	sys 0.023s
I20260709 12:28:10.436899 29561 raft_consensus.cc:493] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.439839 29561 raft_consensus.cc:515] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.445094 29561 leader_election.cc:290] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:10.446146 29239 raft_consensus.cc:3060] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.447412 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.447757 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:10.448524 29390 raft_consensus.cc:2468] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
W20260709 12:28:10.451390 29279 leader_election.cc:343] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.446570 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8adbb821c8c4e11ad628089fc00d166" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.453141 29240 raft_consensus.cc:2468] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:10.446322 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8adbb821c8c4e11ad628089fc00d166" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:10.454828 29388 raft_consensus.cc:2468] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:10.463862 29427 leader_election.cc:304] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:10.468501 29560 raft_consensus.cc:2804] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.468971 29560 raft_consensus.cc:493] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.469290 29560 raft_consensus.cc:3060] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.474743 29513 tablet_bootstrap.cc:654] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.445140 29621 leader_election.cc:290] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.475672 29540 consensus_queue.cc:1048] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.477581 29510 raft_consensus.cc:359] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.478470 29510 raft_consensus.cc:385] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.478787 29510 raft_consensus.cc:740] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.476958 29621 raft_consensus.cc:493] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.483210 29621 raft_consensus.cc:515] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.483512 29560 raft_consensus.cc:515] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.479820 29510 consensus_queue.cc:260] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.487370 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.487869 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:10.493798 29315 raft_consensus.cc:2393] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dbe6e4429184e5fb137cae093024bce in current term 1: Already voted for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in this term.
I20260709 12:28:10.494971 29279 leader_election.cc:304] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:10.491447 29533 raft_consensus.cc:493] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.495716 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8adbb821c8c4e11ad628089fc00d166" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:10.496002 29561 raft_consensus.cc:2804] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.495941 29533 raft_consensus.cc:515] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.496380 29388 raft_consensus.cc:3060] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.500154 29510 ts_tablet_manager.cc:1434] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:28:10.502153 29516 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:10.502882 29516 ts_tablet_manager.cc:1403] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.028s
I20260709 12:28:10.503324 29510 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:10.496611 29561 raft_consensus.cc:493] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.507823 29533 leader_election.cc:290] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:10.511309 29597 raft_consensus.cc:515] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.511785 29509 raft_consensus.cc:359] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.512552 29509 raft_consensus.cc:385] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.490955 29621 leader_election.cc:290] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:10.514323 29509 raft_consensus.cc:740] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.516523 29533 raft_consensus.cc:493] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.509886 29561 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.519224 29533 raft_consensus.cc:515] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.522778 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:10.523511 29464 raft_consensus.cc:3060] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.524748 29516 raft_consensus.cc:359] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.525060 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:10.525543 29516 raft_consensus.cc:385] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.525784 29390 raft_consensus.cc:3060] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.525877 29516 raft_consensus.cc:740] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.516095 29427 leader_election.cc:304] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:10.522792 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:10.527639 29560 leader_election.cc:290] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
W20260709 12:28:10.528152 29430 leader_election.cc:343] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.528375 29560 raft_consensus.cc:3060] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.531729 29464 raft_consensus.cc:2468] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:10.534144 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ae76c376541159f0e79e554e34cd2" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:10.534785 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.534958 29389 raft_consensus.cc:2468] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:10.517091 29597 leader_election.cc:290] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:10.536345 29513 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:10.536919 29513 ts_tablet_manager.cc:1403] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.141s	user 0.009s	sys 0.005s
I20260709 12:28:10.537395 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8adbb821c8c4e11ad628089fc00d166" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:10.538043 29241 raft_consensus.cc:3060] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.539476 29427 leader_election.cc:304] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:10.540508 29621 raft_consensus.cc:2804] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.540913 29621 raft_consensus.cc:493] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.541254 29621 raft_consensus.cc:3060] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.541409 29597 raft_consensus.cc:493] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.541946 29597 raft_consensus.cc:515] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.542577 29510 tablet_bootstrap.cc:654] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.544225 29597 leader_election.cc:290] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:10.532688 29561 raft_consensus.cc:515] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.545794 29516 consensus_queue.cc:260] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:10.544894 29597 consensus_queue.cc:1048] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.551594 29516 ts_tablet_manager.cc:1434] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 12:28:10.551147 29509 consensus_queue.cc:260] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.552556 29516 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:10.557854 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63924737d2d47bf8921d8c66bb9967e" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:10.541246 29388 raft_consensus.cc:2468] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:10.555815 29513 raft_consensus.cc:359] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.560489 29513 raft_consensus.cc:385] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.560868 29513 raft_consensus.cc:740] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.561625 29513 consensus_queue.cc:260] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.565148 29513 ts_tablet_manager.cc:1434] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:28:10.575562 29509 ts_tablet_manager.cc:1434] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.000s
I20260709 12:28:10.583472 29509 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:10.587931 29561 leader_election.cc:290] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:10.588464 29427 leader_election.cc:304] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:10.589706 29564 raft_consensus.cc:2804] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.590761 29560 raft_consensus.cc:2749] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.592554 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:10.593511 29388 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.613834 29388 raft_consensus.cc:2468] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:10.616794 29279 leader_election.cc:304] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:10.618000 29561 raft_consensus.cc:2804] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.618683 29561 raft_consensus.cc:697] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:10.619946 29561 consensus_queue.cc:237] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
W20260709 12:28:10.623413 29427 leader_election.cc:343] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.623987 29427 leader_election.cc:304] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:10.624953 29204 leader_election.cc:304] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 
I20260709 12:28:10.626720 29562 consensus_queue.cc:1048] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.627159 29560 raft_consensus.cc:2749] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.629861 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63924737d2d47bf8921d8c66bb9967e" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:10.634444 29241 raft_consensus.cc:2468] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:10.642174 29533 leader_election.cc:290] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.643540 29513 tablet_bootstrap.cc:492] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:10.648412 29464 raft_consensus.cc:2393] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 629ba7d0b7eb4d9b8832b0f605f79443 in current term 1: Already voted for candidate c098fe137f19465bb9f67dbd64763b72 in this term.
I20260709 12:28:10.649734 29516 tablet_bootstrap.cc:654] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.643465 29621 raft_consensus.cc:515] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.659827 29597 raft_consensus.cc:2804] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.662348 29551 consensus_queue.cc:1048] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.695207 29597 raft_consensus.cc:697] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
W20260709 12:28:10.704947 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:10.704790 29597 consensus_queue.cc:237] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.705834 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ae76c376541159f0e79e554e34cd2" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.707731 29510 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:10.707626 29562 raft_consensus.cc:493] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.708308 29562 raft_consensus.cc:515] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.710440 29510 ts_tablet_manager.cc:1403] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.208s	user 0.010s	sys 0.013s
I20260709 12:28:10.717077 29564 raft_consensus.cc:697] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:10.723781 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:10.738057 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e528a3aa1c4b73a3f5dad737cf41a4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:10.740470 29510 raft_consensus.cc:359] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.761833 29387 raft_consensus.cc:2468] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:10.747574 29621 leader_election.cc:290] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.748786 29513 tablet_bootstrap.cc:654] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.763129 29279 leader_election.cc:304] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:10.748353 29562 leader_election.cc:290] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:10.750519 29651 consensus_queue.cc:1048] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.764070 29551 raft_consensus.cc:2804] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:10.758944 29427 leader_election.cc:343] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.766971 29596 raft_consensus.cc:493] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96bd9c3c81e04118abc2fe11d2b361ed)
I20260709 12:28:10.767751 29596 raft_consensus.cc:515] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.729215 29390 raft_consensus.cc:2468] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:10.760711 29659 consensus_queue.cc:1048] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.762034 29510 raft_consensus.cc:385] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.770562 29510 raft_consensus.cc:740] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.771629 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ae76c376541159f0e79e554e34cd2" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:10.771387 29510 consensus_queue.cc:260] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.772284 29387 raft_consensus.cc:3060] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.749749 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e528a3aa1c4b73a3f5dad737cf41a4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:10.773952 29510 ts_tablet_manager.cc:1434] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:28:10.776904 29510 tablet_bootstrap.cc:492] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:10.760030 29509 tablet_bootstrap.cc:654] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.765599 29551 raft_consensus.cc:493] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.779469 29551 raft_consensus.cc:3060] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.779563 29564 consensus_queue.cc:237] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.782590 29596 leader_election.cc:290] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
W20260709 12:28:10.795569 29279 leader_election.cc:343] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.793232 29597 consensus_queue.cc:1048] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:28:10.804615 29204 leader_election.cc:304] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:10.808986 29516 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:10.809634 29516 ts_tablet_manager.cc:1403] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.257s	user 0.017s	sys 0.009s
I20260709 12:28:10.809758 29651 raft_consensus.cc:3060] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.812752 29516 raft_consensus.cc:359] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.813505 29516 raft_consensus.cc:385] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.813768 29516 raft_consensus.cc:740] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.816184 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c24bf9c694736abe899bcaa6e99f0" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:10.817806 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c24bf9c694736abe899bcaa6e99f0" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:10.827612 29510 tablet_bootstrap.cc:654] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.828536 29551 raft_consensus.cc:515] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.829921 29516 consensus_queue.cc:260] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.844583 29513 tablet_bootstrap.cc:492] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:10.845199 29513 ts_tablet_manager.cc:1403] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.202s	user 0.011s	sys 0.007s
I20260709 12:28:10.803158 29596 consensus_queue.cc:1048] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:28:10.853299 29516 ts_tablet_manager.cc:1434] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:28:10.854938 29516 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:10.849604 29621 raft_consensus.cc:493] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.877986 29621 raft_consensus.cc:515] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.881394 29134 catalog_manager.cc:5697] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:10.883116 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:10.884970 29389 raft_consensus.cc:2468] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:10.850211 29387 raft_consensus.cc:2468] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:10.852738 29239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ae76c376541159f0e79e554e34cd2" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:10.862553 29204 leader_election.cc:304] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:10.898015 29427 leader_election.cc:304] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:10.898800 29650 raft_consensus.cc:2749] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:10.867031 29551 leader_election.cc:290] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:10.881153 29621 leader_election.cc:290] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:10.913587 29427 leader_election.cc:304] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:10.914875 29621 raft_consensus.cc:2804] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.915454 29621 raft_consensus.cc:697] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:10.916404 29621 consensus_queue.cc:237] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:10.918718 29513 raft_consensus.cc:359] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:10.919567 29513 raft_consensus.cc:385] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.919909 29513 raft_consensus.cc:740] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
W20260709 12:28:10.911017 29279 leader_election.cc:343] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.931084 29509 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:10.931731 29509 ts_tablet_manager.cc:1403] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.352s	user 0.010s	sys 0.017s
I20260709 12:28:10.908046 29564 raft_consensus.cc:2804] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.936163 29513 consensus_queue.cc:260] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
W20260709 12:28:10.911696 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 54677us
I20260709 12:28:10.936784 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e528a3aa1c4b73a3f5dad737cf41a4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:10.938961 29509 raft_consensus.cc:359] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.939687 29509 raft_consensus.cc:385] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.939951 29509 raft_consensus.cc:740] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.940649 29509 consensus_queue.cc:260] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:10.933724 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e528a3aa1c4b73a3f5dad737cf41a4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:10.948022 29387 raft_consensus.cc:3060] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.948276 29651 raft_consensus.cc:2749] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:10.950305 29427 leader_election.cc:343] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.935388 29564 raft_consensus.cc:493] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.951494 29564 raft_consensus.cc:3060] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.952936 29239 raft_consensus.cc:3060] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.953789 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:10.932945 29136 catalog_manager.cc:5697] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.969826 29509 ts_tablet_manager.cc:1434] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
W20260709 12:28:10.970381 29427 leader_election.cc:343] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:10.972750 29279 leader_election.cc:343] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.973662 29562 consensus_queue.cc:1048] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:10.969832 29668 log.cc:927] Time spent T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:28:10.983831 29513 ts_tablet_manager.cc:1434] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.138s	user 0.008s	sys 0.000s
I20260709 12:28:10.985005 29513 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:10.971093 29509 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:10.998523 29516 tablet_bootstrap.cc:654] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.004614 29562 raft_consensus.cc:493] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.005451 29562 raft_consensus.cc:515] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.065860 29561 raft_consensus.cc:493] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.115219 29562 leader_election.cc:290] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:11.107911 29509 tablet_bootstrap.cc:654] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.129527 29551 consensus_queue.cc:1048] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:11.094133 29561 raft_consensus.cc:515] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.133862 29561 leader_election.cc:290] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:11.138844 29564 raft_consensus.cc:515] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:11.150255 29513 tablet_bootstrap.cc:654] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.153172 29564 leader_election.cc:290] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:11.138237 29567 raft_consensus.cc:493] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.163406 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:11.164238 29510 tablet_bootstrap.cc:492] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:11.164855 29510 ts_tablet_manager.cc:1403] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.388s	user 0.041s	sys 0.032s
W20260709 12:28:11.165788 29427 leader_election.cc:343] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:11.160931 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 86425us
I20260709 12:28:11.168831 29651 raft_consensus.cc:493] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.174989 29651 raft_consensus.cc:515] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.175921 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae09303fa81d45f086eec87509b6e72b" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:11.167647 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:11.179412 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae09303fa81d45f086eec87509b6e72b" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:11.180177 29389 raft_consensus.cc:2468] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:11.181679 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:11.179605 29390 raft_consensus.cc:3060] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.182582 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:11.183656 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.186223 29516 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:11.180922 29651 leader_election.cc:290] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.186887 29516 ts_tablet_manager.cc:1403] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.332s	user 0.010s	sys 0.005s
I20260709 12:28:11.159804 29567 raft_consensus.cc:515] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.188406 29386 raft_consensus.cc:2468] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:11.188777 29387 raft_consensus.cc:2468] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:11.189211 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:11.189672 29567 leader_election.cc:290] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.186918 29510 raft_consensus.cc:359] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.190997 29510 raft_consensus.cc:385] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.191408 29510 raft_consensus.cc:740] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.194638 29510 consensus_queue.cc:260] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.192242 29239 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.204562 29510 ts_tablet_manager.cc:1434] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.002s
I20260709 12:28:11.206135 29510 tablet_bootstrap.cc:492] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:11.206179 29204 leader_election.cc:304] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:11.207433 29597 raft_consensus.cc:2749] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.197930 29651 consensus_queue.cc:1048] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:28:11.210520 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:11.214016 29516 raft_consensus.cc:359] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.214823 29516 raft_consensus.cc:385] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.215512 29516 raft_consensus.cc:740] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.216403 29516 consensus_queue.cc:260] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.216897 29390 raft_consensus.cc:2468] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:11.218286 29427 leader_election.cc:304] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
W20260709 12:28:11.212116 29279 leader_election.cc:343] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.219610 29655 raft_consensus.cc:2804] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.220161 29655 raft_consensus.cc:697] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:11.220435 29681 consensus_queue.cc:1048] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:11.221047 29655 consensus_queue.cc:237] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:11.221769 29509 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:11.218926 29516 ts_tablet_manager.cc:1434] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:28:11.222368 29509 ts_tablet_manager.cc:1403] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.251s	user 0.019s	sys 0.007s
I20260709 12:28:11.237116 29513 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:11.238039 29513 ts_tablet_manager.cc:1403] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.253s	user 0.015s	sys 0.024s
I20260709 12:28:11.238102 29516 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:11.223811 29353 leader_election.cc:343] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.240847 29509 raft_consensus.cc:359] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.241789 29509 raft_consensus.cc:385] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.242619 29509 raft_consensus.cc:740] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.241334 29513 raft_consensus.cc:359] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.229614 29596 raft_consensus.cc:493] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:11.231937 29279 leader_election.cc:343] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.234441 29651 consensus_queue.cc:1048] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:11.245249 29596 raft_consensus.cc:515] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.250530 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.251385 29516 tablet_bootstrap.cc:654] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.253479 29596 leader_election.cc:290] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:11.253713 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:11.254222 29513 raft_consensus.cc:385] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.243734 29509 consensus_queue.cc:260] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.229485 29510 tablet_bootstrap.cc:654] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.254640 29513 raft_consensus.cc:740] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.254482 29390 raft_consensus.cc:2468] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:11.260360 29509 ts_tablet_manager.cc:1434] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 12:28:11.261678 29509 tablet_bootstrap.cc:492] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:11.259379 29204 leader_election.cc:304] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:11.271530 29596 raft_consensus.cc:2804] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.272172 29596 raft_consensus.cc:493] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.272639 29596 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.280032 29139 catalog_manager.cc:5697] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.267906 29513 consensus_queue.cc:260] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.290943 29513 ts_tablet_manager.cc:1434] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:28:11.292483 29513 tablet_bootstrap.cc:492] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:11.301033 29681 consensus_queue.cc:1048] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:11.328673 29516 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:11.329211 29516 ts_tablet_manager.cc:1403] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.049s
I20260709 12:28:11.329797 29509 tablet_bootstrap.cc:654] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.334189 29510 tablet_bootstrap.cc:492] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:11.334824 29510 ts_tablet_manager.cc:1403] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.129s	user 0.037s	sys 0.027s
I20260709 12:28:11.335875 29596 raft_consensus.cc:515] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.341125 29510 raft_consensus.cc:359] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.341898 29510 raft_consensus.cc:385] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.337906 29596 leader_election.cc:290] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:11.342373 29513 tablet_bootstrap.cc:654] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.347357 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:11.350934 29279 leader_election.cc:304] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:11.342170 29510 raft_consensus.cc:740] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.360117 29681 raft_consensus.cc:2804] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.360690 29681 raft_consensus.cc:493] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.361202 29681 raft_consensus.cc:3060] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.361718 29137 catalog_manager.cc:5697] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.363855 29137 catalog_manager.cc:5697] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.365514 29510 consensus_queue.cc:260] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.373884 29510 ts_tablet_manager.cc:1434] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:28:11.375092 29510 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:11.381910 29510 tablet_bootstrap.cc:654] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.370867 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:11.367385 29279 leader_election.cc:304] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:11.385842 29516 raft_consensus.cc:359] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:11.385632 29386 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:11.387928 29427 consensus_peers.cc:597] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:11.386488 29516 raft_consensus.cc:385] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.388652 29516 raft_consensus.cc:740] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.390321 29551 raft_consensus.cc:2804] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.390986 29551 raft_consensus.cc:697] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:11.391970 29551 consensus_queue.cc:237] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.393474 29655 consensus_queue.cc:1048] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.397473 29681 raft_consensus.cc:515] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.389508 29516 consensus_queue.cc:260] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:11.400990 29516 ts_tablet_manager.cc:1434] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.072s	user 0.002s	sys 0.005s
I20260709 12:28:11.400828 29279 leader_election.cc:304] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:11.402101 29516 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:11.403327 29562 raft_consensus.cc:2804] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.403760 29562 raft_consensus.cc:493] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.404109 29562 raft_consensus.cc:3060] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.409545 29516 tablet_bootstrap.cc:654] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.411348 29561 consensus_queue.cc:1048] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.416910 29513 tablet_bootstrap.cc:492] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:11.417515 29513 ts_tablet_manager.cc:1403] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.008s
I20260709 12:28:11.417939 29681 leader_election.cc:290] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:11.418792 29509 tablet_bootstrap.cc:492] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:11.419283 29509 ts_tablet_manager.cc:1403] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.158s	user 0.012s	sys 0.011s
I20260709 12:28:11.420712 29513 raft_consensus.cc:359] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.423010 29509 raft_consensus.cc:359] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.423995 29509 raft_consensus.cc:385] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.424363 29509 raft_consensus.cc:740] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.425283 29509 consensus_queue.cc:260] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.426764 29386 raft_consensus.cc:2468] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:11.429778 29204 leader_election.cc:304] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:11.432660 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.434545 29596 raft_consensus.cc:2804] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.435108 29596 raft_consensus.cc:697] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:11.440454 29596 consensus_queue.cc:237] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.443022 29655 raft_consensus.cc:493] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.443229 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae09303fa81d45f086eec87509b6e72b" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:11.443997 29389 raft_consensus.cc:3060] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.443782 29655 raft_consensus.cc:515] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.447619 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305487a552d34f96a1555a8d55564031" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.448262 29655 leader_election.cc:290] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:11.448531 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305487a552d34f96a1555a8d55564031" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:11.449414 29430 leader_election.cc:343] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:11.450031 29427 leader_election.cc:343] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.450548 29427 leader_election.cc:304] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:11.436771 29387 raft_consensus.cc:1240] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Rejecting Update request from peer c098fe137f19465bb9f67dbd64763b72 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:28:11.452138 29655 raft_consensus.cc:2749] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:11.438062 29564 consensus_queue.cc:1048] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:28:11.438123 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae09303fa81d45f086eec87509b6e72b" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:11.455348 29464 raft_consensus.cc:3060] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.463532 29241 raft_consensus.cc:1240] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Rejecting Update request from peer c098fe137f19465bb9f67dbd64763b72 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:28:11.467700 29464 raft_consensus.cc:2468] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:11.436385 29562 raft_consensus.cc:515] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.480479 29315 raft_consensus.cc:2393] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96bd9c3c81e04118abc2fe11d2b361ed in current term 1: Already voted for candidate c098fe137f19465bb9f67dbd64763b72 in this term.
I20260709 12:28:11.421443 29513 raft_consensus.cc:385] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.481047 29513 raft_consensus.cc:740] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.481978 29513 consensus_queue.cc:260] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.480177 29389 raft_consensus.cc:2468] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:11.434885 29509 ts_tablet_manager.cc:1434] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:28:11.485263 29509 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:11.485884 29655 consensus_queue.cc:1048] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.486251 29513 ts_tablet_manager.cc:1434] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 12:28:11.490082 29513 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:11.494159 29596 raft_consensus.cc:493] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.494791 29596 raft_consensus.cc:515] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.496615 29516 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:11.498478 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:11.498944 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.499253 29463 raft_consensus.cc:2468] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:11.499650 29315 raft_consensus.cc:2468] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:11.500865 29207 leader_election.cc:304] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:11.501690 29647 raft_consensus.cc:2804] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.502051 29647 raft_consensus.cc:493] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.502362 29647 raft_consensus.cc:3060] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.508519 29513 tablet_bootstrap.cc:654] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.509109 29136 catalog_manager.cc:5697] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.497144 29516 ts_tablet_manager.cc:1403] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.012s
I20260709 12:28:11.511919 29647 raft_consensus.cc:515] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.515266 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:11.516000 29463 raft_consensus.cc:3060] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.518301 29596 leader_election.cc:290] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
W20260709 12:28:11.520704 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 82174.5us
I20260709 12:28:11.524163 29516 raft_consensus.cc:359] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.525023 29516 raft_consensus.cc:385] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.525300 29516 raft_consensus.cc:740] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.529740 29562 leader_election.cc:290] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:11.529317 29681 consensus_queue.cc:1059] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:11.530594 29681 consensus_queue.cc:1243] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Peer 629ba7d0b7eb4d9b8832b0f605f79443 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:28:11.530949 29647 leader_election.cc:290] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.531322 29681 raft_consensus.cc:3055] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.531841 29681 raft_consensus.cc:740] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:11.533252 29681 consensus_queue.cc:260] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.534914 29681 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.536923 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:11.537629 29315 raft_consensus.cc:3060] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.537660 29138 catalog_manager.cc:5697] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from c098fe137f19465bb9f67dbd64763b72 (127.17.40.2) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.543455 29463 raft_consensus.cc:2468] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:11.545080 29204 leader_election.cc:304] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 
I20260709 12:28:11.545226 29516 consensus_queue.cc:260] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.546638 29647 raft_consensus.cc:2804] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.547333 29647 raft_consensus.cc:697] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:11.548368 29647 consensus_queue.cc:237] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.553304 29567 raft_consensus.cc:493] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.554224 29567 raft_consensus.cc:515] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.557965 29567 leader_election.cc:290] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.561631 29513 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:11.562232 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb406a0615254e56b17f64445f811223" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:11.563464 29516 ts_tablet_manager.cc:1434] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
W20260709 12:28:11.563933 29353 leader_election.cc:343] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.564536 29516 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:11.576670 29279 leader_election.cc:304] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:11.578074 29658 raft_consensus.cc:2804] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.578718 29658 raft_consensus.cc:697] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:11.578625 29356 leader_election.cc:304] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:11.579850 29658 consensus_queue.cc:237] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.580643 29567 raft_consensus.cc:3060] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.593017 29315 raft_consensus.cc:2468] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:11.562269 29513 ts_tablet_manager.cc:1403] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.072s	user 0.005s	sys 0.007s
I20260709 12:28:11.605399 29516 tablet_bootstrap.cc:654] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.608078 29567 raft_consensus.cc:2749] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:11.608474 29513 raft_consensus.cc:359] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.609937 29513 raft_consensus.cc:385] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.610217 29513 raft_consensus.cc:740] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.614846 29510 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:11.615475 29510 ts_tablet_manager.cc:1403] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.241s	user 0.042s	sys 0.044s
I20260709 12:28:11.618521 29510 raft_consensus.cc:359] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.618165 29138 catalog_manager.cc:5697] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.619313 29510 raft_consensus.cc:385] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.619697 29510 raft_consensus.cc:740] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.619496 29137 catalog_manager.cc:5697] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.620556 29510 consensus_queue.cc:260] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.622221 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:11.623638 29510 ts_tablet_manager.cc:1434] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:11.627588 29509 tablet_bootstrap.cc:654] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.627835 29510 tablet_bootstrap.cc:492] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:11.628401 29567 raft_consensus.cc:493] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.628959 29567 raft_consensus.cc:515] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.631124 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:11.634049 29567 leader_election.cc:290] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:11.631596 29513 consensus_queue.cc:260] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.636765 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d481b0699148d0a3874c922f9faa21" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:11.637696 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb406a0615254e56b17f64445f811223" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.638461 29313 raft_consensus.cc:2468] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
W20260709 12:28:11.638751 29353 leader_election.cc:343] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.640575 29510 tablet_bootstrap.cc:654] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.650754 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d481b0699148d0a3874c922f9faa21" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.651636 29313 raft_consensus.cc:2468] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:11.652644 29513 ts_tablet_manager.cc:1434] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.003s
I20260709 12:28:11.652801 29647 raft_consensus.cc:493] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.653414 29647 raft_consensus.cc:515] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:11.655683 29647 leader_election.cc:290] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
W20260709 12:28:11.658717 29279 leader_election.cc:343] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.662663 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ae76c376541159f0e79e554e34cd2" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:11.665723 29356 leader_election.cc:304] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:11.668165 29356 leader_election.cc:304] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:11.669144 29540 raft_consensus.cc:2804] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.669729 29540 raft_consensus.cc:493] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.670212 29540 raft_consensus.cc:3060] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.672622 29567 raft_consensus.cc:2804] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.673341 29567 raft_consensus.cc:493] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.674314 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ae76c376541159f0e79e554e34cd2" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:11.673900 29567 raft_consensus.cc:3060] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.676169 29513 tablet_bootstrap.cc:492] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:11.679230 29510 tablet_bootstrap.cc:492] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:11.685925 29510 ts_tablet_manager.cc:1403] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.007s
I20260709 12:28:11.676750 29387 raft_consensus.cc:2468] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:11.682849 29204 leader_election.cc:304] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:11.687570 29279 leader_election.cc:304] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:11.687829 29596 raft_consensus.cc:2749] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:11.688704 29681 raft_consensus.cc:2804] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.689992 29681 raft_consensus.cc:697] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:11.690953 29510 raft_consensus.cc:359] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.691789 29510 raft_consensus.cc:385] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.692169 29510 raft_consensus.cc:740] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.692899 29510 consensus_queue.cc:260] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.694252 29540 raft_consensus.cc:515] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.695802 29510 ts_tablet_manager.cc:1434] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:28:11.697319 29513 tablet_bootstrap.cc:654] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.691511 29509 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:11.698622 29510 tablet_bootstrap.cc:492] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:11.698572 29509 ts_tablet_manager.cc:1403] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.014s
I20260709 12:28:11.700999 29681 consensus_queue.cc:237] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.708611 29655 consensus_queue.cc:1048] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:11.711880 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d481b0699148d0a3874c922f9faa21" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:11.712672 29313 raft_consensus.cc:3060] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.724215 29567 raft_consensus.cc:515] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.738354 29516 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:11.739235 29516 ts_tablet_manager.cc:1403] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.175s	user 0.017s	sys 0.013s
I20260709 12:28:11.734629 29540 leader_election.cc:290] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:11.732885 29509 raft_consensus.cc:359] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.739733 29510 tablet_bootstrap.cc:654] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.740135 29509 raft_consensus.cc:385] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.740640 29509 raft_consensus.cc:740] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.738310 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb406a0615254e56b17f64445f811223" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:11.722095 29313 raft_consensus.cc:2468] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:11.742925 29509 consensus_queue.cc:260] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.745497 29509 ts_tablet_manager.cc:1434] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:28:11.747465 29516 raft_consensus.cc:359] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.752022 29516 raft_consensus.cc:385] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.752343 29516 raft_consensus.cc:740] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
W20260709 12:28:11.752936 29353 leader_election.cc:343] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.750505 29567 leader_election.cc:290] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.753134 29516 consensus_queue.cc:260] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.754971 29356 leader_election.cc:304] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:11.735002 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d481b0699148d0a3874c922f9faa21" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:11.757004 29510 tablet_bootstrap.cc:492] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:11.757247 29463 raft_consensus.cc:3060] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.757586 29510 ts_tablet_manager.cc:1403] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.014s
I20260709 12:28:11.757874 29516 ts_tablet_manager.cc:1434] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:28:11.758028 29540 raft_consensus.cc:2804] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.760288 29540 raft_consensus.cc:697] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:11.761103 29510 raft_consensus.cc:359] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.761456 29540 consensus_queue.cc:237] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.761163 29516 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:11.762090 29510 raft_consensus.cc:385] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.758455 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb406a0615254e56b17f64445f811223" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:11.765494 29510 raft_consensus.cc:740] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.765784 29313 raft_consensus.cc:3060] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.766552 29510 consensus_queue.cc:260] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.767712 29647 raft_consensus.cc:493] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.768255 29647 raft_consensus.cc:515] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.769064 29510 ts_tablet_manager.cc:1434] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 12:28:11.770212 29510 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:11.772538 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.773005 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:11.773304 29315 raft_consensus.cc:2468] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
W20260709 12:28:11.774735 29204 leader_election.cc:343] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:11.775136 29651 raft_consensus.cc:493] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.775650 29651 raft_consensus.cc:515] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.778050 29651 leader_election.cc:290] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.780258 29510 tablet_bootstrap.cc:654] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.780145 29207 leader_election.cc:304] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:11.782234 29516 tablet_bootstrap.cc:654] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.783470 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:11.784296 29315 raft_consensus.cc:2468] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:11.785848 29651 raft_consensus.cc:2804] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.786460 29651 raft_consensus.cc:493] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.786769 29509 tablet_bootstrap.cc:492] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:11.786906 29651 raft_consensus.cc:3060] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.790869 29207 leader_election.cc:304] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:11.780881 29647 leader_election.cc:290] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.807631 29313 raft_consensus.cc:2468] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:11.813398 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:11.814201 29464 raft_consensus.cc:2468] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:11.809998 29509 tablet_bootstrap.cc:654] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.817394 29356 leader_election.cc:304] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:11.803465 29596 raft_consensus.cc:2804] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.823809 29596 raft_consensus.cc:493] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.824285 29596 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:11.824136 29427 consensus_peers.cc:597] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:11.828888 29238 raft_consensus.cc:3060] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.842123 29516 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:11.842787 29516 ts_tablet_manager.cc:1403] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.015s
I20260709 12:28:11.811710 29463 raft_consensus.cc:2468] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:11.824707 29567 raft_consensus.cc:2804] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.849231 29516 raft_consensus.cc:359] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.850013 29516 raft_consensus.cc:385] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.850374 29516 raft_consensus.cc:740] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
W20260709 12:28:11.849362 29207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 58636us
I20260709 12:28:11.851258 29516 consensus_queue.cc:260] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.848649 29596 raft_consensus.cc:515] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.854120 29516 ts_tablet_manager.cc:1434] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:28:11.854956 29510 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:11.855577 29510 ts_tablet_manager.cc:1403] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.016s
I20260709 12:28:11.857851 29509 tablet_bootstrap.cc:492] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:11.858544 29509 ts_tablet_manager.cc:1403] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.005s
I20260709 12:28:11.859488 29510 raft_consensus.cc:359] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.860916 29510 raft_consensus.cc:385] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.861306 29510 raft_consensus.cc:740] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.849743 29567 raft_consensus.cc:697] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:11.863667 29567 consensus_queue.cc:237] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.866947 29651 raft_consensus.cc:515] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.866714 29510 consensus_queue.cc:260] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:11.871944 29651 leader_election.cc:290] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.873991 29596 leader_election.cc:290] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:11.890183 29510 ts_tablet_manager.cc:1434] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:28:11.891402 29510 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:11.896834 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:11.896665 29551 consensus_queue.cc:1048] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:11.897349 29462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:11.897641 29463 raft_consensus.cc:3060] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.898027 29462 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.904659 29513 tablet_bootstrap.cc:492] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:11.905253 29513 ts_tablet_manager.cc:1403] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.252s	user 0.009s	sys 0.004s
I20260709 12:28:11.913686 29513 raft_consensus.cc:359] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.917477 29509 raft_consensus.cc:359] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.919137 29509 raft_consensus.cc:385] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.919567 29509 raft_consensus.cc:740] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.923625 29513 raft_consensus.cc:385] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.924717 29516 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:11.924675 29509 consensus_queue.cc:260] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.930626 29510 tablet_bootstrap.cc:654] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.938894 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:11.939924 29315 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.942319 29509 ts_tablet_manager.cc:1434] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.004s
I20260709 12:28:11.942679 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:11.943608 29313 raft_consensus.cc:3060] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.928201 29513 raft_consensus.cc:740] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.949062 29513 consensus_queue.cc:260] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:11.951577 29138 catalog_manager.cc:5697] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.956542 29313 raft_consensus.cc:2468] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:11.957912 29207 leader_election.cc:304] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:11.943567 29509 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:11.970582 29513 ts_tablet_manager.cc:1434] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 12:28:11.973922 29513 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
W20260709 12:28:11.974953 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:11.977315 29462 raft_consensus.cc:2468] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:11.969555 29509 tablet_bootstrap.cc:654] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.980526 29516 tablet_bootstrap.cc:654] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.980952 29596 raft_consensus.cc:2804] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.981141 29717 raft_consensus.cc:493] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.982282 29717 raft_consensus.cc:515] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:11.988840 29513 tablet_bootstrap.cc:654] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.982182 29596 raft_consensus.cc:697] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:11.995380 29596 consensus_queue.cc:237] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.000907 29717 leader_election.cc:290] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:12.002023 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb406a0615254e56b17f64445f811223" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:12.003167 29314 raft_consensus.cc:2393] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 629ba7d0b7eb4d9b8832b0f605f79443 in current term 1: Already voted for candidate 96bd9c3c81e04118abc2fe11d2b361ed in this term.
I20260709 12:28:12.007858 29462 raft_consensus.cc:3060] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.009902 29463 raft_consensus.cc:2468] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:12.011938 29204 leader_election.cc:304] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 
I20260709 12:28:12.016381 29315 raft_consensus.cc:2468] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:12.013363 29387 raft_consensus.cc:1275] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:28:12.020181 29717 consensus_queue.cc:1048] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:12.022960 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb406a0615254e56b17f64445f811223" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:12.013412 29721 raft_consensus.cc:2804] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:12.030524 29721 raft_consensus.cc:697] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:12.038022 29136 catalog_manager.cc:5697] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:12.042621 29136 catalog_manager.cc:5697] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:12.032192 29721 consensus_queue.cc:237] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.050148 29314 raft_consensus.cc:1275] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:28:12.051110 29314 pending_rounds.cc:85] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72: Aborting all ops after (but not including) 0
I20260709 12:28:12.051625 29561 consensus_queue.cc:1048] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:12.051365 29314 pending_rounds.cc:107] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:28:12.037111 29204 leader_election.cc:304] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:12.057564 29314 raft_consensus.cc:2889] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:12.063877 29596 raft_consensus.cc:3060] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.072206 29717 consensus_queue.cc:1048] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.077564 29134 catalog_manager.cc:5697] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:12.081867 29551 consensus_queue.cc:1048] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.093343 29596 raft_consensus.cc:2749] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.096838 29564 raft_consensus.cc:493] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.097457 29564 raft_consensus.cc:515] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.102411 29510 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:12.103089 29510 ts_tablet_manager.cc:1403] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.212s	user 0.024s	sys 0.056s
I20260709 12:28:12.105968 29551 raft_consensus.cc:493] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.106775 29551 raft_consensus.cc:515] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.114241 29510 raft_consensus.cc:359] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.115063 29510 raft_consensus.cc:385] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.115305 29510 raft_consensus.cc:740] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
W20260709 12:28:12.105415 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 68237.3us
I20260709 12:28:12.120564 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305487a552d34f96a1555a8d55564031" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:12.124099 29279 leader_election.cc:343] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.127511 29551 leader_election.cc:290] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:12.127699 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e528a3aa1c4b73a3f5dad737cf41a4" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:12.128093 29564 leader_election.cc:290] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:12.129107 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305487a552d34f96a1555a8d55564031" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:12.129779 29463 raft_consensus.cc:2468] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:12.136435 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e528a3aa1c4b73a3f5dad737cf41a4" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:12.138232 29430 leader_election.cc:304] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:12.143222 29567 raft_consensus.cc:493] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.143975 29567 raft_consensus.cc:515] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.146049 29516 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:12.147348 29509 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:12.147935 29509 ts_tablet_manager.cc:1403] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.205s	user 0.017s	sys 0.007s
I20260709 12:28:12.149963 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:12.150903 29509 raft_consensus.cc:359] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.151656 29516 ts_tablet_manager.cc:1403] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.227s	user 0.012s	sys 0.008s
I20260709 12:28:12.152208 29510 consensus_queue.cc:260] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.151688 29509 raft_consensus.cc:385] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.153528 29509 raft_consensus.cc:740] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.154721 29509 consensus_queue.cc:260] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
W20260709 12:28:12.139732 29279 consensus_peers.cc:597] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.157966 29353 leader_election.cc:343] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.159904 29651 consensus_queue.cc:1048] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.160725 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:12.153508 29567 leader_election.cc:290] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
W20260709 12:28:12.171978 29356 leader_election.cc:343] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.172562 29356 leader_election.cc:304] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:12.169457 29651 consensus_queue.cc:1048] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:28:12.175392 29279 leader_election.cc:304] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:12.177170 29681 raft_consensus.cc:2804] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:12.177629 29681 raft_consensus.cc:493] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.178064 29681 raft_consensus.cc:3060] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.179770 29510 ts_tablet_manager.cc:1434] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:28:12.174232 29567 raft_consensus.cc:2749] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.184720 29509 ts_tablet_manager.cc:1434] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 12:28:12.185855 29510 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:12.186161 29509 tablet_bootstrap.cc:492] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:12.187891 29516 raft_consensus.cc:359] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.188890 29516 raft_consensus.cc:385] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.189225 29516 raft_consensus.cc:740] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.190116 29516 consensus_queue.cc:260] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.198380 29513 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:12.198989 29513 ts_tablet_manager.cc:1403] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.225s	user 0.051s	sys 0.050s
I20260709 12:28:12.199705 29562 consensus_queue.cc:1048] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:12.201857 29513 raft_consensus.cc:359] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.208076 29513 raft_consensus.cc:385] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.208755 29513 raft_consensus.cc:740] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.210031 29513 consensus_queue.cc:260] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
W20260709 12:28:12.211962 29729 log.cc:927] Time spent T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:28:12.214128 29513 ts_tablet_manager.cc:1434] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:28:12.219002 29540 consensus_queue.cc:1048] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.220470 29567 raft_consensus.cc:493] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.225303 29567 raft_consensus.cc:515] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.231989 29516 ts_tablet_manager.cc:1434] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:28:12.232658 29567 leader_election.cc:290] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:12.233461 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:12.234155 29516 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:12.234915 29356 leader_election.cc:343] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.236348 29513 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:12.235404 29138 catalog_manager.cc:5697] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:12.221446 29681 raft_consensus.cc:515] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.272200 29564 raft_consensus.cc:2749] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:12.273622 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:12.261917 29567 raft_consensus.cc:493] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.286736 29567 raft_consensus.cc:515] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.304509 29567 leader_election.cc:290] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:12.306463 29681 leader_election.cc:290] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:12.307209 29239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:12.310912 29353 leader_election.cc:343] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.311821 29461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:12.312619 29353 leader_election.cc:343] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.313201 29353 leader_election.cc:304] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:12.314707 29567 raft_consensus.cc:2749] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.274962 29516 tablet_bootstrap.cc:654] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.318801 29509 tablet_bootstrap.cc:654] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.324299 29241 raft_consensus.cc:3060] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:12.325716 29353 leader_election.cc:343] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.335493 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305487a552d34f96a1555a8d55564031" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:12.336231 29463 raft_consensus.cc:3060] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.342828 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305487a552d34f96a1555a8d55564031" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:12.343339 29567 consensus_queue.cc:1048] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:12.350279 29279 leader_election.cc:343] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.351924 29463 raft_consensus.cc:2468] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:12.339066 29353 leader_election.cc:304] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:12.362510 29711 raft_consensus.cc:2749] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.367568 29279 leader_election.cc:304] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:12.386809 29567 consensus_queue.cc:1048] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.387166 29596 consensus_queue.cc:1048] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:12.372520 29681 raft_consensus.cc:2804] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:12.388212 29681 raft_consensus.cc:697] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:12.392405 29562 consensus_queue.cc:1048] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.389146 29681 consensus_queue.cc:237] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.419430 29516 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:12.420231 29516 ts_tablet_manager.cc:1403] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.187s	user 0.019s	sys 0.018s
I20260709 12:28:12.434384 29510 tablet_bootstrap.cc:654] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.445289 29513 tablet_bootstrap.cc:654] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.458150 29647 raft_consensus.cc:493] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dbe6e4429184e5fb137cae093024bce)
I20260709 12:28:12.458854 29647 raft_consensus.cc:515] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.468176 29647 leader_election.cc:290] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:12.469935 29509 tablet_bootstrap.cc:492] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:12.470556 29509 ts_tablet_manager.cc:1403] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.285s	user 0.022s	sys 0.016s
I20260709 12:28:12.473534 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:12.474459 29516 raft_consensus.cc:359] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.479171 29516 raft_consensus.cc:385] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.479452 29516 raft_consensus.cc:740] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.480300 29516 consensus_queue.cc:260] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.483552 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:12.485489 29204 leader_election.cc:304] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:12.486519 29647 raft_consensus.cc:2749] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:12.473573 29509 raft_consensus.cc:359] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.491286 29509 raft_consensus.cc:385] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.491595 29509 raft_consensus.cc:740] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.498492 29516 ts_tablet_manager.cc:1434] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.078s	user 0.003s	sys 0.007s
I20260709 12:28:12.500391 29516 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:12.505551 29743 log.cc:927] Time spent T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:28:12.510111 29510 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:12.510720 29510 ts_tablet_manager.cc:1403] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.330s	user 0.022s	sys 0.015s
I20260709 12:28:12.512226 29134 catalog_manager.cc:5697] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:12.513710 29510 raft_consensus.cc:359] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.500308 29509 consensus_queue.cc:260] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.528983 29510 raft_consensus.cc:385] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.529836 29510 raft_consensus.cc:740] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.530815 29509 ts_tablet_manager.cc:1434] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
I20260709 12:28:12.530661 29510 consensus_queue.cc:260] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.520447 29717 consensus_queue.cc:1048] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.533174 29510 ts_tablet_manager.cc:1434] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:28:12.522940 29540 consensus_queue.cc:1048] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.538757 29510 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:12.538852 29513 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:12.539456 29513 ts_tablet_manager.cc:1403] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.324s	user 0.010s	sys 0.011s
I20260709 12:28:12.553457 29516 tablet_bootstrap.cc:654] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.558211 29681 raft_consensus.cc:493] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.559108 29509 tablet_bootstrap.cc:492] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:12.558864 29681 raft_consensus.cc:515] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.568775 29717 raft_consensus.cc:493] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.569491 29596 consensus_queue.cc:1048] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.569566 29717 raft_consensus.cc:515] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.573343 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:12.582644 29717 leader_election.cc:290] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:12.614071 29560 raft_consensus.cc:493] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.614851 29560 raft_consensus.cc:515] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.624387 29513 raft_consensus.cc:359] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.625293 29513 raft_consensus.cc:385] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.625599 29513 raft_consensus.cc:740] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.626489 29513 consensus_queue.cc:260] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.629987 29681 leader_election.cc:290] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:12.630367 29560 leader_election.cc:290] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:12.633786 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:12.635332 29427 leader_election.cc:343] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.633845 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:12.638798 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:12.640062 29204 leader_election.cc:304] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:12.641069 29567 raft_consensus.cc:493] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.643889 29717 raft_consensus.cc:2749] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.653592 29513 ts_tablet_manager.cc:1434] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.001s
I20260709 12:28:12.655349 29513 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:12.656309 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:12.664399 29513 tablet_bootstrap.cc:654] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.646476 29567 raft_consensus.cc:515] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
W20260709 12:28:12.667661 29427 leader_election.cc:343] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.668246 29427 leader_election.cc:304] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
W20260709 12:28:12.671655 29279 leader_election.cc:343] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.672351 29564 raft_consensus.cc:2749] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.674050 29596 consensus_queue.cc:1048] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.675494 29567 leader_election.cc:290] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:12.678819 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305487a552d34f96a1555a8d55564031" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:12.684532 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305487a552d34f96a1555a8d55564031" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:12.685563 29463 raft_consensus.cc:2393] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96bd9c3c81e04118abc2fe11d2b361ed in current term 1: Already voted for candidate c098fe137f19465bb9f67dbd64763b72 in this term.
I20260709 12:28:12.686981 29353 leader_election.cc:304] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:12.687585 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:12.689455 29279 leader_election.cc:343] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.689919 29279 leader_election.cc:304] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:12.695873 29562 raft_consensus.cc:2749] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.692227 29567 raft_consensus.cc:3060] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.711992 29562 raft_consensus.cc:493] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.712774 29562 raft_consensus.cc:515] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.726328 29509 tablet_bootstrap.cc:654] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.734418 29567 raft_consensus.cc:2749] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.734175 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109246823e454b4ea19cff032f7345a3" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:12.738031 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109246823e454b4ea19cff032f7345a3" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:12.741861 29562 leader_election.cc:290] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:12.744658 29510 tablet_bootstrap.cc:654] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.744940 29516 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:12.750573 29516 ts_tablet_manager.cc:1403] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.251s	user 0.035s	sys 0.024s
I20260709 12:28:12.751652 29513 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:12.752166 29513 ts_tablet_manager.cc:1403] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.054s
I20260709 12:28:12.753588 29516 raft_consensus.cc:359] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.754350 29516 raft_consensus.cc:385] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.754639 29516 raft_consensus.cc:740] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.755023 29513 raft_consensus.cc:359] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.755746 29513 raft_consensus.cc:385] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.756031 29513 raft_consensus.cc:740] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.756892 29513 consensus_queue.cc:260] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.758188 29241 raft_consensus.cc:3060] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.755357 29516 consensus_queue.cc:260] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:12.759166 29513 ts_tablet_manager.cc:1434] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:28:12.760236 29516 ts_tablet_manager.cc:1434] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:28:12.760483 29513 tablet_bootstrap.cc:492] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:12.761242 29516 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:12.767195 29513 tablet_bootstrap.cc:654] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.767195 29516 tablet_bootstrap.cc:654] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:12.775429 29279 leader_election.cc:343] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:12.776564 29279 leader_election.cc:343] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.776968 29279 leader_election.cc:304] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:12.779793 29561 raft_consensus.cc:2749] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:12.784698 29564 raft_consensus.cc:493] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.785359 29564 raft_consensus.cc:515] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.789260 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bc94f78eb745a8ae182fa765caf007" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:12.800470 29315 raft_consensus.cc:2468] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:12.802474 29430 leader_election.cc:304] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:12.803670 29560 raft_consensus.cc:2804] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:12.805207 29560 raft_consensus.cc:493] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.805648 29560 raft_consensus.cc:3060] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.789911 29564 leader_election.cc:290] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:12.803606 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bc94f78eb745a8ae182fa765caf007" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:12.813876 29427 leader_election.cc:343] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.827061 29509 tablet_bootstrap.cc:492] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:12.827665 29509 ts_tablet_manager.cc:1403] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.296s	user 0.005s	sys 0.021s
I20260709 12:28:12.831843 29513 tablet_bootstrap.cc:492] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:12.832440 29513 ts_tablet_manager.cc:1403] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.037s
I20260709 12:28:12.835512 29513 raft_consensus.cc:359] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.836232 29513 raft_consensus.cc:385] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.836540 29513 raft_consensus.cc:740] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.837360 29513 consensus_queue.cc:260] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.839838 29513 ts_tablet_manager.cc:1434] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:12.841130 29513 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:12.846695 29560 raft_consensus.cc:515] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.851889 29513 tablet_bootstrap.cc:654] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.867614 29516 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:12.868203 29516 ts_tablet_manager.cc:1403] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.007s
I20260709 12:28:12.871543 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bc94f78eb745a8ae182fa765caf007" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
W20260709 12:28:12.874006 29427 leader_election.cc:343] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.873853 29516 raft_consensus.cc:359] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.875165 29516 raft_consensus.cc:385] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.875564 29516 raft_consensus.cc:740] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.877902 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bc94f78eb745a8ae182fa765caf007" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:12.878847 29314 raft_consensus.cc:3060] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.887394 29509 raft_consensus.cc:359] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.888038 29560 leader_election.cc:290] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:12.888500 29509 raft_consensus.cc:385] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.904567 29509 raft_consensus.cc:740] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.876644 29516 consensus_queue.cc:260] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.903402 29513 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:12.905773 29513 ts_tablet_manager.cc:1403] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.016s
I20260709 12:28:12.905427 29509 consensus_queue.cc:260] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:12.906533 29596 raft_consensus.cc:493] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.906817 29516 ts_tablet_manager.cc:1434] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:28:12.907089 29596 raft_consensus.cc:515] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.907861 29516 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:12.908972 29513 raft_consensus.cc:359] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.909679 29513 raft_consensus.cc:385] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.909936 29513 raft_consensus.cc:740] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.910768 29513 consensus_queue.cc:260] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.913305 29513 ts_tablet_manager.cc:1434] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 12:28:12.914439 29513 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:12.915907 29516 tablet_bootstrap.cc:654] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.917834 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:12.922597 29204 leader_election.cc:343] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:12.928843 29513 tablet_bootstrap.cc:654] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.904732 29314 raft_consensus.cc:2468] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:12.941543 29551 consensus_queue.cc:1048] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:12.941984 29430 leader_election.cc:304] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:12.943373 29560 raft_consensus.cc:2804] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:12.943929 29560 raft_consensus.cc:697] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:12.944830 29560 consensus_queue.cc:237] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:12.930171 29596 leader_election.cc:290] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:12.931342 29509 ts_tablet_manager.cc:1434] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 12:28:12.947681 29509 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:12.904021 29510 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:12.948587 29510 ts_tablet_manager.cc:1403] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.410s	user 0.066s	sys 0.073s
I20260709 12:28:12.932149 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:12.953521 29510 raft_consensus.cc:359] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.956427 29510 raft_consensus.cc:385] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:12.956840 29510 raft_consensus.cc:740] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.959173 29460 raft_consensus.cc:2468] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:12.959496 29510 consensus_queue.cc:260] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.961191 29204 leader_election.cc:304] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:12.962519 29510 ts_tablet_manager.cc:1434] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:28:12.963752 29596 raft_consensus.cc:2804] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:12.964321 29596 raft_consensus.cc:493] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.964707 29596 raft_consensus.cc:3060] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:12.963953 29510 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:12.966931 29509 tablet_bootstrap.cc:654] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.986047 29510 tablet_bootstrap.cc:654] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:12.986527 29516 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:12.988106 29516 ts_tablet_manager.cc:1403] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.007s
I20260709 12:28:12.993614 29596 raft_consensus.cc:515] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:12.998281 29513 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:12.998929 29513 ts_tablet_manager.cc:1403] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.001s
I20260709 12:28:13.002149 29596 leader_election.cc:290] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:13.003557 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:13.004451 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:13.005366 29460 raft_consensus.cc:3060] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.010094 29681 consensus_queue.cc:1048] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:13.012856 29204 leader_election.cc:343] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.026647 29516 raft_consensus.cc:359] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.028671 29516 raft_consensus.cc:385] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.029109 29516 raft_consensus.cc:740] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.021925 29513 raft_consensus.cc:359] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.033728 29513 raft_consensus.cc:385] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.034200 29513 raft_consensus.cc:740] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.023012 29137 catalog_manager.cc:5697] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:13.036269 29510 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:13.036840 29510 ts_tablet_manager.cc:1403] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.002s
I20260709 12:28:13.029914 29516 consensus_queue.cc:260] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.039167 29513 consensus_queue.cc:260] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.044410 29509 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:13.045159 29509 ts_tablet_manager.cc:1403] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.008s
I20260709 12:28:13.048071 29513 ts_tablet_manager.cc:1434] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:28:13.053164 29516 ts_tablet_manager.cc:1434] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:28:13.055197 29516 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:13.063236 29516 tablet_bootstrap.cc:654] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.084548 29460 raft_consensus.cc:2468] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:13.088304 29204 leader_election.cc:304] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:13.087112 29509 raft_consensus.cc:359] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.093726 29651 raft_consensus.cc:2804] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:13.093760 29509 raft_consensus.cc:385] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.094436 29651 raft_consensus.cc:697] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:13.094743 29509 raft_consensus.cc:740] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.095435 29651 consensus_queue.cc:237] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.097018 29513 tablet_bootstrap.cc:492] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:13.101823 29509 consensus_queue.cc:260] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.116238 29516 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:13.116106 29510 raft_consensus.cc:359] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.116918 29516 ts_tablet_manager.cc:1403] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.021s
I20260709 12:28:13.117038 29510 raft_consensus.cc:385] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.117441 29510 raft_consensus.cc:740] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.118520 29510 consensus_queue.cc:260] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.119679 29681 raft_consensus.cc:493] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.120222 29681 raft_consensus.cc:515] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.120229 29516 raft_consensus.cc:359] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.122993 29516 raft_consensus.cc:385] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.123289 29516 raft_consensus.cc:740] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.124163 29510 ts_tablet_manager.cc:1434] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:28:13.125463 29510 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:13.127884 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:13.128705 29386 raft_consensus.cc:2468] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:13.129446 29513 tablet_bootstrap.cc:654] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.130172 29279 leader_election.cc:304] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:13.130550 29681 leader_election.cc:290] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:13.132526 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:13.132714 29561 raft_consensus.cc:2804] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:13.133368 29561 raft_consensus.cc:493] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.124171 29516 consensus_queue.cc:260] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.134373 29561 raft_consensus.cc:3060] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.139919 29516 ts_tablet_manager.cc:1434] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:28:13.140578 29509 ts_tablet_manager.cc:1434] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.005s
I20260709 12:28:13.141386 29516 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:13.151541 29279 leader_election.cc:343] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.152149 29509 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:13.170517 29138 catalog_manager.cc:5697] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:13.173254 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:13.173507 29561 raft_consensus.cc:515] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.175369 29516 tablet_bootstrap.cc:654] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.180428 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:13.181382 29386 raft_consensus.cc:3060] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.192310 29510 tablet_bootstrap.cc:654] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.193662 29386 raft_consensus.cc:2468] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:13.196664 29279 leader_election.cc:304] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:13.197566 29681 raft_consensus.cc:2804] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:13.198101 29681 raft_consensus.cc:697] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:13.199010 29681 consensus_queue.cc:237] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.201784 29561 leader_election.cc:290] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:13.201967 29513 tablet_bootstrap.cc:492] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:13.202030 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:13.202729 29513 ts_tablet_manager.cc:1403] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.006s
W20260709 12:28:13.203963 29279 leader_election.cc:343] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.209837 29513 raft_consensus.cc:359] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.210680 29513 raft_consensus.cc:385] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.210976 29513 raft_consensus.cc:740] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.212234 29513 consensus_queue.cc:260] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.214684 29509 tablet_bootstrap.cc:654] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.216881 29516 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:13.216569 29513 ts_tablet_manager.cc:1434] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:28:13.220563 29516 ts_tablet_manager.cc:1403] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.009s
I20260709 12:28:13.222468 29513 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:13.223662 29516 raft_consensus.cc:359] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.224401 29516 raft_consensus.cc:385] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.224658 29516 raft_consensus.cc:740] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.226862 29651 raft_consensus.cc:493] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.227422 29651 raft_consensus.cc:515] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.229291 29513 tablet_bootstrap.cc:654] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.229612 29651 leader_election.cc:290] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:13.231240 29516 consensus_queue.cc:260] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.234741 29516 ts_tablet_manager.cc:1434] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 12:28:13.235770 29516 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:13.239912 29717 raft_consensus.cc:493] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.241591 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:13.242314 29315 raft_consensus.cc:2468] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:13.242455 29516 tablet_bootstrap.cc:654] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.242764 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:13.240514 29717 raft_consensus.cc:515] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.243474 29386 raft_consensus.cc:2468] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:13.244917 29717 leader_election.cc:290] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:13.245362 29204 leader_election.cc:304] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:13.247314 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bb3ad82b4543fb90ad68213c62327e" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:13.250128 29204 leader_election.cc:343] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.250749 29651 raft_consensus.cc:2804] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:13.251509 29651 raft_consensus.cc:493] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.251940 29651 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.254326 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bb3ad82b4543fb90ad68213c62327e" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:13.261689 29596 raft_consensus.cc:493] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.264976 29596 raft_consensus.cc:515] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
W20260709 12:28:13.265774 29204 leader_election.cc:343] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.266522 29204 leader_election.cc:304] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:13.269078 29717 raft_consensus.cc:2749] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:13.269258 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:13.270011 29596 leader_election.cc:290] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:13.269336 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:13.270889 29204 leader_election.cc:343] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.271020 29315 raft_consensus.cc:2468] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:13.272768 29207 leader_election.cc:304] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:13.274309 29717 raft_consensus.cc:2804] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:13.274717 29717 raft_consensus.cc:493] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.275053 29717 raft_consensus.cc:3060] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.275863 29134 catalog_manager.cc:5697] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:13.280455 29651 raft_consensus.cc:515] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.284863 29510 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:13.285516 29510 ts_tablet_manager.cc:1403] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.004s
I20260709 12:28:13.285871 29651 leader_election.cc:290] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:13.287703 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:13.288074 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:13.288576 29386 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.290517 29717 raft_consensus.cc:515] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.288795 29315 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.296469 29560 raft_consensus.cc:493] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.297043 29560 raft_consensus.cc:515] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.299381 29560 leader_election.cc:290] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:13.300663 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:13.301343 29386 raft_consensus.cc:2468] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:13.301375 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:13.302829 29510 raft_consensus.cc:359] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.303408 29510 raft_consensus.cc:385] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.302182 29387 raft_consensus.cc:2468] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
W20260709 12:28:13.304672 29427 leader_election.cc:343] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.304960 29204 leader_election.cc:304] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:13.305529 29427 leader_election.cc:304] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:13.303642 29510 raft_consensus.cc:740] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.307273 29510 consensus_queue.cc:260] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.306205 29596 raft_consensus.cc:2804] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:13.308871 29560 raft_consensus.cc:2804] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:13.309850 29560 raft_consensus.cc:493] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.310192 29560 raft_consensus.cc:3060] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.312093 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:13.312820 29460 raft_consensus.cc:3060] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.315791 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:13.316510 29314 raft_consensus.cc:3060] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.323977 29509 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:13.324674 29509 ts_tablet_manager.cc:1403] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.173s	user 0.010s	sys 0.009s
I20260709 12:28:13.326054 29516 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:13.326854 29516 ts_tablet_manager.cc:1403] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.014s
I20260709 12:28:13.327864 29551 raft_consensus.cc:493] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.334914 29510 ts_tablet_manager.cc:1434] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:28:13.312140 29717 leader_election.cc:290] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:13.338490 29510 tablet_bootstrap.cc:492] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:13.330912 29551 raft_consensus.cc:515] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.344900 29551 leader_election.cc:290] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:13.349803 29509 raft_consensus.cc:359] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.350368 29509 raft_consensus.cc:385] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.346737 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:13.350660 29509 raft_consensus.cc:740] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.350773 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:13.353883 29279 leader_election.cc:343] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:13.356089 29279 leader_election.cc:343] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.356355 29510 tablet_bootstrap.cc:654] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.356841 29279 leader_election.cc:304] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:13.348371 29596 raft_consensus.cc:697] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:13.359586 29509 consensus_queue.cc:260] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.357849 29567 raft_consensus.cc:493] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.370833 29681 raft_consensus.cc:493] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.374145 29596 consensus_queue.cc:237] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.374416 29681 raft_consensus.cc:515] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.375869 29567 raft_consensus.cc:515] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.376441 29711 raft_consensus.cc:493] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.376817 29681 leader_election.cc:290] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:13.377067 29711 raft_consensus.cc:515] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.380352 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e6ef31c2e34233803b7c52b878c0ef" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:13.381085 29463 raft_consensus.cc:2468] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:13.383021 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070e1d9927ae4642bb5c37d25f11c996" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:13.383864 29386 raft_consensus.cc:2468] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:13.384482 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070e1d9927ae4642bb5c37d25f11c996" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:13.385201 29316 raft_consensus.cc:2468] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:13.386258 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e6ef31c2e34233803b7c52b878c0ef" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:13.386962 29238 raft_consensus.cc:2468] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:13.367600 29513 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:13.389546 29513 ts_tablet_manager.cc:1403] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.169s	user 0.016s	sys 0.014s
I20260709 12:28:13.391850 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070e1d9927ae4642bb5c37d25f11c996" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:13.392581 29513 raft_consensus.cc:359] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.393313 29513 raft_consensus.cc:385] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.393581 29513 raft_consensus.cc:740] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.396382 29516 raft_consensus.cc:359] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.378238 29567 leader_election.cc:290] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:13.397161 29356 leader_election.cc:304] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:13.398792 29711 leader_election.cc:290] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:13.400621 29567 raft_consensus.cc:2804] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:13.359269 29781 raft_consensus.cc:2749] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:13.394295 29513 consensus_queue.cc:260] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.397188 29516 raft_consensus.cc:385] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.401535 29560 raft_consensus.cc:515] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.412497 29516 raft_consensus.cc:740] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.402642 29279 leader_election.cc:304] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:13.406695 29567 raft_consensus.cc:493] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.416953 29513 ts_tablet_manager.cc:1434] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:28:13.418447 29567 raft_consensus.cc:3060] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.422053 29315 raft_consensus.cc:2468] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:13.415858 29509 ts_tablet_manager.cc:1434] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.000s
I20260709 12:28:13.424019 29509 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
W20260709 12:28:13.429752 29279 leader_election.cc:343] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.414062 29516 consensus_queue.cc:260] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.449527 29513 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:13.458222 29516 ts_tablet_manager.cc:1434] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.131s	user 0.009s	sys 0.000s
I20260709 12:28:13.460085 29516 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:13.432186 29561 raft_consensus.cc:2804] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:13.459477 29314 raft_consensus.cc:2468] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:13.469807 29561 raft_consensus.cc:493] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.475544 29781 raft_consensus.cc:493] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.470301 29460 raft_consensus.cc:2468] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:13.493021 29561 raft_consensus.cc:3060] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.519094 29207 leader_election.cc:304] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:13.522624 29596 raft_consensus.cc:2804] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:13.522096 29509 tablet_bootstrap.cc:654] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.523268 29596 raft_consensus.cc:697] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:13.529888 29516 tablet_bootstrap.cc:654] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.535027 29711 raft_consensus.cc:493] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.541900 29596 consensus_queue.cc:237] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.546573 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070e1d9927ae4642bb5c37d25f11c996" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:13.543720 29711 raft_consensus.cc:515] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.549037 29513 tablet_bootstrap.cc:654] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.549840 29711 leader_election.cc:290] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:13.506610 29781 raft_consensus.cc:515] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.535355 29560 leader_election.cc:290] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:13.550213 29567 raft_consensus.cc:515] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.566306 29781 leader_election.cc:290] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:13.567868 29561 raft_consensus.cc:515] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.567729 29567 leader_election.cc:290] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:13.570676 29561 leader_election.cc:290] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:13.616319 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:13.632236 29353 leader_election.cc:304] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:13.636207 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070e1d9927ae4642bb5c37d25f11c996" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:13.634529 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109246823e454b4ea19cff032f7345a3" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:13.637652 29316 raft_consensus.cc:2468] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:13.638015 29315 raft_consensus.cc:2393] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96bd9c3c81e04118abc2fe11d2b361ed in current term 1: Already voted for candidate c098fe137f19465bb9f67dbd64763b72 in this term.
W20260709 12:28:13.646606 29353 leader_election.cc:343] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.648800 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:13.659379 29390 raft_consensus.cc:3060] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.667770 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070e1d9927ae4642bb5c37d25f11c996" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:13.669310 29389 raft_consensus.cc:2393] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c098fe137f19465bb9f67dbd64763b72 in current term 1: Already voted for candidate 96bd9c3c81e04118abc2fe11d2b361ed in this term.
I20260709 12:28:13.713918 29390 raft_consensus.cc:2468] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:13.719499 29785 raft_consensus.cc:493] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.720124 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070e1d9927ae4642bb5c37d25f11c996" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:13.720649 29785 raft_consensus.cc:515] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:13.722007 29510 tablet_bootstrap.cc:492] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:13.760057 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:13.707491 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109246823e454b4ea19cff032f7345a3" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:13.768975 29711 raft_consensus.cc:2804] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:13.769708 29711 raft_consensus.cc:493] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.770254 29711 raft_consensus.cc:3060] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.780627 29510 ts_tablet_manager.cc:1403] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.443s	user 0.016s	sys 0.011s
I20260709 12:28:13.780877 29139 catalog_manager.cc:5697] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:13.782209 29516 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:13.783303 29516 ts_tablet_manager.cc:1403] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.324s	user 0.016s	sys 0.000s
I20260709 12:28:13.782286 29785 leader_election.cc:290] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:13.791000 29510 raft_consensus.cc:359] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:13.792220 29510 raft_consensus.cc:385] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.792698 29510 raft_consensus.cc:740] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
W20260709 12:28:13.794909 29787 log.cc:927] Time spent T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Append to log took a long time: real 0.303s	user 0.006s	sys 0.000s
I20260709 12:28:13.797005 29791 consensus_queue.cc:1048] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:13.804327 29279 leader_election.cc:343] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.808841 29510 consensus_queue.cc:260] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
W20260709 12:28:13.814896 29356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 59152.7us
I20260709 12:28:13.815623 29510 ts_tablet_manager.cc:1434] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.002s
I20260709 12:28:13.817070 29356 leader_election.cc:304] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:13.817751 29510 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:13.831566 29516 raft_consensus.cc:359] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.835266 29788 raft_consensus.cc:2804] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:13.821131 29427 consensus_peers.cc:597] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:13.836053 29788 raft_consensus.cc:493] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.836650 29788 raft_consensus.cc:3060] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:13.836277 29427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 52914.2us
I20260709 12:28:13.835258 29516 raft_consensus.cc:385] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:13.863395 29516 raft_consensus.cc:740] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
W20260709 12:28:13.873963 29279 leader_election.cc:343] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.882174 29516 consensus_queue.cc:260] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.885172 29279 leader_election.cc:304] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:13.881721 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070e1d9927ae4642bb5c37d25f11c996" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:13.912284 29562 raft_consensus.cc:2749] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:13.893512 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:13.913523 29460 raft_consensus.cc:3060] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:13.894789 29427 leader_election.cc:343] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:13.928339 29427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 61069.8us
W20260709 12:28:13.930953 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 67556.4us
I20260709 12:28:13.926842 29711 raft_consensus.cc:515] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:13.937783 29711 leader_election.cc:290] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:13.978700 29462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0ac53345b44e3abcf7fd2b8a8e4518" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:13.939920 29516 ts_tablet_manager.cc:1434] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.156s	user 0.012s	sys 0.000s
I20260709 12:28:13.935499 29513 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:13.945400 29460 raft_consensus.cc:2468] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:13.981634 29513 ts_tablet_manager.cc:1403] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.532s	user 0.029s	sys 0.018s
I20260709 12:28:13.988161 29516 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:13.948616 29353 leader_election.cc:343] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:13.949234 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e6ef31c2e34233803b7c52b878c0ef" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:13.966668 29510 tablet_bootstrap.cc:654] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:13.995272 29463 raft_consensus.cc:3060] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:13.968384 29509 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:13.997236 29509 ts_tablet_manager.cc:1403] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.574s	user 0.032s	sys 0.045s
W20260709 12:28:13.970294 29279 consensus_peers.cc:597] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 -> Peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Couldn't send request to peer 8dbe6e4429184e5fb137cae093024bce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:13.970065 29315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0ac53345b44e3abcf7fd2b8a8e4518" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:13.971088 29788 raft_consensus.cc:515] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:13.985997 29513 raft_consensus.cc:359] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.002010 29513 raft_consensus.cc:385] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.002524 29513 raft_consensus.cc:740] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.003687 29513 consensus_queue.cc:260] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.005645 29788 leader_election.cc:290] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:14.012763 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e6ef31c2e34233803b7c52b878c0ef" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:14.013691 29238 raft_consensus.cc:3060] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:14.027838 29513 ts_tablet_manager.cc:1434] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.002s
I20260709 12:28:14.029563 29513 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:14.032418 29509 raft_consensus.cc:359] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.033316 29509 raft_consensus.cc:385] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.033605 29509 raft_consensus.cc:740] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
W20260709 12:28:14.034783 29353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 86230.2us
I20260709 12:28:14.037616 29353 leader_election.cc:304] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:14.038728 29788 raft_consensus.cc:2804] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:14.039289 29788 raft_consensus.cc:697] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:14.040433 29788 consensus_queue.cc:237] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:14.041153 29463 raft_consensus.cc:2468] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
W20260709 12:28:14.043190 29279 leader_election.cc:343] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.034318 29509 consensus_queue.cc:260] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.043692 29279 leader_election.cc:304] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:14.044982 29513 tablet_bootstrap.cc:654] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.047725 29794 raft_consensus.cc:2749] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:14.050673 29238 raft_consensus.cc:2468] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:14.055300 29516 tablet_bootstrap.cc:654] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.060446 29510 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:14.061072 29510 ts_tablet_manager.cc:1403] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.244s	user 0.021s	sys 0.021s
I20260709 12:28:14.065774 29353 leader_election.cc:304] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:14.068655 29800 raft_consensus.cc:2804] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:14.068775 29204 leader_election.cc:343] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.069330 29800 raft_consensus.cc:697] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:14.070755 29801 consensus_queue.cc:1048] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:14.070613 29800 consensus_queue.cc:237] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.062449 29427 leader_election.cc:304] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:14.075594 29560 raft_consensus.cc:2804] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:14.076290 29560 raft_consensus.cc:697] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:14.077596 29560 consensus_queue.cc:237] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.071909 29510 raft_consensus.cc:359] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:14.080933 29510 raft_consensus.cc:385] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.081307 29510 raft_consensus.cc:740] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.082140 29510 consensus_queue.cc:260] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
W20260709 12:28:14.084498 29207 leader_election.cc:343] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.085109 29207 leader_election.cc:304] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:14.085392 29801 raft_consensus.cc:493] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.087123 29807 raft_consensus.cc:2749] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:14.086031 29801 raft_consensus.cc:515] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.064791 29137 catalog_manager.cc:5697] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:14.090376 29808 consensus_queue.cc:1048] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:14.091439 29794 consensus_queue.cc:1048] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:14.098738 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109246823e454b4ea19cff032f7345a3" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:14.099606 29312 raft_consensus.cc:3060] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:14.101642 29204 consensus_peers.cc:597] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:14.113638 29808 consensus_queue.cc:1048] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:14.114766 29510 ts_tablet_manager.cc:1434] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 12:28:14.116073 29510 tablet_bootstrap.cc:492] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:14.116979 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109246823e454b4ea19cff032f7345a3" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:14.135429 29509 ts_tablet_manager.cc:1434] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.138s	user 0.011s	sys 0.000s
I20260709 12:28:14.140755 29807 consensus_queue.cc:1048] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:14.147217 29562 raft_consensus.cc:493] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.156811 29136 catalog_manager.cc:5697] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:14.168283 29353 leader_election.cc:343] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.183353 29513 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:14.185223 29801 leader_election.cc:290] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:14.188181 29513 ts_tablet_manager.cc:1403] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.012s
I20260709 12:28:14.160871 29807 consensus_queue.cc:1048] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:28:14.170919 29562 raft_consensus.cc:515] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.204725 29312 raft_consensus.cc:2468] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:14.205359 29562 leader_election.cc:290] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:14.208019 29761 raft_consensus.cc:493] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.208640 29761 raft_consensus.cc:515] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:14.215150 29510 tablet_bootstrap.cc:654] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.239596 29509 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:14.239765 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:14.247335 29817 log.cc:927] Time spent T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:28:14.222833 29356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 58409.2us
I20260709 12:28:14.254647 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dd764d395b4a1db1fa0542bad9979b" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:14.233670 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:14.257604 29389 raft_consensus.cc:3060] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:14.259085 29279 leader_election.cc:343] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:14.266655 29279 leader_election.cc:343] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.269806 29279 leader_election.cc:304] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:14.274592 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dd764d395b4a1db1fa0542bad9979b" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:14.277977 29204 leader_election.cc:343] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.273851 29513 raft_consensus.cc:359] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.278824 29513 raft_consensus.cc:385] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.281373 29513 raft_consensus.cc:740] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.279248 29562 raft_consensus.cc:2749] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:14.279816 29356 leader_election.cc:304] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:14.286774 29513 consensus_queue.cc:260] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
W20260709 12:28:14.305061 29818 log.cc:927] Time spent T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce: Append to log took a long time: real 0.102s	user 0.000s	sys 0.002s
I20260709 12:28:14.307813 29513 ts_tablet_manager.cc:1434] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.119s	user 0.010s	sys 0.000s
I20260709 12:28:14.311410 29513 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:14.308287 29711 raft_consensus.cc:2804] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:14.316354 29711 raft_consensus.cc:697] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:14.317524 29711 consensus_queue.cc:237] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.329874 29509 tablet_bootstrap.cc:654] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.326360 29136 catalog_manager.cc:5697] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:14.376142 29204 leader_election.cc:343] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.376622 29204 leader_election.cc:304] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:14.379364 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:14.383517 29516 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:14.384235 29516 ts_tablet_manager.cc:1403] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.397s	user 0.015s	sys 0.016s
I20260709 12:28:14.395552 29799 raft_consensus.cc:2749] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:14.397625 29761 leader_election.cc:290] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:14.401556 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:14.402500 29311 raft_consensus.cc:2468] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
W20260709 12:28:14.407353 29427 leader_election.cc:343] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.407516 29513 tablet_bootstrap.cc:654] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.415192 29430 leader_election.cc:304] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:14.435487 29516 raft_consensus.cc:359] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.436195 29516 raft_consensus.cc:385] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.436383 29516 raft_consensus.cc:740] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.437507 29516 consensus_queue.cc:260] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.431147 29761 raft_consensus.cc:2804] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:14.453604 29510 tablet_bootstrap.cc:492] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:14.457212 29516 ts_tablet_manager.cc:1434] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 12:28:14.458557 29516 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:14.454241 29510 ts_tablet_manager.cc:1403] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.339s	user 0.017s	sys 0.025s
I20260709 12:28:14.445706 29761 raft_consensus.cc:493] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.471410 29510 raft_consensus.cc:359] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:14.472195 29510 raft_consensus.cc:385] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.472491 29510 raft_consensus.cc:740] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.473299 29510 consensus_queue.cc:260] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:14.478325 29761 raft_consensus.cc:3060] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:14.487406 29800 raft_consensus.cc:493] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:14.494026 29800 raft_consensus.cc:515] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.495482 29551 raft_consensus.cc:493] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.496078 29551 raft_consensus.cc:515] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.507090 29551 leader_election.cc:290] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:14.514488 29510 ts_tablet_manager.cc:1434] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:28:14.520004 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e140659184a569b1e220d086f4b63" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:14.522890 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e140659184a569b1e220d086f4b63" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:14.521871 29823 consensus_queue.cc:1048] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:28:14.525295 29279 leader_election.cc:343] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:14.527899 29279 leader_election.cc:343] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.533480 29279 leader_election.cc:304] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:14.536983 29803 raft_consensus.cc:2749] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:14.537945 29800 leader_election.cc:290] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:14.547001 29510 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:14.548854 29513 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:14.549474 29513 ts_tablet_manager.cc:1403] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.238s	user 0.029s	sys 0.019s
I20260709 12:28:14.552536 29509 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:14.553117 29509 ts_tablet_manager.cc:1403] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.314s	user 0.016s	sys 0.004s
I20260709 12:28:14.554818 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:14.556367 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:14.559626 29509 raft_consensus.cc:359] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.560451 29509 raft_consensus.cc:385] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.560727 29509 raft_consensus.cc:740] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.563184 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:14.565395 29516 tablet_bootstrap.cc:654] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.566941 29510 tablet_bootstrap.cc:654] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.566542 29136 catalog_manager.cc:5697] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:14.576546 29509 consensus_queue.cc:260] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.615350 29820 consensus_queue.cc:1048] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:14.616675 29509 ts_tablet_manager.cc:1434] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.002s
I20260709 12:28:14.618057 29509 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:14.626166 29761 raft_consensus.cc:515] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:14.630659 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:14.631424 29312 raft_consensus.cc:3060] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:14.633105 29427 consensus_peers.cc:597] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:14.636307 29761 leader_election.cc:290] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:14.637818 29513 raft_consensus.cc:359] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:14.634865 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:14.638664 29513 raft_consensus.cc:385] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.642143 29513 raft_consensus.cc:740] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.616693 29353 leader_election.cc:304] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
W20260709 12:28:14.644963 29427 leader_election.cc:343] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.649423 29513 consensus_queue.cc:260] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:14.650269 29711 consensus_queue.cc:1048] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:14.661998 29789 raft_consensus.cc:2749] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.668581 29513 ts_tablet_manager.cc:1434] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.000s
I20260709 12:28:14.686077 29513 tablet_bootstrap.cc:492] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:14.686662 29516 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:14.687286 29516 ts_tablet_manager.cc:1403] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.229s	user 0.011s	sys 0.010s
I20260709 12:28:14.695196 29516 raft_consensus.cc:359] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:14.695977 29516 raft_consensus.cc:385] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.696290 29516 raft_consensus.cc:740] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.697487 29516 consensus_queue.cc:260] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:14.697953 29509 tablet_bootstrap.cc:654] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.705049 29789 consensus_queue.cc:1048] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:14.705394 29711 consensus_queue.cc:1048] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:14.717207 29312 raft_consensus.cc:2468] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:14.720201 29430 leader_election.cc:304] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:14.720630 29510 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:14.721233 29510 ts_tablet_manager.cc:1403] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.181s	user 0.016s	sys 0.007s
I20260709 12:28:14.721371 29516 ts_tablet_manager.cc:1434] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:28:14.723409 29761 raft_consensus.cc:2804] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:14.723909 29761 raft_consensus.cc:697] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:14.724767 29761 consensus_queue.cc:237] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:14.730207 29513 tablet_bootstrap.cc:654] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.732625 29510 raft_consensus.cc:359] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.733453 29510 raft_consensus.cc:385] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.733724 29510 raft_consensus.cc:740] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.736274 29240 raft_consensus.cc:3060] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:14.742039 29785 raft_consensus.cc:493] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.741497 29510 consensus_queue.cc:260] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.747732 29510 ts_tablet_manager.cc:1434] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 12:28:14.744282 29785 raft_consensus.cc:515] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.750423 29792 raft_consensus.cc:493] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.751364 29792 raft_consensus.cc:515] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:14.752173 29516 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:14.754719 29785 leader_election.cc:290] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:14.756521 29387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:14.755573 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:14.758312 29204 leader_election.cc:343] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.755641 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:14.759557 29314 raft_consensus.cc:2468] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:14.763603 29509 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:14.764216 29509 ts_tablet_manager.cc:1403] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.014s
I20260709 12:28:14.764402 29792 leader_election.cc:290] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:14.766983 29207 leader_election.cc:304] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:14.768573 29785 raft_consensus.cc:2804] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:14.769120 29785 raft_consensus.cc:493] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.769605 29785 raft_consensus.cc:3060] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:14.786051 29509 raft_consensus.cc:359] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.786957 29509 raft_consensus.cc:385] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.787400 29509 raft_consensus.cc:740] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.789145 29509 consensus_queue.cc:260] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.793147 29510 tablet_bootstrap.cc:492] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:14.795485 29137 catalog_manager.cc:5697] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:14.796406 29509 ts_tablet_manager.cc:1434] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 12:28:14.816320 29509 tablet_bootstrap.cc:492] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:14.817253 29139 catalog_manager.cc:5697] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:14.799045 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:14.829797 29427 leader_election.cc:304] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:14.831164 29792 raft_consensus.cc:2749] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:14.832163 29509 tablet_bootstrap.cc:654] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.833201 29516 tablet_bootstrap.cc:654] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.838847 29711 raft_consensus.cc:493] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.839497 29711 raft_consensus.cc:515] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.841972 29711 leader_election.cc:290] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:14.834589 29785 raft_consensus.cc:515] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.843187 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:14.844264 29314 raft_consensus.cc:2468] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:14.845762 29356 leader_election.cc:304] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:14.846165 29240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:14.847347 29711 raft_consensus.cc:2804] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:14.847756 29711 raft_consensus.cc:493] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.848100 29711 raft_consensus.cc:3060] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:14.800450 29513 tablet_bootstrap.cc:492] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:14.851060 29509 tablet_bootstrap.cc:492] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:14.853051 29509 ts_tablet_manager.cc:1403] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 12:28:14.856274 29509 raft_consensus.cc:359] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:14.857039 29509 raft_consensus.cc:385] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.857342 29509 raft_consensus.cc:740] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.852399 29513 ts_tablet_manager.cc:1403] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.183s	user 0.013s	sys 0.004s
I20260709 12:28:14.861030 29513 raft_consensus.cc:359] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:14.861897 29513 raft_consensus.cc:385] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:28:14.861984 29353 leader_election.cc:343] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.862728 29509 consensus_queue.cc:260] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:14.864490 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:14.865233 29314 raft_consensus.cc:3060] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:14.865362 29509 ts_tablet_manager.cc:1434] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:28:14.866775 29509 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:14.868757 29785 leader_election.cc:290] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:14.869491 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
W20260709 12:28:14.872253 29204 leader_election.cc:343] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.873979 29509 tablet_bootstrap.cc:654] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.874086 29464 raft_consensus.cc:3060] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:14.875945 29711 raft_consensus.cc:515] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.879104 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:14.862248 29513 raft_consensus.cc:740] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
W20260709 12:28:14.880970 29353 leader_election.cc:343] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:14.880725 29513 consensus_queue.cc:260] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:14.901381 29516 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:14.902014 29516 ts_tablet_manager.cc:1403] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.154s	user 0.007s	sys 0.004s
I20260709 12:28:14.905473 29516 raft_consensus.cc:359] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.906225 29516 raft_consensus.cc:385] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.906541 29516 raft_consensus.cc:740] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.908892 29711 leader_election.cc:290] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:14.910612 29513 ts_tablet_manager.cc:1434] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:28:14.910219 29516 consensus_queue.cc:260] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.910938 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:14.911667 29312 raft_consensus.cc:3060] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:14.911769 29513 tablet_bootstrap.cc:492] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:14.913060 29516 ts_tablet_manager.cc:1434] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:14.915477 29516 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:14.917457 29510 tablet_bootstrap.cc:654] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.921206 29312 raft_consensus.cc:2468] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:14.921494 29314 raft_consensus.cc:2468] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:14.923142 29509 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:14.922896 29356 leader_election.cc:304] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:14.923765 29509 ts_tablet_manager.cc:1403] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.057s	user 0.034s	sys 0.003s
I20260709 12:28:14.922897 29207 leader_election.cc:304] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:14.925474 29711 raft_consensus.cc:2804] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:14.926304 29711 raft_consensus.cc:697] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:14.926545 29801 raft_consensus.cc:2804] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:14.927145 29801 raft_consensus.cc:697] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:14.926952 29509 raft_consensus.cc:359] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.927721 29509 raft_consensus.cc:385] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.927368 29711 consensus_queue.cc:237] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.928122 29509 raft_consensus.cc:740] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.928069 29801 consensus_queue.cc:237] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:14.929280 29509 consensus_queue.cc:260] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:14.931895 29509 ts_tablet_manager.cc:1434] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:28:14.933036 29509 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
W20260709 12:28:14.943455 29353 consensus_peers.cc:597] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:14.946688 29789 consensus_queue.cc:1048] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:14.949529 29516 tablet_bootstrap.cc:654] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.951282 29509 tablet_bootstrap.cc:654] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.977646 29138 catalog_manager.cc:5697] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:14.980480 29136 catalog_manager.cc:5697] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:14.986621 29513 tablet_bootstrap.cc:654] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.002696 29510 tablet_bootstrap.cc:492] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:15.003327 29510 ts_tablet_manager.cc:1403] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.210s	user 0.003s	sys 0.009s
I20260709 12:28:15.008426 29801 raft_consensus.cc:493] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.009012 29801 raft_consensus.cc:515] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.012137 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:15.015816 29801 leader_election.cc:290] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:15.016835 29510 raft_consensus.cc:359] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.017598 29510 raft_consensus.cc:385] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.017853 29510 raft_consensus.cc:740] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.020133 29510 consensus_queue.cc:260] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.022667 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:15.023191 29516 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:15.026909 29516 ts_tablet_manager.cc:1403] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.022s
I20260709 12:28:15.033393 29516 raft_consensus.cc:359] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.034240 29516 raft_consensus.cc:385] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.034559 29516 raft_consensus.cc:740] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.035130 29204 leader_election.cc:304] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:15.035609 29510 ts_tablet_manager.cc:1434] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:28:15.036818 29510 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:15.037360 29509 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:15.037926 29509 ts_tablet_manager.cc:1403] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.005s
I20260709 12:28:15.041640 29509 raft_consensus.cc:359] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.042435 29509 raft_consensus.cc:385] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.042733 29509 raft_consensus.cc:740] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.043467 29509 consensus_queue.cc:260] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.043766 29807 raft_consensus.cc:2749] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:15.045996 29509 ts_tablet_manager.cc:1434] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:15.046917 29516 consensus_queue.cc:260] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.051677 29509 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:15.060568 29510 tablet_bootstrap.cc:654] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.063503 29803 raft_consensus.cc:493] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.064194 29803 raft_consensus.cc:515] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.067541 29516 ts_tablet_manager.cc:1434] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 12:28:15.071664 29516 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:15.086578 29509 tablet_bootstrap.cc:654] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.087594 29820 raft_consensus.cc:493] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.088137 29820 raft_consensus.cc:515] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.089767 29516 tablet_bootstrap.cc:654] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.090626 29820 leader_election.cc:290] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:15.091882 29761 raft_consensus.cc:493] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.092482 29761 raft_consensus.cc:515] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.093109 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bb3ad82b4543fb90ad68213c62327e" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:15.094880 29353 leader_election.cc:343] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.096315 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cc57e0ce6841219ed37c3d7d5a70be" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:15.096652 29761 leader_election.cc:290] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:15.097177 29390 raft_consensus.cc:2468] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:15.098450 29427 leader_election.cc:304] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:15.098894 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bb3ad82b4543fb90ad68213c62327e" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:15.099323 29761 raft_consensus.cc:2804] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.099644 29238 raft_consensus.cc:2468] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:15.099823 29761 raft_consensus.cc:493] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.102353 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b597f990ad43f0b26beedf929c6aff" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:15.104333 29279 leader_election.cc:343] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.106416 29803 leader_election.cc:290] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:15.101025 29761 raft_consensus.cc:3060] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.113541 29509 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:15.114236 29509 ts_tablet_manager.cc:1403] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.009s
I20260709 12:28:15.114492 29353 leader_election.cc:304] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:15.115772 29820 raft_consensus.cc:2804] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.116174 29820 raft_consensus.cc:493] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.116544 29820 raft_consensus.cc:3060] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.116655 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b597f990ad43f0b26beedf929c6aff" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:15.117866 29516 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:15.118492 29516 ts_tablet_manager.cc:1403] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.000s
I20260709 12:28:15.118777 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cc57e0ce6841219ed37c3d7d5a70be" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:15.117702 29509 raft_consensus.cc:359] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.121153 29509 raft_consensus.cc:385] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.123168 29516 raft_consensus.cc:359] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.124495 29516 raft_consensus.cc:385] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.124814 29516 raft_consensus.cc:740] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.124037 29509 raft_consensus.cc:740] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.126052 29509 consensus_queue.cc:260] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.128713 29509 ts_tablet_manager.cc:1434] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:28:15.130913 29516 consensus_queue.cc:260] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.132917 29509 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:15.135803 29820 raft_consensus.cc:515] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.142079 29516 ts_tablet_manager.cc:1434] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:28:15.143458 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bb3ad82b4543fb90ad68213c62327e" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
W20260709 12:28:15.145269 29353 leader_election.cc:343] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:15.145305 29279 leader_election.cc:343] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.146378 29509 tablet_bootstrap.cc:654] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.146528 29279 leader_election.cc:304] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
W20260709 12:28:15.145808 29427 leader_election.cc:343] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.143530 29516 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:15.153671 29803 raft_consensus.cc:2749] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:15.159175 29516 tablet_bootstrap.cc:654] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.163902 29820 leader_election.cc:290] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:15.167158 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bb3ad82b4543fb90ad68213c62327e" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:15.168030 29238 raft_consensus.cc:3060] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.163956 29509 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:15.170348 29509 ts_tablet_manager.cc:1403] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.001s
I20260709 12:28:15.177286 29510 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:15.176923 29509 raft_consensus.cc:359] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.177829 29509 raft_consensus.cc:385] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.177935 29510 ts_tablet_manager.cc:1403] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.141s	user 0.009s	sys 0.004s
I20260709 12:28:15.178161 29509 raft_consensus.cc:740] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.179745 29509 consensus_queue.cc:260] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.181228 29510 raft_consensus.cc:359] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.181900 29509 ts_tablet_manager.cc:1434] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:15.182081 29510 raft_consensus.cc:385] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.182900 29792 raft_consensus.cc:493] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.188158 29510 raft_consensus.cc:740] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.188453 29792 raft_consensus.cc:515] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.189095 29510 consensus_queue.cc:260] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.191514 29510 ts_tablet_manager.cc:1434] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:28:15.192377 29792 leader_election.cc:290] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:15.193055 29240 raft_consensus.cc:3060] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.193506 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a89b86cbfd049bb9445919c85a2a661" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:15.195355 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a89b86cbfd049bb9445919c85a2a661" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:15.196671 29430 leader_election.cc:343] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:15.197177 29427 leader_election.cc:343] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.197613 29427 leader_election.cc:304] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:15.198774 29792 raft_consensus.cc:2749] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:15.218727 29820 raft_consensus.cc:493] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.219338 29820 raft_consensus.cc:515] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.183171 29509 tablet_bootstrap.cc:492] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:15.221864 29820 leader_election.cc:290] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:15.224416 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dd764d395b4a1db1fa0542bad9979b" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:15.226260 29353 leader_election.cc:343] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.226796 29236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dd764d395b4a1db1fa0542bad9979b" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:15.227581 29236 raft_consensus.cc:2468] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:15.234328 29353 leader_election.cc:304] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:15.235656 29820 raft_consensus.cc:2804] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.236066 29820 raft_consensus.cc:493] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.236474 29820 raft_consensus.cc:3060] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.245355 29711 raft_consensus.cc:493] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.246047 29711 raft_consensus.cc:515] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.253607 29820 raft_consensus.cc:515] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.259644 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6a39a3308459fa622a39fb1bf5dad" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:15.260499 29314 raft_consensus.cc:2468] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:15.261749 29356 leader_election.cc:304] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:15.263551 29789 raft_consensus.cc:2804] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.263998 29789 raft_consensus.cc:493] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.264375 29789 raft_consensus.cc:3060] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.270092 29820 leader_election.cc:290] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:15.270237 29236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dd764d395b4a1db1fa0542bad9979b" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:15.271320 29236 raft_consensus.cc:3060] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.272686 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dd764d395b4a1db1fa0542bad9979b" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
W20260709 12:28:15.283027 29353 leader_election.cc:343] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.284725 29711 leader_election.cc:290] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:15.287012 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6a39a3308459fa622a39fb1bf5dad" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:15.289299 29513 tablet_bootstrap.cc:492] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
W20260709 12:28:15.312861 29353 leader_election.cc:343] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.317075 29761 raft_consensus.cc:515] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.319028 29711 raft_consensus.cc:493] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.319640 29711 raft_consensus.cc:515] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.320426 29761 leader_election.cc:290] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:15.322901 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cc57e0ce6841219ed37c3d7d5a70be" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:15.323312 29516 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:15.323817 29516 ts_tablet_manager.cc:1403] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.181s	user 0.033s	sys 0.025s
I20260709 12:28:15.324561 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:15.325043 29427 leader_election.cc:343] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.324951 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18cc57e0ce6841219ed37c3d7d5a70be" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:15.326155 29386 raft_consensus.cc:3060] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:15.326218 29356 leader_election.cc:343] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.327008 29711 leader_election.cc:290] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
W20260709 12:28:15.332671 29427 consensus_peers.cc:597] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:15.335376 29238 raft_consensus.cc:2468] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:15.336853 29789 raft_consensus.cc:515] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.339738 29236 raft_consensus.cc:2468] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:15.352770 29509 tablet_bootstrap.cc:654] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.341629 29513 ts_tablet_manager.cc:1403] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.430s	user 0.024s	sys 0.014s
I20260709 12:28:15.342873 29353 leader_election.cc:304] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:15.343231 29516 raft_consensus.cc:359] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.353775 29516 raft_consensus.cc:385] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.354130 29516 raft_consensus.cc:740] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.354912 29516 consensus_queue.cc:260] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.356007 29513 raft_consensus.cc:359] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.356755 29513 raft_consensus.cc:385] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.357007 29513 raft_consensus.cc:740] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.357414 29516 ts_tablet_manager.cc:1434] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 12:28:15.357751 29513 consensus_queue.cc:260] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.347414 29792 consensus_queue.cc:1048] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:15.348107 29237 raft_consensus.cc:3060] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.349555 29510 tablet_bootstrap.cc:492] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:15.366243 29711 raft_consensus.cc:2804] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.366954 29711 raft_consensus.cc:697] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:15.367928 29711 consensus_queue.cc:237] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.372210 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6a39a3308459fa622a39fb1bf5dad" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:15.373095 29314 raft_consensus.cc:3060] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.351850 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:15.352159 29789 leader_election.cc:290] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:15.336239 29386 raft_consensus.cc:2468] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:15.374419 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6a39a3308459fa622a39fb1bf5dad" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
W20260709 12:28:15.377750 29353 leader_election.cc:343] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.377964 29513 ts_tablet_manager.cc:1434] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:28:15.381740 29513 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:15.382676 29510 tablet_bootstrap.cc:654] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.358718 29516 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:15.388568 29427 leader_election.cc:304] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:15.394613 29792 raft_consensus.cc:2804] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.395459 29792 raft_consensus.cc:697] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:15.396334 29792 consensus_queue.cc:237] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
W20260709 12:28:15.399703 29204 consensus_peers.cc:597] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:15.403560 29353 leader_election.cc:304] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:15.404467 29820 raft_consensus.cc:2804] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:15.404891 29353 leader_election.cc:343] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.405006 29820 raft_consensus.cc:697] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:15.405479 29353 leader_election.cc:304] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:15.406065 29820 consensus_queue.cc:237] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:15.406764 29711 raft_consensus.cc:2749] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:15.415522 29516 tablet_bootstrap.cc:654] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.429641 29789 raft_consensus.cc:493] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.430472 29789 raft_consensus.cc:515] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
W20260709 12:28:15.465780 29430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 46875.4us
W20260709 12:28:15.470870 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 50844.2us
W20260709 12:28:15.471946 29353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 51450.9us
I20260709 12:28:15.478140 29510 tablet_bootstrap.cc:492] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:15.478773 29510 ts_tablet_manager.cc:1403] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.009s
I20260709 12:28:15.485097 29789 leader_election.cc:290] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:15.502571 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e140659184a569b1e220d086f4b63" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:15.508630 29138 catalog_manager.cc:5697] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.507483 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e140659184a569b1e220d086f4b63" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:15.512787 29311 raft_consensus.cc:2468] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:15.503401 29238 raft_consensus.cc:2468] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
I20260709 12:28:15.523006 29356 leader_election.cc:304] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:15.536862 29820 raft_consensus.cc:2804] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.537315 29820 raft_consensus.cc:493] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.537648 29820 raft_consensus.cc:3060] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.538693 29516 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:15.539274 29516 ts_tablet_manager.cc:1403] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.001s
I20260709 12:28:15.540485 29807 consensus_queue.cc:1048] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:15.542794 29792 raft_consensus.cc:493] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.543342 29792 raft_consensus.cc:515] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.545491 29792 leader_election.cc:290] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:15.549257 29510 raft_consensus.cc:359] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.559846 29510 raft_consensus.cc:385] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.560201 29510 raft_consensus.cc:740] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.558547 29314 raft_consensus.cc:2468] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:15.562265 29510 consensus_queue.cc:260] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.586623 29516 raft_consensus.cc:359] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.587759 29516 raft_consensus.cc:385] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.588117 29516 raft_consensus.cc:740] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.603981 29516 consensus_queue.cc:260] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
W20260709 12:28:15.608181 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 69509.7us
I20260709 12:28:15.615605 29510 ts_tablet_manager.cc:1434] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.137s	user 0.006s	sys 0.003s
I20260709 12:28:15.620558 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b597f990ad43f0b26beedf929c6aff" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:15.621388 29316 raft_consensus.cc:2468] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:15.623968 29430 leader_election.cc:304] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:15.624753 29509 tablet_bootstrap.cc:492] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:15.625547 29509 ts_tablet_manager.cc:1403] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.443s	user 0.027s	sys 0.009s
I20260709 12:28:15.636246 29510 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:15.641633 29516 ts_tablet_manager.cc:1434] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.102s	user 0.010s	sys 0.002s
I20260709 12:28:15.663046 29513 tablet_bootstrap.cc:654] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.670233 29136 catalog_manager.cc:5697] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.672108 29136 catalog_manager.cc:5697] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.682825 29516 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:15.668511 29883 raft_consensus.cc:2804] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.688360 29883 raft_consensus.cc:493] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:15.680622 29430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 56792.6us
I20260709 12:28:15.695968 29883 raft_consensus.cc:3060] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.709859 29509 raft_consensus.cc:359] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.712666 29509 raft_consensus.cc:385] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.713119 29509 raft_consensus.cc:740] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.695912 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b597f990ad43f0b26beedf929c6aff" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:15.715713 29509 consensus_queue.cc:260] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.718935 29509 ts_tablet_manager.cc:1434] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.093s	user 0.011s	sys 0.000s
I20260709 12:28:15.741475 29510 tablet_bootstrap.cc:654] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:15.718231 29879 log.cc:927] Time spent T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed: Append to log took a long time: real 0.206s	user 0.004s	sys 0.000s
I20260709 12:28:15.742029 29516 tablet_bootstrap.cc:654] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.706240 29820 raft_consensus.cc:515] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.767887 29820 leader_election.cc:290] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:15.769063 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e140659184a569b1e220d086f4b63" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:15.769820 29313 raft_consensus.cc:3060] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:15.773597 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 53157.1us
W20260709 12:28:15.775954 29427 leader_election.cc:343] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.780453 29807 raft_consensus.cc:493] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.781057 29807 raft_consensus.cc:515] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.783308 29807 leader_election.cc:290] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:15.820127 29803 raft_consensus.cc:493] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.833138 29803 raft_consensus.cc:515] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.835592 29803 leader_election.cc:290] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:15.837985 29310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52884fe0058e4164905c706a05528483" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:15.831888 29510 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:15.843083 29510 ts_tablet_manager.cc:1403] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.224s	user 0.020s	sys 0.005s
I20260709 12:28:15.831640 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52884fe0058e4164905c706a05528483" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:15.846197 29510 raft_consensus.cc:359] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.846972 29510 raft_consensus.cc:385] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.847265 29510 raft_consensus.cc:740] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.849212 29509 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
W20260709 12:28:15.851547 29207 leader_election.cc:343] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:15.855839 29204 leader_election.cc:343] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.856307 29204 leader_election.cc:304] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:15.857493 29313 raft_consensus.cc:2468] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:15.858907 29884 raft_consensus.cc:2749] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:15.859490 29516 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:15.866938 29516 ts_tablet_manager.cc:1403] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.198s	user 0.029s	sys 0.012s
I20260709 12:28:15.867318 29356 leader_election.cc:304] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:15.875524 29509 tablet_bootstrap.cc:654] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:15.850200 29353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 326533us
I20260709 12:28:15.885671 29888 raft_consensus.cc:2804] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.875651 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a89b86cbfd049bb9445919c85a2a661" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:15.887225 29800 consensus_queue.cc:1048] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:15.888705 29888 raft_consensus.cc:697] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:15.892968 29888 consensus_queue.cc:237] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.905926 29356 leader_election.cc:304] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:15.908679 29711 raft_consensus.cc:2804] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.909204 29711 raft_consensus.cc:697] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:15.910075 29711 consensus_queue.cc:237] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:15.913318 29236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e140659184a569b1e220d086f4b63" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:15.914075 29236 raft_consensus.cc:3060] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.847978 29510 consensus_queue.cc:260] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
W20260709 12:28:15.918877 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:15.922809 29883 raft_consensus.cc:515] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.932412 29510 ts_tablet_manager.cc:1434] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 12:28:15.934001 29510 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:15.941562 29516 raft_consensus.cc:359] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:15.958674 29516 raft_consensus.cc:385] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.959043 29516 raft_consensus.cc:740] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.958377 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b597f990ad43f0b26beedf929c6aff" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:15.959791 29516 consensus_queue.cc:260] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
W20260709 12:28:15.961704 29427 leader_election.cc:343] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:15.962612 29427 consensus_peers.cc:597] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:15.947717 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a89b86cbfd049bb9445919c85a2a661" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:15.950606 29883 leader_election.cc:290] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:15.950630 29791 raft_consensus.cc:493] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.963564 29463 raft_consensus.cc:2468] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:15.963567 29791 raft_consensus.cc:515] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.965366 29516 ts_tablet_manager.cc:1434] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.035s	user 0.001s	sys 0.006s
I20260709 12:28:15.966168 29791 leader_election.cc:290] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:15.966527 29516 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:15.951838 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 62573us
I20260709 12:28:15.972249 29136 catalog_manager.cc:5697] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.973459 29279 leader_election.cc:304] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:15.974537 29893 raft_consensus.cc:2804] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.974933 29893 raft_consensus.cc:493] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.975284 29893 raft_consensus.cc:3060] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.976349 29516 tablet_bootstrap.cc:654] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.981164 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bc4e256b44d7bad8a2915325ebf16" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:15.987007 29430 leader_election.cc:343] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.990533 29893 raft_consensus.cc:515] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:15.992949 29893 leader_election.cc:290] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
W20260709 12:28:16.001821 29279 leader_election.cc:343] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:15.943794 29353 consensus_peers.cc:597] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:15.946008 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b597f990ad43f0b26beedf929c6aff" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
W20260709 12:28:16.004624 29353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 60976.8us
I20260709 12:28:16.005089 29313 raft_consensus.cc:3060] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.955561 29236 raft_consensus.cc:2468] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
W20260709 12:28:16.003130 29901 log.cc:927] Time spent T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72: Append to log took a long time: real 0.054s	user 0.010s	sys 0.000s
W20260709 12:28:16.007267 29907 log.cc:927] Time spent T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed: Append to log took a long time: real 0.070s	user 0.001s	sys 0.002s
W20260709 12:28:16.013435 29863 log.cc:927] Time spent T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Append to log took a long time: real 0.130s	user 0.004s	sys 0.011s
I20260709 12:28:16.014770 29509 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:16.015376 29509 ts_tablet_manager.cc:1403] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.001s
I20260709 12:28:16.015653 29897 raft_consensus.cc:493] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.017150 29791 consensus_queue.cc:1048] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:16.018149 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bc4e256b44d7bad8a2915325ebf16" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:16.018882 29389 raft_consensus.cc:2468] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
W20260709 12:28:16.020453 29353 consensus_peers.cc:597] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Couldn't send request to peer 8dbe6e4429184e5fb137cae093024bce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:16.020493 29427 leader_election.cc:304] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:16.022099 29791 raft_consensus.cc:2804] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:16.022383 29353 consensus_peers.cc:597] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Couldn't send request to peer 8dbe6e4429184e5fb137cae093024bce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:16.022583 29791 raft_consensus.cc:493] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.022992 29791 raft_consensus.cc:3060] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.027697 29510 tablet_bootstrap.cc:654] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:16.028530 29905 raft_consensus.cc:493] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.029198 29905 raft_consensus.cc:515] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:16.029660 29136 catalog_manager.cc:5697] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:16.031700 29910 log.cc:927] Time spent T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:28:16.031549 29509 raft_consensus.cc:359] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:16.032346 29509 raft_consensus.cc:385] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.032650 29509 raft_consensus.cc:740] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.033387 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0ac53345b44e3abcf7fd2b8a8e4518" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:16.033380 29509 consensus_queue.cc:260] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:16.004061 29513 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
W20260709 12:28:16.036504 29430 leader_election.cc:343] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:16.036401 29905 leader_election.cc:290] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:16.042212 29888 consensus_queue.cc:1048] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.052171 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a89b86cbfd049bb9445919c85a2a661" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:16.047052 29513 ts_tablet_manager.cc:1403] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.667s	user 0.039s	sys 0.036s
I20260709 12:28:16.057782 29236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0ac53345b44e3abcf7fd2b8a8e4518" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:16.058233 29895 raft_consensus.cc:493] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.058816 29895 raft_consensus.cc:515] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:16.060070 29236 raft_consensus.cc:2468] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:16.061460 29895 leader_election.cc:290] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:16.064970 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0ac53345b44e3abcf7fd2b8a8e4518" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:16.068948 29427 leader_election.cc:304] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:16.016284 29897 raft_consensus.cc:515] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
W20260709 12:28:16.076521 29207 leader_election.cc:343] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:16.079167 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0ac53345b44e3abcf7fd2b8a8e4518" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:16.082502 29509 ts_tablet_manager.cc:1434] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.002s
W20260709 12:28:16.082937 29279 leader_election.cc:343] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:16.074615 29313 raft_consensus.cc:2468] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:16.091827 29430 leader_election.cc:304] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:16.093408 29904 raft_consensus.cc:2804] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:16.094002 29904 raft_consensus.cc:697] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:16.094941 29904 consensus_queue.cc:237] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:16.080957 29883 raft_consensus.cc:2804] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:16.098057 29883 raft_consensus.cc:493] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.098629 29883 raft_consensus.cc:3060] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.111208 29509 tablet_bootstrap.cc:492] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:16.085602 29513 raft_consensus.cc:359] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:16.116662 29513 raft_consensus.cc:385] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.117125 29513 raft_consensus.cc:740] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.120218 29510 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:16.120827 29510 ts_tablet_manager.cc:1403] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.187s	user 0.010s	sys 0.003s
I20260709 12:28:16.125753 29897 leader_election.cc:290] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:16.127588 29510 raft_consensus.cc:359] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:16.128400 29510 raft_consensus.cc:385] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.128367 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:16.128877 29510 raft_consensus.cc:740] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.129588 29510 consensus_queue.cc:260] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:16.131810 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:16.132121 29510 ts_tablet_manager.cc:1434] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:28:16.133278 29510 tablet_bootstrap.cc:492] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
W20260709 12:28:16.133554 29207 leader_election.cc:343] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:16.138732 29888 consensus_queue.cc:1048] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.140736 29510 tablet_bootstrap.cc:654] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:16.141144 29204 leader_election.cc:343] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:16.141649 29204 leader_election.cc:304] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:16.142854 29897 raft_consensus.cc:2749] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:16.154139 29513 consensus_queue.cc:260] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:16.159586 29513 ts_tablet_manager.cc:1434] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 12:28:16.166832 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a89b86cbfd049bb9445919c85a2a661" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:16.167609 29464 raft_consensus.cc:3060] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.168722 29883 raft_consensus.cc:515] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:16.169862 29463 raft_consensus.cc:2393] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 629ba7d0b7eb4d9b8832b0f605f79443 in current term 1: Already voted for candidate 8dbe6e4429184e5fb137cae093024bce in this term.
I20260709 12:28:16.172894 29204 leader_election.cc:304] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:16.175364 29513 tablet_bootstrap.cc:492] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:16.175065 29791 raft_consensus.cc:515] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.176019 29895 raft_consensus.cc:3060] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.178953 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bc4e256b44d7bad8a2915325ebf16" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
W20260709 12:28:16.180461 29430 leader_election.cc:343] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:16.219630 29791 leader_election.cc:290] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:16.221350 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bc4e256b44d7bad8a2915325ebf16" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:16.227052 29390 raft_consensus.cc:3060] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.230607 29513 tablet_bootstrap.cc:654] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:16.210283 29139 catalog_manager.cc:5697] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.232887 29516 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:16.233522 29516 ts_tablet_manager.cc:1403] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.267s	user 0.034s	sys 0.044s
I20260709 12:28:16.237236 29883 leader_election.cc:290] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:16.245682 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0ac53345b44e3abcf7fd2b8a8e4518" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:16.247058 29311 raft_consensus.cc:3060] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.250162 29509 tablet_bootstrap.cc:654] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:16.252471 29236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0ac53345b44e3abcf7fd2b8a8e4518" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:16.213582 29464 raft_consensus.cc:2468] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:16.256242 29238 raft_consensus.cc:3060] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.269133 29279 leader_election.cc:304] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:16.272063 29893 raft_consensus.cc:2804] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:16.328119 29883 raft_consensus.cc:493] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.328940 29883 raft_consensus.cc:515] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:16.412434 29883 leader_election.cc:290] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:16.413940 29510 tablet_bootstrap.cc:492] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:16.414551 29510 ts_tablet_manager.cc:1403] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.281s	user 0.019s	sys 0.006s
I20260709 12:28:16.410148 29516 raft_consensus.cc:359] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:16.422297 29510 raft_consensus.cc:359] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.422963 29516 raft_consensus.cc:385] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.423032 29510 raft_consensus.cc:385] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.423404 29510 raft_consensus.cc:740] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.424820 29516 raft_consensus.cc:740] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.424095 29510 consensus_queue.cc:260] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.428319 29464 raft_consensus.cc:3060] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.429090 29510 ts_tablet_manager.cc:1434] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:28:16.429337 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dd764d395b4a1db1fa0542bad9979b" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:16.430590 29510 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:16.439435 29820 consensus_queue.cc:1048] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.425535 29516 consensus_queue.cc:260] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:16.441069 29893 raft_consensus.cc:697] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:16.465780 29516 ts_tablet_manager.cc:1434] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.232s	user 0.009s	sys 0.014s
I20260709 12:28:16.472370 29237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dd764d395b4a1db1fa0542bad9979b" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:16.466599 29510 tablet_bootstrap.cc:654] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:16.479655 29384 raft_consensus.cc:3060] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.440570 29390 raft_consensus.cc:2468] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:16.497645 29516 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:16.497870 29509 tablet_bootstrap.cc:492] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:16.502820 29509 ts_tablet_manager.cc:1403] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.417s	user 0.034s	sys 0.020s
I20260709 12:28:16.514997 29509 raft_consensus.cc:359] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.516203 29311 raft_consensus.cc:2468] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:16.516831 29893 consensus_queue.cc:237] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.526007 29427 leader_election.cc:304] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:16.526248 29509 raft_consensus.cc:385] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.540791 29509 raft_consensus.cc:740] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.548890 29516 tablet_bootstrap.cc:654] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:16.551317 29904 raft_consensus.cc:2749] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:16.573237 29509 consensus_queue.cc:260] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.655165 29509 ts_tablet_manager.cc:1434] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.152s	user 0.011s	sys 0.000s
I20260709 12:28:16.670188 29427 leader_election.cc:304] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:16.649507 29895 raft_consensus.cc:2749] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:16.682185 29430 leader_election.cc:304] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
W20260709 12:28:16.684471 29356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 51330.5us
I20260709 12:28:16.692395 29509 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:16.686498 29904 raft_consensus.cc:2804] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:16.689778 29791 raft_consensus.cc:2804] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:16.674997 29711 consensus_queue.cc:1048] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
W20260709 12:28:16.711668 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 150220us
I20260709 12:28:16.717676 29513 tablet_bootstrap.cc:492] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:16.718297 29513 ts_tablet_manager.cc:1403] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.543s	user 0.029s	sys 0.016s
I20260709 12:28:16.701743 29789 consensus_queue.cc:1048] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 12:28:16.713124 29207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 151712us
I20260709 12:28:16.754158 29510 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:16.754844 29510 ts_tablet_manager.cc:1403] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.325s	user 0.009s	sys 0.016s
I20260709 12:28:16.756738 29513 raft_consensus.cc:359] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.740871 29897 raft_consensus.cc:493] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dbe6e4429184e5fb137cae093024bce)
I20260709 12:28:16.759742 29513 raft_consensus.cc:385] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.760228 29513 raft_consensus.cc:740] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.740245 29904 raft_consensus.cc:697] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:16.792440 29516 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:16.794724 29513 consensus_queue.cc:260] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.793999 29516 ts_tablet_manager.cc:1403] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.297s	user 0.012s	sys 0.030s
I20260709 12:28:16.792395 29897 raft_consensus.cc:515] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
W20260709 12:28:16.792694 29934 log.cc:927] Time spent T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:28:16.804029 29513 ts_tablet_manager.cc:1434] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.001s
I20260709 12:28:16.807523 29942 consensus_queue.cc:1048] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.805433 29510 raft_consensus.cc:359] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:16.819406 29509 tablet_bootstrap.cc:654] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:16.825299 29510 raft_consensus.cc:385] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.825676 29510 raft_consensus.cc:740] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.830770 29510 consensus_queue.cc:260] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
W20260709 12:28:16.839819 29356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 96586us
W20260709 12:28:16.823122 29207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 63718.7us
I20260709 12:28:16.839380 29791 raft_consensus.cc:697] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:16.852195 29510 ts_tablet_manager.cc:1434] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.097s	user 0.018s	sys 0.005s
I20260709 12:28:16.852588 29513 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:16.856439 29463 raft_consensus.cc:3060] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.850000 29904 consensus_queue.cc:237] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:16.873463 29236 raft_consensus.cc:2468] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:16.877807 29238 raft_consensus.cc:3060] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.888064 29510 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
W20260709 12:28:16.959035 29952 log.cc:927] Time spent T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:28:16.953533 29791 consensus_queue.cc:237] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:16.975067 29510 tablet_bootstrap.cc:654] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:16.986583 29876 raft_consensus.cc:493] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.994426 29516 raft_consensus.cc:359] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:16.995326 29516 raft_consensus.cc:385] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:16.995606 29516 raft_consensus.cc:740] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.996335 29516 consensus_queue.cc:260] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:16.998088 29516 ts_tablet_manager.cc:1434] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.180s	user 0.005s	sys 0.001s
I20260709 12:28:16.997709 29876 raft_consensus.cc:515] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.001435 29897 leader_election.cc:290] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:16.998093 29945 consensus_queue.cc:1048] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:28:17.020644 29461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:16.991978 29207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 63388us
W20260709 12:28:17.052455 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:17.060945 29509 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:17.061530 29509 ts_tablet_manager.cc:1403] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.385s	user 0.019s	sys 0.012s
I20260709 12:28:17.069669 29513 tablet_bootstrap.cc:654] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.072124 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:17.050048 29904 raft_consensus.cc:493] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.078685 29904 raft_consensus.cc:515] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:17.079993 29946 raft_consensus.cc:493] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.080613 29946 raft_consensus.cc:515] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.081959 29904 leader_election.cc:290] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:17.087060 29876 leader_election.cc:290] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:17.096297 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a89b86cbfd049bb9445919c85a2a661" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:17.077541 29509 raft_consensus.cc:359] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:17.104333 29509 raft_consensus.cc:385] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.104929 29509 raft_consensus.cc:740] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.060024 29820 raft_consensus.cc:493] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
W20260709 12:28:17.117045 29427 consensus_peers.cc:597] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:17.117807 29427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 303260us
I20260709 12:28:17.106568 29509 consensus_queue.cc:260] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:17.134850 29946 leader_election.cc:290] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:17.155216 29516 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:17.156508 29509 ts_tablet_manager.cc:1434] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.000s
I20260709 12:28:17.142725 29820 raft_consensus.cc:515] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:17.184320 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bc4e256b44d7bad8a2915325ebf16" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:17.185351 29382 raft_consensus.cc:2393] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c098fe137f19465bb9f67dbd64763b72 in current term 1: Already voted for candidate 8dbe6e4429184e5fb137cae093024bce in this term.
I20260709 12:28:17.189831 29388 raft_consensus.cc:3060] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.197675 29516 tablet_bootstrap.cc:654] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:17.208248 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 139945us
I20260709 12:28:17.211073 29923 raft_consensus.cc:493] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96bd9c3c81e04118abc2fe11d2b361ed)
I20260709 12:28:17.211647 29923 raft_consensus.cc:515] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:17.212229 29820 leader_election.cc:290] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:17.214951 29207 leader_election.cc:304] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.218797 29925 raft_consensus.cc:2749] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:17.218916 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bb3ad82b4543fb90ad68213c62327e" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:17.232122 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:17.249572 29510 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:17.250245 29510 ts_tablet_manager.cc:1403] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.363s	user 0.024s	sys 0.009s
I20260709 12:28:17.238080 29940 raft_consensus.cc:493] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.255981 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a89b86cbfd049bb9445919c85a2a661" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:17.257093 29463 raft_consensus.cc:2393] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96bd9c3c81e04118abc2fe11d2b361ed in current term 1: Already voted for candidate c098fe137f19465bb9f67dbd64763b72 in this term.
I20260709 12:28:17.264386 29461 raft_consensus.cc:3060] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.258935 29923 leader_election.cc:290] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:17.268047 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bc4e256b44d7bad8a2915325ebf16" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:17.270905 29509 tablet_bootstrap.cc:492] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:17.261274 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:17.257968 29940 raft_consensus.cc:515] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:17.280047 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4bb3ad82b4543fb90ad68213c62327e" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:17.296452 29353 leader_election.cc:304] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.298151 29233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:17.315878 29513 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:17.316634 29513 ts_tablet_manager.cc:1403] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.474s	user 0.018s	sys 0.006s
I20260709 12:28:17.319795 29893 consensus_queue.cc:1048] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:17.320104 29516 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:17.322122 29516 ts_tablet_manager.cc:1403] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.001s
I20260709 12:28:17.322501 29279 leader_election.cc:304] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:17.324033 29928 raft_consensus.cc:3060] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.308481 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:17.326409 29207 leader_election.cc:343] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:17.325141 29516 raft_consensus.cc:359] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.327358 29516 raft_consensus.cc:385] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.327639 29516 raft_consensus.cc:740] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.329110 29516 consensus_queue.cc:260] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.329327 29510 raft_consensus.cc:359] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.330003 29510 raft_consensus.cc:385] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.331561 29789 raft_consensus.cc:2749] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:17.331808 29876 consensus_queue.cc:1048] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:17.333734 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:17.346208 29509 tablet_bootstrap.cc:654] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.333734 29513 raft_consensus.cc:359] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:17.351217 29513 raft_consensus.cc:385] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.351658 29513 raft_consensus.cc:740] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.349367 29516 ts_tablet_manager.cc:1434] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:28:17.338583 29928 raft_consensus.cc:2749] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:17.346251 29940 leader_election.cc:290] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:17.353036 29513 consensus_queue.cc:260] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:17.360067 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:17.330279 29510 raft_consensus.cc:740] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.374205 29389 raft_consensus.cc:2468] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:17.374939 29513 ts_tablet_manager.cc:1434] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 12:28:17.374624 29510 consensus_queue.cc:260] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.376078 29513 tablet_bootstrap.cc:492] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:17.377087 29510 ts_tablet_manager.cc:1434] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.126s	user 0.006s	sys 0.000s
I20260709 12:28:17.378278 29510 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:17.372210 29516 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:17.390482 29353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 80750.3us
I20260709 12:28:17.394150 29353 leader_election.cc:304] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.391918 29427 leader_election.cc:304] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:17.396586 29204 leader_election.cc:304] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.370931 29137 catalog_manager.cc:5697] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:17.399612 29137 catalog_manager.cc:5697] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:17.404048 29204 leader_election.cc:304] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.412133 29942 raft_consensus.cc:2749] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:17.423578 29516 tablet_bootstrap.cc:654] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.423986 29940 raft_consensus.cc:2804] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:17.428507 29940 raft_consensus.cc:493] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:17.428978 29940 raft_consensus.cc:3060] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.423053 29942 raft_consensus.cc:493] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.429857 29942 raft_consensus.cc:515] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.431824 29932 raft_consensus.cc:493] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.432380 29932 raft_consensus.cc:515] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:17.414537 29923 raft_consensus.cc:2749] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:17.423058 29941 raft_consensus.cc:2749] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:17.443938 29510 tablet_bootstrap.cc:654] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.434751 29932 leader_election.cc:290] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:17.448647 29513 tablet_bootstrap.cc:654] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.454727 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52884fe0058e4164905c706a05528483" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:17.456496 29430 leader_election.cc:343] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:17.457127 29942 leader_election.cc:290] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:17.458954 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:17.461825 29940 raft_consensus.cc:515] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:17.464926 29940 leader_election.cc:290] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:17.466634 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:17.467478 29314 raft_consensus.cc:3060] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:17.476405 29353 leader_election.cc:343] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:17.482282 29235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:17.484422 29235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52884fe0058e4164905c706a05528483" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:17.485219 29235 raft_consensus.cc:2468] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:17.486253 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:17.487217 29389 raft_consensus.cc:3060] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.490515 29427 leader_election.cc:304] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.495849 29314 raft_consensus.cc:2468] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:17.499378 29207 leader_election.cc:304] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:17.500896 29940 raft_consensus.cc:2804] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:17.504336 29509 tablet_bootstrap.cc:492] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:17.504904 29509 ts_tablet_manager.cc:1403] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.245s	user 0.011s	sys 0.008s
W20260709 12:28:17.506651 29353 leader_election.cc:343] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:17.507104 29353 leader_election.cc:304] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:17.514227 29510 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:17.514930 29510 ts_tablet_manager.cc:1403] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.008s
I20260709 12:28:17.505770 29942 raft_consensus.cc:2804] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:17.519380 29942 raft_consensus.cc:493] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:17.519811 29942 raft_consensus.cc:3060] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.510632 29820 raft_consensus.cc:2749] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:17.528017 29943 consensus_queue.cc:1048] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:17.530656 29942 raft_consensus.cc:515] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.505512 29940 raft_consensus.cc:697] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:17.532866 29940 consensus_queue.cc:237] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:17.534801 29235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52884fe0058e4164905c706a05528483" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:17.535522 29235 raft_consensus.cc:3060] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.540614 29942 leader_election.cc:290] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:17.543375 29942 consensus_queue.cc:1048] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:17.543673 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52884fe0058e4164905c706a05528483" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
W20260709 12:28:17.545178 29430 leader_election.cc:343] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:17.552871 29942 consensus_queue.cc:1048] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:17.578116 29235 raft_consensus.cc:2468] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:17.585402 29510 raft_consensus.cc:359] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.585966 29427 leader_election.cc:304] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.587457 29942 raft_consensus.cc:2804] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:17.588016 29942 raft_consensus.cc:697] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:17.588725 29516 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:17.589290 29516 ts_tablet_manager.cc:1403] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.217s	user 0.008s	sys 0.014s
I20260709 12:28:17.588956 29942 consensus_queue.cc:237] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.586293 29510 raft_consensus.cc:385] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.577939 29923 raft_consensus.cc:493] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.593470 29510 raft_consensus.cc:740] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.602707 29883 consensus_queue.cc:1048] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:17.599939 29923 raft_consensus.cc:515] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.605831 29923 leader_election.cc:290] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:17.607470 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b597f990ad43f0b26beedf929c6aff" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:17.609917 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b597f990ad43f0b26beedf929c6aff" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:17.612187 29207 leader_election.cc:304] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.614102 29937 raft_consensus.cc:2749] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:17.614548 29516 raft_consensus.cc:359] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.615788 29516 raft_consensus.cc:385] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.616092 29516 raft_consensus.cc:740] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.616890 29516 consensus_queue.cc:260] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.621840 29516 ts_tablet_manager.cc:1434] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
W20260709 12:28:17.628130 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 65358.7us
I20260709 12:28:17.625589 29510 consensus_queue.cc:260] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.638127 29513 tablet_bootstrap.cc:492] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:17.639372 29513 ts_tablet_manager.cc:1403] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.264s	user 0.026s	sys 0.014s
I20260709 12:28:17.625288 29389 raft_consensus.cc:2468] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:17.645584 29513 raft_consensus.cc:359] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.646708 29513 raft_consensus.cc:385] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.646629 29509 raft_consensus.cc:359] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.647198 29513 raft_consensus.cc:740] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.647518 29509 raft_consensus.cc:385] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.647858 29509 raft_consensus.cc:740] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.652006 29509 consensus_queue.cc:260] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.689105 29516 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:17.691082 29509 ts_tablet_manager.cc:1434] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.186s	user 0.006s	sys 0.003s
I20260709 12:28:17.690830 29513 consensus_queue.cc:260] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.692847 29510 ts_tablet_manager.cc:1434] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.178s	user 0.010s	sys 0.000s
I20260709 12:28:17.705758 29513 ts_tablet_manager.cc:1434] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:28:17.710494 29510 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:17.717337 29509 tablet_bootstrap.cc:492] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:17.746598 29513 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:17.765127 29509 tablet_bootstrap.cc:654] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.768273 29513 tablet_bootstrap.cc:654] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.775434 29516 tablet_bootstrap.cc:654] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:17.785852 29984 log.cc:927] Time spent T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:28:17.799903 29987 log.cc:927] Time spent T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:28:17.811774 29510 tablet_bootstrap.cc:654] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.841727 29941 raft_consensus.cc:493] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.842489 29941 raft_consensus.cc:515] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.843335 29943 raft_consensus.cc:493] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.843995 29943 raft_consensus.cc:515] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.845191 29941 leader_election.cc:290] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:17.847081 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:17.848436 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:17.848971 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae36f5a0ab77484ba95cc4f091a975c4" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:17.849762 29356 leader_election.cc:343] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:17.850881 29430 leader_election.cc:343] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:17.851711 29353 leader_election.cc:343] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:17.852173 29353 leader_election.cc:304] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.852646 29238 raft_consensus.cc:3060] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.853482 29941 raft_consensus.cc:2749] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:17.854558 29943 leader_election.cc:290] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:17.852497 29235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae36f5a0ab77484ba95cc4f091a975c4" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:17.858915 29235 raft_consensus.cc:2468] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:17.862007 29509 tablet_bootstrap.cc:492] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:17.862937 29509 ts_tablet_manager.cc:1403] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.158s	user 0.036s	sys 0.038s
I20260709 12:28:17.866031 29509 raft_consensus.cc:359] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.868891 29509 raft_consensus.cc:385] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.869221 29509 raft_consensus.cc:740] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.871140 29427 leader_election.cc:304] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:17.871799 29516 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:17.872427 29516 ts_tablet_manager.cc:1403] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.229s	user 0.014s	sys 0.006s
I20260709 12:28:17.873646 29509 consensus_queue.cc:260] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:17.876531 29509 ts_tablet_manager.cc:1434] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:28:17.876757 29516 raft_consensus.cc:359] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:17.878204 29509 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:17.878683 29943 raft_consensus.cc:2804] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:17.886704 29943 raft_consensus.cc:493] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:17.887377 29943 raft_consensus.cc:3060] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.880358 29510 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:17.895004 29510 ts_tablet_manager.cc:1403] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.000s
I20260709 12:28:17.900475 29135 catalog_manager.cc:5697] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:17.897257 29516 raft_consensus.cc:385] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.902137 29516 raft_consensus.cc:740] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.903059 29516 consensus_queue.cc:260] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:17.910472 29509 tablet_bootstrap.cc:654] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.915565 29516 ts_tablet_manager.cc:1434] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:28:17.916949 29516 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:17.919008 29510 raft_consensus.cc:359] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:17.919860 29510 raft_consensus.cc:385] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.920151 29510 raft_consensus.cc:740] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.921064 29510 consensus_queue.cc:260] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:17.922590 29943 raft_consensus.cc:515] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:17.927982 29138 catalog_manager.cc:5697] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:17.934015 29510 ts_tablet_manager.cc:1434] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:28:17.935428 29510 tablet_bootstrap.cc:492] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:17.940665 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae36f5a0ab77484ba95cc4f091a975c4" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
W20260709 12:28:17.942094 29430 leader_election.cc:343] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:17.942920 29943 leader_election.cc:290] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:17.932425 29516 tablet_bootstrap.cc:654] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.955840 29134 catalog_manager.cc:5697] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:17.980085 29513 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:17.981484 29513 ts_tablet_manager.cc:1403] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.239s	user 0.032s	sys 0.010s
I20260709 12:28:17.991869 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae36f5a0ab77484ba95cc4f091a975c4" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:17.994344 29238 raft_consensus.cc:3060] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.973628 29510 tablet_bootstrap.cc:654] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.021004 29238 raft_consensus.cc:2468] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:18.022094 29427 leader_election.cc:304] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:18.025018 29968 raft_consensus.cc:2804] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:18.027858 29968 raft_consensus.cc:697] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:18.034507 29235 raft_consensus.cc:3060] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.035535 29513 raft_consensus.cc:359] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.037707 29513 raft_consensus.cc:385] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.038122 29513 raft_consensus.cc:740] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.041425 29513 consensus_queue.cc:260] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
W20260709 12:28:18.050016 29430 consensus_peers.cc:597] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:18.034276 29968 consensus_queue.cc:237] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:18.055332 29513 ts_tablet_manager.cc:1434] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.003s
I20260709 12:28:18.059253 29513 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:18.063164 29923 consensus_queue.cc:1048] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:18.082571 29785 raft_consensus.cc:493] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.082949 29513 tablet_bootstrap.cc:654] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.083220 29785 raft_consensus.cc:515] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.085534 29785 leader_election.cc:290] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:18.088744 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:18.092295 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:18.093104 29314 raft_consensus.cc:2468] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
W20260709 12:28:18.097676 29204 leader_election.cc:343] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:18.109226 29509 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:18.110059 29509 ts_tablet_manager.cc:1403] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.232s	user 0.016s	sys 0.032s
I20260709 12:28:18.131515 29883 consensus_queue.cc:1048] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:18.146695 29516 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:18.147321 29516 ts_tablet_manager.cc:1403] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.231s	user 0.042s	sys 0.032s
I20260709 12:28:18.150288 29516 raft_consensus.cc:359] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.151043 29516 raft_consensus.cc:385] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.145880 29509 raft_consensus.cc:359] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.151798 29509 raft_consensus.cc:385] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.152326 29509 raft_consensus.cc:740] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.151353 29516 raft_consensus.cc:740] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.157483 29509 consensus_queue.cc:260] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.168238 29516 consensus_queue.cc:260] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.172551 29516 ts_tablet_manager.cc:1434] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:28:18.173691 29516 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:18.134155 29207 leader_election.cc:304] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:18.182145 29513 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:18.182812 29513 ts_tablet_manager.cc:1403] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.000s
I20260709 12:28:18.189049 29509 ts_tablet_manager.cc:1434] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 12:28:18.184193 29941 raft_consensus.cc:493] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.187436 29945 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.188027 29785 raft_consensus.cc:2804] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.209178 29681 raft_consensus.cc:493] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.209824 29681 raft_consensus.cc:515] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
W20260709 12:28:18.195140 29207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 71565.8us
I20260709 12:28:18.229743 29509 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:18.204213 29785 raft_consensus.cc:493] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.249785 29510 tablet_bootstrap.cc:492] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:18.204912 29945 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.250379 29510 ts_tablet_manager.cc:1403] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.315s	user 0.006s	sys 0.020s
I20260709 12:28:18.244031 29785 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.253530 29510 raft_consensus.cc:359] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
W20260709 12:28:18.270311 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:18.259974 29516 tablet_bootstrap.cc:654] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.259476 29681 leader_election.cc:290] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:18.199958 29941 raft_consensus.cc:515] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:18.278019 29461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b328ca221d47f2a2ce812ca6545c69" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:18.278766 29941 leader_election.cc:290] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:18.280807 29510 raft_consensus.cc:385] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.281169 29510 raft_consensus.cc:740] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.260581 29134 catalog_manager.cc:5697] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:18.287165 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b328ca221d47f2a2ce812ca6545c69" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:18.281898 29510 consensus_queue.cc:260] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:18.261816 29883 raft_consensus.cc:493] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.316836 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:18.299791 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b328ca221d47f2a2ce812ca6545c69" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:18.320247 29312 raft_consensus.cc:2468] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
W20260709 12:28:18.323019 29999 log.cc:927] Time spent T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:28:18.296608 29461 raft_consensus.cc:2468] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:18.324823 29945 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:18.326923 29356 leader_election.cc:304] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:18.327348 29510 ts_tablet_manager.cc:1434] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 12:28:18.328568 29510 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:18.330989 29932 raft_consensus.cc:2804] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.331473 29932 raft_consensus.cc:493] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.331853 29932 raft_consensus.cc:3060] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.317739 29883 raft_consensus.cc:515] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
W20260709 12:28:18.339107 29353 leader_election.cc:343] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:18.350848 29923 consensus_queue.cc:1048] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:18.358978 30003 log.cc:927] Time spent T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:28:18.357529 29513 raft_consensus.cc:359] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.363998 29513 raft_consensus.cc:385] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.364414 29513 raft_consensus.cc:740] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.363081 29279 leader_election.cc:304] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:18.375654 29681 raft_consensus.cc:2804] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.376092 29681 raft_consensus.cc:493] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.376432 29681 raft_consensus.cc:3060] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.376925 29513 consensus_queue.cc:260] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.377578 29932 raft_consensus.cc:515] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
W20260709 12:28:18.404714 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 102468us
I20260709 12:28:18.406977 29509 tablet_bootstrap.cc:654] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.410277 29513 ts_tablet_manager.cc:1434] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.227s	user 0.007s	sys 0.002s
I20260709 12:28:18.438902 29803 raft_consensus.cc:493] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.439548 29803 raft_consensus.cc:515] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.441736 29803 leader_election.cc:290] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:18.444301 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b328ca221d47f2a2ce812ca6545c69" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:18.445281 29390 raft_consensus.cc:2393] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c098fe137f19465bb9f67dbd64763b72 in current term 1: Already voted for candidate 96bd9c3c81e04118abc2fe11d2b361ed in this term.
I20260709 12:28:18.447327 29785 raft_consensus.cc:515] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.485299 29510 tablet_bootstrap.cc:654] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.486657 29237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861e1b95735b4e49a7d677502df85d2c" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:18.487972 29509 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:18.488713 29509 ts_tablet_manager.cc:1403] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.290s	user 0.012s	sys 0.024s
I20260709 12:28:18.496224 29932 leader_election.cc:290] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:18.480526 29883 leader_election.cc:290] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:18.504908 29785 leader_election.cc:290] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:18.515808 29681 raft_consensus.cc:515] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:18.505746 29233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:18.528326 29516 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:18.528935 29516 ts_tablet_manager.cc:1403] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.356s	user 0.052s	sys 0.055s
I20260709 12:28:18.529100 29681 leader_election.cc:290] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:18.535156 29513 tablet_bootstrap.cc:492] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:18.540421 29516 raft_consensus.cc:359] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.541260 29516 raft_consensus.cc:385] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.541527 29516 raft_consensus.cc:740] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
W20260709 12:28:18.546751 29427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 124472us
I20260709 12:28:18.542248 29516 consensus_queue.cc:260] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.542937 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861e1b95735b4e49a7d677502df85d2c" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:18.562371 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:18.571026 29516 ts_tablet_manager.cc:1434] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:28:18.572958 29937 raft_consensus.cc:493] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.573553 29937 raft_consensus.cc:515] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.545166 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:18.576185 29316 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.578570 29516 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:18.579861 29937 leader_election.cc:290] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:18.581379 29509 raft_consensus.cc:359] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.582453 29509 raft_consensus.cc:385] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.582736 29509 raft_consensus.cc:740] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.589183 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b328ca221d47f2a2ce812ca6545c69" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:18.589928 29464 raft_consensus.cc:3060] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:18.591045 29279 leader_election.cc:343] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:18.595161 29279 leader_election.cc:343] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:18.593801 29353 leader_election.cc:343] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:18.597864 29279 leader_election.cc:304] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:18.598425 29353 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:18.601727 29681 raft_consensus.cc:2749] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:18.608525 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b328ca221d47f2a2ce812ca6545c69" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:18.609025 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:18.609409 29314 raft_consensus.cc:2393] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96bd9c3c81e04118abc2fe11d2b361ed in current term 1: Already voted for candidate c098fe137f19465bb9f67dbd64763b72 in this term.
I20260709 12:28:18.609774 29385 raft_consensus.cc:2468] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:18.611358 30012 raft_consensus.cc:2749] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:18.613118 29239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:18.613925 29239 raft_consensus.cc:2468] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:18.616109 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:18.616930 29385 raft_consensus.cc:2468] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:18.585598 29940 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.624593 29940 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
W20260709 12:28:18.626559 29204 leader_election.cc:343] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:18.626961 29940 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:18.627727 29461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b328ca221d47f2a2ce812ca6545c69" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:18.627943 29204 leader_election.cc:304] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:18.628787 29923 raft_consensus.cc:2804] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.629199 29923 raft_consensus.cc:493] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.629532 29923 raft_consensus.cc:3060] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.634565 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b328ca221d47f2a2ce812ca6545c69" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:18.635496 29389 raft_consensus.cc:2393] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c098fe137f19465bb9f67dbd64763b72 in current term 1: Already voted for candidate 96bd9c3c81e04118abc2fe11d2b361ed in this term.
I20260709 12:28:18.606047 29509 consensus_queue.cc:260] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.614250 29316 raft_consensus.cc:2468] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:18.649063 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:18.650003 29382 raft_consensus.cc:2468] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:18.650482 29353 leader_election.cc:304] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:18.652786 29207 leader_election.cc:304] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:18.642259 29464 raft_consensus.cc:2468] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:18.661728 29509 ts_tablet_manager.cc:1434] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.173s	user 0.008s	sys 0.000s
I20260709 12:28:18.664914 29461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:18.665963 29461 raft_consensus.cc:2468] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:18.669344 29204 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:18.672686 29279 leader_election.cc:304] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:18.680500 29681 raft_consensus.cc:2804] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:18.681207 29681 raft_consensus.cc:697] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:18.683954 29681 consensus_queue.cc:237] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:18.667933 29940 raft_consensus.cc:2804] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:18.670982 30009 raft_consensus.cc:2749] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:18.692461 29509 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
I20260709 12:28:18.683395 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:18.711532 29945 raft_consensus.cc:493] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.717350 29945 raft_consensus.cc:515] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.719823 29945 leader_election.cc:290] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:18.720907 29513 tablet_bootstrap.cc:654] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:18.723012 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 53761.1us
I20260709 12:28:18.723203 29940 raft_consensus.cc:697] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:18.724874 29785 raft_consensus.cc:2804] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.725469 29785 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.725948 29785 raft_consensus.cc:3060] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.731407 29234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861e1b95735b4e49a7d677502df85d2c" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:18.724360 29940 consensus_queue.cc:237] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:18.723016 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861e1b95735b4e49a7d677502df85d2c" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:18.748458 29314 raft_consensus.cc:2468] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 0.
W20260709 12:28:18.754922 29204 leader_election.cc:343] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:18.762737 29510 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:18.763525 29510 ts_tablet_manager.cc:1403] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.435s	user 0.018s	sys 0.008s
I20260709 12:28:18.799482 29356 leader_election.cc:304] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
W20260709 12:28:18.800318 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 45441.6us
W20260709 12:28:18.801810 29353 leader_election.cc:343] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:18.804670 29427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 113428us
W20260709 12:28:18.805665 29430 consensus_peers.cc:597] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:18.806161 29427 leader_election.cc:304] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:18.821759 29509 tablet_bootstrap.cc:654] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.807353 29945 raft_consensus.cc:2804] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.844287 29516 tablet_bootstrap.cc:654] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.815249 30016 raft_consensus.cc:2804] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.855142 29923 raft_consensus.cc:515] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.856096 29785 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:18.857632 29923 leader_election.cc:290] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:18.860960 29785 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:18.863198 29386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:18.863957 29386 raft_consensus.cc:3060] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.834728 29945 raft_consensus.cc:493] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.864648 29945 raft_consensus.cc:3060] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.847714 30016 raft_consensus.cc:493] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.862071 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:18.870383 30016 raft_consensus.cc:3060] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.870803 29388 raft_consensus.cc:3060] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.875773 29510 raft_consensus.cc:359] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:18.876663 29510 raft_consensus.cc:385] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.876951 29510 raft_consensus.cc:740] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.878476 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:18.878894 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
W20260709 12:28:18.881464 29204 leader_election.cc:343] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:18.877627 29510 consensus_queue.cc:260] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:18.885548 29510 ts_tablet_manager.cc:1434] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.003s
I20260709 12:28:18.887398 29386 raft_consensus.cc:2468] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
W20260709 12:28:18.891809 29207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 59760.9us
I20260709 12:28:18.892346 29204 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:18.897768 29785 raft_consensus.cc:2804] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:18.901669 29785 raft_consensus.cc:697] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:18.924611 29510 tablet_bootstrap.cc:492] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:18.928481 29513 tablet_bootstrap.cc:492] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:18.929124 29513 ts_tablet_manager.cc:1403] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.418s	user 0.025s	sys 0.029s
I20260709 12:28:18.934896 29945 raft_consensus.cc:515] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
W20260709 12:28:18.936218 29427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 99664.8us
I20260709 12:28:18.939978 29509 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
I20260709 12:28:18.958906 29509 ts_tablet_manager.cc:1403] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.272s	user 0.013s	sys 0.015s
I20260709 12:28:18.973264 29785 consensus_queue.cc:237] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:19.019186 29513 raft_consensus.cc:359] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:19.023249 29513 raft_consensus.cc:385] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.023617 29513 raft_consensus.cc:740] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.027451 29513 consensus_queue.cc:260] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:18.986120 29388 raft_consensus.cc:2468] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:19.012573 30032 consensus_queue.cc:1048] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:28:19.045647 29513 ts_tablet_manager.cc:1434] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.116s	user 0.010s	sys 0.001s
I20260709 12:28:19.045712 30016 raft_consensus.cc:515] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:19.048231 29459 raft_consensus.cc:2393] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 629ba7d0b7eb4d9b8832b0f605f79443 in current term 1: Already voted for candidate 8dbe6e4429184e5fb137cae093024bce in this term.
I20260709 12:28:19.050729 29510 tablet_bootstrap.cc:654] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.057920 30016 leader_election.cc:290] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:19.058897 29945 leader_election.cc:290] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:19.061178 29204 leader_election.cc:304] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:19.064538 30007 raft_consensus.cc:2804] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:19.065093 30007 raft_consensus.cc:697] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:19.064860 29516 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:19.068917 29516 ts_tablet_manager.cc:1403] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.491s	user 0.024s	sys 0.028s
I20260709 12:28:19.066236 30007 consensus_queue.cc:237] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:19.073222 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:19.074234 29382 raft_consensus.cc:2393] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dbe6e4429184e5fb137cae093024bce in current term 1: Already voted for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in this term.
I20260709 12:28:19.069674 29513 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:19.080127 29509 raft_consensus.cc:359] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:19.081287 29509 raft_consensus.cc:385] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.083536 29509 raft_consensus.cc:740] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.095846 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861e1b95735b4e49a7d677502df85d2c" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:19.096690 29313 raft_consensus.cc:3060] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:19.094478 29509 consensus_queue.cc:260] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:19.101774 29234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861e1b95735b4e49a7d677502df85d2c" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:19.106457 29134 catalog_manager.cc:5697] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:19.166646 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 60927.4us
W20260709 12:28:19.175421 29356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 72921.7us
W20260709 12:28:19.176437 29353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 71498.3us
I20260709 12:28:19.180698 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:19.185928 29681 consensus_queue.cc:1048] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:19.194221 29427 leader_election.cc:304] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:19.196967 30032 raft_consensus.cc:2749] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:19.212293 29509 ts_tablet_manager.cc:1434] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.253s	user 0.009s	sys 0.002s
I20260709 12:28:19.213898 29509 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed: Bootstrap starting.
W20260709 12:28:19.221909 29353 leader_election.cc:343] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:19.226189 29513 tablet_bootstrap.cc:654] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.234345 29516 raft_consensus.cc:359] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:19.235452 29516 raft_consensus.cc:385] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.235812 29516 raft_consensus.cc:740] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.236675 29516 consensus_queue.cc:260] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:19.241652 30025 raft_consensus.cc:493] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.242214 30025 raft_consensus.cc:515] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
W20260709 12:28:19.249925 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 65283.8us
I20260709 12:28:19.251272 29510 tablet_bootstrap.cc:492] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:19.252243 29510 ts_tablet_manager.cc:1403] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.330s	user 0.011s	sys 0.012s
I20260709 12:28:19.252851 30025 leader_election.cc:290] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:19.253877 30031 consensus_queue.cc:1048] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:19.256062 29384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:19.256819 29384 raft_consensus.cc:2468] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:19.265815 29681 consensus_queue.cc:1048] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:19.268652 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:19.275982 29516 ts_tablet_manager.cc:1434] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
I20260709 12:28:19.274286 29279 leader_election.cc:304] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:19.277381 29681 raft_consensus.cc:2804] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:19.277747 29681 raft_consensus.cc:493] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:19.278048 29681 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:19.299925 29313 raft_consensus.cc:2468] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:19.306859 29513 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:19.307482 29513 ts_tablet_manager.cc:1403] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.261s	user 0.022s	sys 0.003s
I20260709 12:28:19.310797 29513 raft_consensus.cc:359] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.311553 29513 raft_consensus.cc:385] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.311838 29513 raft_consensus.cc:740] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.312675 29513 consensus_queue.cc:260] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.315359 29513 ts_tablet_manager.cc:1434] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:19.316743 29513 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:19.320838 29509 tablet_bootstrap.cc:654] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.323331 29513 tablet_bootstrap.cc:654] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.327170 29356 leader_election.cc:304] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:19.330227 29681 raft_consensus.cc:515] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:19.336439 29516 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:19.350574 29681 leader_election.cc:290] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:19.346972 30026 raft_consensus.cc:493] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.352656 30026 raft_consensus.cc:515] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.338425 29941 raft_consensus.cc:2804] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:19.356349 29941 raft_consensus.cc:697] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:19.360334 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:19.355288 30026 leader_election.cc:290] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:19.386436 29516 tablet_bootstrap.cc:654] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.377923 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
W20260709 12:28:19.388568 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:19.377197 29384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:19.357748 29941 consensus_queue.cc:237] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:19.420861 30004 raft_consensus.cc:493] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.430681 30004 raft_consensus.cc:515] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:19.416318 29384 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:19.443254 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861e1b95735b4e49a7d677502df85d2c" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:19.444453 29314 raft_consensus.cc:2393] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 629ba7d0b7eb4d9b8832b0f605f79443 in current term 1: Already voted for candidate 96bd9c3c81e04118abc2fe11d2b361ed in this term.
W20260709 12:28:19.499439 29207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 53585.2us
I20260709 12:28:19.540867 29510 raft_consensus.cc:359] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:19.541746 29510 raft_consensus.cc:385] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.542083 29510 raft_consensus.cc:740] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.543267 29510 consensus_queue.cc:260] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:19.546864 29510 ts_tablet_manager.cc:1434] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.294s	user 0.010s	sys 0.000s
I20260709 12:28:19.551551 29459 raft_consensus.cc:2468] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 0.
I20260709 12:28:19.555634 29385 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:19.556901 29384 raft_consensus.cc:2468] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:19.562319 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861e1b95735b4e49a7d677502df85d2c" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:19.565156 29204 leader_election.cc:304] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443; no voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:19.578855 29279 leader_election.cc:304] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:19.580365 30017 raft_consensus.cc:2804] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:19.581038 30017 raft_consensus.cc:697] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:19.582141 30017 consensus_queue.cc:237] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:19.591184 30005 raft_consensus.cc:3060] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:19.593916 29234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
W20260709 12:28:19.635716 29430 leader_election.cc:343] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:19.534089 30004 leader_election.cc:290] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:19.588276 30035 consensus_queue.cc:1048] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:19.643707 29138 catalog_manager.cc:5697] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:19.657599 29138 catalog_manager.cc:5697] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:19.668320 29510 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:19.679571 29681 raft_consensus.cc:493] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.680344 29681 raft_consensus.cc:515] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.672448 29460 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:19.684978 29681 leader_election.cc:290] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:19.692972 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52884fe0058e4164905c706a05528483" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:19.684674 29789 raft_consensus.cc:493] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.705927 29513 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:19.706634 29513 ts_tablet_manager.cc:1403] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.390s	user 0.016s	sys 0.002s
I20260709 12:28:19.701578 29789 raft_consensus.cc:515] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:19.744177 29789 leader_election.cc:290] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:19.765158 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:19.784593 30005 raft_consensus.cc:2749] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:19.762203 29513 raft_consensus.cc:359] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.797631 29513 raft_consensus.cc:385] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.799335 29510 tablet_bootstrap.cc:654] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.798197 29513 raft_consensus.cc:740] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.805374 29513 consensus_queue.cc:260] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
W20260709 12:28:19.814543 29430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:42675, user_credentials={real_user=slave}} blocked reactor thread for 162013us
I20260709 12:28:19.820938 29513 ts_tablet_manager.cc:1434] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.114s	user 0.010s	sys 0.000s
I20260709 12:28:19.819499 29135 catalog_manager.cc:5697] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 1 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:19.845098 29460 raft_consensus.cc:2468] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:19.860834 29513 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72: Bootstrap starting.
I20260709 12:28:19.867628 29516 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:19.868250 29516 ts_tablet_manager.cc:1403] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.539s	user 0.030s	sys 0.053s
I20260709 12:28:19.881723 29509 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed: No bootstrap required, opened a new log
W20260709 12:28:19.885890 29204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.4:34741, user_credentials={real_user=slave}} blocked reactor thread for 319579us
W20260709 12:28:19.889449 29427 leader_election.cc:343] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:19.889971 29427 leader_election.cc:304] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:19.890821 30019 raft_consensus.cc:2749] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:19.875913 29311 raft_consensus.cc:3060] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:19.896768 29516 raft_consensus.cc:359] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.903340 29516 raft_consensus.cc:385] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.903688 29516 raft_consensus.cc:740] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.904485 29516 consensus_queue.cc:260] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.905525 29513 tablet_bootstrap.cc:654] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.911549 29509 ts_tablet_manager.cc:1403] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent bootstrapping tablet: real 0.698s	user 0.022s	sys 0.009s
I20260709 12:28:19.921465 29516 ts_tablet_manager.cc:1434] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.002s
I20260709 12:28:19.922784 29516 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:19.931547 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:19.938076 29510 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:19.938702 29510 ts_tablet_manager.cc:1403] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.276s	user 0.024s	sys 0.030s
I20260709 12:28:19.938642 29509 raft_consensus.cc:359] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:19.941757 29510 raft_consensus.cc:359] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:19.942540 29510 raft_consensus.cc:385] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.942839 29510 raft_consensus.cc:740] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.944636 29510 consensus_queue.cc:260] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:19.947263 29510 ts_tablet_manager.cc:1434] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:28:19.948431 29510 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce: Bootstrap starting.
I20260709 12:28:19.949939 30009 consensus_queue.cc:1048] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:19.955346 29510 tablet_bootstrap.cc:654] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.939659 29509 raft_consensus.cc:385] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.956463 29509 raft_consensus.cc:740] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.957535 29509 consensus_queue.cc:260] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:19.964063 29509 ts_tablet_manager.cc:1434] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:28:19.966614 29513 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72: No bootstrap required, opened a new log
I20260709 12:28:19.967286 29513 ts_tablet_manager.cc:1403] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.000s
I20260709 12:28:19.969282 29134 catalog_manager.cc:5697] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:19.970415 29513 raft_consensus.cc:359] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.989431 29513 raft_consensus.cc:385] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:19.989799 29513 raft_consensus.cc:740] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Initialized, Role: FOLLOWER
I20260709 12:28:19.990617 29513 consensus_queue.cc:260] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:19.994572 29513 ts_tablet_manager.cc:1434] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:28:20.003933 30017 consensus_queue.cc:1048] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:19.973974 29516 tablet_bootstrap.cc:654] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:19.976341 29510 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce: No bootstrap required, opened a new log
I20260709 12:28:19.980711 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52884fe0058e4164905c706a05528483" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:20.007660 29510 ts_tablet_manager.cc:1403] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.004s
I20260709 12:28:19.985545 30005 raft_consensus.cc:493] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.011538 30005 raft_consensus.cc:515] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:20.012800 29510 raft_consensus.cc:359] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:20.013561 29510 raft_consensus.cc:385] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:20.013892 29510 raft_consensus.cc:740] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Initialized, Role: FOLLOWER
I20260709 12:28:20.015461 30005 leader_election.cc:290] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:20.016516 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:20.016422 29510 consensus_queue.cc:260] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:20.017352 29314 raft_consensus.cc:2468] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
I20260709 12:28:20.018450 29207 leader_election.cc:304] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:20.019209 29510 ts_tablet_manager.cc:1434] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 12:28:20.019631 30005 raft_consensus.cc:2804] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:20.020063 30005 raft_consensus.cc:493] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:20.020404 30005 raft_consensus.cc:3060] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:20.028501 30017 raft_consensus.cc:493] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.029117 30017 raft_consensus.cc:515] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:20.031332 30017 leader_election.cc:290] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:20.032801 29138 catalog_manager.cc:5697] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.041878 30005 raft_consensus.cc:515] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:20.056974 30005 leader_election.cc:290] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:20.062453 30005 consensus_queue.cc:1048] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:20.063371 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:20.067114 30031 consensus_queue.cc:1048] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:20.072196 29461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae36f5a0ab77484ba95cc4f091a975c4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:20.073748 29311 raft_consensus.cc:3060] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:20.083329 29353 leader_election.cc:304] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:20.085666 29932 raft_consensus.cc:2749] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:20.099875 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:20.100349 30055 consensus_queue.cc:1048] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:20.101303 29462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:20.100665 29463 raft_consensus.cc:2468] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 0.
W20260709 12:28:20.105434 29204 consensus_peers.cc:597] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 -> Peer 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741): Couldn't send request to peer 8dbe6e4429184e5fb137cae093024bce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:20.117146 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae36f5a0ab77484ba95cc4f091a975c4" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:20.132258 29516 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: No bootstrap required, opened a new log
I20260709 12:28:20.132949 29516 ts_tablet_manager.cc:1403] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.210s	user 0.005s	sys 0.006s
I20260709 12:28:20.133379 29312 raft_consensus.cc:3060] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:20.139700 29516 raft_consensus.cc:359] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:20.140585 29516 raft_consensus.cc:385] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:20.140902 29516 raft_consensus.cc:740] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:20.141634 29516 consensus_queue.cc:260] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:20.144747 29516 ts_tablet_manager.cc:1434] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:28:20.147432 29279 leader_election.cc:304] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:20.152356 29279 leader_election.cc:304] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:20.154454 29893 raft_consensus.cc:2749] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:20.152477 30008 consensus_queue.cc:1048] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:28:20.229513 29311 raft_consensus.cc:2468] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 1.
I20260709 12:28:20.226567 30041 consensus_queue.cc:1048] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:28:20.226788 30016 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.247678 30016 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:20.250003 30016 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:20.253548 29237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:20.257225 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:20.267550 29207 leader_election.cc:304] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:20.276973 30052 raft_consensus.cc:2804] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:20.282480 30052 raft_consensus.cc:697] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:20.283470 30052 consensus_queue.cc:237] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:20.290452 30016 raft_consensus.cc:493] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.291144 30016 raft_consensus.cc:515] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:20.293606 30016 leader_election.cc:290] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:20.296655 29427 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:20.298815 30065 raft_consensus.cc:2749] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:20.298642 29232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21efe1fe062e4b28bbfa5e3832bb2df9" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" is_pre_election: true
I20260709 12:28:20.299948 29232 raft_consensus.cc:2468] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:20.301893 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21efe1fe062e4b28bbfa5e3832bb2df9" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:20.305142 29388 raft_consensus.cc:2468] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 0.
I20260709 12:28:20.309729 29427 leader_election.cc:304] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:20.310906 29942 raft_consensus.cc:2804] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:20.370446 29459 raft_consensus.cc:3060] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:20.336932 29942 raft_consensus.cc:493] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:20.374503 29942 raft_consensus.cc:3060] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:20.402004 29893 raft_consensus.cc:2749] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:20.495033 30085 log.cc:927] Time spent T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:28:20.527796 29942 raft_consensus.cc:515] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:20.531317 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21efe1fe062e4b28bbfa5e3832bb2df9" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:20.532068 29385 raft_consensus.cc:3060] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:20.540282 30086 log.cc:927] Time spent T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:28:20.573293 29135 catalog_manager.cc:5697] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:20.591527 29186 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:20.580092 29942 leader_election.cc:290] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:20.579471 29385 raft_consensus.cc:2468] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:20.599218 29234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21efe1fe062e4b28bbfa5e3832bb2df9" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
I20260709 12:28:20.619606 29427 leader_election.cc:304] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:20.619668 29234 raft_consensus.cc:3060] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:20.621763 30064 raft_consensus.cc:2804] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:20.622417 30064 raft_consensus.cc:697] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:20.623413 30064 consensus_queue.cc:237] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:20.635272 29234 raft_consensus.cc:2468] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:20.678802 29139 catalog_manager.cc:5697] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 1 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.717833 29459 raft_consensus.cc:3060] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:20.740199 30087 consensus_queue.cc:1048] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:20.779911 30052 consensus_queue.cc:1048] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:21.026036 30064 consensus_queue.cc:1048] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:21.065613 30065 consensus_queue.cc:1048] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:21.666373 17568 tablet_server.cc:179] TabletServer@127.17.40.1:0 shutting down...
W20260709 12:28:21.672210 29427 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:28:21.712999 29427 consensus_peers.cc:597] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:21.714222 29427 consensus_peers.cc:597] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:21.735133 29427 consensus_peers.cc:597] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:21.740782 29353 consensus_peers.cc:597] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:21.743336 29427 consensus_peers.cc:597] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.769995 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:21.771240 17568 tablet_replica.cc:333] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.772703 17568 raft_consensus.cc:2243] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.773320 17568 raft_consensus.cc:2272] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.777778 17568 tablet_replica.cc:333] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.778709 17568 raft_consensus.cc:2243] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.779260 17568 raft_consensus.cc:2272] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.781844 17568 tablet_replica.cc:333] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.782732 17568 raft_consensus.cc:2243] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.783278 17568 raft_consensus.cc:2272] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:21.783824 29427 consensus_peers.cc:597] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.785774 17568 tablet_replica.cc:333] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.786567 17568 raft_consensus.cc:2243] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.787025 17568 raft_consensus.cc:2272] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.788975 17568 tablet_replica.cc:333] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.789587 17568 raft_consensus.cc:2243] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.790381 17568 raft_consensus.cc:2272] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.792774 17568 tablet_replica.cc:333] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.793638 17568 raft_consensus.cc:2243] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.794162 17568 raft_consensus.cc:2272] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.796329 17568 tablet_replica.cc:333] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.797098 17568 raft_consensus.cc:2243] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.797616 17568 raft_consensus.cc:2272] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.800156 17568 tablet_replica.cc:333] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.801276 17568 raft_consensus.cc:2243] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.801959 17568 raft_consensus.cc:2272] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.805298 17568 tablet_replica.cc:333] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.806375 17568 raft_consensus.cc:2243] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.807545 17568 raft_consensus.cc:2272] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.810204 17568 tablet_replica.cc:333] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.811071 17568 raft_consensus.cc:2243] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.811630 17568 raft_consensus.cc:2272] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.814309 17568 tablet_replica.cc:333] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.815209 17568 raft_consensus.cc:2243] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.815761 17568 raft_consensus.cc:2272] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:21.816895 29427 consensus_peers.cc:597] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:21.817672 29427 consensus_peers.cc:597] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.818523 17568 tablet_replica.cc:333] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.819502 17568 raft_consensus.cc:2243] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.820628 17568 raft_consensus.cc:2272] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.823287 17568 tablet_replica.cc:333] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.824177 17568 raft_consensus.cc:2243] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.824679 17568 raft_consensus.cc:2272] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.827310 17568 tablet_replica.cc:333] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.828152 17568 raft_consensus.cc:2243] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.828651 17568 raft_consensus.cc:2272] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:21.829227 29279 consensus_peers.cc:597] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.831485 17568 tablet_replica.cc:333] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
W20260709 12:28:21.832063 29279 consensus_peers.cc:597] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.833429 17568 raft_consensus.cc:2243] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:21.833809 29353 consensus_peers.cc:597] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.834722 17568 raft_consensus.cc:2272] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.837479 17568 tablet_replica.cc:333] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.838210 17568 raft_consensus.cc:2243] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.839558 17568 raft_consensus.cc:2272] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.842341 17568 tablet_replica.cc:333] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.843211 17568 raft_consensus.cc:2243] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.843904 17568 raft_consensus.cc:2272] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.847025 17568 tablet_replica.cc:333] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.847906 17568 raft_consensus.cc:2243] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.848500 17568 raft_consensus.cc:2272] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.851306 17568 tablet_replica.cc:333] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.852218 17568 raft_consensus.cc:2243] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.853350 17568 raft_consensus.cc:2272] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.856341 17568 tablet_replica.cc:333] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.857198 17568 raft_consensus.cc:2243] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.857753 17568 raft_consensus.cc:2272] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.860494 17568 tablet_replica.cc:333] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.861347 17568 raft_consensus.cc:2243] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.862426 17568 raft_consensus.cc:2272] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.865192 17568 tablet_replica.cc:333] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.866021 17568 raft_consensus.cc:2243] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.866616 17568 raft_consensus.cc:2272] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.869562 17568 tablet_replica.cc:333] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.870373 17568 raft_consensus.cc:2243] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.870930 17568 raft_consensus.cc:2272] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.873433 17568 tablet_replica.cc:333] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.874256 17568 raft_consensus.cc:2243] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.874863 17568 raft_consensus.cc:2272] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:21.876945 29353 consensus_peers.cc:597] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.877806 17568 tablet_replica.cc:333] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.878767 17568 raft_consensus.cc:2243] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:21.879093 29427 consensus_peers.cc:597] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.879343 17568 raft_consensus.cc:2272] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.882534 17568 tablet_replica.cc:333] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.883438 17568 raft_consensus.cc:2243] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.884637 17568 raft_consensus.cc:2272] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.887595 17568 tablet_replica.cc:333] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.888509 17568 raft_consensus.cc:2243] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:21.889467 29427 consensus_peers.cc:597] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.889614 17568 raft_consensus.cc:2272] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.892524 17568 tablet_replica.cc:333] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.893306 17568 raft_consensus.cc:2243] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.894263 17568 raft_consensus.cc:2272] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.896674 17568 tablet_replica.cc:333] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.897305 17568 raft_consensus.cc:2243] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.897830 17568 raft_consensus.cc:2272] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.900053 17568 tablet_replica.cc:333] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.900635 17568 raft_consensus.cc:2243] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.901667 17568 raft_consensus.cc:2272] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.904366 17568 tablet_replica.cc:333] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.905141 17568 raft_consensus.cc:2243] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.905742 17568 raft_consensus.cc:2272] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.908818 17568 tablet_replica.cc:333] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
W20260709 12:28:21.909011 29427 consensus_peers.cc:597] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.909578 17568 raft_consensus.cc:2243] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.910185 17568 raft_consensus.cc:2272] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.912499 17568 tablet_replica.cc:333] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.913264 17568 raft_consensus.cc:2243] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.914333 17568 raft_consensus.cc:2272] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.917096 17568 tablet_replica.cc:333] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.917898 17568 raft_consensus.cc:2243] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.918498 17568 raft_consensus.cc:2272] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.920858 17568 tablet_replica.cc:333] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.921535 17568 raft_consensus.cc:2243] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.922093 17568 raft_consensus.cc:2272] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.924603 17568 tablet_replica.cc:333] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
W20260709 12:28:21.925050 29353 consensus_peers.cc:597] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.925280 17568 raft_consensus.cc:2243] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.925932 17568 raft_consensus.cc:2272] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.928268 17568 tablet_replica.cc:333] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.928857 17568 raft_consensus.cc:2243] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.929637 17568 raft_consensus.cc:2272] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.931890 17568 tablet_replica.cc:333] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.932495 17568 raft_consensus.cc:2243] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.932925 17568 raft_consensus.cc:2272] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.935567 17568 tablet_replica.cc:333] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.936512 17568 raft_consensus.cc:2243] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.937510 17568 raft_consensus.cc:2272] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.939847 17568 tablet_replica.cc:333] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.940634 17568 raft_consensus.cc:2243] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.941234 17568 raft_consensus.cc:2272] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.944027 17568 tablet_replica.cc:333] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.944782 17568 raft_consensus.cc:2243] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.945811 17568 raft_consensus.cc:2272] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:21.947595 29353 consensus_peers.cc:597] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:21.948293 17568 tablet_replica.cc:333] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.948930 17568 raft_consensus.cc:2243] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.949417 17568 raft_consensus.cc:2272] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.951470 17568 tablet_replica.cc:333] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.952028 17568 raft_consensus.cc:2243] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.952558 17568 raft_consensus.cc:2272] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.955591 17568 tablet_replica.cc:333] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.956463 17568 raft_consensus.cc:2243] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:21.956969 17568 raft_consensus.cc:2272] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:21.959074 17568 tablet_replica.cc:333] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: stopping tablet replica
I20260709 12:28:21.959614 17568 raft_consensus.cc:2243] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:21.960590 17568 raft_consensus.cc:2272] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:21.980878 29279 consensus_peers.cc:597] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:21.989635 29353 consensus_peers.cc:597] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:21.991750 29353 consensus_peers.cc:597] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.031272 29279 connection.cc:573] client connection to 127.17.40.1:35813 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:28:22.049971 29427 consensus_peers.cc:597] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.049976 29279 consensus_peers.cc:597] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.056823 29353 consensus_peers.cc:597] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.076915 29353 consensus_peers.cc:597] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.077291 29279 consensus_peers.cc:597] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.093722 29427 consensus_peers.cc:597] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.100297 29427 consensus_peers.cc:597] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.157320 29353 consensus_peers.cc:597] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:22.177594 29427 consensus_peers.cc:597] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:22.798485 30008 raft_consensus.cc:493] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.799048 30008 raft_consensus.cc:515] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:22.802078 30008 leader_election.cc:290] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:22.802567 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:22.808753 29353 leader_election.cc:336] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:22.809273 29353 leader_election.cc:304] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:22.809924 30008 raft_consensus.cc:2749] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:22.810523 30088 raft_consensus.cc:493] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.811098 30088 raft_consensus.cc:515] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:22.813027 30088 leader_election.cc:290] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:22.814769 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:22.829573 29353 leader_election.cc:336] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:22.831379 29353 leader_election.cc:304] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:22.832190 30088 raft_consensus.cc:2749] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:22.880971 30103 raft_consensus.cc:493] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.881594 30103 raft_consensus.cc:515] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:22.884276 30103 leader_election.cc:290] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:22.886091 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:22.892638 29427 leader_election.cc:336] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:22.893129 29427 leader_election.cc:304] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:22.893937 30103 raft_consensus.cc:2749] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:22.899674 30103 raft_consensus.cc:493] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.900226 30103 raft_consensus.cc:515] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:22.902621 30103 leader_election.cc:290] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:22.904461 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:22.908923 29427 leader_election.cc:336] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:22.909353 29427 leader_election.cc:304] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:22.910269 30103 raft_consensus.cc:2749] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:22.912371 30103 raft_consensus.cc:493] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.912955 30103 raft_consensus.cc:515] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:22.915939 30103 leader_election.cc:290] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:22.917229 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:22.922497 29427 leader_election.cc:336] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:22.922942 29427 leader_election.cc:304] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:22.923782 30065 raft_consensus.cc:2749] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:22.960201 30088 raft_consensus.cc:493] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.960783 30088 raft_consensus.cc:515] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:22.962859 30088 leader_election.cc:290] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:22.963999 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
W20260709 12:28:22.967480 29353 leader_election.cc:336] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:22.967945 29353 leader_election.cc:304] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:22.968626 30088 raft_consensus.cc:2749] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:22.970643 30082 raft_consensus.cc:493] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.971298 30082 raft_consensus.cc:515] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:22.973188 30082 leader_election.cc:290] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:22.974913 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:22.977267 29279 leader_election.cc:336] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:22.977447 30082 raft_consensus.cc:493] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.977753 29279 leader_election.cc:304] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:22.978075 30082 raft_consensus.cc:515] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:22.978552 29893 raft_consensus.cc:2749] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:22.980755 30082 leader_election.cc:290] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:22.981403 30103 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.981552 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:22.982028 30103 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:22.984076 30103 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:22.984972 30088 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.985725 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:22.985697 30088 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:22.986949 29389 raft_consensus.cc:2468] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:22.988098 30088 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:22.989060 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:22.990917 29427 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:22.990962 29463 raft_consensus.cc:2468] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:22.991806 30065 raft_consensus.cc:493] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.992347 30065 raft_consensus.cc:515] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:22.994370 30065 leader_election.cc:290] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:22.995029 30065 raft_consensus.cc:2804] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:22.995416 30065 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.995543 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:22.994421 29353 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:22.995834 30065 raft_consensus.cc:3060] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.998237 30008 raft_consensus.cc:2804] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:22.998742 30008 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:22.999145 30008 raft_consensus.cc:3060] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:22.999630 29279 leader_election.cc:336] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.000190 29279 leader_election.cc:304] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:23.001799 29893 raft_consensus.cc:2749] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:23.006006 29427 leader_election.cc:336] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.008385 30065 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.009913 29893 raft_consensus.cc:493] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.010790 30065 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.010589 29893 raft_consensus.cc:515] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.013875 29893 leader_election.cc:290] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
W20260709 12:28:23.015254 29427 leader_election.cc:336] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.015682 29427 leader_election.cc:304] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:23.015792 30008 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.016530 30065 raft_consensus.cc:2749] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:23.018059 29353 leader_election.cc:336] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.020433 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59b9f4048214a868afee18cf9e843fd" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:23.021236 29389 raft_consensus.cc:2468] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
W20260709 12:28:23.022868 29279 leader_election.cc:336] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.024788 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:23.025662 29385 raft_consensus.cc:2393] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dbe6e4429184e5fb137cae093024bce in current term 2: Already voted for candidate 96bd9c3c81e04118abc2fe11d2b361ed in this term.
I20260709 12:28:23.027714 30008 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.031569 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:23.032449 29463 raft_consensus.cc:2393] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96bd9c3c81e04118abc2fe11d2b361ed in current term 2: Already voted for candidate 8dbe6e4429184e5fb137cae093024bce in this term.
I20260709 12:28:23.033689 29279 leader_election.cc:304] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.038122 29893 raft_consensus.cc:2804] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.038708 29893 raft_consensus.cc:493] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.039155 29893 raft_consensus.cc:3060] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:23.044170 29427 leader_election.cc:336] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.044212 29353 leader_election.cc:336] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.044752 29427 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:23.045490 29353 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:23.046253 30065 raft_consensus.cc:2749] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:23.047804 30008 raft_consensus.cc:2749] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:28:23.050195 17568 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 29262)
I20260709 12:28:23.057046 30008 raft_consensus.cc:493] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.059753 30008 raft_consensus.cc:515] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.061836 29893 raft_consensus.cc:515] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.065567 30008 leader_election.cc:290] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.068208 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:23.070196 29893 leader_election.cc:290] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
W20260709 12:28:23.071523 29279 leader_election.cc:336] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.072276 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59b9f4048214a868afee18cf9e843fd" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:23.073045 29385 raft_consensus.cc:3060] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:23.074597 29353 leader_election.cc:336] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.075127 29353 leader_election.cc:304] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:23.076498 30088 raft_consensus.cc:2749] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:23.082845 29385 raft_consensus.cc:2468] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 2.
I20260709 12:28:23.084465 29279 leader_election.cc:304] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.086649 29893 raft_consensus.cc:2804] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.087538 29893 raft_consensus.cc:697] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:23.089900 30082 raft_consensus.cc:493] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.090566 30082 raft_consensus.cc:515] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.092914 30082 leader_election.cc:290] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.088419 29893 consensus_queue.cc:237] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.093735 30064 raft_consensus.cc:493] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.094558 30064 raft_consensus.cc:515] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.096953 30064 leader_election.cc:290] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.098959 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
W20260709 12:28:23.111249 29427 leader_election.cc:336] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.112483 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:23.121959 29427 leader_election.cc:304] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:23.124828 30064 raft_consensus.cc:2749] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:23.127241 30088 raft_consensus.cc:493] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.127830 30088 raft_consensus.cc:515] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.130125 30088 leader_election.cc:290] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.131462 30064 raft_consensus.cc:493] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.132092 30064 raft_consensus.cc:515] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.134027 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:23.134492 30064 leader_election.cc:290] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.134840 29463 raft_consensus.cc:2468] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:23.137564 29311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:23.141883 29353 leader_election.cc:304] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:23.140324 29138 catalog_manager.cc:5697] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.143121 30065 raft_consensus.cc:493] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.143770 30065 raft_consensus.cc:515] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.145239 30088 raft_consensus.cc:2804] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.145709 30088 raft_consensus.cc:493] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.146121 30088 raft_consensus.cc:3060] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.146318 30065 leader_election.cc:290] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.160027 29893 raft_consensus.cc:493] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.160764 29893 raft_consensus.cc:515] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.162978 29893 leader_election.cc:290] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:23.163399 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:23.164024 29279 leader_election.cc:336] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.164143 29389 raft_consensus.cc:2468] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:23.164701 29279 leader_election.cc:304] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:23.165230 30008 raft_consensus.cc:493] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.165817 30008 raft_consensus.cc:515] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.167776 30008 leader_election.cc:290] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
W20260709 12:28:23.168466 29353 leader_election.cc:336] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.170712 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:23.171473 29463 raft_consensus.cc:2468] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:23.172043 29893 raft_consensus.cc:2749] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:23.173131 29353 leader_election.cc:304] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:23.174299 30008 raft_consensus.cc:2804] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.174419 29893 raft_consensus.cc:493] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.174774 30008 raft_consensus.cc:493] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.175251 30008 raft_consensus.cc:3060] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.175101 29893 raft_consensus.cc:515] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.177770 29893 leader_election.cc:290] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:23.181703 30088 raft_consensus.cc:515] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
W20260709 12:28:23.185076 29353 leader_election.cc:336] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.186028 30088 leader_election.cc:290] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
W20260709 12:28:23.186678 29427 leader_election.cc:336] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.187307 29427 leader_election.cc:304] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:23.187765 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:23.190519 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:23.191248 29389 raft_consensus.cc:2468] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:23.191661 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84317ec210984cb490e9b8af0ddf23ff" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:23.192436 29463 raft_consensus.cc:3060] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.196095 29893 raft_consensus.cc:493] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.198227 29893 raft_consensus.cc:515] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.200279 29463 raft_consensus.cc:2468] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 2.
I20260709 12:28:23.201541 29893 leader_election.cc:290] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:23.204113 30065 raft_consensus.cc:2749] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:23.209940 29353 leader_election.cc:304] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:23.210711 30088 raft_consensus.cc:2804] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.211788 30088 raft_consensus.cc:697] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:23.213238 30088 consensus_queue.cc:237] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.214674 30008 raft_consensus.cc:515] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.217067 29279 leader_election.cc:304] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.223490 30082 raft_consensus.cc:2804] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.223920 30082 raft_consensus.cc:493] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.224310 30082 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.226809 30112 raft_consensus.cc:493] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.226840 29893 raft_consensus.cc:493] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.227526 30112 raft_consensus.cc:515] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.227816 29893 raft_consensus.cc:515] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.230240 29893 leader_election.cc:290] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.231051 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:23.231766 29312 raft_consensus.cc:2468] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:23.233028 29893 raft_consensus.cc:493] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.233260 30112 leader_election.cc:290] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.233062 29430 leader_election.cc:304] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.219158 29427 leader_election.cc:304] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:23.234750 30112 raft_consensus.cc:2804] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.236568 30064 raft_consensus.cc:2804] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.235159 30112 raft_consensus.cc:493] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.237005 30064 raft_consensus.cc:493] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.237437 30064 raft_consensus.cc:3060] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.240252 30082 raft_consensus.cc:515] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.242558 30082 leader_election.cc:290] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:23.233596 29893 raft_consensus.cc:515] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.244881 29893 leader_election.cc:290] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:23.245883 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
W20260709 12:28:23.246078 29427 leader_election.cc:336] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.237425 30112 raft_consensus.cc:3060] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.246626 29138 catalog_manager.cc:5697] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 2 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.246649 29389 raft_consensus.cc:2468] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 2.
W20260709 12:28:23.217545 29353 leader_election.cc:336] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.256019 29427 leader_election.cc:336] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.257357 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:23.257683 29893 raft_consensus.cc:493] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.258131 29459 raft_consensus.cc:2468] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:23.258283 29893 raft_consensus.cc:515] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.260689 30110 raft_consensus.cc:493] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.261252 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:23.261337 30110 raft_consensus.cc:515] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.262002 29389 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.264827 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884f2ad3d291412691e9a8815a9d7838" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:23.265528 29459 raft_consensus.cc:3060] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.267454 30110 leader_election.cc:290] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.268380 29893 leader_election.cc:290] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
W20260709 12:28:23.275532 29353 leader_election.cc:336] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.278429 29389 raft_consensus.cc:2468] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 2.
I20260709 12:28:23.280344 29459 raft_consensus.cc:2468] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 2.
I20260709 12:28:23.281558 30008 leader_election.cc:290] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.281842 30065 raft_consensus.cc:493] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.271522 30064 raft_consensus.cc:515] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.282506 30065 raft_consensus.cc:515] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.284722 30064 leader_election.cc:290] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
W20260709 12:28:23.285565 29279 leader_election.cc:336] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.288265 29279 leader_election.cc:304] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:23.291638 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6796c6bbe9b6429daa40ed2fdb2529a5" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:23.286747 30112 raft_consensus.cc:515] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.286849 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:23.290915 30065 leader_election.cc:290] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.291155 29353 leader_election.cc:304] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:23.292198 29893 raft_consensus.cc:2749] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:23.292268 29389 raft_consensus.cc:3060] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:23.293614 29427 leader_election.cc:336] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.292361 29279 leader_election.cc:336] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.308712 29427 leader_election.cc:336] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.309427 30008 raft_consensus.cc:2804] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.309713 29312 raft_consensus.cc:2468] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 1.
I20260709 12:28:23.310791 30008 raft_consensus.cc:697] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:23.311100 29430 leader_election.cc:304] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.311748 30008 consensus_queue.cc:237] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.315979 30112 leader_election.cc:290] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.316803 30112 raft_consensus.cc:2804] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.317212 30112 raft_consensus.cc:493] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.317617 30112 raft_consensus.cc:3060] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:23.320359 29353 leader_election.cc:336] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.320896 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182ad32890aa4949b7f06c2dae04a331" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:23.321952 29312 raft_consensus.cc:3060] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:23.325070 29427 leader_election.cc:336] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.331668 29279 leader_election.cc:304] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.331842 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:23.332558 29893 raft_consensus.cc:2804] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.332613 29385 raft_consensus.cc:2468] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:23.333030 29893 raft_consensus.cc:493] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.333622 29893 raft_consensus.cc:3060] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.336329 29138 catalog_manager.cc:5697] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 2 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.332973 29279 leader_election.cc:304] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.339277 30100 raft_consensus.cc:2804] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:23.339677 30100 raft_consensus.cc:493] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.339624 29279 leader_election.cc:304] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.340312 30100 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:23.348111 30082 raft_consensus.cc:2804] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.348754 30082 raft_consensus.cc:697] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:23.349587 30082 consensus_queue.cc:237] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.350864 29312 raft_consensus.cc:2468] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 2.
I20260709 12:28:23.352423 29430 leader_election.cc:304] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.353566 30065 raft_consensus.cc:2804] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.354832 30065 raft_consensus.cc:697] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:23.355839 30065 consensus_queue.cc:237] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.358333 29893 raft_consensus.cc:515] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.359387 29389 raft_consensus.cc:2468] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 2.
I20260709 12:28:23.360488 29427 leader_election.cc:304] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.361645 30103 raft_consensus.cc:2804] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.362744 30103 raft_consensus.cc:697] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:23.362872 29279 leader_election.cc:304] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.363824 30103 consensus_queue.cc:237] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:23.365712 30120 raft_consensus.cc:2804] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.366238 30120 raft_consensus.cc:493] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.366729 30120 raft_consensus.cc:3060] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.368664 29893 leader_election.cc:290] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.362603 30112 raft_consensus.cc:515] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.378250 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:23.379236 29459 raft_consensus.cc:2468] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:23.380544 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f3994d7ed94748b84df1afd9e331fd" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:23.381434 29312 raft_consensus.cc:3060] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.386669 29893 raft_consensus.cc:493] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.387478 29893 raft_consensus.cc:515] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.364645 30100 raft_consensus.cc:515] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.401558 29893 leader_election.cc:290] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:23.396337 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef042d8e1fa4cb7bc3d1fbe923b826c" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:23.404767 29459 raft_consensus.cc:3060] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:23.406597 29427 leader_election.cc:336] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.409864 30008 raft_consensus.cc:493] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.403417 30100 leader_election.cc:290] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 3 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:23.398176 30112 leader_election.cc:290] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.410564 30008 raft_consensus.cc:515] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.395380 29312 raft_consensus.cc:2468] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 2.
I20260709 12:28:23.415083 29430 leader_election.cc:304] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.411197 30100 raft_consensus.cc:493] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.416910 30112 raft_consensus.cc:2804] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.416779 30100 raft_consensus.cc:515] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.423878 30100 leader_election.cc:290] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.409757 30120 raft_consensus.cc:515] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.421808 29459 raft_consensus.cc:2468] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 2.
I20260709 12:28:23.426811 30120 leader_election.cc:290] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:23.422982 29138 catalog_manager.cc:5697] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:23.424122 29353 leader_election.cc:336] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.417534 30112 raft_consensus.cc:697] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:23.434437 30112 consensus_queue.cc:237] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.424710 30008 leader_election.cc:290] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.431391 29139 catalog_manager.cc:5697] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 2 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.451974 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:23.452595 29312 raft_consensus.cc:2468] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
I20260709 12:28:23.455390 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72" is_pre_election: true
I20260709 12:28:23.456032 29312 raft_consensus.cc:2468] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 1.
W20260709 12:28:23.457772 29279 leader_election.cc:336] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.458552 29279 leader_election.cc:336] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.459571 29279 leader_election.cc:336] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.471603 29279 leader_election.cc:336] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.485316 29139 catalog_manager.cc:5697] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 2 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.487768 29139 catalog_manager.cc:5697] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 2 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.491279 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d0ab7da7f4218a16f383088db71d3" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:23.491986 29389 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:23.493269 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:23.493957 29463 raft_consensus.cc:2468] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:23.497079 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09b1a02c21b411f97bf8eeb736a44ea" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:23.497714 29385 raft_consensus.cc:3060] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.491279 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce" is_pre_election: true
I20260709 12:28:23.499092 29459 raft_consensus.cc:2468] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 1.
I20260709 12:28:23.499881 29389 raft_consensus.cc:2468] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 3.
I20260709 12:28:23.505790 29385 raft_consensus.cc:2468] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 2.
I20260709 12:28:23.508428 29356 leader_election.cc:304] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.510490 29356 leader_election.cc:304] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.510847 30008 raft_consensus.cc:2804] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.511337 30008 raft_consensus.cc:493] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.511719 30008 raft_consensus.cc:3060] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.512722 30088 raft_consensus.cc:2804] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.513230 30088 raft_consensus.cc:493] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.513691 30088 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.515810 29279 leader_election.cc:304] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.516691 30120 raft_consensus.cc:2804] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:23.517212 30120 raft_consensus.cc:697] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 3 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:23.518074 30120 consensus_queue.cc:237] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.521656 30008 raft_consensus.cc:515] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.523129 29279 leader_election.cc:304] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.524876 30123 raft_consensus.cc:2804] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.525681 30123 raft_consensus.cc:697] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:23.525033 29279 leader_election.cc:304] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.526988 30123 consensus_queue.cc:237] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.528172 30126 raft_consensus.cc:2804] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.528741 30126 raft_consensus.cc:493] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.529091 30126 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.529634 29279 leader_election.cc:304] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.531209 30100 raft_consensus.cc:2804] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.524497 30008 leader_election.cc:290] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.531751 30100 raft_consensus.cc:697] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:23.532742 30100 consensus_queue.cc:237] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.533851 29279 leader_election.cc:304] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.536839 29893 raft_consensus.cc:2804] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:23.537216 29893 raft_consensus.cc:493] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.537528 29893 raft_consensus.cc:3060] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.544085 29279 leader_election.cc:304] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.547338 29139 catalog_manager.cc:5697] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 2 to 3, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 3 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.550536 30126 raft_consensus.cc:515] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.552026 30125 raft_consensus.cc:2804] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:28:23.552371 29279 leader_election.cc:336] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.547916 30088 raft_consensus.cc:515] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.561004 30125 raft_consensus.cc:493] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:23.559610 29893 raft_consensus.cc:515] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.565352 29893 leader_election.cc:290] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
W20260709 12:28:23.561476 29279 leader_election.cc:336] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.563095 30125 raft_consensus.cc:3060] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.575659 30125 raft_consensus.cc:515] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.579219 30126 leader_election.cc:290] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:23.579366 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd8b20a4d4149f2aefaf5d791c65c89" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:23.580031 29312 raft_consensus.cc:3060] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.581924 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee763875334a56886a8163b24992db" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:23.582662 29459 raft_consensus.cc:3060] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:23.583678 29353 leader_election.cc:336] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.590430 29312 raft_consensus.cc:2468] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 2.
I20260709 12:28:23.590771 29459 raft_consensus.cc:2468] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 2.
I20260709 12:28:23.602846 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:23.603552 29459 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.603797 29139 catalog_manager.cc:5697] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.606842 30088 leader_election.cc:290] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:23.607679 17568 tablet_server.cc:196] TabletServer@127.17.40.1:0 shutdown complete.
I20260709 12:28:23.610541 29139 catalog_manager.cc:5697] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:23.608837 29353 leader_election.cc:336] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.614382 29459 raft_consensus.cc:2468] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 2.
I20260709 12:28:23.614733 30125 leader_election.cc:290] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Requested vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:23.618410 29279 leader_election.cc:304] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.619547 29279 leader_election.cc:304] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:23.619663 30100 raft_consensus.cc:2804] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.620405 30100 raft_consensus.cc:697] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:23.620541 30123 raft_consensus.cc:2804] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.621131 30123 raft_consensus.cc:697] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:23.621326 30100 consensus_queue.cc:237] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.622009 30123 consensus_queue.cc:237] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.622783 29356 leader_election.cc:304] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.626518 30088 raft_consensus.cc:2804] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.628610 30088 raft_consensus.cc:697] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:23.629542 30088 consensus_queue.cc:237] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:23.647051 29139 catalog_manager.cc:5697] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 2 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:23.650031 29279 consensus_peers.cc:597] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:23.650956 29279 leader_election.cc:336] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.652097 29279 leader_election.cc:336] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.652776 29279 leader_election.cc:336] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.653496 29279 leader_election.cc:336] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.654259 29279 leader_election.cc:336] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.657536 29138 catalog_manager.cc:5697] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:23.659929 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010149f21014bed809737f86f527ccc" candidate_uuid: "c098fe137f19465bb9f67dbd64763b72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:23.660589 29459 raft_consensus.cc:3060] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.659832 29138 catalog_manager.cc:5697] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:23.664170 29314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
W20260709 12:28:23.664745 29279 leader_election.cc:336] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:23.665359 29279 leader_election.cc:336] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:23.664845 29314 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.687603 29385 raft_consensus.cc:1275] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer c098fe137f19465bb9f67dbd64763b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.691476 30123 consensus_queue.cc:1048] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.695752 29314 raft_consensus.cc:2468] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 2.
I20260709 12:28:23.696930 29459 raft_consensus.cc:2468] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c098fe137f19465bb9f67dbd64763b72 in term 2.
I20260709 12:28:23.697736 29356 leader_election.cc:304] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.699120 30109 raft_consensus.cc:2804] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.699779 30109 raft_consensus.cc:697] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:23.701239 30109 consensus_queue.cc:237] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
W20260709 12:28:23.706777 29353 consensus_peers.cc:597] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:23.712672 29279 leader_election.cc:304] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, c098fe137f19465bb9f67dbd64763b72; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:23.713882 30123 raft_consensus.cc:2804] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.714583 30123 raft_consensus.cc:697] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Leader. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:23.716269 30123 consensus_queue.cc:237] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:23.733162 29459 raft_consensus.cc:1275] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 96bd9c3c81e04118abc2fe11d2b361ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:23.733870 29353 consensus_peers.cc:597] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:23.735144 30088 consensus_queue.cc:1048] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.750649 29138 catalog_manager.cc:5697] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to c098fe137f19465bb9f67dbd64763b72 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "c098fe137f19465bb9f67dbd64763b72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:23.754683 29314 raft_consensus.cc:1275] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 8dbe6e4429184e5fb137cae093024bce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.756724 30112 consensus_queue.cc:1048] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.768344 29459 raft_consensus.cc:1275] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 96bd9c3c81e04118abc2fe11d2b361ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.769775 30088 consensus_queue.cc:1048] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.821987 29139 catalog_manager.cc:5697] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 1 to 2, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 2 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:23.846374 29385 raft_consensus.cc:1275] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 8dbe6e4429184e5fb137cae093024bce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:23.894308 29427 consensus_peers.cc:597] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:23.939556 30112 consensus_queue.cc:1048] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:23.947070 29427 consensus_peers.cc:597] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:23.948027 29385 raft_consensus.cc:1275] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer c098fe137f19465bb9f67dbd64763b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.959020 30100 consensus_queue.cc:1048] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:23.967070 29427 consensus_peers.cc:597] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:23.968592 29312 raft_consensus.cc:1275] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 8dbe6e4429184e5fb137cae093024bce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:23.978338 29427 consensus_peers.cc:597] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:23.978513 30064 consensus_queue.cc:1048] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:23.959476 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 12:28:24.002125 29463 raft_consensus.cc:1275] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer c098fe137f19465bb9f67dbd64763b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:24.045639 29279 consensus_peers.cc:597] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.068301 30082 consensus_queue.cc:1048] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:24.078544 29382 raft_consensus.cc:1275] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Refusing update from remote peer c098fe137f19465bb9f67dbd64763b72: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:28:24.090997 29279 consensus_peers.cc:597] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.095330 29463 raft_consensus.cc:1275] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer c098fe137f19465bb9f67dbd64763b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:24.122175 30126 consensus_queue.cc:1048] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:24.125399 30126 consensus_queue.cc:1048] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 12:28:24.151024 29427 consensus_peers.cc:597] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.158286 30150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:24.168618 29279 consensus_peers.cc:597] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:24.179539 29427 consensus_peers.cc:597] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.180238 29427 consensus_peers.cc:597] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.191246 29459 raft_consensus.cc:1275] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer c098fe137f19465bb9f67dbd64763b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:24.195863 30152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:24.201269 29427 consensus_peers.cc:597] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.218086 29427 consensus_peers.cc:597] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.245814 29312 raft_consensus.cc:1275] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 96bd9c3c81e04118abc2fe11d2b361ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:24.270702 29353 consensus_peers.cc:597] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.275465 29353 consensus_peers.cc:597] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.287467 29353 consensus_peers.cc:597] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:24.290597 30154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:24.291313 30126 consensus_queue.cc:1048] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:24.293540 17568 server_base.cc:1061] running on GCE node
W20260709 12:28:24.294268 29427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:45901, user_credentials={real_user=slave}} blocked reactor thread for 53995.3us
I20260709 12:28:24.313390 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:24.313930 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:24.314268 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600104314236 us; error 0 us; skew 500 ppm
I20260709 12:28:24.315410 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:28:24.302321 29353 consensus_peers.cc:597] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:24.297652 29279 consensus_peers.cc:597] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:24.320322 29427 consensus_peers.cc:597] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.320761 29463 raft_consensus.cc:1275] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer c098fe137f19465bb9f67dbd64763b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:24.324760 29353 consensus_peers.cc:597] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.328330 29389 raft_consensus.cc:1275] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer c098fe137f19465bb9f67dbd64763b72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:24.330461 30008 consensus_queue.cc:1048] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:24.328411 29427 consensus_peers.cc:597] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.332746 17568 webserver.cc:533] Webserver started at http://127.17.40.1:44187/ using document root <none> and password file <none>
I20260709 12:28:24.333671 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:24.333964 17568 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:28:24.339298 29427 consensus_peers.cc:597] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.346694 30123 consensus_queue.cc:1048] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:24.348668 17568 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.003s	sys 0.001s
I20260709 12:28:24.356801 29314 raft_consensus.cc:1275] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 96bd9c3c81e04118abc2fe11d2b361ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:24.367604 30163 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:24.369510 17568 fs_manager.cc:730] Time spent opening block manager: real 0.009s	user 0.000s	sys 0.004s
I20260709 12:28:24.370095 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
format_stamp: "Formatted at 2026-07-09 12:28:05 on dist-test-slave-tjfs"
W20260709 12:28:24.370941 29427 consensus_peers.cc:597] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.370668 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:28:24.374980 29279 consensus_peers.cc:597] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.390407 30082 consensus_queue.cc:1048] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:24.401072 30146 consensus_queue.cc:1048] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:24.423135 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
W20260709 12:28:24.425102 29279 consensus_peers.cc:597] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.425130 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 12:28:24.425752 29279 consensus_peers.cc:597] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.428323 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:28:24.463707 29353 consensus_peers.cc:597] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.462831 29279 consensus_peers.cc:597] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.469087 29353 consensus_peers.cc:597] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.480913 29353 consensus_peers.cc:597] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.481789 29427 consensus_peers.cc:597] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.495333 30174 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:28:24.526546 29353 consensus_peers.cc:597] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.528717 29353 consensus_peers.cc:597] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.538648 29279 consensus_peers.cc:597] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.550516 29279 consensus_peers.cc:597] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.573137 30158 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.573925 30158 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
W20260709 12:28:24.575870 29279 consensus_peers.cc:597] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.576433 30158 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:24.577286 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" is_pre_election: true
I20260709 12:28:24.578305 29382 raft_consensus.cc:2468] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 2.
I20260709 12:28:24.579730 29427 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:24.580499 30158 raft_consensus.cc:2804] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:24.580858 30158 raft_consensus.cc:493] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:24.581192 30158 raft_consensus.cc:3060] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:24.582085 29427 leader_election.cc:336] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:24.593658 30158 raft_consensus.cc:515] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:24.595824 30158 leader_election.cc:290] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:24.600165 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805181416bfb47f0a641552cee55b488" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:24.600864 29385 raft_consensus.cc:3060] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:24.603681 29427 leader_election.cc:336] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
W20260709 12:28:24.606302 29279 consensus_peers.cc:597] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.609576 29385 raft_consensus.cc:2468] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 3.
I20260709 12:28:24.610981 29427 leader_election.cc:304] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:24.611904 30103 raft_consensus.cc:2804] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:24.612423 30103 raft_consensus.cc:697] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 3 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:24.613456 30103 consensus_queue.cc:237] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:24.624877 29138 catalog_manager.cc:5697] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 1 to 3, leader changed from 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1) to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 3 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:24.640268 29427 consensus_peers.cc:597] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.652580 29427 consensus_peers.cc:597] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.672226 29353 consensus_peers.cc:597] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.677481 29353 consensus_peers.cc:597] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:24.683445 29427 consensus_peers.cc:597] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:24.835144 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:28:24.835551 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.347s	user 0.006s	sys 0.009s
I20260709 12:28:24.835893 17568 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:28:24.841987 30174 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:24.859766 30174 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:24.860772 30174 tablet_bootstrap.cc:492] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:24.861507 30174 ts_tablet_manager.cc:1403] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:28:24.864362 30174 raft_consensus.cc:359] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:24.865073 30174 raft_consensus.cc:740] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:24.865836 30174 consensus_queue.cc:260] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:24.868438 30174 ts_tablet_manager.cc:1434] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 12:28:24.869309 30174 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:24.885010 30174 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:24.886039 30174 tablet_bootstrap.cc:492] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:24.886775 30174 ts_tablet_manager.cc:1403] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:28:24.889400 30174 raft_consensus.cc:359] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:24.890093 30174 raft_consensus.cc:740] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:24.890821 30174 consensus_queue.cc:260] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:24.892814 30174 ts_tablet_manager.cc:1434] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:24.893757 30174 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:24.907882 30174 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:24.908964 30174 tablet_bootstrap.cc:492] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:24.909634 30174 ts_tablet_manager.cc:1403] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:28:24.912225 30174 raft_consensus.cc:359] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:24.912993 30174 raft_consensus.cc:740] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:24.913692 30174 consensus_queue.cc:260] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:24.915674 30174 ts_tablet_manager.cc:1434] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:24.916481 30174 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:24.933712 30174 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:24.934721 30174 tablet_bootstrap.cc:492] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:24.935421 30174 ts_tablet_manager.cc:1403] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:28:24.937914 30174 raft_consensus.cc:359] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:24.938499 30174 raft_consensus.cc:740] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:24.939193 30174 consensus_queue.cc:260] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:24.941288 30174 ts_tablet_manager.cc:1434] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:24.941972 30174 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:24.955981 30174 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:24.957000 30174 tablet_bootstrap.cc:492] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:24.957687 30174 ts_tablet_manager.cc:1403] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:28:24.960367 30174 raft_consensus.cc:359] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:24.961087 30174 raft_consensus.cc:740] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:24.961822 30174 consensus_queue.cc:260] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:24.963940 30174 ts_tablet_manager.cc:1434] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:24.964821 30174 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.008241 30174 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.009595 30174 tablet_bootstrap.cc:492] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.010545 30174 ts_tablet_manager.cc:1403] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.016s
I20260709 12:28:25.013409 30174 raft_consensus.cc:359] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.014191 30174 raft_consensus.cc:740] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.015983 30174 consensus_queue.cc:260] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.019567 30174 ts_tablet_manager.cc:1434] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:28:25.020483 30174 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.037212 30174 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.038201 30174 tablet_bootstrap.cc:492] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.038925 30174 ts_tablet_manager.cc:1403] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
W20260709 12:28:25.039947 29427 consensus_peers.cc:597] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.041471 30174 raft_consensus.cc:359] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.042222 30174 raft_consensus.cc:740] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.042953 30174 consensus_queue.cc:260] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.045148 30174 ts_tablet_manager.cc:1434] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:25.045975 30174 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.061784 30174 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.062798 30174 tablet_bootstrap.cc:492] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.063489 30174 ts_tablet_manager.cc:1403] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:28:25.066061 30174 raft_consensus.cc:359] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.066787 30174 raft_consensus.cc:740] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.067446 30174 consensus_queue.cc:260] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.069468 30174 ts_tablet_manager.cc:1434] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:25.070271 30174 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.087616 30174 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.098543 30174 tablet_bootstrap.cc:492] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.099308 30174 ts_tablet_manager.cc:1403] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.008s
I20260709 12:28:25.101994 30174 raft_consensus.cc:359] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.107125 30174 raft_consensus.cc:740] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.108021 30174 consensus_queue.cc:260] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.114790 30174 ts_tablet_manager.cc:1434] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:28:25.115712 30174 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.137310 30174 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.139007 30174 tablet_bootstrap.cc:492] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.139734 30174 ts_tablet_manager.cc:1403] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:28:25.142546 30174 raft_consensus.cc:359] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.143224 30174 raft_consensus.cc:740] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.144140 30174 consensus_queue.cc:260] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.146550 30174 ts_tablet_manager.cc:1434] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:25.147353 30174 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.165199 29385 raft_consensus.cc:1275] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Refusing update from remote peer 8dbe6e4429184e5fb137cae093024bce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:25.167171 30158 consensus_queue.cc:1048] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:25.169525 17568 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:28:25.169937 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.334s	user 0.315s	sys 0.000s
I20260709 12:28:25.170023 30174 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.171180 30174 tablet_bootstrap.cc:492] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.172122 30174 ts_tablet_manager.cc:1403] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 12:28:25.176151 30174 raft_consensus.cc:359] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.177119 30174 raft_consensus.cc:740] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.178077 30174 consensus_queue.cc:260] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.180766 30174 ts_tablet_manager.cc:1434] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:28:25.181737 30174 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.210457 30174 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.211736 30174 tablet_bootstrap.cc:492] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.212704 30174 ts_tablet_manager.cc:1403] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.000s
I20260709 12:28:25.216246 30174 raft_consensus.cc:359] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.217413 30174 raft_consensus.cc:740] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.218600 30174 consensus_queue.cc:260] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.222196 30174 ts_tablet_manager.cc:1434] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:28:25.223327 30174 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.244983 30174 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.246232 30174 tablet_bootstrap.cc:492] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.247120 30174 ts_tablet_manager.cc:1403] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.010s
I20260709 12:28:25.250557 30174 raft_consensus.cc:359] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.251544 30174 raft_consensus.cc:740] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.252744 30174 consensus_queue.cc:260] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.292166 30174 ts_tablet_manager.cc:1434] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.045s	user 0.014s	sys 0.012s
I20260709 12:28:25.293176 30174 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.320647 30174 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.322000 30174 tablet_bootstrap.cc:492] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.322796 30174 ts_tablet_manager.cc:1403] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 12:28:25.325619 30174 raft_consensus.cc:359] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.326629 30174 raft_consensus.cc:740] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.327641 30174 consensus_queue.cc:260] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.330893 30174 ts_tablet_manager.cc:1434] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:25.332057 30174 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.360447 30174 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.362042 30174 tablet_bootstrap.cc:492] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.363224 30174 ts_tablet_manager.cc:1403] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.008s
I20260709 12:28:25.367308 30174 raft_consensus.cc:359] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.368364 30174 raft_consensus.cc:740] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.381948 30174 consensus_queue.cc:260] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.396550 30174 ts_tablet_manager.cc:1434] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:28:25.397926 30174 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.429231 30174 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.430640 30174 tablet_bootstrap.cc:492] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.431766 30174 ts_tablet_manager.cc:1403] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.009s
I20260709 12:28:25.436728 30174 raft_consensus.cc:359] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.437300 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:35813
I20260709 12:28:25.437665 30174 raft_consensus.cc:740] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.436234 30255 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:35813 every 8 connection(s)
I20260709 12:28:25.438537 30174 consensus_queue.cc:260] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.443215 30174 ts_tablet_manager.cc:1434] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:28:25.444538 30174 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.473564 30174 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.474818 30174 tablet_bootstrap.cc:492] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.475543 30174 ts_tablet_manager.cc:1403] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 12:28:25.479481 30174 raft_consensus.cc:359] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.479923 30257 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38223
I20260709 12:28:25.480255 30174 raft_consensus.cc:740] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.480496 30257 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:25.481093 30174 consensus_queue.cc:260] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.481633 30257 heartbeater.cc:507] Master 127.17.40.62:38223 requested a full tablet report, sending...
I20260709 12:28:25.483505 30174 ts_tablet_manager.cc:1434] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:25.484414 30174 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.513276 29138 ts_manager.cc:194] Re-registered known tserver with Master: 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
I20260709 12:28:25.520700 30225 raft_consensus.cc:3060] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:25.537783 30174 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.538968 30174 tablet_bootstrap.cc:492] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.539747 30174 ts_tablet_manager.cc:1403] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.029s
I20260709 12:28:25.542881 30174 raft_consensus.cc:359] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.547219 30174 raft_consensus.cc:740] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.548096 30174 consensus_queue.cc:260] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.550271 30174 ts_tablet_manager.cc:1434] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:28:25.551304 30174 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.579476 30174 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.580495 30174 tablet_bootstrap.cc:492] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.581175 30174 ts_tablet_manager.cc:1403] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.005s
I20260709 12:28:25.583984 30174 raft_consensus.cc:359] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.584796 30174 raft_consensus.cc:740] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.585541 30174 consensus_queue.cc:260] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.587846 30174 ts_tablet_manager.cc:1434] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:25.588716 30174 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.602813 29138 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35244
I20260709 12:28:25.605212 30225 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.606593 30174 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.607676 30174 tablet_bootstrap.cc:492] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.608397 30174 ts_tablet_manager.cc:1403] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:28:25.609651 30257 heartbeater.cc:499] Master 127.17.40.62:38223 was elected leader, sending a full tablet report...
I20260709 12:28:25.612236 30174 raft_consensus.cc:359] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.613056 30174 raft_consensus.cc:740] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.613837 30174 consensus_queue.cc:260] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:25.616101 30174 ts_tablet_manager.cc:1434] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:25.616950 30174 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.621193 30224 raft_consensus.cc:3060] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.647351 30226 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.667840 30223 raft_consensus.cc:3060] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:25.676808 30174 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.679188 30174 tablet_bootstrap.cc:492] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.680102 30174 ts_tablet_manager.cc:1403] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.019s
I20260709 12:28:25.688113 30174 raft_consensus.cc:359] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.689152 30174 raft_consensus.cc:740] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.690277 30174 consensus_queue.cc:260] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.695592 30174 ts_tablet_manager.cc:1434] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:28:25.696604 30174 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.699627 30222 raft_consensus.cc:3060] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.714563 30225 raft_consensus.cc:3060] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.719321 30227 raft_consensus.cc:3060] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:25.732518 29279 consensus_peers.cc:597] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:25.734534 30174 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.735742 30174 tablet_bootstrap.cc:492] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.736476 30174 ts_tablet_manager.cc:1403] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.009s
I20260709 12:28:25.739378 30174 raft_consensus.cc:359] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.740181 30174 raft_consensus.cc:740] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.741958 30174 consensus_queue.cc:260] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.744228 30174 ts_tablet_manager.cc:1434] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:25.745536 30174 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.775498 30174 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.776304 30174 tablet_bootstrap.cc:492] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.776875 30174 ts_tablet_manager.cc:1403] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.012s
I20260709 12:28:25.779079 30174 raft_consensus.cc:359] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.779651 30174 raft_consensus.cc:740] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.780352 30174 consensus_queue.cc:260] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.782182 30174 ts_tablet_manager.cc:1434] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:25.783057 30174 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.827661 30174 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.828708 30174 tablet_bootstrap.cc:492] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.831408 30174 ts_tablet_manager.cc:1403] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.020s
I20260709 12:28:25.837172 30174 raft_consensus.cc:359] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.837949 30174 raft_consensus.cc:740] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.838719 30174 consensus_queue.cc:260] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.841063 30174 ts_tablet_manager.cc:1434] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:28:25.842103 30174 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.857383 30174 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.858532 30174 tablet_bootstrap.cc:492] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.859254 30174 ts_tablet_manager.cc:1403] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:28:25.861682 30174 raft_consensus.cc:359] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.862430 30174 raft_consensus.cc:740] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.863106 30174 consensus_queue.cc:260] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.864974 30174 ts_tablet_manager.cc:1434] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:25.866431 30174 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.882815 30174 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.883824 30174 tablet_bootstrap.cc:492] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.884502 30174 ts_tablet_manager.cc:1403] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:28:25.887066 30174 raft_consensus.cc:359] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.887598 30174 raft_consensus.cc:740] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.888214 30174 consensus_queue.cc:260] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.889997 30174 ts_tablet_manager.cc:1434] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:25.890826 30174 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.907022 30174 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.908059 30174 tablet_bootstrap.cc:492] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.908691 30174 ts_tablet_manager.cc:1403] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 12:28:25.911137 30174 raft_consensus.cc:359] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.911553 30222 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.911900 30174 raft_consensus.cc:740] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.912700 30174 consensus_queue.cc:260] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.915035 30174 ts_tablet_manager.cc:1434] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:25.915992 30174 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.933907 30174 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.935035 30174 tablet_bootstrap.cc:492] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.935820 30174 ts_tablet_manager.cc:1403] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:28:25.938428 30174 raft_consensus.cc:359] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.939170 30174 raft_consensus.cc:740] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.939842 30174 consensus_queue.cc:260] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:25.941999 30174 ts_tablet_manager.cc:1434] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:25.942915 30174 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.958783 30174 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.959851 30174 tablet_bootstrap.cc:492] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.960587 30174 ts_tablet_manager.cc:1403] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 12:28:25.963332 30174 raft_consensus.cc:359] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:25.964054 30174 raft_consensus.cc:740] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.964717 30174 consensus_queue.cc:260] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:25.967002 30174 ts_tablet_manager.cc:1434] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:25.967912 30174 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:25.985437 30174 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:25.986479 30174 tablet_bootstrap.cc:492] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:25.987280 30174 ts_tablet_manager.cc:1403] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:28:25.990010 30174 raft_consensus.cc:359] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.990756 30174 raft_consensus.cc:740] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:25.991555 30174 consensus_queue.cc:260] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:25.993070 30174 ts_tablet_manager.cc:1434] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:25.993922 30174 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.010133 30174 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.011180 30174 tablet_bootstrap.cc:492] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.011857 30174 ts_tablet_manager.cc:1403] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:28:26.013954 30174 raft_consensus.cc:359] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.014669 30174 raft_consensus.cc:740] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.015316 30174 consensus_queue.cc:260] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.017817 30174 ts_tablet_manager.cc:1434] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:28:26.019369 30174 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.040547 30174 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.041569 30174 tablet_bootstrap.cc:492] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.042307 30174 ts_tablet_manager.cc:1403] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:28:26.044920 30174 raft_consensus.cc:359] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.045603 30174 raft_consensus.cc:740] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.046303 30174 consensus_queue.cc:260] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.048210 30174 ts_tablet_manager.cc:1434] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:26.048960 30174 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.061506 30174 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.062283 30174 tablet_bootstrap.cc:492] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.062906 30174 ts_tablet_manager.cc:1403] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:28:26.064733 30174 raft_consensus.cc:359] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:26.065227 30174 raft_consensus.cc:740] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.065718 30174 consensus_queue.cc:260] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:26.067480 30174 ts_tablet_manager.cc:1434] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:26.068733 30174 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.084652 30174 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.085692 30174 tablet_bootstrap.cc:492] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.086462 30174 ts_tablet_manager.cc:1403] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:28:26.089102 30174 raft_consensus.cc:359] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.089864 30174 raft_consensus.cc:740] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.090576 30174 consensus_queue.cc:260] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.092684 30174 ts_tablet_manager.cc:1434] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:26.093571 30174 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.114343 30222 raft_consensus.cc:3060] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.138669 30174 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.139712 30174 tablet_bootstrap.cc:492] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.140461 30174 ts_tablet_manager.cc:1403] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.020s
I20260709 12:28:26.145583 30174 raft_consensus.cc:359] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.146349 30174 raft_consensus.cc:740] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.147078 30174 consensus_queue.cc:260] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.148856 30174 ts_tablet_manager.cc:1434] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:26.149752 30174 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.177021 30174 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.178150 30174 tablet_bootstrap.cc:492] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.178951 30174 ts_tablet_manager.cc:1403] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.029s	user 0.024s	sys 0.004s
I20260709 12:28:26.181718 30174 raft_consensus.cc:359] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:26.182497 30174 raft_consensus.cc:740] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.183212 30174 consensus_queue.cc:260] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:26.185707 30174 ts_tablet_manager.cc:1434] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:26.186605 30174 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.208652 30222 raft_consensus.cc:3060] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.222888 30174 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.223934 30174 tablet_bootstrap.cc:492] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.224677 30174 ts_tablet_manager.cc:1403] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.000s
I20260709 12:28:26.228591 30174 raft_consensus.cc:359] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:26.230955 30174 raft_consensus.cc:740] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.231808 30174 consensus_queue.cc:260] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:26.235541 30174 ts_tablet_manager.cc:1434] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
W20260709 12:28:26.236059 29353 consensus_peers.cc:597] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:26.236640 30174 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
W20260709 12:28:26.239094 29427 consensus_peers.cc:597] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:26.253861 30174 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.254992 30174 tablet_bootstrap.cc:492] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.255738 30174 ts_tablet_manager.cc:1403] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:28:26.258562 30174 raft_consensus.cc:359] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.259243 30174 raft_consensus.cc:740] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.260090 30174 consensus_queue.cc:260] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.261715 30174 ts_tablet_manager.cc:1434] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:26.262611 30174 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.278470 30174 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.279474 30174 tablet_bootstrap.cc:492] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.280228 30174 ts_tablet_manager.cc:1403] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:28:26.282898 30174 raft_consensus.cc:359] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.283601 30174 raft_consensus.cc:740] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.284287 30174 consensus_queue.cc:260] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.286178 30174 ts_tablet_manager.cc:1434] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:26.286919 30174 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.299144 30225 raft_consensus.cc:3060] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.305244 30174 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.306465 30174 tablet_bootstrap.cc:492] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.307212 30174 ts_tablet_manager.cc:1403] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:28:26.309890 30174 raft_consensus.cc:359] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.310622 30174 raft_consensus.cc:740] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.311450 30174 consensus_queue.cc:260] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.313326 30174 ts_tablet_manager.cc:1434] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:26.314025 30174 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.333246 30174 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.334288 30174 tablet_bootstrap.cc:492] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.335079 30174 ts_tablet_manager.cc:1403] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:28:26.337513 30174 raft_consensus.cc:359] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.338238 30174 raft_consensus.cc:740] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.338898 30174 consensus_queue.cc:260] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.341104 30174 ts_tablet_manager.cc:1434] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:26.341972 30174 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.357287 30174 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.358322 30174 tablet_bootstrap.cc:492] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.359210 30174 ts_tablet_manager.cc:1403] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:28:26.362504 30174 raft_consensus.cc:359] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.363267 30174 raft_consensus.cc:740] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.363986 30174 consensus_queue.cc:260] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.366258 30174 ts_tablet_manager.cc:1434] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:28:26.367203 30174 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.386831 30223 raft_consensus.cc:3060] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:26.393124 29427 consensus_peers.cc:597] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:26.394070 30174 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.395227 30174 tablet_bootstrap.cc:492] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.395951 30174 ts_tablet_manager.cc:1403] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.007s
I20260709 12:28:26.398731 30174 raft_consensus.cc:359] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.399452 30174 raft_consensus.cc:740] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.400135 30174 consensus_queue.cc:260] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.402377 30174 ts_tablet_manager.cc:1434] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:26.403276 30174 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.422051 30222 raft_consensus.cc:3060] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.482470 30174 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.483517 30174 tablet_bootstrap.cc:492] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.484311 30174 ts_tablet_manager.cc:1403] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.081s	user 0.032s	sys 0.040s
I20260709 12:28:26.487308 30174 raft_consensus.cc:359] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.487985 30174 raft_consensus.cc:740] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.489840 30174 consensus_queue.cc:260] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:26.492161 30174 ts_tablet_manager.cc:1434] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:26.492930 30174 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap starting.
I20260709 12:28:26.514279 30174 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:26.515388 30174 tablet_bootstrap.cc:492] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Bootstrap complete.
I20260709 12:28:26.516170 30174 ts_tablet_manager.cc:1403] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 12:28:26.518975 30174 raft_consensus.cc:359] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.519714 30174 raft_consensus.cc:740] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.520509 30174 consensus_queue.cc:260] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:26.523264 30174 ts_tablet_manager.cc:1434] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:26.670698 30223 raft_consensus.cc:3060] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.718992 30223 raft_consensus.cc:3060] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:34.131062 29279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.1:35813, user_credentials={real_user=slave}} blocked reactor thread for 59856.1us
I20260709 12:28:35.462491 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:35.531356 29460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:28:35.532438 29460 raft_consensus.cc:606] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:35.535269 29460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:28:35.535737 29460 raft_consensus.cc:606] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:35.538182 29460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:28:35.538851 29460 raft_consensus.cc:606] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:35.554622 29316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f"
dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
mode: GRACEFUL
new_leader_uuid: "8dbe6e4429184e5fb137cae093024bce"
 from {username='slave'} at 127.0.0.1:58028
I20260709 12:28:35.555177 29316 raft_consensus.cc:606] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Received request to transfer leadership to TS 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:35.557763 29460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5bc94f78eb745a8ae182fa765caf007"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:28:35.558291 29460 raft_consensus.cc:606] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:35.571166 29389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af5e140659184a569b1e220d086f4b63"
dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:57188
I20260709 12:28:35.571698 29389 raft_consensus.cc:606] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:35.574666 29460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:28:35.575182 29460 raft_consensus.cc:606] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:35.576249 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:28:35.577469 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:35.578179 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:35.629215 30332 raft_consensus.cc:993] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.629915 30320 raft_consensus.cc:1081] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.631598 30225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34758
I20260709 12:28:35.632146 30225 raft_consensus.cc:493] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.632481 30225 raft_consensus.cc:3060] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.642210 30225 raft_consensus.cc:515] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:35.645231 30225 leader_election.cc:290] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:35.657709 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:35.658527 29389 raft_consensus.cc:3060] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.659204 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e123d694327a439f955f8e8831cbbfef" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:35.659763 29460 raft_consensus.cc:3055] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:35.660009 29460 raft_consensus.cc:740] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:35.660738 29460 consensus_queue.cc:260] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:35.661978 29460 raft_consensus.cc:3060] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.666917 29389 raft_consensus.cc:2468] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.668370 30164 leader_election.cc:304] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:35.670362 30339 raft_consensus.cc:2804] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:35.671730 29460 raft_consensus.cc:2468] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.671799 30339 raft_consensus.cc:697] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:35.673290 30339 consensus_queue.cc:237] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:35.685153 29135 catalog_manager.cc:5697] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 8dbe6e4429184e5fb137cae093024bce (127.17.40.4) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:35.829665 30323 raft_consensus.cc:993] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.830331 30328 raft_consensus.cc:1081] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.832213 30227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af5e140659184a569b1e220d086f4b63"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34774
I20260709 12:28:35.832768 30227 raft_consensus.cc:493] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.833201 30227 raft_consensus.cc:3060] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.833415 30332 raft_consensus.cc:993] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.835636 30332 raft_consensus.cc:1081] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.836223 30329 raft_consensus.cc:993] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.836804 30320 raft_consensus.cc:1081] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.838850 30225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5bc94f78eb745a8ae182fa765caf007"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34758
I20260709 12:28:35.839294 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34758
I20260709 12:28:35.839447 30225 raft_consensus.cc:493] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.839793 30222 raft_consensus.cc:493] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.839953 30225 raft_consensus.cc:3060] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.840201 30222 raft_consensus.cc:3060] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.843073 30227 raft_consensus.cc:515] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:35.846336 30227 leader_election.cc:290] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:35.846959 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e140659184a569b1e220d086f4b63" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:35.847589 29389 raft_consensus.cc:3055] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:35.847786 29389 raft_consensus.cc:740] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:35.848682 29389 consensus_queue.cc:260] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:35.850107 29389 raft_consensus.cc:3060] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.851307 30222 raft_consensus.cc:515] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:35.854864 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:35.855485 29385 raft_consensus.cc:3060] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.855808 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1f2771eb4fcb81923b5712b47b2f" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:35.856477 29460 raft_consensus.cc:3055] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:35.856805 29460 raft_consensus.cc:740] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:35.857607 29460 consensus_queue.cc:260] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:35.858726 29460 raft_consensus.cc:3060] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.863296 29385 raft_consensus.cc:2468] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.865381 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e140659184a569b1e220d086f4b63" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:35.865473 30164 leader_election.cc:304] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:35.866050 29316 raft_consensus.cc:3060] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.869370 30225 raft_consensus.cc:515] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:35.870009 30339 raft_consensus.cc:2804] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:35.870697 30339 raft_consensus.cc:697] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:35.871671 30339 consensus_queue.cc:237] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:35.874833 29389 raft_consensus.cc:2468] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.877017 29316 raft_consensus.cc:2468] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.877897 29313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bc94f78eb745a8ae182fa765caf007" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:35.878216 30164 leader_election.cc:304] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:35.878683 29313 raft_consensus.cc:3060] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.876711 30225 leader_election.cc:290] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:35.879377 30340 raft_consensus.cc:2804] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:35.881023 30340 raft_consensus.cc:697] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:35.882030 30340 consensus_queue.cc:237] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:35.887616 29460 raft_consensus.cc:2468] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.890132 29313 raft_consensus.cc:2468] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.891170 30222 leader_election.cc:290] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:35.896595 30169 leader_election.cc:304] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:35.892758 29135 catalog_manager.cc:5697] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 8dbe6e4429184e5fb137cae093024bce (127.17.40.4) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:35.898182 30339 raft_consensus.cc:2804] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:35.899427 30339 raft_consensus.cc:697] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:35.900635 30339 consensus_queue.cc:237] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:35.907850 30332 raft_consensus.cc:993] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.908883 30346 raft_consensus.cc:1081] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.914156 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bc94f78eb745a8ae182fa765caf007" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:35.914824 29460 raft_consensus.cc:3055] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:35.915635 29460 raft_consensus.cc:740] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:35.917423 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34758
I20260709 12:28:35.918071 30222 raft_consensus.cc:493] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.918493 30222 raft_consensus.cc:3060] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.921357 29460 consensus_queue.cc:260] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:35.923951 29460 raft_consensus.cc:3060] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.934209 29460 raft_consensus.cc:2468] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.936283 29135 catalog_manager.cc:5697] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.938098 29135 catalog_manager.cc:5697] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 8dbe6e4429184e5fb137cae093024bce (127.17.40.4) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.940761 30222 raft_consensus.cc:515] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:35.942672 30222 leader_election.cc:290] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:35.943472 29460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:35.944182 29460 raft_consensus.cc:3055] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:35.944491 29460 raft_consensus.cc:740] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:35.945938 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719834bbc8ea4a43a3fcf5ccbd9aab62" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:35.945818 29460 consensus_queue.cc:260] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:35.946548 29316 raft_consensus.cc:3060] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.947249 29460 raft_consensus.cc:3060] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.957315 29460 raft_consensus.cc:2468] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.958865 29316 raft_consensus.cc:2468] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:35.963424 30169 leader_election.cc:304] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:35.964963 30339 raft_consensus.cc:2804] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:35.965514 30339 raft_consensus.cc:697] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:35.966481 30339 consensus_queue.cc:237] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:35.975996 30350 raft_consensus.cc:993] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72: : Instructing follower 8dbe6e4429184e5fb137cae093024bce to start an election
I20260709 12:28:35.976822 30282 raft_consensus.cc:1081] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Signalling peer 8dbe6e4429184e5fb137cae093024bce to start an election
I20260709 12:28:35.979781 29459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
 from {username='slave'} at 127.0.0.1:39844
I20260709 12:28:35.980473 29459 raft_consensus.cc:493] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.980845 29459 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.982208 30320 raft_consensus.cc:993] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.982846 30320 raft_consensus.cc:1081] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:35.987437 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34758
I20260709 12:28:35.988045 30222 raft_consensus.cc:493] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.988648 30222 raft_consensus.cc:3060] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.988025 29135 catalog_manager.cc:5697] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 8dbe6e4429184e5fb137cae093024bce (127.17.40.4) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.997490 29459 raft_consensus.cc:515] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:36.000694 30222 raft_consensus.cc:515] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:36.002332 29459 leader_election.cc:290] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:36.004510 30222 leader_election.cc:290] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:36.005822 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:36.006455 29385 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.006543 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:36.007251 29389 raft_consensus.cc:3060] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.008884 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:36.009529 29316 raft_consensus.cc:3055] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:36.009841 29316 raft_consensus.cc:740] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:36.010720 29316 consensus_queue.cc:260] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:36.012459 29316 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.014533 29385 raft_consensus.cc:2468] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 2.
I20260709 12:28:36.015125 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ebdc5d6e304383b31da2f9f039a2fb" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:36.016479 29459 raft_consensus.cc:3055] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:36.016547 29427 leader_election.cc:304] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:36.017040 29459 raft_consensus.cc:740] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:36.017829 30346 raft_consensus.cc:2804] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:36.018368 30346 raft_consensus.cc:697] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:36.018107 29459 consensus_queue.cc:260] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:36.019788 29459 raft_consensus.cc:3060] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.019407 30346 consensus_queue.cc:237] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:36.028683 29459 raft_consensus.cc:2468] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:36.029881 30164 leader_election.cc:304] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 
I20260709 12:28:36.030789 30339 raft_consensus.cc:2804] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:36.031279 30339 raft_consensus.cc:697] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:36.031340 29389 raft_consensus.cc:2468] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:36.032505 29316 raft_consensus.cc:2468] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 2.
I20260709 12:28:36.032238 30339 consensus_queue.cc:237] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:36.047375 29135 catalog_manager.cc:5697] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 1 to 2, leader changed from c098fe137f19465bb9f67dbd64763b72 (127.17.40.2) to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 2 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:36.053190 29138 catalog_manager.cc:5697] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 8dbe6e4429184e5fb137cae093024bce (127.17.40.4) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:36.120241 29389 raft_consensus.cc:1275] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.121587 30339 consensus_queue.cc:1048] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.138938 29459 raft_consensus.cc:1275] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.145821 30339 consensus_queue.cc:1048] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:36.310082 29389 raft_consensus.cc:1275] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.311722 30339 consensus_queue.cc:1048] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.328105 29460 raft_consensus.cc:1275] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.329841 30348 consensus_queue.cc:1048] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:36.357383 29313 raft_consensus.cc:1275] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.358714 30348 consensus_queue.cc:1048] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.366602 29316 raft_consensus.cc:1275] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.368005 30348 consensus_queue.cc:1048] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.382426 29389 raft_consensus.cc:1275] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.383679 30339 consensus_queue.cc:1048] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.398819 29460 raft_consensus.cc:1275] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.401389 30339 consensus_queue.cc:1048] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.425689 29314 raft_consensus.cc:1275] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.430066 30339 consensus_queue.cc:1048] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:36.479339 29382 raft_consensus.cc:1275] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 8dbe6e4429184e5fb137cae093024bce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.488090 29382 raft_consensus.cc:1275] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.491952 30339 consensus_queue.cc:1048] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.493983 29459 raft_consensus.cc:1275] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.499838 30339 consensus_queue.cc:1048] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.502235 30329 consensus_queue.cc:1048] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:36.519795 29459 raft_consensus.cc:1275] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.522441 30339 consensus_queue.cc:1048] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.536813 29312 raft_consensus.cc:1275] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 8dbe6e4429184e5fb137cae093024bce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.538746 30320 consensus_queue.cc:1048] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.616498 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:36.655189 29382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0"
dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:57188
I20260709 12:28:36.655774 29382 raft_consensus.cc:606] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:36.658690 29459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21efe1fe062e4b28bbfa5e3832bb2df9"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:28:36.659400 29459 raft_consensus.cc:606] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:36.662159 29312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688"
dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
mode: GRACEFUL
new_leader_uuid: "8dbe6e4429184e5fb137cae093024bce"
 from {username='slave'} at 127.0.0.1:58028
I20260709 12:28:36.662655 29312 raft_consensus.cc:606] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Received request to transfer leadership to TS 8dbe6e4429184e5fb137cae093024bce
I20260709 12:28:36.665196 29312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8"
dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:58028
I20260709 12:28:36.665789 29312 raft_consensus.cc:606] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:36.668591 29382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb406a0615254e56b17f64445f811223"
dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:57188
I20260709 12:28:36.669239 29382 raft_consensus.cc:606] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:36.670840 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:36.672650 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:36.673456 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:36.903797 30320 raft_consensus.cc:993] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:36.904369 30346 raft_consensus.cc:1081] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:36.905948 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21efe1fe062e4b28bbfa5e3832bb2df9"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34758
I20260709 12:28:36.906489 30222 raft_consensus.cc:493] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:36.906780 30222 raft_consensus.cc:3060] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.912281 30222 raft_consensus.cc:515] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:36.914347 30222 leader_election.cc:290] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:36.916097 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21efe1fe062e4b28bbfa5e3832bb2df9" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:36.916802 29382 raft_consensus.cc:3060] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.917255 29459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21efe1fe062e4b28bbfa5e3832bb2df9" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:36.917879 29459 raft_consensus.cc:3055] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:36.918175 29459 raft_consensus.cc:740] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:36.918975 29459 consensus_queue.cc:260] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:36.920061 29459 raft_consensus.cc:3060] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.927560 29459 raft_consensus.cc:2468] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:36.928820 30164 leader_election.cc:304] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 
I20260709 12:28:36.930573 29382 raft_consensus.cc:2468] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:36.930984 30375 raft_consensus.cc:2804] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:36.931559 30375 raft_consensus.cc:697] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:36.932466 30375 consensus_queue.cc:237] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:36.943813 29139 catalog_manager.cc:5697] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 8dbe6e4429184e5fb137cae093024bce (127.17.40.4) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:36.988389 30323 raft_consensus.cc:993] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:36.988907 30323 raft_consensus.cc:1081] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:36.990435 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb406a0615254e56b17f64445f811223"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34774
I20260709 12:28:36.991022 30222 raft_consensus.cc:493] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:36.991376 30222 raft_consensus.cc:3060] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.998661 30222 raft_consensus.cc:515] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:37.000530 30222 leader_election.cc:290] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:37.001305 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb406a0615254e56b17f64445f811223" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:37.001565 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb406a0615254e56b17f64445f811223" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:37.001881 29312 raft_consensus.cc:3060] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.002146 29389 raft_consensus.cc:3055] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:37.002379 29389 raft_consensus.cc:740] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:37.003151 29389 consensus_queue.cc:260] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:37.003994 29389 raft_consensus.cc:3060] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.009407 29312 raft_consensus.cc:2468] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:37.010761 30169 leader_election.cc:304] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:37.011641 30340 raft_consensus.cc:2804] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:37.012121 30340 raft_consensus.cc:697] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:37.013007 30340 consensus_queue.cc:237] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:37.013487 29389 raft_consensus.cc:2468] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:37.023943 29138 catalog_manager.cc:5697] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:37.030586 30282 raft_consensus.cc:993] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72: : Instructing follower 8dbe6e4429184e5fb137cae093024bce to start an election
I20260709 12:28:37.031111 30350 raft_consensus.cc:1081] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Signalling peer 8dbe6e4429184e5fb137cae093024bce to start an election
I20260709 12:28:37.033126 29460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
 from {username='slave'} at 127.0.0.1:39844
I20260709 12:28:37.033819 29460 raft_consensus.cc:493] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:37.034224 29460 raft_consensus.cc:3060] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.043679 29460 raft_consensus.cc:515] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:37.045377 30328 raft_consensus.cc:993] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:37.045928 30328 raft_consensus.cc:1081] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:37.047801 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:37.048303 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6367cd0a53431592b263b9893fe688" candidate_uuid: "8dbe6e4429184e5fb137cae093024bce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:37.049019 29382 raft_consensus.cc:3060] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.048076 29460 leader_election.cc:290] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:37.048450 29312 raft_consensus.cc:3055] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:37.050436 29312 raft_consensus.cc:740] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:37.051527 29312 consensus_queue.cc:260] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:37.052870 29312 raft_consensus.cc:3060] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.056588 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34774
I20260709 12:28:37.057020 29382 raft_consensus.cc:2468] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 2.
I20260709 12:28:37.057173 30222 raft_consensus.cc:493] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:37.057677 30222 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.058490 29427 leader_election.cc:304] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:37.059347 30346 raft_consensus.cc:2804] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:37.059880 30346 raft_consensus.cc:697] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Becoming Leader. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:37.059957 29312 raft_consensus.cc:2468] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dbe6e4429184e5fb137cae093024bce in term 2.
I20260709 12:28:37.060767 30346 consensus_queue.cc:237] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:37.064648 30282 raft_consensus.cc:993] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:37.065279 30350 raft_consensus.cc:1081] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:37.065569 30222 raft_consensus.cc:515] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:37.067834 30225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34788
I20260709 12:28:37.068478 30225 raft_consensus.cc:493] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:37.068914 30225 raft_consensus.cc:3060] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.069240 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:37.069989 29382 raft_consensus.cc:3055] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:37.070327 29382 raft_consensus.cc:740] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:37.067955 30222 leader_election.cc:290] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 3 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:37.071777 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f041c0e08404949a06ddbd74b8d2ab0" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:37.072474 29312 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.072125 29382 consensus_queue.cc:260] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:37.073650 29382 raft_consensus.cc:3060] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.079968 29312 raft_consensus.cc:2468] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 3.
I20260709 12:28:37.078156 30225 raft_consensus.cc:515] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:37.081221 30169 leader_election.cc:304] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:37.081308 29382 raft_consensus.cc:2468] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 3.
I20260709 12:28:37.082268 30340 raft_consensus.cc:2804] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:37.082804 30340 raft_consensus.cc:697] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:37.083716 30225 leader_election.cc:290] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:37.083791 30340 consensus_queue.cc:237] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:37.085443 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:37.086004 29463 raft_consensus.cc:3060] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.089080 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7afb986dea142578781a4b0902cf6b8" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:37.089857 29312 raft_consensus.cc:3055] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:37.090135 29312 raft_consensus.cc:740] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:37.090958 29312 consensus_queue.cc:260] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:37.092283 29312 raft_consensus.cc:3060] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.093825 29463 raft_consensus.cc:2468] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:37.093986 29138 catalog_manager.cc:5697] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce reported cstate change: term changed from 1 to 2, leader changed from c098fe137f19465bb9f67dbd64763b72 (127.17.40.2) to 8dbe6e4429184e5fb137cae093024bce (127.17.40.4). New cstate: current_term: 2 leader_uuid: "8dbe6e4429184e5fb137cae093024bce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:37.095175 30164 leader_election.cc:304] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 
I20260709 12:28:37.096238 30340 raft_consensus.cc:2804] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:37.096830 30340 raft_consensus.cc:697] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:37.097014 29139 catalog_manager.cc:5697] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 2 to 3, leader changed from 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:37.098017 30340 consensus_queue.cc:237] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:37.099483 29312 raft_consensus.cc:2468] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:37.125092 29139 catalog_manager.cc:5697] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from c098fe137f19465bb9f67dbd64763b72 (127.17.40.2) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:37.448753 29382 raft_consensus.cc:1275] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.450522 30375 consensus_queue.cc:1048] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.462963 29460 raft_consensus.cc:1275] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.465163 30348 consensus_queue.cc:1048] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.480562 29316 raft_consensus.cc:1275] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.482185 30375 consensus_queue.cc:1048] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.493422 29385 raft_consensus.cc:1275] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.491398 29463 raft_consensus.cc:1275] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.495194 30348 consensus_queue.cc:1048] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.495821 30375 consensus_queue.cc:1048] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.546329 29316 raft_consensus.cc:1275] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.548111 30395 consensus_queue.cc:1048] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.614620 29316 raft_consensus.cc:1275] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 8dbe6e4429184e5fb137cae093024bce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.615979 30332 consensus_queue.cc:1048] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.627538 29382 raft_consensus.cc:1275] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 8dbe6e4429184e5fb137cae093024bce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.629235 30346 consensus_queue.cc:1048] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.661962 29316 raft_consensus.cc:1275] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:37.664925 30395 consensus_queue.cc:1048] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:37.668342 29382 raft_consensus.cc:1275] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:37.669984 30340 consensus_queue.cc:1048] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:37.711946 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:37.762064 29312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32ff10fa1089410688f12362821cc67f"
dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:58028
I20260709 12:28:37.762693 29312 raft_consensus.cc:606] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:37.765641 29312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053"
dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:58028
I20260709 12:28:37.766189 29312 raft_consensus.cc:606] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:37.769641 29460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f"
dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
mode: GRACEFUL
new_leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
 from {username='slave'} at 127.0.0.1:33388
I20260709 12:28:37.770242 29460 raft_consensus.cc:606] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Received request to transfer leadership to TS 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:37.773437 29312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663"
dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:58028
I20260709 12:28:37.774051 29312 raft_consensus.cc:606] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:37.775190 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:28:37.776664 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:37.777493 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:37.841135 30350 raft_consensus.cc:993] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:37.841780 30350 raft_consensus.cc:1081] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:37.844633 30225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34788
I20260709 12:28:37.845218 30225 raft_consensus.cc:493] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:37.845575 30225 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.852299 30225 raft_consensus.cc:515] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:37.854518 30225 leader_election.cc:290] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 3 election: Requested vote from peers 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:37.855607 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:37.855852 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d66330581c44f65ab1e6c89c0da8053" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:37.856240 29316 raft_consensus.cc:3055] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:37.856447 29463 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.856599 29316 raft_consensus.cc:740] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:37.857455 29316 consensus_queue.cc:260] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:37.858474 29316 raft_consensus.cc:3060] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.862075 29463 raft_consensus.cc:2468] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 3.
I20260709 12:28:37.863502 30164 leader_election.cc:304] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 8dbe6e4429184e5fb137cae093024bce; no voters: 
I20260709 12:28:37.863973 29316 raft_consensus.cc:2468] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 3.
I20260709 12:28:37.864288 30395 raft_consensus.cc:2804] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:37.864959 30395 raft_consensus.cc:697] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:37.865955 30395 consensus_queue.cc:237] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:37.878559 29139 catalog_manager.cc:5697] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 2 to 3, leader changed from c098fe137f19465bb9f67dbd64763b72 (127.17.40.2) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:38.078531 30398 raft_consensus.cc:993] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce: : Instructing follower 96bd9c3c81e04118abc2fe11d2b361ed to start an election
I20260709 12:28:38.079082 30346 raft_consensus.cc:1081] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Signalling peer 96bd9c3c81e04118abc2fe11d2b361ed to start an election
I20260709 12:28:38.080659 29382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f"
dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
 from {username='slave'} at 127.0.0.1:48896
I20260709 12:28:38.081086 29382 raft_consensus.cc:493] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.081347 29382 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.088800 29382 raft_consensus.cc:515] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:38.091141 29382 leader_election.cc:290] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 3 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 8dbe6e4429184e5fb137cae093024bce (127.17.40.4:34741)
I20260709 12:28:38.091959 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:38.092643 29316 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.092250 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a087124d7b34efe966b79089d1ec64f" candidate_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8dbe6e4429184e5fb137cae093024bce"
I20260709 12:28:38.093261 29463 raft_consensus.cc:3055] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:38.093568 29463 raft_consensus.cc:740] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dbe6e4429184e5fb137cae093024bce, State: Running, Role: LEADER
I20260709 12:28:38.094342 29463 consensus_queue.cc:260] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:38.095609 29463 raft_consensus.cc:3060] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.103211 29316 raft_consensus.cc:2468] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 3.
I20260709 12:28:38.105010 29356 leader_election.cc:304] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96bd9c3c81e04118abc2fe11d2b361ed, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:38.106185 30323 raft_consensus.cc:2804] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:38.106805 30323 raft_consensus.cc:697] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 LEADER]: Becoming Leader. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:38.106602 29463 raft_consensus.cc:2468] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96bd9c3c81e04118abc2fe11d2b361ed in term 3.
I20260709 12:28:38.107844 30323 consensus_queue.cc:237] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } }
I20260709 12:28:38.121876 29139 catalog_manager.cc:5697] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed reported cstate change: term changed from 2 to 3, leader changed from 8dbe6e4429184e5fb137cae093024bce (127.17.40.4) to 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3). New cstate: current_term: 3 leader_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:38.221186 30352 raft_consensus.cc:993] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:38.221714 30352 raft_consensus.cc:1081] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:38.224110 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32ff10fa1089410688f12362821cc67f"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34788
I20260709 12:28:38.224720 30222 raft_consensus.cc:493] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.225123 30222 raft_consensus.cc:3060] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.232645 30222 raft_consensus.cc:515] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:38.235334 30222 leader_election.cc:290] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:38.236352 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:38.237043 29382 raft_consensus.cc:3060] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.236382 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ff10fa1089410688f12362821cc67f" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:38.238760 29316 raft_consensus.cc:3055] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:38.239156 29316 raft_consensus.cc:740] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:38.239990 29316 consensus_queue.cc:260] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:38.241050 29316 raft_consensus.cc:3060] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.243889 29382 raft_consensus.cc:2468] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:38.245177 30164 leader_election.cc:304] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:38.246001 30340 raft_consensus.cc:2804] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:38.246500 30340 raft_consensus.cc:697] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:38.246942 29316 raft_consensus.cc:2468] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:38.247430 30340 consensus_queue.cc:237] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:38.259476 29139 catalog_manager.cc:5697] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from c098fe137f19465bb9f67dbd64763b72 (127.17.40.2) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:38.285518 30350 raft_consensus.cc:993] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:38.286168 30352 raft_consensus.cc:1081] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:38.288024 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34788
I20260709 12:28:38.288661 30222 raft_consensus.cc:493] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.289050 30222 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.294250 30222 raft_consensus.cc:515] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:38.295849 30222 leader_election.cc:290] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 3 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:38.296782 29316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:38.296867 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31ecc85ad2246b194eb65cbc188a663" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:38.297475 29316 raft_consensus.cc:3055] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:38.297852 29316 raft_consensus.cc:740] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c098fe137f19465bb9f67dbd64763b72, State: Running, Role: LEADER
I20260709 12:28:38.297933 29382 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.298604 29316 consensus_queue.cc:260] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:38.299885 29316 raft_consensus.cc:3060] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.306643 29382 raft_consensus.cc:2468] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 3.
I20260709 12:28:38.307981 30164 leader_election.cc:304] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed; no voters: 
I20260709 12:28:38.308846 30340 raft_consensus.cc:2804] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:38.309381 30340 raft_consensus.cc:697] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:38.310364 30340 consensus_queue.cc:237] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:38.310845 29316 raft_consensus.cc:2468] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 3.
I20260709 12:28:38.312528 29463 raft_consensus.cc:1275] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.314610 29316 raft_consensus.cc:1275] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.315965 30348 consensus_queue.cc:1048] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:38.317034 30375 consensus_queue.cc:1048] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:38.325042 29139 catalog_manager.cc:5697] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 2 to 3, leader changed from c098fe137f19465bb9f67dbd64763b72 (127.17.40.2) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:38.489473 29312 raft_consensus.cc:1275] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Refusing update from remote peer 96bd9c3c81e04118abc2fe11d2b361ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.490840 30323 consensus_queue.cc:1048] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:38.505930 29463 raft_consensus.cc:1275] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Refusing update from remote peer 96bd9c3c81e04118abc2fe11d2b361ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.509423 30419 consensus_queue.cc:1048] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:38.690611 29382 raft_consensus.cc:1275] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:38.691975 30348 consensus_queue.cc:1048] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:38.707679 29316 raft_consensus.cc:1275] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:38.709436 30395 consensus_queue.cc:1048] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:38.748261 29316 raft_consensus.cc:1275] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.749709 30395 consensus_queue.cc:1048] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:38.761497 29385 raft_consensus.cc:1275] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.766091 30348 consensus_queue.cc:1048] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:38.821979 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:38.861112 29382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49368782c45545549da92ef0b10a987e"
dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
mode: GRACEFUL
new_leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:57188
I20260709 12:28:38.861696 29382 raft_consensus.cc:606] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Received request to transfer leadership to TS 629ba7d0b7eb4d9b8832b0f605f79443
I20260709 12:28:38.863061 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:38.864357 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:38.865011 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:39.046779 30323 raft_consensus.cc:993] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed: : Instructing follower 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:39.047313 30419 raft_consensus.cc:1081] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Signalling peer 629ba7d0b7eb4d9b8832b0f605f79443 to start an election
I20260709 12:28:39.049165 30222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49368782c45545549da92ef0b10a987e"
dest_uuid: "629ba7d0b7eb4d9b8832b0f605f79443"
 from {username='slave'} at 127.0.0.1:34774
I20260709 12:28:39.049695 30222 raft_consensus.cc:493] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:39.049994 30222 raft_consensus.cc:3060] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:39.055963 30222 raft_consensus.cc:515] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:39.058030 30222 leader_election.cc:290] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Requested vote from peers c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675), 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901)
I20260709 12:28:39.058529 29312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c098fe137f19465bb9f67dbd64763b72"
I20260709 12:28:39.059281 29312 raft_consensus.cc:3060] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:39.060031 29385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49368782c45545549da92ef0b10a987e" candidate_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96bd9c3c81e04118abc2fe11d2b361ed"
I20260709 12:28:39.060704 29385 raft_consensus.cc:3055] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:39.060972 29385 raft_consensus.cc:740] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96bd9c3c81e04118abc2fe11d2b361ed, State: Running, Role: LEADER
I20260709 12:28:39.061604 29385 consensus_queue.cc:260] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:39.062635 29385 raft_consensus.cc:3060] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:39.065286 29312 raft_consensus.cc:2468] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:39.066609 30169 leader_election.cc:304] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72; no voters: 
I20260709 12:28:39.067374 30348 raft_consensus.cc:2804] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:39.067695 29385 raft_consensus.cc:2468] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629ba7d0b7eb4d9b8832b0f605f79443 in term 2.
I20260709 12:28:39.067855 30348 raft_consensus.cc:697] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Becoming Leader. State: Replica: 629ba7d0b7eb4d9b8832b0f605f79443, State: Running, Role: LEADER
I20260709 12:28:39.069355 30348 consensus_queue.cc:237] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } }
I20260709 12:28:39.081136 29138 catalog_manager.cc:5697] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 reported cstate change: term changed from 1 to 2, leader changed from 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3) to 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:39.584967 29312 raft_consensus.cc:1275] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:39.586479 30375 consensus_queue.cc:1048] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:39.607100 29385 raft_consensus.cc:1275] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Refusing update from remote peer 629ba7d0b7eb4d9b8832b0f605f79443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:39.609001 30375 consensus_queue.cc:1048] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:39.906072 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:39.942373 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:39.943457 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:39.943961 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:39.977962 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:40.015712 17568 tablet_server.cc:179] TabletServer@127.17.40.1:35813 shutting down...
W20260709 12:28:40.024909 29427 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 320 similar messages]
W20260709 12:28:40.029989 29427 consensus_peers.cc:597] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.090765 29279 consensus_peers.cc:597] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.097832 29353 consensus_peers.cc:597] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.097210 29279 consensus_peers.cc:597] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.102129 29353 consensus_peers.cc:597] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.107860 29427 consensus_peers.cc:597] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.111063 29353 consensus_peers.cc:597] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.112874 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:40.113966 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.115149 17568 raft_consensus.cc:2243] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.115787 17568 raft_consensus.cc:2272] T 85f3994d7ed94748b84df1afd9e331fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.118880 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.119558 17568 raft_consensus.cc:2243] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.119982 17568 raft_consensus.cc:2272] T 995ae76c376541159f0e79e554e34cd2 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.122058 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.123039 17568 raft_consensus.cc:2243] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.123553 17568 raft_consensus.cc:2272] T b7e6ef31c2e34233803b7c52b878c0ef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.126284 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.126959 17568 raft_consensus.cc:2243] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.127745 17568 raft_consensus.cc:2272] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.129769 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.130508 17568 raft_consensus.cc:2243] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.131448 17568 raft_consensus.cc:2272] T fb406a0615254e56b17f64445f811223 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.133869 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.134609 17568 raft_consensus.cc:2243] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.135052 17568 raft_consensus.cc:2272] T 884f2ad3d291412691e9a8815a9d7838 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.137323 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.138044 17568 raft_consensus.cc:2243] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.138540 17568 raft_consensus.cc:2272] T 109246823e454b4ea19cff032f7345a3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.141698 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.142634 17568 raft_consensus.cc:2243] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.143167 17568 raft_consensus.cc:2272] T f63924737d2d47bf8921d8c66bb9967e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.145876 29279 consensus_peers.cc:597] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.146924 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.147843 17568 raft_consensus.cc:2243] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.148427 17568 raft_consensus.cc:2272] T 84317ec210984cb490e9b8af0ddf23ff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.151564 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.152633 17568 raft_consensus.cc:2243] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:40.153225 29353 consensus_peers.cc:597] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.153692 17568 raft_consensus.cc:2272] T 32ff10fa1089410688f12362821cc67f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.157013 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.157806 17568 raft_consensus.cc:2243] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.158198 17568 raft_consensus.cc:2272] T 91c3c65a128840b8a030ea09d702ead4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.161263 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.162106 17568 raft_consensus.cc:2243] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.162704 17568 raft_consensus.cc:2272] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.165827 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.166813 17568 raft_consensus.cc:2243] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.167368 17568 raft_consensus.cc:2272] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.170503 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.171155 17568 raft_consensus.cc:2243] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:40.171299 29427 consensus_peers.cc:597] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.171794 17568 raft_consensus.cc:2272] T 182ad32890aa4949b7f06c2dae04a331 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.172173 29427 consensus_peers.cc:597] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.174592 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.175434 17568 raft_consensus.cc:2243] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.176155 17568 raft_consensus.cc:2272] T f31ecc85ad2246b194eb65cbc188a663 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.178624 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.179447 17568 raft_consensus.cc:2243] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.180392 17568 raft_consensus.cc:2272] T 0f041c0e08404949a06ddbd74b8d2ab0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.181790 29427 consensus_peers.cc:597] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.182934 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.183672 17568 raft_consensus.cc:2243] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.184105 17568 raft_consensus.cc:2272] T 634977a6ff1244a3a46eb6a9b9ceb36a P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.186247 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.186882 17568 raft_consensus.cc:2243] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.187357 17568 raft_consensus.cc:2272] T b49d0ab7da7f4218a16f383088db71d3 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.189610 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.190280 17568 raft_consensus.cc:2243] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.191156 17568 raft_consensus.cc:2272] T 552b1f2771eb4fcb81923b5712b47b2f P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.193401 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.194024 17568 raft_consensus.cc:2243] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.194551 17568 raft_consensus.cc:2272] T e2dd764d395b4a1db1fa0542bad9979b P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.197546 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.198491 17568 raft_consensus.cc:2243] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.199343 17568 raft_consensus.cc:2272] T e123d694327a439f955f8e8831cbbfef P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.201407 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.202086 17568 raft_consensus.cc:2243] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.202950 17568 raft_consensus.cc:2272] T a5bc94f78eb745a8ae182fa765caf007 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.205652 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.206351 17568 raft_consensus.cc:2243] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.206805 17568 raft_consensus.cc:2272] T 643c24bf9c694736abe899bcaa6e99f0 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.209614 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.210371 17568 raft_consensus.cc:2243] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.210943 17568 raft_consensus.cc:2272] T c59b9f4048214a868afee18cf9e843fd P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.212239 29279 consensus_peers.cc:597] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.213536 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.214254 17568 raft_consensus.cc:2243] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.214800 17568 raft_consensus.cc:2272] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.216935 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.217546 17568 raft_consensus.cc:2243] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.218056 17568 raft_consensus.cc:2272] T 2db86f70e69d430d914533e9338966da P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.220942 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.221700 17568 raft_consensus.cc:2243] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.222256 17568 raft_consensus.cc:2272] T 18cc57e0ce6841219ed37c3d7d5a70be P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.225432 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.226048 17568 raft_consensus.cc:2243] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.226514 17568 raft_consensus.cc:2272] T b010149f21014bed809737f86f527ccc P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.228497 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.229068 17568 raft_consensus.cc:2243] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.229460 17568 raft_consensus.cc:2272] T 52884fe0058e4164905c706a05528483 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.231585 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.232177 17568 raft_consensus.cc:2243] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.233108 17568 raft_consensus.cc:2272] T 4d66330581c44f65ab1e6c89c0da8053 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.235898 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.236763 17568 raft_consensus.cc:2243] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:40.236799 29279 consensus_peers.cc:597] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.237303 17568 raft_consensus.cc:2272] T 861e1b95735b4e49a7d677502df85d2c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.240003 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.240640 17568 raft_consensus.cc:2243] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.241452 17568 raft_consensus.cc:2272] T a7afb986dea142578781a4b0902cf6b8 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.243656 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.244357 17568 raft_consensus.cc:2243] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.244776 17568 raft_consensus.cc:2272] T 805181416bfb47f0a641552cee55b488 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.246932 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.247509 17568 raft_consensus.cc:2243] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.248034 17568 raft_consensus.cc:2272] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.251001 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.251822 17568 raft_consensus.cc:2243] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.252369 17568 raft_consensus.cc:2272] T bbc799754b16428a9fd044cbd3073a05 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.252697 29279 consensus_peers.cc:597] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.255415 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.256299 17568 raft_consensus.cc:2243] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.257320 17568 raft_consensus.cc:2272] T 49368782c45545549da92ef0b10a987e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.260569 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.261183 17568 raft_consensus.cc:2243] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.262188 17568 raft_consensus.cc:2272] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.265364 17568 tablet_replica.cc:333] stopping tablet replica
W20260709 12:28:40.265784 29353 consensus_peers.cc:597] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.266233 17568 raft_consensus.cc:2243] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.266938 17568 raft_consensus.cc:2272] T e09b1a02c21b411f97bf8eeb736a44ea P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.269691 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.270651 17568 raft_consensus.cc:2243] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.271135 17568 raft_consensus.cc:2272] T ae36f5a0ab77484ba95cc4f091a975c4 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.274145 17568 tablet_replica.cc:333] stopping tablet replica
W20260709 12:28:40.274696 29353 consensus_peers.cc:597] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.274981 17568 raft_consensus.cc:2243] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.275699 17568 raft_consensus.cc:2272] T ffee763875334a56886a8163b24992db P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.278769 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.279629 17568 raft_consensus.cc:2243] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.280186 17568 raft_consensus.cc:2272] T a4bb3ad82b4543fb90ad68213c62327e P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.283335 17568 tablet_replica.cc:333] stopping tablet replica
W20260709 12:28:40.283556 29353 consensus_peers.cc:597] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.283957 17568 raft_consensus.cc:2243] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:40.283634 29279 consensus_peers.cc:597] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.284983 17568 raft_consensus.cc:2272] T af5e140659184a569b1e220d086f4b63 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.287405 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.288121 17568 raft_consensus.cc:2243] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.288589 17568 raft_consensus.cc:2272] T 39b597f990ad43f0b26beedf929c6aff P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.291419 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.292002 17568 raft_consensus.cc:2243] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.292538 17568 raft_consensus.cc:2272] T f8adbb821c8c4e11ad628089fc00d166 P 629ba7d0b7eb4d9b8832b0f605f79443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.295624 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.296398 17568 raft_consensus.cc:2243] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:40.296983 29427 consensus_peers.cc:597] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.297457 17568 raft_consensus.cc:2272] T 93ebdc5d6e304383b31da2f9f039a2fb P 629ba7d0b7eb4d9b8832b0f605f79443 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.304117 29353 consensus_peers.cc:597] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.328106 29427 consensus_peers.cc:597] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.355247 29427 consensus_peers.cc:597] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.378511 17568 tablet_server.cc:196] TabletServer@127.17.40.1:35813 shutdown complete.
W20260709 12:28:40.394773 29427 consensus_peers.cc:597] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.415158 29279 consensus_peers.cc:597] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.423354 29353 consensus_peers.cc:597] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.447700 29353 consensus_peers.cc:597] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.470072 17568 tablet_server.cc:179] TabletServer@127.17.40.2:0 shutting down...
W20260709 12:28:40.474998 29427 consensus_peers.cc:597] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.476588 29430 consensus_peers.cc:597] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.503036 29356 consensus_peers.cc:597] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.518381 29356 consensus_peers.cc:597] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.519304 29279 consensus_peers.cc:597] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.528106 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:40.529183 17568 tablet_replica.cc:333] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.530382 17568 raft_consensus.cc:2243] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.531544 17568 raft_consensus.cc:2272] T ffee763875334a56886a8163b24992db P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.534965 17568 tablet_replica.cc:333] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.535766 17568 raft_consensus.cc:2243] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.536379 17568 raft_consensus.cc:2272] T 861e1b95735b4e49a7d677502df85d2c P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.539974 17568 tablet_replica.cc:333] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.540752 17568 raft_consensus.cc:2243] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.541818 17568 raft_consensus.cc:2272] T e3b328ca221d47f2a2ce812ca6545c69 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.544816 17568 tablet_replica.cc:333] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.545662 17568 raft_consensus.cc:2243] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.546247 17568 raft_consensus.cc:2272] T 013bc4e256b44d7bad8a2915325ebf16 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.549274 17568 tablet_replica.cc:333] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.550184 17568 raft_consensus.cc:2243] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.551323 17568 raft_consensus.cc:2272] T 6a89b86cbfd049bb9445919c85a2a661 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.554495 17568 tablet_replica.cc:333] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.555389 17568 raft_consensus.cc:2243] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.555972 17568 raft_consensus.cc:2272] T 39b597f990ad43f0b26beedf929c6aff P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.559268 17568 tablet_replica.cc:333] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.560218 17568 raft_consensus.cc:2243] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.560798 17568 raft_consensus.cc:2272] T af5e140659184a569b1e220d086f4b63 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.563635 17568 tablet_replica.cc:333] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.564548 17568 raft_consensus.cc:2243] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.565054 17568 raft_consensus.cc:2272] T 28d6a39a3308459fa622a39fb1bf5dad P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.578305 17568 tablet_replica.cc:333] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.579356 17568 raft_consensus.cc:2243] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.580060 17568 raft_consensus.cc:2272] T 49368782c45545549da92ef0b10a987e P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.588779 17568 tablet_replica.cc:333] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.589532 17568 raft_consensus.cc:2243] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.590016 17568 raft_consensus.cc:2272] T 070e1d9927ae4642bb5c37d25f11c996 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.592808 17568 tablet_replica.cc:333] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.593551 17568 raft_consensus.cc:2243] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.594203 17568 raft_consensus.cc:2272] T ae36f5a0ab77484ba95cc4f091a975c4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.597127 17568 tablet_replica.cc:333] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.597956 17568 raft_consensus.cc:2243] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.599146 17568 raft_consensus.cc:2272] T e09b1a02c21b411f97bf8eeb736a44ea P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.600132 29356 consensus_peers.cc:597] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.600874 29356 consensus_peers.cc:597] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.601540 29356 consensus_peers.cc:597] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.602066 17568 tablet_replica.cc:333] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.602902 17568 raft_consensus.cc:2243] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.603420 17568 raft_consensus.cc:2272] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.605935 17568 tablet_replica.cc:333] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.606639 17568 raft_consensus.cc:2243] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.607661 17568 raft_consensus.cc:2272] T 305487a552d34f96a1555a8d55564031 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.610184 17568 tablet_replica.cc:333] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.611008 17568 raft_consensus.cc:2243] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.611545 17568 raft_consensus.cc:2272] T fb406a0615254e56b17f64445f811223 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.614301 17568 tablet_replica.cc:333] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.615238 17568 raft_consensus.cc:2243] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:40.615229 29427 consensus_peers.cc:597] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.616267 17568 raft_consensus.cc:2272] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.618635 17568 tablet_replica.cc:333] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.619273 17568 raft_consensus.cc:2243] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.619742 17568 raft_consensus.cc:2272] T 109246823e454b4ea19cff032f7345a3 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.621830 17568 tablet_replica.cc:333] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.622493 17568 raft_consensus.cc:2243] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.623445 17568 raft_consensus.cc:2272] T ae09303fa81d45f086eec87509b6e72b P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.625496 17568 tablet_replica.cc:333] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.626250 17568 raft_consensus.cc:2243] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.626935 17568 raft_consensus.cc:2272] T 85f3994d7ed94748b84df1afd9e331fd P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.629792 17568 tablet_replica.cc:333] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.633152 17568 raft_consensus.cc:2243] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.634418 17568 raft_consensus.cc:2272] T b49d0ab7da7f4218a16f383088db71d3 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.634739 29427 consensus_peers.cc:597] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce -> Peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Couldn't send request to peer 629ba7d0b7eb4d9b8832b0f605f79443. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.637660 17568 tablet_replica.cc:333] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.638651 17568 raft_consensus.cc:2243] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.639294 17568 raft_consensus.cc:2272] T 9a087124d7b34efe966b79089d1ec64f P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.642114 17568 tablet_replica.cc:333] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.642817 17568 raft_consensus.cc:2243] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.643378 17568 raft_consensus.cc:2272] T a5bc94f78eb745a8ae182fa765caf007 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.646247 17568 tablet_replica.cc:333] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.647245 17568 raft_consensus.cc:2243] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.648826 17568 raft_consensus.cc:2272] T 86e528a3aa1c4b73a3f5dad737cf41a4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.650588 29430 consensus_peers.cc:597] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.652181 17568 tablet_replica.cc:333] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.653225 17568 raft_consensus.cc:2243] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.654386 17568 raft_consensus.cc:2272] T f63924737d2d47bf8921d8c66bb9967e P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.657436 17568 tablet_replica.cc:333] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.658277 17568 raft_consensus.cc:2243] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.658915 17568 raft_consensus.cc:2272] T f31ecc85ad2246b194eb65cbc188a663 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.660145 29356 consensus_peers.cc:597] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.661645 17568 tablet_replica.cc:333] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.662343 17568 raft_consensus.cc:2243] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.662922 17568 raft_consensus.cc:2272] T 884c1fec4f1f4f7db0bf24665b7826c5 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.665666 17568 tablet_replica.cc:333] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.666625 17568 raft_consensus.cc:2243] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.667856 17568 raft_consensus.cc:2272] T c59b9f4048214a868afee18cf9e843fd P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.671077 17568 tablet_replica.cc:333] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.672032 17568 raft_consensus.cc:2243] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.672734 17568 raft_consensus.cc:2272] T 0f041c0e08404949a06ddbd74b8d2ab0 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.675643 17568 tablet_replica.cc:333] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.676627 17568 raft_consensus.cc:2243] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.677736 17568 raft_consensus.cc:2272] T 634977a6ff1244a3a46eb6a9b9ceb36a P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.680873 17568 tablet_replica.cc:333] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.681687 17568 raft_consensus.cc:2243] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.682257 17568 raft_consensus.cc:2272] T 9cd8b20a4d4149f2aefaf5d791c65c89 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.684638 17568 tablet_replica.cc:333] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.685258 17568 raft_consensus.cc:2243] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.685737 17568 raft_consensus.cc:2272] T cc0ac53345b44e3abcf7fd2b8a8e4518 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.688174 17568 tablet_replica.cc:333] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.688764 17568 raft_consensus.cc:2243] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.689285 17568 raft_consensus.cc:2272] T 182ad32890aa4949b7f06c2dae04a331 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.692157 17568 tablet_replica.cc:333] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.692950 17568 raft_consensus.cc:2243] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:40.692989 29430 consensus_peers.cc:597] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.693491 17568 raft_consensus.cc:2272] T 47d481b0699148d0a3874c922f9faa21 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.695396 29430 consensus_peers.cc:597] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.696142 29430 consensus_peers.cc:597] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.696590 17568 tablet_replica.cc:333] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.697496 17568 raft_consensus.cc:2243] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.698066 17568 raft_consensus.cc:2272] T 52884fe0058e4164905c706a05528483 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.701009 17568 tablet_replica.cc:333] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.701900 17568 raft_consensus.cc:2243] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.702477 17568 raft_consensus.cc:2272] T 4d66330581c44f65ab1e6c89c0da8053 P c098fe137f19465bb9f67dbd64763b72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.705430 17568 tablet_replica.cc:333] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.706013 17568 raft_consensus.cc:2243] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.706465 17568 raft_consensus.cc:2272] T 2db86f70e69d430d914533e9338966da P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.708469 17568 tablet_replica.cc:333] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.709105 17568 raft_consensus.cc:2243] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.709846 17568 raft_consensus.cc:2272] T b010149f21014bed809737f86f527ccc P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.712009 17568 tablet_replica.cc:333] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.712596 17568 raft_consensus.cc:2243] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.713044 17568 raft_consensus.cc:2272] T bbc799754b16428a9fd044cbd3073a05 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.715211 17568 tablet_replica.cc:333] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.715807 17568 raft_consensus.cc:2243] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.716280 17568 raft_consensus.cc:2272] T 6a6367cd0a53431592b263b9893fe688 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.718991 17568 tablet_replica.cc:333] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.719780 17568 raft_consensus.cc:2243] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:40.720355 29356 consensus_peers.cc:597] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.720736 17568 raft_consensus.cc:2272] T 91c3c65a128840b8a030ea09d702ead4 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.721043 29356 consensus_peers.cc:597] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.723196 17568 tablet_replica.cc:333] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.723929 17568 raft_consensus.cc:2243] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.724414 17568 raft_consensus.cc:2272] T c08ab113fecb4c37adc9b881aa73cd06 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.726681 17568 tablet_replica.cc:333] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.727241 17568 raft_consensus.cc:2243] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.728087 17568 raft_consensus.cc:2272] T a2f77efefeec49378e0c4347125ef945 P c098fe137f19465bb9f67dbd64763b72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.730195 17568 tablet_replica.cc:333] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.730720 17568 raft_consensus.cc:2243] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.731163 17568 raft_consensus.cc:2272] T 32ff10fa1089410688f12362821cc67f P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.733122 17568 tablet_replica.cc:333] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72: stopping tablet replica
I20260709 12:28:40.733611 17568 raft_consensus.cc:2243] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.734054 17568 raft_consensus.cc:2272] T a7afb986dea142578781a4b0902cf6b8 P c098fe137f19465bb9f67dbd64763b72 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.774513 29430 consensus_peers.cc:597] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.788105 29430 consensus_peers.cc:597] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.814139 17568 tablet_server.cc:196] TabletServer@127.17.40.2:0 shutdown complete.
W20260709 12:28:40.828838 29430 consensus_peers.cc:597] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:42675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.873188 29356 consensus_peers.cc:597] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:42675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.912839 29430 consensus_peers.cc:597] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:42675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.912846 17568 tablet_server.cc:179] TabletServer@127.17.40.3:0 shutting down...
W20260709 12:28:40.948149 29427 consensus_peers.cc:597] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.967675 29430 consensus_peers.cc:597] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce -> Peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Couldn't send request to peer c098fe137f19465bb9f67dbd64763b72. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:42675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.970153 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:40.971072 17568 tablet_replica.cc:333] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:40.971841 17568 raft_consensus.cc:2243] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.972373 17568 raft_consensus.cc:2272] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.974545 17568 tablet_replica.cc:333] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:40.975188 17568 raft_consensus.cc:2243] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.976044 17568 raft_consensus.cc:2272] T 861e1b95735b4e49a7d677502df85d2c P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.978224 17568 tablet_replica.cc:333] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:40.978883 17568 raft_consensus.cc:2243] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.979369 17568 raft_consensus.cc:2272] T 805181416bfb47f0a641552cee55b488 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.981670 17568 tablet_replica.cc:333] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:40.982594 17568 raft_consensus.cc:2243] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.983158 17568 raft_consensus.cc:2272] T e3b328ca221d47f2a2ce812ca6545c69 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.986155 17568 tablet_replica.cc:333] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:40.986833 17568 raft_consensus.cc:2243] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.987300 17568 raft_consensus.cc:2272] T 6a89b86cbfd049bb9445919c85a2a661 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.989612 17568 tablet_replica.cc:333] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:40.990326 17568 raft_consensus.cc:2243] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.990844 17568 raft_consensus.cc:2272] T e09b1a02c21b411f97bf8eeb736a44ea P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.993372 17568 tablet_replica.cc:333] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:40.994019 17568 raft_consensus.cc:2243] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.994531 17568 raft_consensus.cc:2272] T 013bc4e256b44d7bad8a2915325ebf16 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.996541 17568 tablet_replica.cc:333] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:40.997148 17568 raft_consensus.cc:2243] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.997575 17568 raft_consensus.cc:2272] T af5e140659184a569b1e220d086f4b63 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.999491 17568 tablet_replica.cc:333] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.000097 17568 raft_consensus.cc:2243] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.000891 17568 raft_consensus.cc:2272] T 9cd8b20a4d4149f2aefaf5d791c65c89 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.003203 17568 tablet_replica.cc:333] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.004038 17568 raft_consensus.cc:2243] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.004676 17568 raft_consensus.cc:2272] T 18cc57e0ce6841219ed37c3d7d5a70be P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.007097 17568 tablet_replica.cc:333] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.007747 17568 raft_consensus.cc:2243] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.008622 17568 raft_consensus.cc:2272] T a4bb3ad82b4543fb90ad68213c62327e P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.011031 17568 tablet_replica.cc:333] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.011641 17568 raft_consensus.cc:2243] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.012450 17568 raft_consensus.cc:2272] T e2dd764d395b4a1db1fa0542bad9979b P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.014518 17568 tablet_replica.cc:333] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.015173 17568 raft_consensus.cc:2243] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.016002 17568 raft_consensus.cc:2272] T 28d6a39a3308459fa622a39fb1bf5dad P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.018074 17568 tablet_replica.cc:333] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.018733 17568 raft_consensus.cc:2243] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.019196 17568 raft_consensus.cc:2272] T 49368782c45545549da92ef0b10a987e P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.021847 17568 tablet_replica.cc:333] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.022745 17568 raft_consensus.cc:2243] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.023829 17568 raft_consensus.cc:2272] T b7e6ef31c2e34233803b7c52b878c0ef P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.026535 17568 tablet_replica.cc:333] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.027108 17568 raft_consensus.cc:2243] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.027949 17568 raft_consensus.cc:2272] T 070e1d9927ae4642bb5c37d25f11c996 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.030742 17568 tablet_replica.cc:333] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.031657 17568 raft_consensus.cc:2243] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.032305 17568 raft_consensus.cc:2272] T f8adbb821c8c4e11ad628089fc00d166 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.035096 17568 tablet_replica.cc:333] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
W20260709 12:28:41.034955 29427 consensus_peers.cc:597] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.035902 17568 raft_consensus.cc:2243] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.036401 17568 raft_consensus.cc:2272] T 305487a552d34f96a1555a8d55564031 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.038450 17568 tablet_replica.cc:333] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.039043 17568 raft_consensus.cc:2243] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.039475 17568 raft_consensus.cc:2272] T 93ebdc5d6e304383b31da2f9f039a2fb P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.041345 17568 tablet_replica.cc:333] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.041936 17568 raft_consensus.cc:2243] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.042387 17568 raft_consensus.cc:2272] T 91c3c65a128840b8a030ea09d702ead4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.044836 17568 tablet_replica.cc:333] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.045537 17568 raft_consensus.cc:2243] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.045991 17568 raft_consensus.cc:2272] T 6a6367cd0a53431592b263b9893fe688 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.047904 17568 tablet_replica.cc:333] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.048501 17568 raft_consensus.cc:2243] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.048940 17568 raft_consensus.cc:2272] T 32ff10fa1089410688f12362821cc67f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.051007 17568 tablet_replica.cc:333] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.051594 17568 raft_consensus.cc:2243] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.052423 17568 raft_consensus.cc:2272] T 884f2ad3d291412691e9a8815a9d7838 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.054576 17568 tablet_replica.cc:333] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.055166 17568 raft_consensus.cc:2243] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.055989 17568 raft_consensus.cc:2272] T 109246823e454b4ea19cff032f7345a3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.058040 17568 tablet_replica.cc:333] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.058704 17568 raft_consensus.cc:2243] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.059157 17568 raft_consensus.cc:2272] T ae09303fa81d45f086eec87509b6e72b P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.061221 17568 tablet_replica.cc:333] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.061971 17568 raft_consensus.cc:2243] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.062594 17568 raft_consensus.cc:2272] T 634977a6ff1244a3a46eb6a9b9ceb36a P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.064833 17568 tablet_replica.cc:333] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.065496 17568 raft_consensus.cc:2243] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.065943 17568 raft_consensus.cc:2272] T 0f041c0e08404949a06ddbd74b8d2ab0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.067950 17568 tablet_replica.cc:333] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.068473 17568 raft_consensus.cc:2243] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.069320 17568 raft_consensus.cc:2272] T 47d481b0699148d0a3874c922f9faa21 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.071522 17568 tablet_replica.cc:333] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.072113 17568 raft_consensus.cc:2243] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.072919 17568 raft_consensus.cc:2272] T 9a087124d7b34efe966b79089d1ec64f P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.075016 17568 tablet_replica.cc:333] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.075691 17568 raft_consensus.cc:2243] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.076134 17568 raft_consensus.cc:2272] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.078567 17568 tablet_replica.cc:333] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.079193 17568 raft_consensus.cc:2243] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.079679 17568 raft_consensus.cc:2272] T e123d694327a439f955f8e8831cbbfef P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.081787 17568 tablet_replica.cc:333] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.082472 17568 raft_consensus.cc:2243] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.082928 17568 raft_consensus.cc:2272] T fb406a0615254e56b17f64445f811223 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.084931 17568 tablet_replica.cc:333] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.085538 17568 raft_consensus.cc:2243] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.087126 17568 raft_consensus.cc:2272] T c08ab113fecb4c37adc9b881aa73cd06 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.089170 17568 tablet_replica.cc:333] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.089761 17568 raft_consensus.cc:2243] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.090201 17568 raft_consensus.cc:2272] T 995ae76c376541159f0e79e554e34cd2 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.092339 17568 tablet_replica.cc:333] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.093223 17568 raft_consensus.cc:2243] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.093802 17568 raft_consensus.cc:2272] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.096647 17568 tablet_replica.cc:333] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.097524 17568 raft_consensus.cc:2243] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.098491 17568 raft_consensus.cc:2272] T 643c24bf9c694736abe899bcaa6e99f0 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.100536 29427 consensus_peers.cc:597] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.101385 17568 tablet_replica.cc:333] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.102160 17568 raft_consensus.cc:2243] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.102735 17568 raft_consensus.cc:2272] T c59b9f4048214a868afee18cf9e843fd P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.105149 17568 tablet_replica.cc:333] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.105650 17568 raft_consensus.cc:2243] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.106441 17568 raft_consensus.cc:2272] T 84317ec210984cb490e9b8af0ddf23ff P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.108490 17568 tablet_replica.cc:333] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.108991 17568 raft_consensus.cc:2243] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.109428 17568 raft_consensus.cc:2272] T 552b1f2771eb4fcb81923b5712b47b2f P 96bd9c3c81e04118abc2fe11d2b361ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.111593 17568 tablet_replica.cc:333] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.112133 17568 raft_consensus.cc:2243] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.112583 17568 raft_consensus.cc:2272] T b49d0ab7da7f4218a16f383088db71d3 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.114699 17568 tablet_replica.cc:333] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.115267 17568 raft_consensus.cc:2243] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.115697 17568 raft_consensus.cc:2272] T a2f77efefeec49378e0c4347125ef945 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.120850 17568 tablet_replica.cc:333] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.121593 17568 raft_consensus.cc:2243] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.122229 17568 raft_consensus.cc:2272] T f31ecc85ad2246b194eb65cbc188a663 P 96bd9c3c81e04118abc2fe11d2b361ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.126600 17568 tablet_replica.cc:333] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.127280 17568 raft_consensus.cc:2243] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.127827 17568 raft_consensus.cc:2272] T 884c1fec4f1f4f7db0bf24665b7826c5 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.130637 17568 tablet_replica.cc:333] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed: stopping tablet replica
I20260709 12:28:41.131275 17568 raft_consensus.cc:2243] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.132375 17568 raft_consensus.cc:2272] T bbc799754b16428a9fd044cbd3073a05 P 96bd9c3c81e04118abc2fe11d2b361ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.175289 29427 consensus_peers.cc:597] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:41.187067 29427 consensus_peers.cc:597] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.229916 17568 tablet_server.cc:196] TabletServer@127.17.40.3:0 shutdown complete.
I20260709 12:28:41.232184 30426 raft_consensus.cc:493] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:41.232860 30426 raft_consensus.cc:515] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:41.235101 30426 leader_election.cc:290] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
W20260709 12:28:41.241137 29430 leader_election.cc:336] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Network error: Client connection negotiation failed: client connection to 127.17.40.2:42675: connect: Connection refused (error 111)
W20260709 12:28:41.241700 29427 consensus_peers.cc:597] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.3:45901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:41.244753 29427 leader_election.cc:336] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:41.245138 29427 leader_election.cc:304] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:41.245754 30426 raft_consensus.cc:2749] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:41.287084 29427 consensus_peers.cc:597] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.3:45901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.289252 30426 raft_consensus.cc:493] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:41.289937 30426 raft_consensus.cc:515] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96bd9c3c81e04118abc2fe11d2b361ed" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 45901 } } peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } }
I20260709 12:28:41.292369 30426 leader_election.cc:290] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901), 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813)
W20260709 12:28:41.302996 29427 leader_election.cc:336] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Network error: Client connection negotiation failed: client connection to 127.17.40.3:45901: connect: Connection refused (error 111)
W20260709 12:28:41.303918 29427 leader_election.cc:336] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:41.304344 29427 leader_election.cc:304] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, 96bd9c3c81e04118abc2fe11d2b361ed
I20260709 12:28:41.305122 30451 raft_consensus.cc:2749] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:41.313578 29427 consensus_peers.cc:597] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce -> Peer 96bd9c3c81e04118abc2fe11d2b361ed (127.17.40.3:45901): Couldn't send request to peer 96bd9c3c81e04118abc2fe11d2b361ed. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.3:45901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.334453 17568 tablet_server.cc:179] TabletServer@127.17.40.4:0 shutting down...
I20260709 12:28:41.379240 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:41.380062 17568 tablet_replica.cc:333] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.380781 17568 raft_consensus.cc:2243] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.381359 17568 raft_consensus.cc:2272] T 21efe1fe062e4b28bbfa5e3832bb2df9 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.383906 17568 tablet_replica.cc:333] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.384683 17568 raft_consensus.cc:2243] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.385231 17568 raft_consensus.cc:2272] T e3b328ca221d47f2a2ce812ca6545c69 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.388145 17568 tablet_replica.cc:333] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.388796 17568 raft_consensus.cc:2243] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.389290 17568 raft_consensus.cc:2272] T ffee763875334a56886a8163b24992db P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.391672 17568 tablet_replica.cc:333] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.392294 17568 raft_consensus.cc:2243] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.392730 17568 raft_consensus.cc:2272] T a4bb3ad82b4543fb90ad68213c62327e P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.394852 17568 tablet_replica.cc:333] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.395584 17568 raft_consensus.cc:2243] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.396015 17568 raft_consensus.cc:2272] T 28d6a39a3308459fa622a39fb1bf5dad P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.397898 30445 raft_consensus.cc:493] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:41.398664 17568 tablet_replica.cc:333] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.398447 30445 raft_consensus.cc:515] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:41.399646 17568 raft_consensus.cc:2243] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.400239 17568 raft_consensus.cc:2272] T e2dd764d395b4a1db1fa0542bad9979b P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.400895 30445 leader_election.cc:290] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:41.403352 17568 tablet_replica.cc:333] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.404425 17568 raft_consensus.cc:2243] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:41.405472 29430 leader_election.cc:336] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Network error: Client connection negotiation failed: client connection to 127.17.40.2:42675: connect: Connection refused (error 111)
I20260709 12:28:41.405488 17568 raft_consensus.cc:2272] T 013bc4e256b44d7bad8a2915325ebf16 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.406072 29427 leader_election.cc:336] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:41.406505 29427 leader_election.cc:304] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:41.407140 30445 raft_consensus.cc:2749] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:41.408579 17568 tablet_replica.cc:333] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.409345 17568 raft_consensus.cc:2243] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.410293 17568 raft_consensus.cc:2272] T 39b597f990ad43f0b26beedf929c6aff P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.412788 17568 tablet_replica.cc:333] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.413411 17568 raft_consensus.cc:2243] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.413889 17568 raft_consensus.cc:2272] T 6a89b86cbfd049bb9445919c85a2a661 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.416121 17568 tablet_replica.cc:333] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.416742 17568 raft_consensus.cc:2243] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.417590 17568 raft_consensus.cc:2272] T 6a6367cd0a53431592b263b9893fe688 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.419729 17568 tablet_replica.cc:333] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.420377 17568 raft_consensus.cc:2243] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.421203 17568 raft_consensus.cc:2272] T ae36f5a0ab77484ba95cc4f091a975c4 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.424003 17568 tablet_replica.cc:333] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.424842 17568 raft_consensus.cc:2243] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.425307 17568 raft_consensus.cc:2272] T 719834bbc8ea4a43a3fcf5ccbd9aab62 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.427784 17568 tablet_replica.cc:333] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.428387 17568 raft_consensus.cc:2243] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.428853 17568 raft_consensus.cc:2272] T 070e1d9927ae4642bb5c37d25f11c996 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.430945 17568 tablet_replica.cc:333] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.431582 17568 raft_consensus.cc:2243] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.432412 17568 raft_consensus.cc:2272] T cc0ac53345b44e3abcf7fd2b8a8e4518 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.434535 17568 tablet_replica.cc:333] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.435138 17568 raft_consensus.cc:2243] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.435995 17568 raft_consensus.cc:2272] T 182ad32890aa4949b7f06c2dae04a331 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.438265 17568 tablet_replica.cc:333] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.438963 17568 raft_consensus.cc:2243] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.439457 17568 raft_consensus.cc:2272] T b7e6ef31c2e34233803b7c52b878c0ef P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.441535 17568 tablet_replica.cc:333] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.442158 17568 raft_consensus.cc:2243] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.442649 17568 raft_consensus.cc:2272] T ae09303fa81d45f086eec87509b6e72b P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.444825 17568 tablet_replica.cc:333] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.445429 17568 raft_consensus.cc:2243] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.445910 17568 raft_consensus.cc:2272] T 884f2ad3d291412691e9a8815a9d7838 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.448179 17568 tablet_replica.cc:333] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.448844 17568 raft_consensus.cc:2243] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.449690 17568 raft_consensus.cc:2272] T 85f3994d7ed94748b84df1afd9e331fd P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.451857 17568 tablet_replica.cc:333] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.452517 17568 raft_consensus.cc:2243] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.452966 17568 raft_consensus.cc:2272] T 93ebdc5d6e304383b31da2f9f039a2fb P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.455054 17568 tablet_replica.cc:333] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.455684 17568 raft_consensus.cc:2243] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.456503 17568 raft_consensus.cc:2272] T f8adbb821c8c4e11ad628089fc00d166 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.458665 17568 tablet_replica.cc:333] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.459259 17568 raft_consensus.cc:2243] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.459718 17568 raft_consensus.cc:2272] T 305487a552d34f96a1555a8d55564031 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.461670 17568 tablet_replica.cc:333] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.462340 17568 raft_consensus.cc:2243] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.462846 17568 raft_consensus.cc:2272] T 0ef042d8e1fa4cb7bc3d1fbe923b826c P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.464813 17568 tablet_replica.cc:333] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.465418 17568 raft_consensus.cc:2243] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.465867 17568 raft_consensus.cc:2272] T c08ab113fecb4c37adc9b881aa73cd06 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.467933 17568 tablet_replica.cc:333] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.468542 17568 raft_consensus.cc:2243] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.469352 17568 raft_consensus.cc:2272] T 995ae76c376541159f0e79e554e34cd2 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.471426 17568 tablet_replica.cc:333] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.472277 17568 raft_consensus.cc:2243] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.472872 17568 raft_consensus.cc:2272] T 84317ec210984cb490e9b8af0ddf23ff P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.476052 17568 tablet_replica.cc:333] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.476852 17568 raft_consensus.cc:2243] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.477449 17568 raft_consensus.cc:2272] T 9a087124d7b34efe966b79089d1ec64f P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.479637 17568 tablet_replica.cc:333] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.479877 30426 raft_consensus.cc:493] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 629ba7d0b7eb4d9b8832b0f605f79443)
I20260709 12:28:41.480266 17568 raft_consensus.cc:2243] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.480342 30426 raft_consensus.cc:515] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dbe6e4429184e5fb137cae093024bce" member_type: VOTER last_known_addr { host: "127.17.40.4" port: 34741 } } peers { permanent_uuid: "629ba7d0b7eb4d9b8832b0f605f79443" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 35813 } } peers { permanent_uuid: "c098fe137f19465bb9f67dbd64763b72" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 42675 } }
I20260709 12:28:41.480829 17568 raft_consensus.cc:2272] T 86e528a3aa1c4b73a3f5dad737cf41a4 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.482329 30426 leader_election.cc:290] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813), c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675)
I20260709 12:28:41.483325 17568 tablet_replica.cc:333] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.484221 17568 raft_consensus.cc:2243] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.484789 17568 raft_consensus.cc:2272] T e123d694327a439f955f8e8831cbbfef P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.486943 29430 leader_election.cc:336] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c098fe137f19465bb9f67dbd64763b72 (127.17.40.2:42675): Network error: Client connection negotiation failed: client connection to 127.17.40.2:42675: connect: Connection refused (error 111)
I20260709 12:28:41.487612 17568 tablet_replica.cc:333] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
W20260709 12:28:41.487663 29427 leader_election.cc:336] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 629ba7d0b7eb4d9b8832b0f605f79443 (127.17.40.1:35813): Network error: Client connection negotiation failed: client connection to 127.17.40.1:35813: connect: Connection refused (error 111)
I20260709 12:28:41.488193 29427 leader_election.cc:304] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dbe6e4429184e5fb137cae093024bce; no voters: 629ba7d0b7eb4d9b8832b0f605f79443, c098fe137f19465bb9f67dbd64763b72
I20260709 12:28:41.488358 17568 raft_consensus.cc:2243] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.488823 30445 raft_consensus.cc:2706] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Received pre-election callback for term 3 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:28:41.489298 17568 raft_consensus.cc:2272] T a5bc94f78eb745a8ae182fa765caf007 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.491241 17568 tablet_replica.cc:333] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.491755 17568 raft_consensus.cc:2243] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.492158 17568 raft_consensus.cc:2272] T 47d481b0699148d0a3874c922f9faa21 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.494140 17568 tablet_replica.cc:333] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.494758 17568 raft_consensus.cc:2243] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.495517 17568 raft_consensus.cc:2272] T 52884fe0058e4164905c706a05528483 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.497519 17568 tablet_replica.cc:333] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.498013 17568 raft_consensus.cc:2243] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.498497 17568 raft_consensus.cc:2272] T 4d66330581c44f65ab1e6c89c0da8053 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.500370 17568 tablet_replica.cc:333] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.500996 17568 raft_consensus.cc:2243] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.501828 17568 raft_consensus.cc:2272] T 18cc57e0ce6841219ed37c3d7d5a70be P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.504522 17568 tablet_replica.cc:333] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.505290 17568 raft_consensus.cc:2243] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.506325 17568 raft_consensus.cc:2272] T 2db86f70e69d430d914533e9338966da P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.508975 17568 tablet_replica.cc:333] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.509536 17568 raft_consensus.cc:2243] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.509970 17568 raft_consensus.cc:2272] T b010149f21014bed809737f86f527ccc P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.512122 17568 tablet_replica.cc:333] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.512813 17568 raft_consensus.cc:2243] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.513659 17568 raft_consensus.cc:2272] T 884c1fec4f1f4f7db0bf24665b7826c5 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.516068 17568 tablet_replica.cc:333] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.516774 17568 raft_consensus.cc:2243] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.517313 17568 raft_consensus.cc:2272] T 552b1f2771eb4fcb81923b5712b47b2f P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.520216 17568 tablet_replica.cc:333] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.520982 17568 raft_consensus.cc:2243] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.521380 17568 raft_consensus.cc:2272] T f63924737d2d47bf8921d8c66bb9967e P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.523497 17568 tablet_replica.cc:333] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.524035 17568 raft_consensus.cc:2243] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.524526 17568 raft_consensus.cc:2272] T a2f77efefeec49378e0c4347125ef945 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.526551 17568 tablet_replica.cc:333] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.527058 17568 raft_consensus.cc:2243] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.527850 17568 raft_consensus.cc:2272] T 6796c6bbe9b6429daa40ed2fdb2529a5 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.529819 17568 tablet_replica.cc:333] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.530349 17568 raft_consensus.cc:2243] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.530841 17568 raft_consensus.cc:2272] T 643c24bf9c694736abe899bcaa6e99f0 P 8dbe6e4429184e5fb137cae093024bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.532790 17568 tablet_replica.cc:333] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.533298 17568 raft_consensus.cc:2243] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.534153 17568 raft_consensus.cc:2272] T 805181416bfb47f0a641552cee55b488 P 8dbe6e4429184e5fb137cae093024bce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.536269 17568 tablet_replica.cc:333] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce: stopping tablet replica
I20260709 12:28:41.536803 17568 raft_consensus.cc:2243] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.537336 17568 raft_consensus.cc:2272] T a7afb986dea142578781a4b0902cf6b8 P 8dbe6e4429184e5fb137cae093024bce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.607743 17568 tablet_server.cc:196] TabletServer@127.17.40.4:0 shutdown complete.
I20260709 12:28:41.696110 17568 master.cc:562] Master@127.17.40.62:38223 shutting down...
I20260709 12:28:41.726325 17568 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.727157 17568 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.727644 17568 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9b91969329c8415c8123d6ccc8dca653: stopping tablet replica
I20260709 12:28:41.752290 17568 master.cc:584] Master@127.17.40.62:38223 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36463 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:28:41.848891 17568 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.40.62:38395
I20260709 12:28:41.850142 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:41.856390 30452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.856515 30453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.857551 30455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.859470 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:41.860653 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:41.860870 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:41.861045 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600121861008 us; error 0 us; skew 500 ppm
I20260709 12:28:41.861624 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:41.864277 17568 webserver.cc:533] Webserver started at http://127.17.40.62:38879/ using document root <none> and password file <none>
I20260709 12:28:41.864826 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:41.865033 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:41.865330 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:41.866619 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/master-0-root/instance:
uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-tjfs"
I20260709 12:28:41.871439 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:28:41.875128 30460 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.875917 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:41.876255 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/master-0-root
uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-tjfs"
I20260709 12:28:41.876577 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:41.895783 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:41.897142 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:41.937407 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.62:38395
I20260709 12:28:41.937542 30511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.62:38395 every 8 connection(s)
I20260709 12:28:41.941582 30512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:41.953006 30512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2: Bootstrap starting.
I20260709 12:28:41.958312 30512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:41.963210 30512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2: No bootstrap required, opened a new log
I20260709 12:28:41.965601 30512 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2" member_type: VOTER }
I20260709 12:28:41.966012 30512 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:41.966287 30512 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e77cb3b80ae4684a2c0b6e651e20ca2, State: Initialized, Role: FOLLOWER
I20260709 12:28:41.967042 30512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2" member_type: VOTER }
I20260709 12:28:41.967552 30512 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:41.967796 30512 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:41.968075 30512 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:41.973376 30512 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2" member_type: VOTER }
I20260709 12:28:41.974031 30512 leader_election.cc:304] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e77cb3b80ae4684a2c0b6e651e20ca2; no voters: 
I20260709 12:28:41.975276 30512 leader_election.cc:290] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:41.975785 30515 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:41.977362 30515 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 1 LEADER]: Becoming Leader. State: Replica: 2e77cb3b80ae4684a2c0b6e651e20ca2, State: Running, Role: LEADER
I20260709 12:28:41.978106 30515 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2" member_type: VOTER }
I20260709 12:28:41.978835 30512 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:41.983469 30516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2" member_type: VOTER } }
I20260709 12:28:41.984148 30516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:41.983372 30517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e77cb3b80ae4684a2c0b6e651e20ca2. Latest consensus state: current_term: 1 leader_uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e77cb3b80ae4684a2c0b6e651e20ca2" member_type: VOTER } }
I20260709 12:28:41.986238 30522 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:41.986445 30517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:41.991860 30522 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:41.996613 17568 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:42.002120 30522 catalog_manager.cc:1383] Generated new cluster ID: c3f1d8a05e6a434bb8c20beb335c8a72
I20260709 12:28:42.002506 30522 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:42.029850 30522 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:42.031279 30522 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:42.046020 30522 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2: Generated new TSK 0
I20260709 12:28:42.046731 30522 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:42.063694 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.070084 30533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.071617 30534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.073060 17568 server_base.cc:1061] running on GCE node
W20260709 12:28:42.073827 30536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.074896 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:42.075142 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.075332 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600122075310 us; error 0 us; skew 500 ppm
I20260709 12:28:42.075892 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.078593 17568 webserver.cc:533] Webserver started at http://127.17.40.1:33563/ using document root <none> and password file <none>
I20260709 12:28:42.079205 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.079417 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.079711 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.080955 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root/instance:
uuid: "e04d66830b094daead9eabf66686bd40"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-tjfs"
I20260709 12:28:42.085779 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:28:42.089576 30541 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.090695 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:42.091150 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "e04d66830b094daead9eabf66686bd40"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-tjfs"
I20260709 12:28:42.091487 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.105922 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.107448 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.109107 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.111871 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.112139 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.112411 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.112643 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.158478 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:33889
I20260709 12:28:42.158545 30603 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:33889 every 8 connection(s)
I20260709 12:28:42.164072 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.172461 30608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.174660 30609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.177443 17568 server_base.cc:1061] running on GCE node
W20260709 12:28:42.177479 30611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.178967 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:42.179185 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.179318 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600122179307 us; error 0 us; skew 500 ppm
I20260709 12:28:42.179812 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.182443 17568 webserver.cc:533] Webserver started at http://127.17.40.2:38369/ using document root <none> and password file <none>
I20260709 12:28:42.182932 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.183097 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.183317 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.184829 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-1-root/instance:
uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-tjfs"
I20260709 12:28:42.188055 30604 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38395
I20260709 12:28:42.188560 30604 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:42.189376 30604 heartbeater.cc:507] Master 127.17.40.62:38395 requested a full tablet report, sending...
I20260709 12:28:42.190297 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:28:42.191936 30477 ts_manager.cc:194] Registered new tserver with Master: e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889)
I20260709 12:28:42.194470 30477 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39348
I20260709 12:28:42.194667 30616 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.195837 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:42.196249 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-1-root
uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-tjfs"
I20260709 12:28:42.196648 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.239856 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.241187 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.242749 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.245349 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.245589 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.245900 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.246078 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.292102 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.2:37803
I20260709 12:28:42.292223 30678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.2:37803 every 8 connection(s)
I20260709 12:28:42.297720 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.306881 30682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.307991 30683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.310575 30679 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38395
I20260709 12:28:42.311190 30679 heartbeater.cc:461] Registering TS with master...
W20260709 12:28:42.312395 30685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.312453 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:42.312475 30679 heartbeater.cc:507] Master 127.17.40.62:38395 requested a full tablet report, sending...
I20260709 12:28:42.314155 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:42.314463 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.314692 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600122314672 us; error 0 us; skew 500 ppm
I20260709 12:28:42.315439 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.315971 30477 ts_manager.cc:194] Registered new tserver with Master: 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:42.317847 30477 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39362
I20260709 12:28:42.318540 17568 webserver.cc:533] Webserver started at http://127.17.40.3:33409/ using document root <none> and password file <none>
I20260709 12:28:42.319224 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.319478 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.319796 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.321178 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-2-root/instance:
uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-tjfs"
I20260709 12:28:42.326444 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:28:42.330344 30690 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.331363 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:42.331728 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-2-root
uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-tjfs"
I20260709 12:28:42.332082 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.350169 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.351498 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.353091 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.355507 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.355762 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.356032 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.356221 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.399159 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.3:36937
I20260709 12:28:42.399255 30752 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.3:36937 every 8 connection(s)
I20260709 12:28:42.414474 30753 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38395
I20260709 12:28:42.414862 30753 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:42.415642 30753 heartbeater.cc:507] Master 127.17.40.62:38395 requested a full tablet report, sending...
I20260709 12:28:42.417702 30477 ts_manager.cc:194] Registered new tserver with Master: 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:42.418610 17568 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015939635s
I20260709 12:28:42.419250 30477 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39374
I20260709 12:28:42.445184 30477 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39380:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:42.448262 30477 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:42.531603 30568 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf7de510136448db926233e69db15b5 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:42.532337 30644 tablet_service.cc:1511] Processing CreateTablet for tablet e4649276c3bf47df8defe360c8270aaf (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:42.533330 30568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf7de510136448db926233e69db15b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.533874 30644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4649276c3bf47df8defe360c8270aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.533562 30566 tablet_service.cc:1511] Processing CreateTablet for tablet 784b5acba0fb49f48b6bf072d093a5af (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:42.535107 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784b5acba0fb49f48b6bf072d093a5af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.535527 30643 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf7de510136448db926233e69db15b5 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:42.535775 30717 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf7de510136448db926233e69db15b5 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:42.536912 30643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf7de510136448db926233e69db15b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.537197 30717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf7de510136448db926233e69db15b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.531715 30569 tablet_service.cc:1511] Processing CreateTablet for tablet e4649276c3bf47df8defe360c8270aaf (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:42.539372 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4649276c3bf47df8defe360c8270aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.539633 30642 tablet_service.cc:1511] Processing CreateTablet for tablet 63b89c17ab1440e1ab5c13ccd5d81bca (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:42.541038 30642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b89c17ab1440e1ab5c13ccd5d81bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.543576 30641 tablet_service.cc:1511] Processing CreateTablet for tablet 784b5acba0fb49f48b6bf072d093a5af (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:42.543668 30567 tablet_service.cc:1511] Processing CreateTablet for tablet 63b89c17ab1440e1ab5c13ccd5d81bca (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:42.545166 30641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784b5acba0fb49f48b6bf072d093a5af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.545228 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b89c17ab1440e1ab5c13ccd5d81bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.533875 30718 tablet_service.cc:1511] Processing CreateTablet for tablet e4649276c3bf47df8defe360c8270aaf (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:42.548025 30718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4649276c3bf47df8defe360c8270aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.548323 30716 tablet_service.cc:1511] Processing CreateTablet for tablet 63b89c17ab1440e1ab5c13ccd5d81bca (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:42.549817 30716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b89c17ab1440e1ab5c13ccd5d81bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.554191 30715 tablet_service.cc:1511] Processing CreateTablet for tablet 784b5acba0fb49f48b6bf072d093a5af (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:42.555693 30715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784b5acba0fb49f48b6bf072d093a5af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.577968 30768 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:42.581679 30567 tablet_service.cc:1511] Processing CreateTablet for tablet 08bc0618e6504dad909e79e62fe858b0 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:42.585719 30640 tablet_service.cc:1511] Processing CreateTablet for tablet 08bc0618e6504dad909e79e62fe858b0 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:42.589913 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08bc0618e6504dad909e79e62fe858b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.594193 30566 tablet_service.cc:1511] Processing CreateTablet for tablet 713f53247cb649fda5d7f1f4ecacd1ce (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:42.595763 30639 tablet_service.cc:1511] Processing CreateTablet for tablet 713f53247cb649fda5d7f1f4ecacd1ce (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:42.598538 30714 tablet_service.cc:1511] Processing CreateTablet for tablet 08bc0618e6504dad909e79e62fe858b0 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:42.599974 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08bc0618e6504dad909e79e62fe858b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.589913 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08bc0618e6504dad909e79e62fe858b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.602680 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713f53247cb649fda5d7f1f4ecacd1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.603729 30713 tablet_service.cc:1511] Processing CreateTablet for tablet 713f53247cb649fda5d7f1f4ecacd1ce (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:42.605263 30713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713f53247cb649fda5d7f1f4ecacd1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.599975 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713f53247cb649fda5d7f1f4ecacd1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.588745 30768 tablet_bootstrap.cc:654] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.609737 30638 tablet_service.cc:1511] Processing CreateTablet for tablet 455b2ef795c34a328ac50361e285d8eb (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:42.611402 30638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455b2ef795c34a328ac50361e285d8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.606935 30568 tablet_service.cc:1511] Processing CreateTablet for tablet 455b2ef795c34a328ac50361e285d8eb (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:42.614558 30568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455b2ef795c34a328ac50361e285d8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.618647 30569 tablet_service.cc:1511] Processing CreateTablet for tablet 2432481993b44c54a14c6cbba5506a43 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:42.619326 30712 tablet_service.cc:1511] Processing CreateTablet for tablet 455b2ef795c34a328ac50361e285d8eb (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:42.620477 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2432481993b44c54a14c6cbba5506a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.621196 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455b2ef795c34a328ac50361e285d8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.665963 30769 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:42.671192 30641 tablet_service.cc:1511] Processing CreateTablet for tablet 2432481993b44c54a14c6cbba5506a43 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:42.672995 30641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2432481993b44c54a14c6cbba5506a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.681660 30716 tablet_service.cc:1511] Processing CreateTablet for tablet 2432481993b44c54a14c6cbba5506a43 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:42.683679 30716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2432481993b44c54a14c6cbba5506a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.711443 30770 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:42.718294 30565 tablet_service.cc:1511] Processing CreateTablet for tablet d4e17b3a57e24feeb8e6cd5fa1da1fcd (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:42.719951 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e17b3a57e24feeb8e6cd5fa1da1fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.732061 30640 tablet_service.cc:1511] Processing CreateTablet for tablet d4e17b3a57e24feeb8e6cd5fa1da1fcd (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:42.733696 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e17b3a57e24feeb8e6cd5fa1da1fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.738721 30715 tablet_service.cc:1511] Processing CreateTablet for tablet d4e17b3a57e24feeb8e6cd5fa1da1fcd (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:42.740265 30715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e17b3a57e24feeb8e6cd5fa1da1fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.740839 30566 tablet_service.cc:1511] Processing CreateTablet for tablet ef7d44785cd74161b56c3107d580a7f6 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:42.743183 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7d44785cd74161b56c3107d580a7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.744807 30768 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:42.745450 30768 ts_tablet_manager.cc:1403] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.009s
I20260709 12:28:42.749135 30768 raft_consensus.cc:359] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.749948 30768 raft_consensus.cc:385] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.752748 30769 tablet_bootstrap.cc:654] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.762562 30643 tablet_service.cc:1511] Processing CreateTablet for tablet ef7d44785cd74161b56c3107d580a7f6 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:42.769759 30770 tablet_bootstrap.cc:654] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.770010 30712 tablet_service.cc:1511] Processing CreateTablet for tablet ef7d44785cd74161b56c3107d580a7f6 (DEFAULT_TABLE table=test-workload [id=c861f88008144e6ca6081de6a9e388ac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:42.771556 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7d44785cd74161b56c3107d580a7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.750286 30768 raft_consensus.cc:740] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.778129 30643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7d44785cd74161b56c3107d580a7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.777310 30768 consensus_queue.cc:260] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.789937 30769 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:42.791335 30769 ts_tablet_manager.cc:1403] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.018s
I20260709 12:28:42.792914 30770 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:42.793581 30770 ts_tablet_manager.cc:1403] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.000s
I20260709 12:28:42.795647 30604 heartbeater.cc:499] Master 127.17.40.62:38395 was elected leader, sending a full tablet report...
I20260709 12:28:42.796840 30770 raft_consensus.cc:359] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.797677 30770 raft_consensus.cc:385] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.797989 30770 raft_consensus.cc:740] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.798885 30769 raft_consensus.cc:359] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.799908 30769 raft_consensus.cc:385] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.799968 30768 ts_tablet_manager.cc:1434] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 12:28:42.800427 30769 raft_consensus.cc:740] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.801309 30768 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:42.801527 30769 consensus_queue.cc:260] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.805419 30770 consensus_queue.cc:260] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.808874 30753 heartbeater.cc:499] Master 127.17.40.62:38395 was elected leader, sending a full tablet report...
I20260709 12:28:42.809386 30769 ts_tablet_manager.cc:1434] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:28:42.809689 30768 tablet_bootstrap.cc:654] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.810638 30769 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:42.819594 30769 tablet_bootstrap.cc:654] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.820174 30770 ts_tablet_manager.cc:1434] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.005s
I20260709 12:28:42.820279 30679 heartbeater.cc:499] Master 127.17.40.62:38395 was elected leader, sending a full tablet report...
I20260709 12:28:42.821483 30770 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:42.841070 30768 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:42.841816 30768 ts_tablet_manager.cc:1403] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.004s
I20260709 12:28:42.842265 30770 tablet_bootstrap.cc:654] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.845036 30768 raft_consensus.cc:359] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.845932 30768 raft_consensus.cc:385] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.846240 30768 raft_consensus.cc:740] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.847123 30768 consensus_queue.cc:260] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.849416 30768 ts_tablet_manager.cc:1434] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:28:42.850548 30768 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:42.856117 30769 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:42.856734 30769 ts_tablet_manager.cc:1403] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.021s
I20260709 12:28:42.857414 30768 tablet_bootstrap.cc:654] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.859424 30770 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:42.860003 30770 ts_tablet_manager.cc:1403] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.006s
I20260709 12:28:42.859939 30769 raft_consensus.cc:359] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.860870 30769 raft_consensus.cc:385] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.861187 30769 raft_consensus.cc:740] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.862114 30769 consensus_queue.cc:260] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.863322 30770 raft_consensus.cc:359] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.864116 30770 raft_consensus.cc:385] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.864401 30770 raft_consensus.cc:740] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.864671 30769 ts_tablet_manager.cc:1434] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:42.865767 30769 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:42.865322 30770 consensus_queue.cc:260] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.867980 30770 ts_tablet_manager.cc:1434] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:42.869032 30770 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:42.873149 30769 tablet_bootstrap.cc:654] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.877858 30770 tablet_bootstrap.cc:654] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.880553 30768 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:42.881156 30768 ts_tablet_manager.cc:1403] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.007s
I20260709 12:28:42.884333 30768 raft_consensus.cc:359] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.884974 30768 raft_consensus.cc:385] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.885277 30768 raft_consensus.cc:740] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.885371 30769 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:42.886113 30769 ts_tablet_manager.cc:1403] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:28:42.886211 30768 consensus_queue.cc:260] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.887030 30770 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:42.887595 30770 ts_tablet_manager.cc:1403] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 12:28:42.888752 30769 raft_consensus.cc:359] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.889385 30769 raft_consensus.cc:385] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.889685 30769 raft_consensus.cc:740] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.890539 30769 consensus_queue.cc:260] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.891057 30768 ts_tablet_manager.cc:1434] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:28:42.892386 30768 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:42.890784 30770 raft_consensus.cc:359] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.892900 30769 ts_tablet_manager.cc:1434] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:42.893344 30770 raft_consensus.cc:385] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.893720 30770 raft_consensus.cc:740] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.894081 30769 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:42.894863 30770 consensus_queue.cc:260] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.900241 30770 ts_tablet_manager.cc:1434] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
W20260709 12:28:42.903666 30754 tablet.cc:2406] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:42.904642 30770 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:42.904908 30768 tablet_bootstrap.cc:654] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.903697 30769 tablet_bootstrap.cc:654] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.913439 30770 tablet_bootstrap.cc:654] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.924171 30770 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:42.924175 30768 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:42.924729 30769 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:42.924773 30770 ts_tablet_manager.cc:1403] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.013s
I20260709 12:28:42.924940 30768 ts_tablet_manager.cc:1403] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.015s
I20260709 12:28:42.925418 30769 ts_tablet_manager.cc:1403] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.004s
I20260709 12:28:42.927719 30770 raft_consensus.cc:359] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.928390 30770 raft_consensus.cc:385] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.928721 30770 raft_consensus.cc:740] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.928398 30768 raft_consensus.cc:359] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.928647 30769 raft_consensus.cc:359] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.929347 30768 raft_consensus.cc:385] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.929426 30769 raft_consensus.cc:385] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.929782 30768 raft_consensus.cc:740] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.929839 30769 raft_consensus.cc:740] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.929677 30770 consensus_queue.cc:260] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.930787 30774 raft_consensus.cc:493] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.930888 30769 consensus_queue.cc:260] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.931167 30768 consensus_queue.cc:260] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.931543 30774 raft_consensus.cc:515] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.933945 30769 ts_tablet_manager.cc:1434] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:42.938495 30768 ts_tablet_manager.cc:1434] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:28:42.935385 30769 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:42.942631 30776 raft_consensus.cc:493] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.943315 30768 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:42.943414 30776 raft_consensus.cc:515] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.955821 30768 tablet_bootstrap.cc:654] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.956405 30770 ts_tablet_manager.cc:1434] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.017s
I20260709 12:28:42.957777 30770 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:42.964445 30775 raft_consensus.cc:493] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.965101 30775 raft_consensus.cc:515] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.966711 30774 leader_election.cc:290] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:42.967290 30774 raft_consensus.cc:493] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.967432 30770 tablet_bootstrap.cc:654] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.967806 30774 raft_consensus.cc:515] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.970064 30774 leader_election.cc:290] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:42.970945 30786 raft_consensus.cc:493] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.959997 30787 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.975082 30786 raft_consensus.cc:515] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.984211 30776 leader_election.cc:290] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:42.979112 30787 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:42.992560 30787 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
W20260709 12:28:42.995499 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:42.981474 30786 leader_election.cc:290] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.009961 30775 leader_election.cc:290] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889)
I20260709 12:28:43.017391 30788 raft_consensus.cc:493] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.036445 30769 tablet_bootstrap.cc:654] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.034513 30788 raft_consensus.cc:515] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.040836 30788 leader_election.cc:290] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:43.041224 30768 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:43.042027 30768 ts_tablet_manager.cc:1403] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.099s	user 0.034s	sys 0.021s
I20260709 12:28:43.046276 30768 raft_consensus.cc:359] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.049371 30768 raft_consensus.cc:385] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.049805 30768 raft_consensus.cc:740] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.050808 30768 consensus_queue.cc:260] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.053629 30768 ts_tablet_manager.cc:1434] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:43.064234 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784b5acba0fb49f48b6bf072d093a5af" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.065340 30579 raft_consensus.cc:2468] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.066304 30770 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:43.066958 30770 ts_tablet_manager.cc:1403] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.110s	user 0.023s	sys 0.004s
I20260709 12:28:43.068235 30618 leader_election.cc:304] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.067056 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.058956 30768 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:43.076617 30786 raft_consensus.cc:2804] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.077564 30786 raft_consensus.cc:493] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.077936 30786 raft_consensus.cc:3060] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.075121 30770 raft_consensus.cc:359] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.079305 30770 raft_consensus.cc:385] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.080405 30770 raft_consensus.cc:740] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.082139 30770 consensus_queue.cc:260] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.084609 30770 ts_tablet_manager.cc:1434] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:28:43.085775 30770 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
W20260709 12:28:43.086671 30618 leader_election.cc:343] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.088131 30769 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:43.088716 30769 ts_tablet_manager.cc:1403] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.010s
I20260709 12:28:43.090472 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4649276c3bf47df8defe360c8270aaf" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.090798 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.091316 30727 raft_consensus.cc:2468] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 0.
I20260709 12:28:43.091572 30726 raft_consensus.cc:2468] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.091971 30769 raft_consensus.cc:359] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.092749 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784b5acba0fb49f48b6bf072d093a5af" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.093137 30620 leader_election.cc:304] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: e04d66830b094daead9eabf66686bd40
I20260709 12:28:43.093998 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4649276c3bf47df8defe360c8270aaf" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.094288 30545 leader_election.cc:304] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.094502 30788 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.094714 30578 raft_consensus.cc:2468] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 0.
I20260709 12:28:43.095182 30788 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.095430 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.096207 30727 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 0.
I20260709 12:28:43.096280 30692 leader_election.cc:304] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.097071 30787 raft_consensus.cc:2804] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.097379 30788 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:43.097503 30787 raft_consensus.cc:493] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.098004 30788 raft_consensus.cc:2804] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.098040 30787 raft_consensus.cc:3060] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.098577 30788 raft_consensus.cc:493] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.098708 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784b5acba0fb49f48b6bf072d093a5af" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.099074 30788 raft_consensus.cc:3060] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.094621 30776 raft_consensus.cc:2804] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.100657 30776 raft_consensus.cc:493] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.101190 30776 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.101416 30768 tablet_bootstrap.cc:654] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.102088 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.102813 30578 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 0.
I20260709 12:28:43.104084 30692 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.104965 30775 raft_consensus.cc:2804] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.105335 30775 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.105660 30775 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.100559 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
W20260709 12:28:43.108227 30692 leader_election.cc:343] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.109879 30545 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.111390 30774 raft_consensus.cc:2804] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.111902 30774 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.112354 30774 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.113480 30775 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.116400 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4649276c3bf47df8defe360c8270aaf" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.117201 30654 raft_consensus.cc:2468] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 0.
I20260709 12:28:43.121132 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.122373 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.122949 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.109826 30786 raft_consensus.cc:515] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.126748 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784b5acba0fb49f48b6bf072d093a5af" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.127410 30579 raft_consensus.cc:3060] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.129609 30788 raft_consensus.cc:515] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.145831 30579 raft_consensus.cc:2468] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.146770 30652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4649276c3bf47df8defe360c8270aaf" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.147876 30652 raft_consensus.cc:2468] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 0.
I20260709 12:28:43.148568 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4649276c3bf47df8defe360c8270aaf" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.131043 30775 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:43.131981 30786 leader_election.cc:290] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.133519 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:43.149552 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784b5acba0fb49f48b6bf072d093a5af" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.150923 30651 raft_consensus.cc:2393] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e04d66830b094daead9eabf66686bd40 in current term 1: Already voted for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in this term.
I20260709 12:28:43.151098 30786 raft_consensus.cc:493] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:43.134644 30693 leader_election.cc:343] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.092782 30769 raft_consensus.cc:385] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.143178 30789 raft_consensus.cc:493] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.151950 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.152323 30789 raft_consensus.cc:515] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.153623 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4649276c3bf47df8defe360c8270aaf" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:43.133749 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784b5acba0fb49f48b6bf072d093a5af" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.154361 30653 raft_consensus.cc:3060] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.155020 30789 leader_election.cc:290] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.157100 30769 raft_consensus.cc:740] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.157881 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.158028 30769 consensus_queue.cc:260] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
W20260709 12:28:43.158900 30544 leader_election.cc:343] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.159148 30728 raft_consensus.cc:2468] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.160110 30544 leader_election.cc:304] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e04d66830b094daead9eabf66686bd40; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:43.160784 30651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.161798 30651 raft_consensus.cc:2468] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 0.
I20260709 12:28:43.151382 30788 leader_election.cc:290] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889)
I20260709 12:28:43.162241 30789 raft_consensus.cc:2749] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:43.162791 30545 leader_election.cc:343] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.163960 30544 leader_election.cc:304] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0
W20260709 12:28:43.166867 30693 leader_election.cc:343] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.165627 30789 raft_consensus.cc:2804] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.169294 30653 raft_consensus.cc:2468] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 1.
I20260709 12:28:43.169555 30789 raft_consensus.cc:493] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.170176 30789 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.170914 30693 leader_election.cc:304] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
I20260709 12:28:43.172195 30788 raft_consensus.cc:2804] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.173120 30788 raft_consensus.cc:697] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:43.151983 30786 raft_consensus.cc:515] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.174149 30788 consensus_queue.cc:237] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.177150 30786 leader_election.cc:290] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.173012 30769 ts_tablet_manager.cc:1434] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.004s
I20260709 12:28:43.172363 30770 tablet_bootstrap.cc:654] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.178702 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b89c17ab1440e1ab5c13ccd5d81bca" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.179425 30728 raft_consensus.cc:2468] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.179230 30774 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.180951 30620 leader_election.cc:304] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
I20260709 12:28:43.181787 30769 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:43.180966 30578 raft_consensus.cc:2393] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in current term 1: Already voted for candidate e04d66830b094daead9eabf66686bd40 in this term.
I20260709 12:28:43.182621 30786 raft_consensus.cc:2804] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.184089 30786 raft_consensus.cc:493] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.184536 30786 raft_consensus.cc:3060] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.185823 30692 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40
I20260709 12:28:43.187750 30775 raft_consensus.cc:2749] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.183383 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:43.141928 30776 raft_consensus.cc:515] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
W20260709 12:28:43.190131 30544 leader_election.cc:343] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.191823 30654 raft_consensus.cc:2393] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in current term 1: Already voted for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in this term.
I20260709 12:28:43.194321 30693 leader_election.cc:304] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40
I20260709 12:28:43.194432 30774 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.195631 30775 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.195832 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b89c17ab1440e1ab5c13ccd5d81bca" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.195971 30789 raft_consensus.cc:515] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.196564 30578 raft_consensus.cc:2468] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.197748 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.199033 30728 raft_consensus.cc:2393] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e04d66830b094daead9eabf66686bd40 in current term 1: Already voted for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in this term.
I20260709 12:28:43.200397 30545 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e04d66830b094daead9eabf66686bd40; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:43.194527 30618 leader_election.cc:304] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:43.202942 30774 raft_consensus.cc:2749] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.206068 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.207165 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
W20260709 12:28:43.207726 30618 leader_election.cc:343] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.207818 30654 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.208034 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.209724 30775 raft_consensus.cc:2749] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:43.210104 30545 leader_election.cc:343] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.184473 30787 raft_consensus.cc:515] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.204366 30769 tablet_bootstrap.cc:654] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.211848 30577 raft_consensus.cc:2393] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in current term 1: Already voted for candidate e04d66830b094daead9eabf66686bd40 in this term.
I20260709 12:28:43.212044 30776 leader_election.cc:290] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.212810 30776 raft_consensus.cc:2804] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.213289 30776 raft_consensus.cc:697] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:43.214265 30776 consensus_queue.cc:237] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.213449 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.211469 30789 leader_election.cc:290] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.223166 30786 raft_consensus.cc:515] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.227806 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b89c17ab1440e1ab5c13ccd5d81bca" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.228492 30577 raft_consensus.cc:3060] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.228785 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b89c17ab1440e1ab5c13ccd5d81bca" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.229445 30727 raft_consensus.cc:3060] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.229864 30768 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:43.230480 30768 ts_tablet_manager.cc:1403] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.172s	user 0.034s	sys 0.069s
I20260709 12:28:43.230608 30787 leader_election.cc:290] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.230821 30726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4649276c3bf47df8defe360c8270aaf" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.232403 30654 raft_consensus.cc:2468] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 1.
I20260709 12:28:43.235298 30544 leader_election.cc:304] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:43.235486 30768 raft_consensus.cc:359] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.236590 30768 raft_consensus.cc:385] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.236971 30768 raft_consensus.cc:740] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.237756 30787 raft_consensus.cc:2804] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.238348 30787 raft_consensus.cc:697] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 1 LEADER]: Becoming Leader. State: Replica: e04d66830b094daead9eabf66686bd40, State: Running, Role: LEADER
I20260709 12:28:43.231761 30786 leader_election.cc:290] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.240914 30577 raft_consensus.cc:2468] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.242595 30618 leader_election.cc:304] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.243927 30786 raft_consensus.cc:2804] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.244974 30786 raft_consensus.cc:697] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:43.238104 30768 consensus_queue.cc:260] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.246254 30786 consensus_queue.cc:237] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.239283 30787 consensus_queue.cc:237] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.251677 30768 ts_tablet_manager.cc:1434] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 12:28:43.252897 30768 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:43.254943 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4649276c3bf47df8defe360c8270aaf" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:43.256177 30654 raft_consensus.cc:2393] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e04d66830b094daead9eabf66686bd40 in current term 1: Already voted for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in this term.
I20260709 12:28:43.257603 30544 leader_election.cc:304] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e04d66830b094daead9eabf66686bd40; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:43.258934 30789 raft_consensus.cc:2749] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.260871 30727 raft_consensus.cc:2468] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.262531 30769 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:43.263382 30769 ts_tablet_manager.cc:1403] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.037s
I20260709 12:28:43.253113 30475 catalog_manager.cc:5697] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:43.266193 30768 tablet_bootstrap.cc:654] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.267910 30769 raft_consensus.cc:359] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.272950 30769 raft_consensus.cc:385] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.278383 30728 raft_consensus.cc:2468] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.281615 30620 leader_election.cc:304] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: e04d66830b094daead9eabf66686bd40
I20260709 12:28:43.283461 30803 raft_consensus.cc:2804] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.279080 30769 raft_consensus.cc:740] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.284053 30476 catalog_manager.cc:5697] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 reported cstate change: term changed from 0 to 1, leader changed from <none> to e04d66830b094daead9eabf66686bd40 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "e04d66830b094daead9eabf66686bd40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.298420 30770 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:43.299258 30770 ts_tablet_manager.cc:1403] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.214s	user 0.020s	sys 0.003s
I20260709 12:28:43.295317 30769 consensus_queue.cc:260] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.309568 30768 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:43.310318 30768 ts_tablet_manager.cc:1403] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.001s
I20260709 12:28:43.310765 30769 ts_tablet_manager.cc:1434] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.006s
I20260709 12:28:43.312373 30769 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:43.314041 30768 raft_consensus.cc:359] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.315335 30768 raft_consensus.cc:385] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.315706 30768 raft_consensus.cc:740] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.316787 30768 consensus_queue.cc:260] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.321944 30768 ts_tablet_manager.cc:1434] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:28:43.323565 30768 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:43.319402 30770 raft_consensus.cc:359] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.327123 30770 raft_consensus.cc:385] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.327605 30770 raft_consensus.cc:740] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.322808 30477 catalog_manager.cc:5697] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.328714 30770 consensus_queue.cc:260] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.332633 30803 raft_consensus.cc:697] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:43.333777 30803 consensus_queue.cc:237] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.334432 30770 ts_tablet_manager.cc:1434] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 12:28:43.335709 30770 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:43.342479 30769 tablet_bootstrap.cc:654] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.346566 30768 tablet_bootstrap.cc:654] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.345364 30770 tablet_bootstrap.cc:654] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.361528 30768 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:43.362149 30768 ts_tablet_manager.cc:1403] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.007s
I20260709 12:28:43.365545 30768 raft_consensus.cc:359] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.366283 30768 raft_consensus.cc:385] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.366601 30768 raft_consensus.cc:740] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.367353 30768 consensus_queue.cc:260] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.369457 30768 ts_tablet_manager.cc:1434] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:28:43.371187 30768 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:43.372927 30769 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:43.373629 30769 ts_tablet_manager.cc:1403] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.000s
I20260709 12:28:43.377182 30768 tablet_bootstrap.cc:654] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.377089 30769 raft_consensus.cc:359] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.378296 30769 raft_consensus.cc:385] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.378826 30769 raft_consensus.cc:740] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.379745 30769 consensus_queue.cc:260] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.382781 30769 ts_tablet_manager.cc:1434] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:28:43.379935 30477 catalog_manager.cc:5697] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.384606 30768 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:43.384903 30769 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:43.385754 30768 ts_tablet_manager.cc:1403] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 12:28:43.385767 30477 catalog_manager.cc:5697] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.388908 30768 raft_consensus.cc:359] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.389737 30768 raft_consensus.cc:385] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.390066 30768 raft_consensus.cc:740] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.390961 30768 consensus_queue.cc:260] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.391916 30770 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:43.392491 30770 ts_tablet_manager.cc:1403] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.000s
I20260709 12:28:43.392561 30769 tablet_bootstrap.cc:654] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.393661 30768 ts_tablet_manager.cc:1434] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:28:43.394840 30768 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:43.396126 30770 raft_consensus.cc:359] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.397289 30770 raft_consensus.cc:385] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.397723 30770 raft_consensus.cc:740] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.399569 30770 consensus_queue.cc:260] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.400882 30787 raft_consensus.cc:493] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.401467 30787 raft_consensus.cc:515] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.403302 30770 ts_tablet_manager.cc:1434] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 12:28:43.403743 30787 leader_election.cc:290] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.404626 30770 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:43.405522 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.405905 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
W20260709 12:28:43.407286 30545 leader_election.cc:343] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:43.408255 30544 leader_election.cc:343] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.408675 30544 leader_election.cc:304] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e04d66830b094daead9eabf66686bd40; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:43.409888 30787 raft_consensus.cc:2749] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.411550 30768 tablet_bootstrap.cc:654] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.417111 30769 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:43.417657 30769 ts_tablet_manager.cc:1403] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.003s
I20260709 12:28:43.420630 30769 raft_consensus.cc:359] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.421056 30768 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: No bootstrap required, opened a new log
I20260709 12:28:43.421411 30769 raft_consensus.cc:385] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.421734 30768 ts_tablet_manager.cc:1403] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.001s
I20260709 12:28:43.421782 30769 raft_consensus.cc:740] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.422824 30769 consensus_queue.cc:260] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.425112 30770 tablet_bootstrap.cc:654] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.424979 30768 raft_consensus.cc:359] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.425766 30768 raft_consensus.cc:385] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.426059 30768 raft_consensus.cc:740] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.426898 30768 consensus_queue.cc:260] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.428638 30769 ts_tablet_manager.cc:1434] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:28:43.429791 30769 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:43.431139 30768 ts_tablet_manager.cc:1434] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:28:43.433485 30788 raft_consensus.cc:493] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.434101 30788 raft_consensus.cc:515] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.436064 30769 tablet_bootstrap.cc:654] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.436425 30788 leader_election.cc:290] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:43.438107 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.439031 30654 raft_consensus.cc:2393] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in current term 1: Already voted for candidate e04d66830b094daead9eabf66686bd40 in this term.
I20260709 12:28:43.441778 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.443627 30692 leader_election.cc:304] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40
I20260709 12:28:43.444446 30788 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.445649 30769 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:43.446130 30769 ts_tablet_manager.cc:1403] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 12:28:43.447655 30770 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:43.448216 30770 ts_tablet_manager.cc:1403] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.000s
I20260709 12:28:43.449388 30769 raft_consensus.cc:359] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.450137 30769 raft_consensus.cc:385] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.450424 30769 raft_consensus.cc:740] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.450953 30788 raft_consensus.cc:2749] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.451274 30770 raft_consensus.cc:359] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.451141 30769 consensus_queue.cc:260] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.451960 30770 raft_consensus.cc:385] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.452265 30770 raft_consensus.cc:740] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.452911 30770 consensus_queue.cc:260] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.453400 30769 ts_tablet_manager.cc:1434] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:28:43.454505 30769 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Bootstrap starting.
I20260709 12:28:43.457679 30770 ts_tablet_manager.cc:1434] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:28:43.458864 30770 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:43.460199 30769 tablet_bootstrap.cc:654] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.465844 30770 tablet_bootstrap.cc:654] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.471104 30770 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:43.471707 30770 ts_tablet_manager.cc:1403] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 12:28:43.474098 30769 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: No bootstrap required, opened a new log
I20260709 12:28:43.474682 30769 ts_tablet_manager.cc:1403] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:28:43.474124 30770 raft_consensus.cc:359] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.475124 30770 raft_consensus.cc:385] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.475359 30770 raft_consensus.cc:740] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.475925 30770 consensus_queue.cc:260] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.477561 30770 ts_tablet_manager.cc:1434] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:28:43.477299 30769 raft_consensus.cc:359] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.478132 30769 raft_consensus.cc:385] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.478484 30769 raft_consensus.cc:740] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.478879 30770 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Bootstrap starting.
I20260709 12:28:43.479441 30769 consensus_queue.cc:260] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.481570 30769 ts_tablet_manager.cc:1434] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:43.484665 30770 tablet_bootstrap.cc:654] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.490658 30770 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4: No bootstrap required, opened a new log
I20260709 12:28:43.491259 30770 ts_tablet_manager.cc:1403] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:28:43.493964 30770 raft_consensus.cc:359] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.494575 30770 raft_consensus.cc:385] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.494799 30770 raft_consensus.cc:740] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.495414 30770 consensus_queue.cc:260] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.496848 30770 ts_tablet_manager.cc:1434] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 12:28:43.508351 30787 raft_consensus.cc:493] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.508927 30787 raft_consensus.cc:515] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.509589 30803 raft_consensus.cc:493] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.510074 30803 raft_consensus.cc:515] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.511050 30787 leader_election.cc:290] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.511891 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.512229 30803 leader_election.cc:290] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.512243 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.512703 30654 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 0.
I20260709 12:28:43.513185 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.513353 30728 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 0.
I20260709 12:28:43.513384 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.513904 30577 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.514230 30727 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.514350 30544 leader_election.cc:304] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.515272 30787 raft_consensus.cc:2804] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.515293 30618 leader_election.cc:304] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.515777 30787 raft_consensus.cc:493] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.516249 30787 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.516322 30803 raft_consensus.cc:2804] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.516760 30803 raft_consensus.cc:493] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.517112 30803 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.524468 30787 raft_consensus.cc:515] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.524968 30803 raft_consensus.cc:515] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.527343 30787 leader_election.cc:290] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.528733 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:43.528891 30803 leader_election.cc:290] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.528771 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.529033 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.529768 30654 raft_consensus.cc:2393] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e04d66830b094daead9eabf66686bd40 in current term 1: Already voted for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in this term.
I20260709 12:28:43.528757 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.529881 30727 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.530680 30577 raft_consensus.cc:2393] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in current term 1: Already voted for candidate e04d66830b094daead9eabf66686bd40 in this term.
I20260709 12:28:43.532004 30618 leader_election.cc:304] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4; no voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40
I20260709 12:28:43.533208 30803 raft_consensus.cc:2749] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.538450 30727 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 1.
I20260709 12:28:43.539707 30545 leader_election.cc:304] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4
I20260709 12:28:43.540423 30787 raft_consensus.cc:2804] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.540923 30787 raft_consensus.cc:697] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 LEADER]: Becoming Leader. State: Replica: e04d66830b094daead9eabf66686bd40, State: Running, Role: LEADER
I20260709 12:28:43.541720 30787 consensus_queue.cc:237] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.549683 30476 catalog_manager.cc:5697] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 reported cstate change: term changed from 0 to 1, leader changed from <none> to e04d66830b094daead9eabf66686bd40 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "e04d66830b094daead9eabf66686bd40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.573215 30803 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.573818 30803 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.575625 30803 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.576610 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.576772 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.577392 30577 raft_consensus.cc:2393] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in current term 1: Already voted for candidate e04d66830b094daead9eabf66686bd40 in this term.
I20260709 12:28:43.577513 30727 raft_consensus.cc:2393] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in current term 1: Already voted for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in this term.
I20260709 12:28:43.578688 30620 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4; no voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40
I20260709 12:28:43.579399 30803 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.585422 30803 raft_consensus.cc:2749] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.636991 30787 consensus_queue.cc:1048] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.654006 30831 consensus_queue.cc:1048] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:43.657426 30803 raft_consensus.cc:493] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.657989 30803 raft_consensus.cc:515] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.660970 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7d44785cd74161b56c3107d580a7f6" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.661586 30803 leader_election.cc:290] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.661767 30577 raft_consensus.cc:2468] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.661345 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7d44785cd74161b56c3107d580a7f6" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.662770 30727 raft_consensus.cc:2468] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.663275 30618 leader_election.cc:304] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.664364 30803 raft_consensus.cc:2804] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.664754 30803 raft_consensus.cc:493] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.665112 30803 raft_consensus.cc:3060] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.670113 30788 consensus_queue.cc:1048] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:43.673341 30803 raft_consensus.cc:515] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.678411 30803 leader_election.cc:290] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.679533 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7d44785cd74161b56c3107d580a7f6" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.679706 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7d44785cd74161b56c3107d580a7f6" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.680390 30578 raft_consensus.cc:3060] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.680548 30727 raft_consensus.cc:3060] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.688735 30788 consensus_queue.cc:1048] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:43.689100 30727 raft_consensus.cc:2468] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.690409 30803 raft_consensus.cc:493] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.690519 30620 leader_election.cc:304] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
I20260709 12:28:43.691123 30803 raft_consensus.cc:515] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.691634 30811 raft_consensus.cc:2804] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.692212 30811 raft_consensus.cc:697] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:43.693112 30811 consensus_queue.cc:237] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.693558 30803 leader_election.cc:290] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.696482 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b2ef795c34a328ac50361e285d8eb" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.696885 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b2ef795c34a328ac50361e285d8eb" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.697278 30728 raft_consensus.cc:2468] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.697587 30579 raft_consensus.cc:2468] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.699076 30831 raft_consensus.cc:493] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.699625 30618 leader_election.cc:304] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.699759 30831 raft_consensus.cc:515] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.699810 30578 raft_consensus.cc:2468] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.701467 30776 raft_consensus.cc:2804] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.701880 30776 raft_consensus.cc:493] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.702244 30776 raft_consensus.cc:3060] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.703666 30831 leader_election.cc:290] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.704263 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.706878 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.707877 30728 raft_consensus.cc:2393] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e04d66830b094daead9eabf66686bd40 in current term 1: Already voted for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in this term.
I20260709 12:28:43.709086 30545 leader_election.cc:304] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e04d66830b094daead9eabf66686bd40; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:43.710187 30831 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.721671 30831 raft_consensus.cc:2749] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.723675 30776 raft_consensus.cc:515] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.724254 30477 catalog_manager.cc:5697] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.726334 30776 leader_election.cc:290] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.728030 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b2ef795c34a328ac50361e285d8eb" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.728567 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b2ef795c34a328ac50361e285d8eb" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.728897 30577 raft_consensus.cc:3060] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.730136 30728 raft_consensus.cc:3060] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.738149 30577 raft_consensus.cc:2468] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.738375 30728 raft_consensus.cc:2468] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.739620 30618 leader_election.cc:304] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.740581 30728 raft_consensus.cc:3060] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.740582 30776 raft_consensus.cc:2804] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.741365 30776 raft_consensus.cc:697] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:43.742142 30776 consensus_queue.cc:237] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.748571 30776 consensus_queue.cc:1048] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.751801 30477 catalog_manager.cc:5697] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.762904 30803 consensus_queue.cc:1048] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.788439 30803 consensus_queue.cc:1048] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.795034 30803 consensus_queue.cc:1048] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.802675 30776 consensus_queue.cc:1048] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.812850 30776 consensus_queue.cc:1048] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.943090 30836 raft_consensus.cc:493] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.943570 30836 raft_consensus.cc:515] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.944119 30776 raft_consensus.cc:493] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.944693 30776 raft_consensus.cc:515] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.945901 30836 leader_election.cc:290] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:43.946768 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.946930 30776 leader_election.cc:290] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.947685 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:43.947783 30577 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 0.
I20260709 12:28:43.948071 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:43.948211 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40" is_pre_election: true
I20260709 12:28:43.948510 30654 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 0.
I20260709 12:28:43.948848 30728 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.948961 30578 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 0.
I20260709 12:28:43.949754 30692 leader_election.cc:304] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:43.949875 30620 leader_election.cc:304] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
I20260709 12:28:43.950784 30836 raft_consensus.cc:2804] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.950906 30776 raft_consensus.cc:2804] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.951251 30836 raft_consensus.cc:493] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.951440 30776 raft_consensus.cc:493] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.951689 30836 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.951874 30776 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.957652 30776 raft_consensus.cc:515] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.957652 30836 raft_consensus.cc:515] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:43.959697 30836 leader_election.cc:290] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:43.959787 30776 leader_election.cc:290] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:43.960760 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.961232 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:43.961549 30578 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.961757 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:43.962163 30728 raft_consensus.cc:2393] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in current term 1: Already voted for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in this term.
I20260709 12:28:43.961793 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:43.962675 30654 raft_consensus.cc:2393] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in current term 1: Already voted for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in this term.
I20260709 12:28:43.963994 30692 leader_election.cc:304] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40
I20260709 12:28:43.964715 30836 raft_consensus.cc:2749] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.968034 30578 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:43.969240 30618 leader_election.cc:304] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:43.970055 30776 raft_consensus.cc:2804] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.970634 30776 raft_consensus.cc:697] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:43.971462 30776 consensus_queue.cc:237] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
W20260709 12:28:44.031332 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:44.030966 30477 catalog_manager.cc:5697] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:44.034384 30831 consensus_queue.cc:1048] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.053390 30789 consensus_queue.cc:1048] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.109736 30811 consensus_queue.cc:1048] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.110539 30776 consensus_queue.cc:1048] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.262282 30786 consensus_queue.cc:1048] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.277037 30811 consensus_queue.cc:1048] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.367347 30786 consensus_queue.cc:1048] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.372442 30803 consensus_queue.cc:1048] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.730727 30789 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.731741 30789 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:44.734844 30789 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:44.735674 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:44.736140 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:44.736719 30654 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 1.
I20260709 12:28:44.736924 30727 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 1.
I20260709 12:28:44.738525 30544 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:44.739493 30789 raft_consensus.cc:2804] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:44.739820 30789 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.740099 30789 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.748435 30789 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:44.750352 30789 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 2 election: Requested vote from peers 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:44.751312 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:44.751475 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "e04d66830b094daead9eabf66686bd40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:44.751971 30654 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.752154 30727 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.759759 30727 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 2.
I20260709 12:28:44.759759 30654 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04d66830b094daead9eabf66686bd40 in term 2.
I20260709 12:28:44.761243 30545 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:44.762198 30789 raft_consensus.cc:2804] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:44.762871 30789 raft_consensus.cc:697] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 2 LEADER]: Becoming Leader. State: Replica: e04d66830b094daead9eabf66686bd40, State: Running, Role: LEADER
I20260709 12:28:44.763903 30789 consensus_queue.cc:237] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:44.773461 30475 catalog_manager.cc:5697] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 reported cstate change: term changed from 0 to 2, leader changed from <none> to e04d66830b094daead9eabf66686bd40 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "e04d66830b094daead9eabf66686bd40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.223101 30654 raft_consensus.cc:1275] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Refusing update from remote peer e04d66830b094daead9eabf66686bd40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:28:45.224488 30789 consensus_queue.cc:1048] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.239351 30727 raft_consensus.cc:1275] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Refusing update from remote peer e04d66830b094daead9eabf66686bd40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:28:45.241496 30864 consensus_queue.cc:1048] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.310436 17568 ts_manager.cc:295] Set tserver state for e04d66830b094daead9eabf66686bd40 to MAINTENANCE_MODE
I20260709 12:28:45.311537 17568 tablet_server.cc:179] TabletServer@127.17.40.1:0 shutting down...
I20260709 12:28:45.349511 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:45.350373 17568 tablet_replica.cc:333] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.351214 17568 raft_consensus.cc:2243] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:45.352134 17568 raft_consensus.cc:2272] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.354815 17568 tablet_replica.cc:333] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.355563 17568 raft_consensus.cc:2243] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:45.356096 17568 raft_consensus.cc:2272] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.358590 17568 tablet_replica.cc:333] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.359197 17568 raft_consensus.cc:2243] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:45.359623 17568 raft_consensus.cc:2272] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.362974 17568 tablet_replica.cc:333] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.363633 17568 raft_consensus.cc:2243] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:45.364557 17568 raft_consensus.cc:2272] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.367034 17568 tablet_replica.cc:333] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.367597 17568 raft_consensus.cc:2243] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:45.368098 17568 raft_consensus.cc:2272] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.370581 17568 tablet_replica.cc:333] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.371161 17568 raft_consensus.cc:2243] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:45.372049 17568 raft_consensus.cc:2272] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.374655 17568 tablet_replica.cc:333] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.375290 17568 raft_consensus.cc:2243] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:45.375759 17568 raft_consensus.cc:2272] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.378134 17568 tablet_replica.cc:333] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.378785 17568 raft_consensus.cc:2243] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:45.379318 17568 raft_consensus.cc:2272] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.381783 17568 tablet_replica.cc:333] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.382490 17568 raft_consensus.cc:2243] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:45.382965 17568 raft_consensus.cc:2272] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.385253 17568 tablet_replica.cc:333] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: stopping tablet replica
I20260709 12:28:45.385856 17568 raft_consensus.cc:2243] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:45.386353 17568 raft_consensus.cc:2272] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:45.421600 17568 tablet_server.cc:196] TabletServer@127.17.40.1:0 shutdown complete.
W20260709 12:28:45.447992 30618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111) [suppressed 118 similar messages]
W20260709 12:28:45.452751 30618 consensus_peers.cc:597] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:45.583508 30618 consensus_peers.cc:597] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:45.589562 30618 consensus_peers.cc:597] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:45.643239 30618 consensus_peers.cc:597] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:45.677520 30618 consensus_peers.cc:597] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:45.750793 30692 consensus_peers.cc:597] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:45.916076 30618 consensus_peers.cc:597] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:46.048229 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:46.441457 30880 raft_consensus.cc:493] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.442152 30880 raft_consensus.cc:515] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.445169 30880 leader_election.cc:290] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:46.445855 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
W20260709 12:28:46.449389 30692 leader_election.cc:336] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.449793 30692 leader_election.cc:304] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40
I20260709 12:28:46.450503 30880 raft_consensus.cc:2749] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:46.522562 30880 raft_consensus.cc:493] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.523222 30880 raft_consensus.cc:515] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.525167 30880 leader_election.cc:290] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:46.526564 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
W20260709 12:28:46.529235 30692 leader_election.cc:336] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.529671 30692 leader_election.cc:304] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40
I20260709 12:28:46.530323 30880 raft_consensus.cc:2749] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:46.559806 30874 raft_consensus.cc:493] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.560362 30874 raft_consensus.cc:515] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.562511 30874 leader_election.cc:290] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:46.563652 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:46.564409 30728 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:46.565932 30620 leader_election.cc:304] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
W20260709 12:28:46.566533 30618 leader_election.cc:336] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.566756 30874 raft_consensus.cc:2804] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:46.567209 30874 raft_consensus.cc:493] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.567502 30874 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.573666 30874 raft_consensus.cc:515] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.575438 30874 leader_election.cc:290] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:46.576645 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:46.577306 30728 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:46.579790 30618 leader_election.cc:336] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.584336 30728 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 2.
I20260709 12:28:46.585515 30620 leader_election.cc:304] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: e04d66830b094daead9eabf66686bd40
I20260709 12:28:46.586274 30874 raft_consensus.cc:2804] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.586767 30874 raft_consensus.cc:697] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:46.587589 30874 consensus_queue.cc:237] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.594877 30477 catalog_manager.cc:5697] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 1 to 2, leader changed from e04d66830b094daead9eabf66686bd40 (127.17.40.1) to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.738876 30874 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.739473 30874 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.741487 30874 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:46.742847 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
W20260709 12:28:46.745085 30618 leader_election.cc:336] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.745225 30880 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.745510 30618 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4; no voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40
I20260709 12:28:46.745810 30880 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.746296 30874 raft_consensus.cc:2749] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:46.748916 30874 raft_consensus.cc:493] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.749619 30880 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:46.749523 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" is_pre_election: true
I20260709 12:28:46.750528 30874 raft_consensus.cc:515] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.750871 30654 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:46.752219 30693 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
W20260709 12:28:46.752877 30692 leader_election.cc:336] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.753244 30880 raft_consensus.cc:2804] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:46.753235 30874 leader_election.cc:290] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:46.753816 30880 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.754717 30880 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:46.755481 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" is_pre_election: true
I20260709 12:28:46.756314 30728 raft_consensus.cc:2468] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 1.
I20260709 12:28:46.757521 30620 leader_election.cc:304] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
W20260709 12:28:46.758277 30618 leader_election.cc:336] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.758639 30874 raft_consensus.cc:2804] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:46.759202 30874 raft_consensus.cc:493] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e04d66830b094daead9eabf66686bd40)
I20260709 12:28:46.759624 30874 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.765830 30880 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.769237 30874 raft_consensus.cc:515] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.770846 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:46.771598 30654 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:46.771843 30874 leader_election.cc:290] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
W20260709 12:28:46.772090 30692 leader_election.cc:336] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.773145 30880 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:46.774256 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:46.774997 30728 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:46.776630 30618 leader_election.cc:336] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111)
I20260709 12:28:46.781229 30654 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 3.
I20260709 12:28:46.782871 30693 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: e04d66830b094daead9eabf66686bd40
I20260709 12:28:46.783601 30728 raft_consensus.cc:2468] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 2.
I20260709 12:28:46.783861 30880 raft_consensus.cc:2804] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:46.785215 30620 leader_election.cc:304] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: e04d66830b094daead9eabf66686bd40
I20260709 12:28:46.786016 30880 raft_consensus.cc:697] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:46.786134 30874 raft_consensus.cc:2804] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.786952 30874 raft_consensus.cc:697] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:46.787233 30880 consensus_queue.cc:237] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.788085 30874 consensus_queue.cc:237] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:46.800586 30477 catalog_manager.cc:5697] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 1 to 2, leader changed from e04d66830b094daead9eabf66686bd40 (127.17.40.1) to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.804692 30475 catalog_manager.cc:5697] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 2 to 3, leader changed from e04d66830b094daead9eabf66686bd40 (127.17.40.1) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 3 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:47.049485 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:47.078138 30728 raft_consensus.cc:1275] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:47.079746 30874 consensus_queue.cc:1048] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:47.095783 30618 consensus_peers.cc:597] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:47.208300 30728 raft_consensus.cc:1275] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:47.209709 30874 consensus_queue.cc:1048] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:47.225028 30618 consensus_peers.cc:597] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:47.338042 30654 raft_consensus.cc:1275] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:47.339620 30880 consensus_queue.cc:1048] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:47.358533 30692 consensus_peers.cc:597] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:47.822837 30618 consensus_peers.cc:597] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:48.050622 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:48.103324 30618 consensus_peers.cc:597] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:48.198072 30618 consensus_peers.cc:597] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:48.202328 30618 consensus_peers.cc:597] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:48.261441 30618 consensus_peers.cc:597] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:48.288013 30618 consensus_peers.cc:597] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:48.444344 30692 consensus_peers.cc:597] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:49.051888 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:49.638844 30618 consensus_peers.cc:597] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:49.871500 30618 consensus_peers.cc:597] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:50.003502 30692 consensus_peers.cc:597] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:50.053043 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:50.111215 30618 consensus_peers.cc:597] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:50.378345 30618 consensus_peers.cc:597] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:50.390789 30618 consensus_peers.cc:597] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:50.456565 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:50.464020 30903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:50.464440 30904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:50.465878 30906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:50.467293 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:50.468366 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:50.468636 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:50.468830 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600130468811 us; error 0 us; skew 500 ppm
I20260709 12:28:50.469434 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:50.472465 17568 webserver.cc:533] Webserver started at http://127.17.40.1:33563/ using document root <none> and password file <none>
I20260709 12:28:50.473052 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:50.473268 17568 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:28:50.477412 17568 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:28:50.481881 30911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:50.482801 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:50.483173 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "e04d66830b094daead9eabf66686bd40"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-tjfs"
I20260709 12:28:50.483590 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:50.496165 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:50.497538 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:50.499531 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:50.503572 30918 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:28:50.549913 30618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111) [suppressed 101 similar messages]
I20260709 12:28:50.563398 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:28:50.563860 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.061s	user 0.002s	sys 0.000s
I20260709 12:28:50.564217 17568 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:28:50.570343 30918 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.585433 30918 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.586315 30918 tablet_bootstrap.cc:492] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.586983 30918 ts_tablet_manager.cc:1403] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:28:50.589375 30918 raft_consensus.cc:359] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.589967 30918 raft_consensus.cc:740] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.590778 30918 consensus_queue.cc:260] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.593885 30918 ts_tablet_manager.cc:1434] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:50.594758 30918 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.610546 30918 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.611394 30918 tablet_bootstrap.cc:492] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.612030 30918 ts_tablet_manager.cc:1403] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.006s
I20260709 12:28:50.614353 30918 raft_consensus.cc:359] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.614990 30918 raft_consensus.cc:740] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.615048 17568 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:28:50.615476 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.051s	user 0.047s	sys 0.004s
I20260709 12:28:50.615797 30918 consensus_queue.cc:260] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.618006 30918 ts_tablet_manager.cc:1434] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:50.619022 30918 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.635135 30918 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.636034 30918 tablet_bootstrap.cc:492] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.636785 30918 ts_tablet_manager.cc:1403] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:28:50.639215 30918 raft_consensus.cc:359] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.639828 30918 raft_consensus.cc:740] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.640565 30918 consensus_queue.cc:260] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.642334 30918 ts_tablet_manager.cc:1434] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:28:50.643301 30918 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
W20260709 12:28:50.648725 30618 consensus_peers.cc:597] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:50.660454 30618 consensus_peers.cc:597] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:50.662168 30918 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.663312 30918 tablet_bootstrap.cc:492] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.663957 30918 ts_tablet_manager.cc:1403] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:28:50.666638 30918 raft_consensus.cc:359] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.667223 30918 raft_consensus.cc:740] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.667966 30918 consensus_queue.cc:260] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.670277 30918 ts_tablet_manager.cc:1434] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:50.671159 30918 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.685117 30918 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.686132 30918 tablet_bootstrap.cc:492] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.686908 30918 ts_tablet_manager.cc:1403] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:28:50.688980 30918 raft_consensus.cc:359] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.689565 30918 raft_consensus.cc:740] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.690390 30918 consensus_queue.cc:260] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.692667 30918 ts_tablet_manager.cc:1434] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:50.693419 30918 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.695163 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:33889
I20260709 12:28:50.695343 30980 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:33889 every 8 connection(s)
I20260709 12:28:50.701990 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:50.718639 30918 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.719983 30918 tablet_bootstrap.cc:492] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.720793 30918 ts_tablet_manager.cc:1403] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 12:28:50.724627 30918 raft_consensus.cc:359] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.725473 30918 raft_consensus.cc:740] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.726377 30918 consensus_queue.cc:260] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.728323 30918 ts_tablet_manager.cc:1434] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:50.729303 30918 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.730835 30981 heartbeater.cc:344] Connected to a master server at 127.17.40.62:38395
I20260709 12:28:50.731397 30981 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:50.732424 30981 heartbeater.cc:507] Master 127.17.40.62:38395 requested a full tablet report, sending...
I20260709 12:28:50.738786 30654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
mode: GRACEFUL
new_leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:28:50.739445 30475 ts_manager.cc:194] Re-registered known tserver with Master: e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889)
I20260709 12:28:50.739637 30654 raft_consensus.cc:606] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Received request to transfer leadership to TS 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:50.743252 30654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
mode: GRACEFUL
new_leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:28:50.744081 30654 raft_consensus.cc:606] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Received request to transfer leadership to TS 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:50.747571 30654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
mode: GRACEFUL
new_leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:28:50.748556 30654 raft_consensus.cc:606] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Received request to transfer leadership to TS 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:50.750231 30475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37528
I20260709 12:28:50.752403 30654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef7d44785cd74161b56c3107d580a7f6"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
mode: GRACEFUL
new_leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:28:50.753086 30654 raft_consensus.cc:606] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Received request to transfer leadership to TS 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:50.754290 30981 heartbeater.cc:499] Master 127.17.40.62:38395 was elected leader, sending a full tablet report...
I20260709 12:28:50.754810 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:28:50.755604 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:50.756418 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:50.756873 30918 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.757912 30918 tablet_bootstrap.cc:492] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.758613 30918 ts_tablet_manager.cc:1403] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.007s
I20260709 12:28:50.761324 30918 raft_consensus.cc:359] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.762040 30918 raft_consensus.cc:740] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.762835 30918 consensus_queue.cc:260] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.764968 30918 ts_tablet_manager.cc:1434] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:50.765836 30918 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.780197 30918 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.781112 30918 tablet_bootstrap.cc:492] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.781795 30918 ts_tablet_manager.cc:1403] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:28:50.782967 30900 raft_consensus.cc:993] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4: : Instructing follower 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:50.783648 30990 raft_consensus.cc:1081] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Signalling peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:50.784556 30918 raft_consensus.cc:359] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.785269 30918 raft_consensus.cc:740] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.785459 30728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:28:50.786089 30728 raft_consensus.cc:493] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.785979 30918 consensus_queue.cc:260] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.786487 30728 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:50.788143 30918 ts_tablet_manager.cc:1434] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:28:50.789040 30918 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.793967 30728 raft_consensus.cc:515] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.797020 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:50.797681 30654 raft_consensus.cc:3055] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:50.798087 30654 raft_consensus.cc:740] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:50.799300 30654 consensus_queue.cc:260] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.800926 30654 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:50.803562 30728 leader_election.cc:290] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:50.811470 30918 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.812673 30918 tablet_bootstrap.cc:492] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.812729 30654 raft_consensus.cc:2468] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 3.
I20260709 12:28:50.813498 30918 ts_tablet_manager.cc:1403] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 12:28:50.814198 30693 leader_election.cc:304] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
I20260709 12:28:50.814618 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:50.815224 30880 raft_consensus.cc:2804] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:50.815325 30955 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:50.816642 30880 raft_consensus.cc:697] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:50.816283 30918 raft_consensus.cc:359] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.817173 30918 raft_consensus.cc:740] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.817720 30880 consensus_queue.cc:237] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.817965 30918 consensus_queue.cc:260] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.820231 30918 ts_tablet_manager.cc:1434] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:50.821208 30918 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Bootstrap starting.
I20260709 12:28:50.825167 30955 raft_consensus.cc:2468] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 3.
I20260709 12:28:50.833125 30477 catalog_manager.cc:5697] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 2 to 3, leader changed from 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 3 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:50.838580 30918 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:50.839437 30918 tablet_bootstrap.cc:492] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Bootstrap complete.
I20260709 12:28:50.840214 30918 ts_tablet_manager.cc:1403] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:28:50.843122 30918 raft_consensus.cc:359] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.843698 30918 raft_consensus.cc:740] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04d66830b094daead9eabf66686bd40, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.844368 30918 consensus_queue.cc:260] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.846271 30918 ts_tablet_manager.cc:1434] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:50.905618 30990 raft_consensus.cc:993] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4: : Instructing follower 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:50.906313 31000 raft_consensus.cc:1081] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Signalling peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:50.908123 30728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef7d44785cd74161b56c3107d580a7f6"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:28:50.908711 30728 raft_consensus.cc:493] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.909109 30728 raft_consensus.cc:3060] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.910476 31000 raft_consensus.cc:993] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4: : Instructing follower 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:50.911010 30990 raft_consensus.cc:1081] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Signalling peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:50.912717 30727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:28:50.913247 30727 raft_consensus.cc:493] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.913571 30727 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.916851 30728 raft_consensus.cc:515] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.918908 30728 leader_election.cc:290] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:50.919880 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7d44785cd74161b56c3107d580a7f6" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:50.920217 30654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7d44785cd74161b56c3107d580a7f6" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:50.920627 30955 raft_consensus.cc:3060] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.920336 30727 raft_consensus.cc:515] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.920807 30654 raft_consensus.cc:3055] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.921327 30654 raft_consensus.cc:740] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:50.922366 30654 consensus_queue.cc:260] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.924132 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:50.924420 30727 leader_election.cc:290] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:50.924965 30954 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.924849 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:50.925657 30653 raft_consensus.cc:3055] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.925983 30653 raft_consensus.cc:740] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:50.926870 30653 consensus_queue.cc:260] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.927842 30654 raft_consensus.cc:3060] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.928086 30653 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.928948 30955 raft_consensus.cc:2468] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:50.930450 30692 leader_election.cc:304] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:50.931507 30880 raft_consensus.cc:2804] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.932294 30880 raft_consensus.cc:697] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:50.933198 30880 consensus_queue.cc:237] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.935530 30954 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:50.937170 30692 leader_election.cc:304] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:50.937796 30654 raft_consensus.cc:2468] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:50.938285 30993 raft_consensus.cc:2804] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.938714 30653 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:50.941607 30993 raft_consensus.cc:697] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:50.942754 30993 consensus_queue.cc:237] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:50.945809 30477 catalog_manager.cc:5697] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 1 to 2, leader changed from 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:50.958482 30477 catalog_manager.cc:5697] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 1 to 2, leader changed from 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:50.985740 30955 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.999315 30955 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:51.054265 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:51.213994 30990 raft_consensus.cc:993] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4: : Instructing follower 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:51.214578 31000 raft_consensus.cc:1081] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Signalling peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:51.216127 30727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:28:51.216676 30727 raft_consensus.cc:493] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:51.217006 30727 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:51.222827 30727 raft_consensus.cc:515] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:51.224550 30727 leader_election.cc:290] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:51.225564 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:51.225735 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:51.226256 30955 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:51.226346 30653 raft_consensus.cc:3055] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:51.226821 30653 raft_consensus.cc:740] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:51.227567 30653 consensus_queue.cc:260] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:51.228587 30653 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:51.236263 30955 raft_consensus.cc:2468] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:51.236533 30653 raft_consensus.cc:2468] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:51.238262 30693 leader_election.cc:304] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, 9dcf62aa129b4a06bfcc9b04cc3dd9c0; no voters: 
I20260709 12:28:51.239423 30993 raft_consensus.cc:2804] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:51.240307 30993 raft_consensus.cc:697] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:51.241107 30993 consensus_queue.cc:237] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:51.249178 30955 raft_consensus.cc:1275] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:51.249154 30475 catalog_manager.cc:5697] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 1 to 2, leader changed from 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:51.250919 31002 consensus_queue.cc:1048] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.267549 30653 raft_consensus.cc:1275] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:51.269119 30993 consensus_queue.cc:1048] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:51.362865 30653 raft_consensus.cc:1275] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.364181 30993 consensus_queue.cc:1048] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.373977 30955 raft_consensus.cc:1275] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.376034 31013 consensus_queue.cc:1048] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.538684 30653 raft_consensus.cc:1275] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.540457 30993 consensus_queue.cc:1048] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.541994 30955 raft_consensus.cc:1275] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.543530 30993 consensus_queue.cc:1048] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.634761 30955 raft_consensus.cc:1275] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.636018 30993 consensus_queue.cc:1048] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.639153 30653 raft_consensus.cc:1275] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.640867 30993 consensus_queue.cc:1048] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.768064 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:51.787048 30727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
mode: GRACEFUL
new_leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
 from {username='slave'} at 127.0.0.1:60864
I20260709 12:28:51.787667 30727 raft_consensus.cc:606] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Received request to transfer leadership to TS 0fe15a5aaeea486ea4e2ca759e86cdd4
I20260709 12:28:51.790302 30727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
mode: GRACEFUL
new_leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
 from {username='slave'} at 127.0.0.1:60864
I20260709 12:28:51.790912 30727 raft_consensus.cc:606] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Received request to transfer leadership to TS 0fe15a5aaeea486ea4e2ca759e86cdd4
I20260709 12:28:51.791976 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:51.792505 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:51.793144 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:28:52.055327 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:52.170055 30993 raft_consensus.cc:993] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: : Instructing follower 0fe15a5aaeea486ea4e2ca759e86cdd4 to start an election
I20260709 12:28:52.170737 30880 raft_consensus.cc:1081] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Signalling peer 0fe15a5aaeea486ea4e2ca759e86cdd4 to start an election
I20260709 12:28:52.172377 30653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
 from {username='slave'} at 127.0.0.1:32940
I20260709 12:28:52.172863 30653 raft_consensus.cc:493] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:52.173128 30653 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:52.179019 30653 raft_consensus.cc:515] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.181011 30653 leader_election.cc:290] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 3 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:52.181936 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:52.182076 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:52.182853 30954 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:52.182952 30727 raft_consensus.cc:3055] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:52.183405 30727 raft_consensus.cc:740] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:52.184224 30727 consensus_queue.cc:260] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.185370 30727 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:52.191195 30954 raft_consensus.cc:2468] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 3.
I20260709 12:28:52.191874 30727 raft_consensus.cc:2468] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 3.
I20260709 12:28:52.192588 30618 leader_election.cc:304] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:52.193400 31000 raft_consensus.cc:2804] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:52.193908 31000 raft_consensus.cc:697] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:52.194795 31000 consensus_queue.cc:237] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.201201 30476 catalog_manager.cc:5697] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 2 to 3, leader changed from 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3) to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 3 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:52.208706 31002 raft_consensus.cc:993] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: : Instructing follower 0fe15a5aaeea486ea4e2ca759e86cdd4 to start an election
I20260709 12:28:52.209267 31002 raft_consensus.cc:1081] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Signalling peer 0fe15a5aaeea486ea4e2ca759e86cdd4 to start an election
I20260709 12:28:52.211200 30653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
 from {username='slave'} at 127.0.0.1:32940
I20260709 12:28:52.211817 30653 raft_consensus.cc:493] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:52.212177 30653 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:52.218652 30653 raft_consensus.cc:515] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.220499 30653 leader_election.cc:290] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 4 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:52.221306 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:52.221524 30727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713f53247cb649fda5d7f1f4ecacd1ce" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:52.221967 30954 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:52.222174 30727 raft_consensus.cc:3055] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:52.222641 30727 raft_consensus.cc:740] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:52.223380 30727 consensus_queue.cc:260] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.224393 30727 raft_consensus.cc:3060] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:52.228001 30954 raft_consensus.cc:2468] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 4.
I20260709 12:28:52.229249 30618 leader_election.cc:304] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:52.230084 31000 raft_consensus.cc:2804] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:52.230156 30727 raft_consensus.cc:2468] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 4.
I20260709 12:28:52.230611 31000 raft_consensus.cc:697] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:52.231562 31000 consensus_queue.cc:237] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.237830 30476 catalog_manager.cc:5697] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 3 to 4, leader changed from 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3) to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 4 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:52.709290 30727 raft_consensus.cc:1275] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:52.711094 31000 consensus_queue.cc:1048] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:52.722642 30954 raft_consensus.cc:1275] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:52.725131 31026 consensus_queue.cc:1048] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:52.746831 30727 raft_consensus.cc:1275] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:52.748543 31000 consensus_queue.cc:1048] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:52.758554 30954 raft_consensus.cc:1275] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:52.760008 31026 consensus_queue.cc:1048] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:52.800081 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:52.807799 30653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
mode: GRACEFUL
new_leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:28:52.808421 30653 raft_consensus.cc:606] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Received request to transfer leadership to TS 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:52.811169 30653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455b2ef795c34a328ac50361e285d8eb"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
mode: GRACEFUL
new_leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:28:52.811698 30653 raft_consensus.cc:606] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Received request to transfer leadership to TS 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:52.812985 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:52.813555 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:52.814196 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:52.882848 30990 raft_consensus.cc:993] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4: : Instructing follower 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:52.883469 31026 raft_consensus.cc:1081] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Signalling peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:52.885002 30727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455b2ef795c34a328ac50361e285d8eb"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:28:52.885499 30727 raft_consensus.cc:493] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:52.885823 30727 raft_consensus.cc:3060] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:52.891141 30727 raft_consensus.cc:515] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.892836 30727 leader_election.cc:290] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:52.893967 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b2ef795c34a328ac50361e285d8eb" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:52.894002 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b2ef795c34a328ac50361e285d8eb" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:52.894726 30653 raft_consensus.cc:3055] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:52.894805 30954 raft_consensus.cc:3060] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:52.895061 30653 raft_consensus.cc:740] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:52.895931 30653 consensus_queue.cc:260] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.896966 30653 raft_consensus.cc:3060] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:52.901520 30954 raft_consensus.cc:2468] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:52.902760 30653 raft_consensus.cc:2468] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 2.
I20260709 12:28:52.902920 30692 leader_election.cc:304] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:52.903854 30993 raft_consensus.cc:2804] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:52.904384 30993 raft_consensus.cc:697] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:52.905162 30993 consensus_queue.cc:237] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:52.912806 30476 catalog_manager.cc:5697] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 1 to 2, leader changed from 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:53.025295 30990 raft_consensus.cc:993] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4: : Instructing follower 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:53.025779 31026 raft_consensus.cc:1081] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Signalling peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:53.027269 30727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:28:53.027761 30727 raft_consensus.cc:493] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:53.028057 30727 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.032892 30727 raft_consensus.cc:515] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:53.034674 30727 leader_election.cc:290] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:53.035530 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:53.035676 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2432481993b44c54a14c6cbba5506a43" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:53.036232 30954 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.036329 30653 raft_consensus.cc:3055] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:53.036852 30653 raft_consensus.cc:740] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:53.037716 30653 consensus_queue.cc:260] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:53.038798 30653 raft_consensus.cc:3060] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.043125 30954 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 3.
I20260709 12:28:53.043982 30953 raft_consensus.cc:1240] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Rejecting Update request from peer 0fe15a5aaeea486ea4e2ca759e86cdd4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:53.044574 30692 leader_election.cc:304] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:53.045558 30993 raft_consensus.cc:2804] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:53.045912 30653 raft_consensus.cc:2468] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 3.
I20260709 12:28:53.046078 30993 raft_consensus.cc:697] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:53.047103 30993 consensus_queue.cc:237] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:53.055382 30476 catalog_manager.cc:5697] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 2 to 3, leader changed from 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 3 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:53.056326 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:53.393028 30953 raft_consensus.cc:1275] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:53.394555 30993 consensus_queue.cc:1048] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:53.406025 30653 raft_consensus.cc:1275] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:53.407635 31041 consensus_queue.cc:1048] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:53.555305 30953 raft_consensus.cc:1275] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:53.556938 31041 consensus_queue.cc:1048] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:53.568746 30653 raft_consensus.cc:1275] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:53.570079 30993 consensus_queue.cc:1048] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:53.820822 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:53.828866 30728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf7de510136448db926233e69db15b5"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
mode: GRACEFUL
new_leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
 from {username='slave'} at 127.0.0.1:60864
I20260709 12:28:53.829490 30728 raft_consensus.cc:606] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Received request to transfer leadership to TS 0fe15a5aaeea486ea4e2ca759e86cdd4
I20260709 12:28:53.832314 30728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
mode: GRACEFUL
new_leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
 from {username='slave'} at 127.0.0.1:60864
I20260709 12:28:53.832788 30728 raft_consensus.cc:606] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Received request to transfer leadership to TS 0fe15a5aaeea486ea4e2ca759e86cdd4
I20260709 12:28:53.833811 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:53.834416 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:53.835101 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:53.845647 31002 raft_consensus.cc:993] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: : Instructing follower 0fe15a5aaeea486ea4e2ca759e86cdd4 to start an election
I20260709 12:28:53.846208 30993 raft_consensus.cc:1081] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Signalling peer 0fe15a5aaeea486ea4e2ca759e86cdd4 to start an election
I20260709 12:28:53.847833 30653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
 from {username='slave'} at 127.0.0.1:32940
I20260709 12:28:53.848367 30653 raft_consensus.cc:493] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:53.848647 30653 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.855206 30653 raft_consensus.cc:515] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:53.857746 30653 leader_election.cc:290] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 3 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:53.857918 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:53.858804 30953 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.859022 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e17b3a57e24feeb8e6cd5fa1da1fcd" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:53.859695 30728 raft_consensus.cc:3055] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:53.859985 30728 raft_consensus.cc:740] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:53.860729 30728 consensus_queue.cc:260] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:53.861811 30728 raft_consensus.cc:3060] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.865694 30953 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 3.
I20260709 12:28:53.866801 30728 raft_consensus.cc:2468] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 3.
I20260709 12:28:53.867070 30618 leader_election.cc:304] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:53.867914 31026 raft_consensus.cc:2804] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:53.868852 31026 raft_consensus.cc:697] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:53.869711 31026 consensus_queue.cc:237] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:53.876576 30476 catalog_manager.cc:5697] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 2 to 3, leader changed from 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3) to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 3 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:54.063398 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:54.201175 31002 raft_consensus.cc:993] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: : Instructing follower 0fe15a5aaeea486ea4e2ca759e86cdd4 to start an election
I20260709 12:28:54.201946 30993 raft_consensus.cc:1081] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Signalling peer 0fe15a5aaeea486ea4e2ca759e86cdd4 to start an election
I20260709 12:28:54.204290 30653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf7de510136448db926233e69db15b5"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
 from {username='slave'} at 127.0.0.1:32940
I20260709 12:28:54.205015 30653 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:54.205381 30653 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:54.216885 30653 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:54.219410 30653 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 4 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3:36937)
I20260709 12:28:54.220778 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:54.221396 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
I20260709 12:28:54.221796 30953 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:54.222083 30728 raft_consensus.cc:3055] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:54.222440 30728 raft_consensus.cc:740] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:54.223742 30728 consensus_queue.cc:260] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:54.225575 30728 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:54.233413 30953 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 4.
I20260709 12:28:54.235208 30618 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe15a5aaeea486ea4e2ca759e86cdd4, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:54.235777 30728 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe15a5aaeea486ea4e2ca759e86cdd4 in term 4.
I20260709 12:28:54.236181 31026 raft_consensus.cc:2804] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:54.236791 31026 raft_consensus.cc:697] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 LEADER]: Becoming Leader. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:54.238137 31026 consensus_queue.cc:237] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:54.247720 30476 catalog_manager.cc:5697] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 reported cstate change: term changed from 3 to 4, leader changed from 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3) to 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2). New cstate: current_term: 4 leader_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.355181 30728 raft_consensus.cc:1275] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:54.356547 31026 consensus_queue.cc:1048] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:54.371378 30953 raft_consensus.cc:1275] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:54.373992 31026 consensus_queue.cc:1048] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:54.696121 30728 raft_consensus.cc:1275] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:54.697309 31026 consensus_queue.cc:1048] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:54.707350 30954 raft_consensus.cc:1275] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Refusing update from remote peer 0fe15a5aaeea486ea4e2ca759e86cdd4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:54.708911 31056 consensus_queue.cc:1048] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:54.842064 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:54.850883 30653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
mode: GRACEFUL
new_leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:28:54.851431 30653 raft_consensus.cc:606] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 LEADER]: Received request to transfer leadership to TS 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:54.854161 30653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf7de510136448db926233e69db15b5"
dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
mode: GRACEFUL
new_leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:28:54.854630 30653 raft_consensus.cc:606] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 LEADER]: Received request to transfer leadership to TS 9dcf62aa129b4a06bfcc9b04cc3dd9c0
I20260709 12:28:54.855592 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:54.856055 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:54.856734 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:54.981617 31026 raft_consensus.cc:993] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4: : Instructing follower 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:54.982204 31056 raft_consensus.cc:1081] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 LEADER]: Signalling peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:54.983877 30728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:28:54.984447 30728 raft_consensus.cc:493] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:54.984790 30728 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:54.993348 30728 raft_consensus.cc:515] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:54.995198 30728 leader_election.cc:290] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 4 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:54.996414 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:54.996321 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08bc0618e6504dad909e79e62fe858b0" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:54.997258 30653 raft_consensus.cc:3055] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:54.997383 30954 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:54.997570 30653 raft_consensus.cc:740] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:54.998853 30653 consensus_queue.cc:260] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:55.000366 30653 raft_consensus.cc:3060] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:55.006945 30954 raft_consensus.cc:2468] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 4.
I20260709 12:28:55.008415 30653 raft_consensus.cc:2468] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 4.
I20260709 12:28:55.008430 30692 leader_election.cc:304] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:55.009573 30993 raft_consensus.cc:2804] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:55.010492 30993 raft_consensus.cc:697] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:55.011682 30993 consensus_queue.cc:237] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:55.019490 30476 catalog_manager.cc:5697] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 3 to 4, leader changed from 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 4 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:55.065312 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:55.119508 31026 raft_consensus.cc:993] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4: : Instructing follower 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:55.120119 31056 raft_consensus.cc:1081] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 LEADER]: Signalling peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0 to start an election
I20260709 12:28:55.122104 30728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf7de510136448db926233e69db15b5"
dest_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:28:55.122761 30728 raft_consensus.cc:493] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:55.123186 30728 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:55.129104 30728 raft_consensus.cc:515] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:55.130862 30728 leader_election.cc:290] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 5 election: Requested vote from peers e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889), 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803)
I20260709 12:28:55.131955 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e04d66830b094daead9eabf66686bd40"
I20260709 12:28:55.131985 30653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf7de510136448db926233e69db15b5" candidate_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4"
I20260709 12:28:55.132763 30653 raft_consensus.cc:3055] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:55.132758 30954 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:55.133067 30653 raft_consensus.cc:740] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0fe15a5aaeea486ea4e2ca759e86cdd4, State: Running, Role: LEADER
I20260709 12:28:55.134039 30653 consensus_queue.cc:260] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:55.135115 30653 raft_consensus.cc:3060] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:55.139671 30954 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 5.
I20260709 12:28:55.141204 30692 leader_election.cc:304] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, e04d66830b094daead9eabf66686bd40; no voters: 
I20260709 12:28:55.141299 30653 raft_consensus.cc:2468] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dcf62aa129b4a06bfcc9b04cc3dd9c0 in term 5.
I20260709 12:28:55.142197 30993 raft_consensus.cc:2804] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:55.142834 30993 raft_consensus.cc:697] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 5 LEADER]: Becoming Leader. State: Replica: 9dcf62aa129b4a06bfcc9b04cc3dd9c0, State: Running, Role: LEADER
I20260709 12:28:55.143682 30993 consensus_queue.cc:237] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } }
I20260709 12:28:55.150655 30476 catalog_manager.cc:5697] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 reported cstate change: term changed from 4 to 5, leader changed from 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2) to 9dcf62aa129b4a06bfcc9b04cc3dd9c0 (127.17.40.3). New cstate: current_term: 5 leader_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dcf62aa129b4a06bfcc9b04cc3dd9c0" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:55.554806 30653 raft_consensus.cc:1275] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 5 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:55.556090 30993 consensus_queue.cc:1048] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:55.565773 30954 raft_consensus.cc:1275] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 5 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:55.567782 30993 consensus_queue.cc:1048] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:55.575325 30653 raft_consensus.cc:1275] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:55.576689 31063 consensus_queue.cc:1048] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe15a5aaeea486ea4e2ca759e86cdd4" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:55.587353 30954 raft_consensus.cc:1275] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Refusing update from remote peer 9dcf62aa129b4a06bfcc9b04cc3dd9c0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:55.593578 30993 consensus_queue.cc:1048] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04d66830b094daead9eabf66686bd40" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:55.864267 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:55.896664 17568 tablet_server.cc:179] TabletServer@127.17.40.1:33889 shutting down...
W20260709 12:28:55.915390 30692 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:28:55.921962 30692 consensus_peers.cc:597] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.934719 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:55.935672 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.936595 17568 raft_consensus.cc:2243] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.937177 17568 raft_consensus.cc:2272] T 08bc0618e6504dad909e79e62fe858b0 P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.940894 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.941684 17568 raft_consensus.cc:2243] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.942241 17568 raft_consensus.cc:2272] T 1bf7de510136448db926233e69db15b5 P e04d66830b094daead9eabf66686bd40 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:55.944813 30692 consensus_peers.cc:597] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:55.946211 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.947069 17568 raft_consensus.cc:2243] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.947573 17568 raft_consensus.cc:2272] T 784b5acba0fb49f48b6bf072d093a5af P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.950490 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.951148 17568 raft_consensus.cc:2243] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.951711 17568 raft_consensus.cc:2272] T 455b2ef795c34a328ac50361e285d8eb P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.954303 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.954969 17568 raft_consensus.cc:2243] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.955471 17568 raft_consensus.cc:2272] T e4649276c3bf47df8defe360c8270aaf P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.957998 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.958792 17568 raft_consensus.cc:2243] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.959400 17568 raft_consensus.cc:2272] T ef7d44785cd74161b56c3107d580a7f6 P e04d66830b094daead9eabf66686bd40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.962260 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.962877 17568 raft_consensus.cc:2243] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.963369 17568 raft_consensus.cc:2272] T 63b89c17ab1440e1ab5c13ccd5d81bca P e04d66830b094daead9eabf66686bd40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.965962 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.966647 17568 raft_consensus.cc:2243] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.967111 17568 raft_consensus.cc:2272] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.969496 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.970072 17568 raft_consensus.cc:2243] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.970688 17568 raft_consensus.cc:2272] T 713f53247cb649fda5d7f1f4ecacd1ce P e04d66830b094daead9eabf66686bd40 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:55.973093 17568 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:55.973630 17568 raft_consensus.cc:2243] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:55.974169 17568 raft_consensus.cc:2272] T 2432481993b44c54a14c6cbba5506a43 P e04d66830b094daead9eabf66686bd40 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:55.984360 30692 consensus_peers.cc:597] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.996922 30618 connection.cc:573] client connection to 127.17.40.1:33889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:28:55.997576 30618 consensus_peers.cc:597] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:56.005528 30618 consensus_peers.cc:597] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:56.013962 17568 tablet_server.cc:196] TabletServer@127.17.40.1:33889 shutdown complete.
I20260709 12:28:56.047963 17568 tablet_server.cc:179] TabletServer@127.17.40.2:0 shutting down...
W20260709 12:28:56.048897 30618 consensus_peers.cc:597] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:56.063879 30618 consensus_peers.cc:597] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:56.066368 30525 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:56.079818 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:56.081002 17568 tablet_replica.cc:333] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.081903 17568 raft_consensus.cc:2243] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.083016 17568 raft_consensus.cc:2272] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.085765 17568 tablet_replica.cc:333] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.086736 17568 raft_consensus.cc:2243] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.087430 17568 raft_consensus.cc:2272] T 2432481993b44c54a14c6cbba5506a43 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.090054 17568 tablet_replica.cc:333] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.090863 17568 raft_consensus.cc:2243] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.091877 17568 raft_consensus.cc:2272] T 713f53247cb649fda5d7f1f4ecacd1ce P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.094708 17568 tablet_replica.cc:333] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.095494 17568 raft_consensus.cc:2243] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.096014 17568 raft_consensus.cc:2272] T 1bf7de510136448db926233e69db15b5 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.102025 17568 tablet_replica.cc:333] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.103021 17568 raft_consensus.cc:2243] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.104310 17568 raft_consensus.cc:2272] T 784b5acba0fb49f48b6bf072d093a5af P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:56.106103 30692 consensus_peers.cc:597] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:56.107955 17568 tablet_replica.cc:333] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.108724 17568 raft_consensus.cc:2243] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.109202 17568 raft_consensus.cc:2272] T 08bc0618e6504dad909e79e62fe858b0 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.112241 17568 tablet_replica.cc:333] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.112890 17568 raft_consensus.cc:2243] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.113471 17568 raft_consensus.cc:2272] T 455b2ef795c34a328ac50361e285d8eb P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.116216 17568 tablet_replica.cc:333] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.116865 17568 raft_consensus.cc:2243] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.117398 17568 raft_consensus.cc:2272] T e4649276c3bf47df8defe360c8270aaf P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.120047 17568 tablet_replica.cc:333] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.120657 17568 raft_consensus.cc:2243] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.121225 17568 raft_consensus.cc:2272] T ef7d44785cd74161b56c3107d580a7f6 P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.124087 17568 tablet_replica.cc:333] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4: stopping tablet replica
I20260709 12:28:56.124699 17568 raft_consensus.cc:2243] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.125831 17568 raft_consensus.cc:2272] T 63b89c17ab1440e1ab5c13ccd5d81bca P 0fe15a5aaeea486ea4e2ca759e86cdd4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:56.133320 30693 consensus_peers.cc:597] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803): Couldn't send request to peer 0fe15a5aaeea486ea4e2ca759e86cdd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:56.145766 30693 consensus_peers.cc:597] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer 0fe15a5aaeea486ea4e2ca759e86cdd4 (127.17.40.2:37803): Couldn't send request to peer 0fe15a5aaeea486ea4e2ca759e86cdd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:56.163689 17568 tablet_server.cc:196] TabletServer@127.17.40.2:0 shutdown complete.
I20260709 12:28:56.191121 17568 tablet_server.cc:179] TabletServer@127.17.40.3:0 shutting down...
I20260709 12:28:56.223500 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:56.224325 17568 tablet_replica.cc:333] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.225100 17568 raft_consensus.cc:2243] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.225639 17568 raft_consensus.cc:2272] T d4e17b3a57e24feeb8e6cd5fa1da1fcd P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.228246 17568 tablet_replica.cc:333] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.228925 17568 raft_consensus.cc:2243] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.229465 17568 raft_consensus.cc:2272] T 713f53247cb649fda5d7f1f4ecacd1ce P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.231943 17568 tablet_replica.cc:333] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.232626 17568 raft_consensus.cc:2243] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.233625 17568 raft_consensus.cc:2272] T 2432481993b44c54a14c6cbba5506a43 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.236351 17568 tablet_replica.cc:333] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.237033 17568 raft_consensus.cc:2243] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.237536 17568 raft_consensus.cc:2272] T 784b5acba0fb49f48b6bf072d093a5af P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.240110 17568 tablet_replica.cc:333] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.240789 17568 raft_consensus.cc:2243] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.241649 17568 raft_consensus.cc:2272] T 1bf7de510136448db926233e69db15b5 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.245035 17568 tablet_replica.cc:333] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.245738 17568 raft_consensus.cc:2243] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.246747 17568 raft_consensus.cc:2272] T 08bc0618e6504dad909e79e62fe858b0 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.250483 17568 tablet_replica.cc:333] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.251225 17568 raft_consensus.cc:2243] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.252496 17568 raft_consensus.cc:2272] T 455b2ef795c34a328ac50361e285d8eb P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:56.253208 30692 consensus_peers.cc:597] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 -> Peer e04d66830b094daead9eabf66686bd40 (127.17.40.1:33889): Couldn't send request to peer e04d66830b094daead9eabf66686bd40. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:33889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:56.255514 17568 tablet_replica.cc:333] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.256299 17568 raft_consensus.cc:2243] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.257344 17568 raft_consensus.cc:2272] T e4649276c3bf47df8defe360c8270aaf P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.259797 17568 tablet_replica.cc:333] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.260365 17568 raft_consensus.cc:2243] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.261292 17568 raft_consensus.cc:2272] T ef7d44785cd74161b56c3107d580a7f6 P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.263666 17568 tablet_replica.cc:333] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0: stopping tablet replica
I20260709 12:28:56.264217 17568 raft_consensus.cc:2243] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:56.264768 17568 raft_consensus.cc:2272] T 63b89c17ab1440e1ab5c13ccd5d81bca P 9dcf62aa129b4a06bfcc9b04cc3dd9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.306749 17568 tablet_server.cc:196] TabletServer@127.17.40.3:0 shutdown complete.
I20260709 12:28:56.336210 17568 master.cc:562] Master@127.17.40.62:38395 shutting down...
I20260709 12:28:56.369335 17568 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:56.369967 17568 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:56.370326 17568 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2e77cb3b80ae4684a2c0b6e651e20ca2: stopping tablet replica
I20260709 12:28:56.392611 17568 master.cc:584] Master@127.17.40.62:38395 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14589 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:28:56.438711 17568 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.40.62:34851
I20260709 12:28:56.439982 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:56.446318 31082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:56.446697 31085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:56.446354 31083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:56.449033 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:56.450062 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:56.450312 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:56.450541 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600136450522 us; error 0 us; skew 500 ppm
I20260709 12:28:56.451120 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:56.453668 17568 webserver.cc:533] Webserver started at http://127.17.40.62:44465/ using document root <none> and password file <none>
I20260709 12:28:56.454269 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:56.454516 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:56.454838 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:56.456090 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/master-0-root/instance:
uuid: "344f5d624815498182b93967dc4c227d"
format_stamp: "Formatted at 2026-07-09 12:28:56 on dist-test-slave-tjfs"
I20260709 12:28:56.461083 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:28:56.465075 31090 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.466180 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:28:56.466553 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/master-0-root
uuid: "344f5d624815498182b93967dc4c227d"
format_stamp: "Formatted at 2026-07-09 12:28:56 on dist-test-slave-tjfs"
I20260709 12:28:56.466854 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:56.480553 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:56.481913 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:56.523675 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.62:34851
I20260709 12:28:56.523820 31141 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.62:34851 every 8 connection(s)
I20260709 12:28:56.528127 31142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.541889 31142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d: Bootstrap starting.
I20260709 12:28:56.547372 31142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.552306 31142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d: No bootstrap required, opened a new log
I20260709 12:28:56.554924 31142 raft_consensus.cc:359] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344f5d624815498182b93967dc4c227d" member_type: VOTER }
I20260709 12:28:56.555372 31142 raft_consensus.cc:385] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.555569 31142 raft_consensus.cc:740] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344f5d624815498182b93967dc4c227d, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.556247 31142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344f5d624815498182b93967dc4c227d" member_type: VOTER }
I20260709 12:28:56.556752 31142 raft_consensus.cc:399] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:56.556973 31142 raft_consensus.cc:493] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:56.557246 31142 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.563033 31142 raft_consensus.cc:515] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344f5d624815498182b93967dc4c227d" member_type: VOTER }
I20260709 12:28:56.563612 31142 leader_election.cc:304] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 344f5d624815498182b93967dc4c227d; no voters: 
I20260709 12:28:56.564818 31142 leader_election.cc:290] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:56.565240 31145 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:56.566726 31145 raft_consensus.cc:697] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 1 LEADER]: Becoming Leader. State: Replica: 344f5d624815498182b93967dc4c227d, State: Running, Role: LEADER
I20260709 12:28:56.567489 31145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344f5d624815498182b93967dc4c227d" member_type: VOTER }
I20260709 12:28:56.568559 31142 sys_catalog.cc:565] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:56.570986 31147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 344f5d624815498182b93967dc4c227d. Latest consensus state: current_term: 1 leader_uuid: "344f5d624815498182b93967dc4c227d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344f5d624815498182b93967dc4c227d" member_type: VOTER } }
I20260709 12:28:56.571033 31146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "344f5d624815498182b93967dc4c227d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344f5d624815498182b93967dc4c227d" member_type: VOTER } }
I20260709 12:28:56.571753 31147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:56.571873 31146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:56.576191 31150 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:56.582201 31150 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:56.585698 17568 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:56.591490 31150 catalog_manager.cc:1383] Generated new cluster ID: 29e40086e4c6440497fe79a768f93045
I20260709 12:28:56.591820 31150 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:56.614552 31150 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:56.616035 31150 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:56.631381 31150 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d: Generated new TSK 0
I20260709 12:28:56.632095 31150 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:56.653023 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:56.659746 31163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:56.661255 31164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:56.662827 31166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:56.662875 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:56.664304 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:56.664593 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:56.664791 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600136664772 us; error 0 us; skew 500 ppm
I20260709 12:28:56.665448 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:56.668354 17568 webserver.cc:533] Webserver started at http://127.17.40.1:45185/ using document root <none> and password file <none>
I20260709 12:28:56.669060 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:56.669274 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:56.669579 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:56.671005 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-0-root/instance:
uuid: "d007ae0880c945ecbd6c356d0e76a651"
format_stamp: "Formatted at 2026-07-09 12:28:56 on dist-test-slave-tjfs"
I20260709 12:28:56.676295 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:56.680625 31171 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.681531 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:28:56.681906 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "d007ae0880c945ecbd6c356d0e76a651"
format_stamp: "Formatted at 2026-07-09 12:28:56 on dist-test-slave-tjfs"
I20260709 12:28:56.682248 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:56.699728 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:56.700968 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:56.702663 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:56.705263 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:56.705549 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.705854 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:56.706055 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.754150 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:39183
I20260709 12:28:56.754277 31233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:39183 every 8 connection(s)
I20260709 12:28:56.760133 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:56.769409 31238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:56.769871 31239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:56.774744 17568 server_base.cc:1061] running on GCE node
W20260709 12:28:56.774628 31241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:56.776480 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:56.776548 31234 heartbeater.cc:344] Connected to a master server at 127.17.40.62:34851
W20260709 12:28:56.776758 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:56.777089 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600136777073 us; error 0 us; skew 500 ppm
I20260709 12:28:56.777146 31234 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:56.777768 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:56.778106 31234 heartbeater.cc:507] Master 127.17.40.62:34851 requested a full tablet report, sending...
I20260709 12:28:56.780539 17568 webserver.cc:533] Webserver started at http://127.17.40.2:40043/ using document root <none> and password file <none>
I20260709 12:28:56.780969 31107 ts_manager.cc:194] Registered new tserver with Master: d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183)
I20260709 12:28:56.781334 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:56.781642 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:56.781972 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:56.783713 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-1-root/instance:
uuid: "cc81689ff422498292ab8adb7876289c"
format_stamp: "Formatted at 2026-07-09 12:28:56 on dist-test-slave-tjfs"
I20260709 12:28:56.783782 31107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51794
I20260709 12:28:56.789439 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:28:56.793365 31246 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.794356 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:28:56.794751 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-1-root
uuid: "cc81689ff422498292ab8adb7876289c"
format_stamp: "Formatted at 2026-07-09 12:28:56 on dist-test-slave-tjfs"
I20260709 12:28:56.795013 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:56.815752 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:56.817013 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:56.818570 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:56.820950 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:56.821152 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.821470 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:56.821614 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.864863 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.2:40441
I20260709 12:28:56.864974 31308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.2:40441 every 8 connection(s)
I20260709 12:28:56.870055 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:56.878978 31312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:56.880751 31313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:56.882154 31315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:56.882752 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:56.884233 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:56.884334 31309 heartbeater.cc:344] Connected to a master server at 127.17.40.62:34851
W20260709 12:28:56.884596 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:56.884872 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600136884857 us; error 0 us; skew 500 ppm
I20260709 12:28:56.884907 31309 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:56.885599 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:56.885936 31309 heartbeater.cc:507] Master 127.17.40.62:34851 requested a full tablet report, sending...
I20260709 12:28:56.888603 31107 ts_manager.cc:194] Registered new tserver with Master: cc81689ff422498292ab8adb7876289c (127.17.40.2:40441)
I20260709 12:28:56.888734 17568 webserver.cc:533] Webserver started at http://127.17.40.3:42519/ using document root <none> and password file <none>
I20260709 12:28:56.889561 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:56.889851 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:56.890197 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:56.890686 31107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51808
I20260709 12:28:56.891866 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-2-root/instance:
uuid: "4d6b297da72b4d37a0a816b92767e690"
format_stamp: "Formatted at 2026-07-09 12:28:56 on dist-test-slave-tjfs"
I20260709 12:28:56.897140 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:28:56.900810 31320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.901676 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:28:56.902005 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-2-root
uuid: "4d6b297da72b4d37a0a816b92767e690"
format_stamp: "Formatted at 2026-07-09 12:28:56 on dist-test-slave-tjfs"
I20260709 12:28:56.902329 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599688508335-17568-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:56.920420 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:56.921715 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:56.923337 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:56.925712 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:56.925982 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:56.926259 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:56.926460 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:28:56.971066 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.3:42871
I20260709 12:28:56.971212 31382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.3:42871 every 8 connection(s)
I20260709 12:28:56.986545 31383 heartbeater.cc:344] Connected to a master server at 127.17.40.62:34851
I20260709 12:28:56.987133 31383 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:56.988018 31383 heartbeater.cc:507] Master 127.17.40.62:34851 requested a full tablet report, sending...
I20260709 12:28:56.990253 31107 ts_manager.cc:194] Registered new tserver with Master: 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871)
I20260709 12:28:56.990870 17568 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01637535s
I20260709 12:28:56.991957 31107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51818
I20260709 12:28:57.019896 31107 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51822:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:57.022140 31107 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:57.073482 31274 tablet_service.cc:1511] Processing CreateTablet for tablet c1443d2fc085446bb378439f892903cf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2797f3e1188045e5a584a91d3e57f6b8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:57.075177 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1443d2fc085446bb378439f892903cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.078666 31273 tablet_service.cc:1511] Processing CreateTablet for tablet 97591bed853f48aabac3b455d27e9fe6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2797f3e1188045e5a584a91d3e57f6b8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:57.080296 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97591bed853f48aabac3b455d27e9fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.087905 31198 tablet_service.cc:1511] Processing CreateTablet for tablet 97591bed853f48aabac3b455d27e9fe6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2797f3e1188045e5a584a91d3e57f6b8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:57.087910 31199 tablet_service.cc:1511] Processing CreateTablet for tablet c1443d2fc085446bb378439f892903cf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2797f3e1188045e5a584a91d3e57f6b8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:57.089323 31198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97591bed853f48aabac3b455d27e9fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.089986 31199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1443d2fc085446bb378439f892903cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.099845 31348 tablet_service.cc:1511] Processing CreateTablet for tablet c1443d2fc085446bb378439f892903cf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2797f3e1188045e5a584a91d3e57f6b8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:57.101678 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1443d2fc085446bb378439f892903cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.107969 31398 tablet_bootstrap.cc:492] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c: Bootstrap starting.
I20260709 12:28:57.112421 31347 tablet_service.cc:1511] Processing CreateTablet for tablet 97591bed853f48aabac3b455d27e9fe6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2797f3e1188045e5a584a91d3e57f6b8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:57.113996 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97591bed853f48aabac3b455d27e9fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.118153 31398 tablet_bootstrap.cc:654] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.119388 31399 tablet_bootstrap.cc:492] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651: Bootstrap starting.
I20260709 12:28:57.128262 31399 tablet_bootstrap.cc:654] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.132341 31398 tablet_bootstrap.cc:492] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c: No bootstrap required, opened a new log
I20260709 12:28:57.132993 31398 ts_tablet_manager.cc:1403] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.012s
I20260709 12:28:57.137192 31402 tablet_bootstrap.cc:492] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690: Bootstrap starting.
I20260709 12:28:57.137437 31398 raft_consensus.cc:359] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.138495 31398 raft_consensus.cc:385] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.138841 31398 raft_consensus.cc:740] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc81689ff422498292ab8adb7876289c, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.139647 31398 consensus_queue.cc:260] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.141566 31399 tablet_bootstrap.cc:492] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651: No bootstrap required, opened a new log
I20260709 12:28:57.142213 31399 ts_tablet_manager.cc:1403] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.003s
I20260709 12:28:57.142244 31309 heartbeater.cc:499] Master 127.17.40.62:34851 was elected leader, sending a full tablet report...
I20260709 12:28:57.142673 31398 ts_tablet_manager.cc:1434] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:28:57.143839 31398 tablet_bootstrap.cc:492] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c: Bootstrap starting.
I20260709 12:28:57.145339 31402 tablet_bootstrap.cc:654] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.145661 31399 raft_consensus.cc:359] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.146497 31399 raft_consensus.cc:385] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.146811 31399 raft_consensus.cc:740] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d007ae0880c945ecbd6c356d0e76a651, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.147871 31399 consensus_queue.cc:260] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.152073 31398 tablet_bootstrap.cc:654] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.159953 31399 ts_tablet_manager.cc:1434] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651: Time spent starting tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:28:57.160133 31234 heartbeater.cc:499] Master 127.17.40.62:34851 was elected leader, sending a full tablet report...
I20260709 12:28:57.164721 31398 tablet_bootstrap.cc:492] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c: No bootstrap required, opened a new log
I20260709 12:28:57.165552 31398 ts_tablet_manager.cc:1403] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.001s
I20260709 12:28:57.166807 31399 tablet_bootstrap.cc:492] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651: Bootstrap starting.
I20260709 12:28:57.168268 31402 tablet_bootstrap.cc:492] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690: No bootstrap required, opened a new log
I20260709 12:28:57.169052 31402 ts_tablet_manager.cc:1403] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.009s
I20260709 12:28:57.169308 31398 raft_consensus.cc:359] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.170238 31398 raft_consensus.cc:385] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.170698 31398 raft_consensus.cc:740] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc81689ff422498292ab8adb7876289c, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.171691 31398 consensus_queue.cc:260] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.174599 31399 tablet_bootstrap.cc:654] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.176239 31402 raft_consensus.cc:359] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.176795 31398 ts_tablet_manager.cc:1434] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:57.177181 31402 raft_consensus.cc:385] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.177603 31402 raft_consensus.cc:740] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.178046 31405 raft_consensus.cc:493] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.178654 31405 raft_consensus.cc:515] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.178681 31402 consensus_queue.cc:260] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.181734 31405 leader_election.cc:290] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc81689ff422498292ab8adb7876289c (127.17.40.2:40441), 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871)
I20260709 12:28:57.194868 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1443d2fc085446bb378439f892903cf" candidate_uuid: "d007ae0880c945ecbd6c356d0e76a651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c" is_pre_election: true
I20260709 12:28:57.196080 31284 raft_consensus.cc:2468] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d007ae0880c945ecbd6c356d0e76a651 in term 0.
I20260709 12:28:57.198117 31175 leader_election.cc:304] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc81689ff422498292ab8adb7876289c, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:57.190536 31399 tablet_bootstrap.cc:492] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651: No bootstrap required, opened a new log
I20260709 12:28:57.199146 31405 raft_consensus.cc:2804] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.199954 31405 raft_consensus.cc:493] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.200903 31383 heartbeater.cc:499] Master 127.17.40.62:34851 was elected leader, sending a full tablet report...
I20260709 12:28:57.201249 31405 raft_consensus.cc:3060] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.201745 31402 ts_tablet_manager.cc:1434] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690: Time spent starting tablet: real 0.032s	user 0.017s	sys 0.007s
I20260709 12:28:57.203147 31402 tablet_bootstrap.cc:492] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690: Bootstrap starting.
I20260709 12:28:57.200976 31399 ts_tablet_manager.cc:1403] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.005s
I20260709 12:28:57.208045 31399 raft_consensus.cc:359] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.208860 31399 raft_consensus.cc:385] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.209173 31399 raft_consensus.cc:740] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d007ae0880c945ecbd6c356d0e76a651, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.210604 31402 tablet_bootstrap.cc:654] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.210963 31405 raft_consensus.cc:515] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.211920 31399 consensus_queue.cc:260] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.214493 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1443d2fc085446bb378439f892903cf" candidate_uuid: "d007ae0880c945ecbd6c356d0e76a651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c"
I20260709 12:28:57.215391 31284 raft_consensus.cc:3060] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.221390 31358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1443d2fc085446bb378439f892903cf" candidate_uuid: "d007ae0880c945ecbd6c356d0e76a651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6b297da72b4d37a0a816b92767e690" is_pre_election: true
W20260709 12:28:57.224339 31172 leader_election.cc:343] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.227038 31405 leader_election.cc:290] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 1 election: Requested vote from peers cc81689ff422498292ab8adb7876289c (127.17.40.2:40441), 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871)
I20260709 12:28:57.227960 31358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1443d2fc085446bb378439f892903cf" candidate_uuid: "d007ae0880c945ecbd6c356d0e76a651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6b297da72b4d37a0a816b92767e690"
W20260709 12:28:57.230214 31172 leader_election.cc:343] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.237537 31284 raft_consensus.cc:2468] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d007ae0880c945ecbd6c356d0e76a651 in term 1.
I20260709 12:28:57.239210 31175 leader_election.cc:304] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc81689ff422498292ab8adb7876289c, d007ae0880c945ecbd6c356d0e76a651; no voters: 4d6b297da72b4d37a0a816b92767e690
I20260709 12:28:57.239494 31399 ts_tablet_manager.cc:1434] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651: Time spent starting tablet: real 0.035s	user 0.020s	sys 0.012s
I20260709 12:28:57.239784 31402 tablet_bootstrap.cc:492] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690: No bootstrap required, opened a new log
I20260709 12:28:57.240391 31402 ts_tablet_manager.cc:1403] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.008s
I20260709 12:28:57.240635 31410 raft_consensus.cc:2804] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.241207 31410 raft_consensus.cc:697] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 1 LEADER]: Becoming Leader. State: Replica: d007ae0880c945ecbd6c356d0e76a651, State: Running, Role: LEADER
I20260709 12:28:57.242146 31410 consensus_queue.cc:237] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.243482 31402 raft_consensus.cc:359] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.244271 31402 raft_consensus.cc:385] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.244530 31402 raft_consensus.cc:740] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.245342 31402 consensus_queue.cc:260] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.247499 31402 ts_tablet_manager.cc:1434] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:28:57.253492 31403 raft_consensus.cc:493] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.252799 31105 catalog_manager.cc:5697] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "d007ae0880c945ecbd6c356d0e76a651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.254142 31403 raft_consensus.cc:515] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.257094 31403 leader_election.cc:290] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871)
I20260709 12:28:57.262327 31408 raft_consensus.cc:493] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.263026 31408 raft_consensus.cc:515] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.268146 31408 leader_election.cc:290] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), cc81689ff422498292ab8adb7876289c (127.17.40.2:40441)
I20260709 12:28:57.270198 31209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "cc81689ff422498292ab8adb7876289c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651" is_pre_election: true
I20260709 12:28:57.271324 31209 raft_consensus.cc:2468] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc81689ff422498292ab8adb7876289c in term 0.
I20260709 12:28:57.273584 31248 leader_election.cc:304] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc81689ff422498292ab8adb7876289c, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:57.274981 31403 raft_consensus.cc:2804] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.275496 31403 raft_consensus.cc:493] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.275959 31403 raft_consensus.cc:3060] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.283529 31209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651" is_pre_election: true
I20260709 12:28:57.284574 31209 raft_consensus.cc:2468] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 0.
I20260709 12:28:57.286356 31322 leader_election.cc:304] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:57.286775 31403 raft_consensus.cc:515] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.287335 31408 raft_consensus.cc:2804] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.287799 31408 raft_consensus.cc:493] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.288177 31408 raft_consensus.cc:3060] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.289336 31358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "cc81689ff422498292ab8adb7876289c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6b297da72b4d37a0a816b92767e690" is_pre_election: true
I20260709 12:28:57.290122 31209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "cc81689ff422498292ab8adb7876289c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
I20260709 12:28:57.290829 31209 raft_consensus.cc:3060] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.292649 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "cc81689ff422498292ab8adb7876289c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d6b297da72b4d37a0a816b92767e690"
I20260709 12:28:57.294173 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c" is_pre_election: true
I20260709 12:28:57.294951 31284 raft_consensus.cc:2393] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d6b297da72b4d37a0a816b92767e690 in current term 1: Already voted for candidate cc81689ff422498292ab8adb7876289c in this term.
I20260709 12:28:57.295728 31403 leader_election.cc:290] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [CANDIDATE]: Term 1 election: Requested vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871)
I20260709 12:28:57.298087 31408 raft_consensus.cc:515] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.299360 31358 raft_consensus.cc:2393] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc81689ff422498292ab8adb7876289c in current term 1: Already voted for candidate 4d6b297da72b4d37a0a816b92767e690 in this term.
I20260709 12:28:57.299409 31209 raft_consensus.cc:2468] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc81689ff422498292ab8adb7876289c in term 1.
I20260709 12:28:57.300836 31248 leader_election.cc:304] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc81689ff422498292ab8adb7876289c, d007ae0880c945ecbd6c356d0e76a651; no voters: 4d6b297da72b4d37a0a816b92767e690
I20260709 12:28:57.301594 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c"
I20260709 12:28:57.301539 31208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
I20260709 12:28:57.302210 31403 raft_consensus.cc:2804] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.302706 31208 raft_consensus.cc:2393] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d6b297da72b4d37a0a816b92767e690 in current term 1: Already voted for candidate cc81689ff422498292ab8adb7876289c in this term.
I20260709 12:28:57.302238 31408 leader_election.cc:290] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 election: Requested vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), cc81689ff422498292ab8adb7876289c (127.17.40.2:40441)
I20260709 12:28:57.303572 31403 raft_consensus.cc:697] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 LEADER]: Becoming Leader. State: Replica: cc81689ff422498292ab8adb7876289c, State: Running, Role: LEADER
I20260709 12:28:57.304680 31403 consensus_queue.cc:237] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.310736 31324 leader_election.cc:304] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690; no voters: cc81689ff422498292ab8adb7876289c, d007ae0880c945ecbd6c356d0e76a651
I20260709 12:28:57.311575 31408 raft_consensus.cc:2749] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:57.313081 31106 catalog_manager.cc:5697] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c reported cstate change: term changed from 0 to 1, leader changed from <none> to cc81689ff422498292ab8adb7876289c (127.17.40.2). New cstate: current_term: 1 leader_uuid: "cc81689ff422498292ab8adb7876289c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.351131 31106 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51830:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:57.353320 31106 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:57.377128 31198 tablet_service.cc:1511] Processing CreateTablet for tablet 7de72f20bc654cad8b2c4e4e40e2dffb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8295a2c35d9b4d6280538201b45140ff]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:57.378576 31198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de72f20bc654cad8b2c4e4e40e2dffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.378443 31274 tablet_service.cc:1511] Processing CreateTablet for tablet 7de72f20bc654cad8b2c4e4e40e2dffb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8295a2c35d9b4d6280538201b45140ff]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:57.379952 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de72f20bc654cad8b2c4e4e40e2dffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.381306 31347 tablet_service.cc:1511] Processing CreateTablet for tablet 7de72f20bc654cad8b2c4e4e40e2dffb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8295a2c35d9b4d6280538201b45140ff]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:57.382774 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de72f20bc654cad8b2c4e4e40e2dffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.382437 31199 tablet_service.cc:1511] Processing CreateTablet for tablet 41d7b83c9706415d8507fbe346b7dd33 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8295a2c35d9b4d6280538201b45140ff]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:57.383961 31199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d7b83c9706415d8507fbe346b7dd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.395207 31273 tablet_service.cc:1511] Processing CreateTablet for tablet 41d7b83c9706415d8507fbe346b7dd33 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8295a2c35d9b4d6280538201b45140ff]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:57.396688 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d7b83c9706415d8507fbe346b7dd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.398155 31399 tablet_bootstrap.cc:492] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651: Bootstrap starting.
I20260709 12:28:57.398074 31348 tablet_service.cc:1511] Processing CreateTablet for tablet 41d7b83c9706415d8507fbe346b7dd33 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8295a2c35d9b4d6280538201b45140ff]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:57.399560 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d7b83c9706415d8507fbe346b7dd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.404939 31402 tablet_bootstrap.cc:492] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690: Bootstrap starting.
I20260709 12:28:57.405423 31399 tablet_bootstrap.cc:654] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.413048 31402 tablet_bootstrap.cc:654] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.431613 31402 tablet_bootstrap.cc:492] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690: No bootstrap required, opened a new log
I20260709 12:28:57.432262 31402 ts_tablet_manager.cc:1403] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.007s
I20260709 12:28:57.433432 31398 tablet_bootstrap.cc:492] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c: Bootstrap starting.
I20260709 12:28:57.435732 31402 raft_consensus.cc:359] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.436661 31402 raft_consensus.cc:385] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.437027 31402 raft_consensus.cc:740] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.438045 31402 consensus_queue.cc:260] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.440006 31399 tablet_bootstrap.cc:492] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651: No bootstrap required, opened a new log
I20260709 12:28:57.440663 31399 ts_tablet_manager.cc:1403] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.030s
I20260709 12:28:57.441407 31398 tablet_bootstrap.cc:654] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.444572 31399 raft_consensus.cc:359] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.445516 31399 raft_consensus.cc:385] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.445896 31399 raft_consensus.cc:740] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d007ae0880c945ecbd6c356d0e76a651, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.446801 31399 consensus_queue.cc:260] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.448628 31402 ts_tablet_manager.cc:1434] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:28:57.449301 31399 ts_tablet_manager.cc:1434] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:57.450456 31398 tablet_bootstrap.cc:492] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c: No bootstrap required, opened a new log
I20260709 12:28:57.451201 31398 ts_tablet_manager.cc:1403] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:28:57.451530 31402 tablet_bootstrap.cc:492] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690: Bootstrap starting.
I20260709 12:28:57.450548 31399 tablet_bootstrap.cc:492] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651: Bootstrap starting.
I20260709 12:28:57.454576 31398 raft_consensus.cc:359] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.455542 31398 raft_consensus.cc:385] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.455931 31398 raft_consensus.cc:740] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc81689ff422498292ab8adb7876289c, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.457105 31398 consensus_queue.cc:260] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.460289 31402 tablet_bootstrap.cc:654] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.462028 31399 tablet_bootstrap.cc:654] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.469216 31402 tablet_bootstrap.cc:492] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690: No bootstrap required, opened a new log
I20260709 12:28:57.469260 31398 ts_tablet_manager.cc:1434] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 12:28:57.469450 31399 tablet_bootstrap.cc:492] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651: No bootstrap required, opened a new log
I20260709 12:28:57.469949 31402 ts_tablet_manager.cc:1403] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 12:28:57.470151 31399 ts_tablet_manager.cc:1403] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 12:28:57.470772 31398 tablet_bootstrap.cc:492] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c: Bootstrap starting.
I20260709 12:28:57.473388 31399 raft_consensus.cc:359] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.473585 31402 raft_consensus.cc:359] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.474373 31399 raft_consensus.cc:385] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.474444 31402 raft_consensus.cc:385] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.474995 31399 raft_consensus.cc:740] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d007ae0880c945ecbd6c356d0e76a651, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.475065 31402 raft_consensus.cc:740] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.476627 31402 consensus_queue.cc:260] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.476126 31399 consensus_queue.cc:260] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.479532 31398 tablet_bootstrap.cc:654] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.479579 31402 ts_tablet_manager.cc:1434] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:28:57.481431 31399 ts_tablet_manager.cc:1434] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:57.488801 31408 raft_consensus.cc:493] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.489419 31408 raft_consensus.cc:515] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.492579 31208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7b83c9706415d8507fbe346b7dd33" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651" is_pre_election: true
I20260709 12:28:57.492913 31398 tablet_bootstrap.cc:492] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c: No bootstrap required, opened a new log
I20260709 12:28:57.493299 31208 raft_consensus.cc:2468] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 0.
I20260709 12:28:57.493537 31398 ts_tablet_manager.cc:1403] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 12:28:57.494717 31322 leader_election.cc:304] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:57.495028 31408 leader_election.cc:290] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), cc81689ff422498292ab8adb7876289c (127.17.40.2:40441)
I20260709 12:28:57.495692 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7b83c9706415d8507fbe346b7dd33" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c" is_pre_election: true
W20260709 12:28:57.497395 31324 leader_election.cc:343] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc81689ff422498292ab8adb7876289c (127.17.40.2:40441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.495692 31408 raft_consensus.cc:2804] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.499035 31408 raft_consensus.cc:493] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.499472 31408 raft_consensus.cc:3060] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.499980 31398 raft_consensus.cc:359] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.501232 31398 raft_consensus.cc:385] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.501725 31398 raft_consensus.cc:740] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc81689ff422498292ab8adb7876289c, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.502969 31398 consensus_queue.cc:260] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.505142 31398 ts_tablet_manager.cc:1434] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.007s
I20260709 12:28:57.507750 31408 raft_consensus.cc:515] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.509649 31408 leader_election.cc:290] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 election: Requested vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), cc81689ff422498292ab8adb7876289c (127.17.40.2:40441)
I20260709 12:28:57.510557 31208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7b83c9706415d8507fbe346b7dd33" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
I20260709 12:28:57.510831 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7b83c9706415d8507fbe346b7dd33" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c"
I20260709 12:28:57.511274 31208 raft_consensus.cc:3060] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.511489 31284 raft_consensus.cc:3060] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.518368 31208 raft_consensus.cc:2468] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 1.
I20260709 12:28:57.519191 31284 raft_consensus.cc:2468] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 1.
I20260709 12:28:57.519580 31322 leader_election.cc:304] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:57.520573 31408 raft_consensus.cc:2804] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.521083 31408 raft_consensus.cc:697] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Becoming Leader. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Running, Role: LEADER
I20260709 12:28:57.521972 31408 consensus_queue.cc:237] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.529788 31104 catalog_manager.cc:5697] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "4d6b297da72b4d37a0a816b92767e690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.574118 31408 raft_consensus.cc:493] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.574910 31408 raft_consensus.cc:515] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } } peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } }
I20260709 12:28:57.577267 31408 leader_election.cc:290] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc81689ff422498292ab8adb7876289c (127.17.40.2:40441), d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183)
I20260709 12:28:57.578157 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1443d2fc085446bb378439f892903cf" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c" is_pre_election: true
I20260709 12:28:57.578622 31208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1443d2fc085446bb378439f892903cf" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651" is_pre_election: true
I20260709 12:28:57.579912 31284 raft_consensus.cc:2393] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d6b297da72b4d37a0a816b92767e690 in current term 1: Already voted for candidate d007ae0880c945ecbd6c356d0e76a651 in this term.
W20260709 12:28:57.580477 31155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:57.581509 31324 leader_election.cc:304] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690; no voters: cc81689ff422498292ab8adb7876289c, d007ae0880c945ecbd6c356d0e76a651
I20260709 12:28:57.582348 31408 raft_consensus.cc:3060] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.589059 31408 raft_consensus.cc:2749] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:57.648959 31410 consensus_queue.cc:1048] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.662562 31405 consensus_queue.cc:1048] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.763056 31408 raft_consensus.cc:493] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.763594 31408 raft_consensus.cc:515] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.765338 31408 leader_election.cc:290] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), cc81689ff422498292ab8adb7876289c (127.17.40.2:40441)
I20260709 12:28:57.766224 31208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651" is_pre_election: true
I20260709 12:28:57.766386 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c" is_pre_election: true
I20260709 12:28:57.766966 31208 raft_consensus.cc:2468] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 0.
I20260709 12:28:57.767136 31284 raft_consensus.cc:2468] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 0.
I20260709 12:28:57.768133 31322 leader_election.cc:304] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:57.768953 31408 raft_consensus.cc:2804] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.769362 31408 raft_consensus.cc:493] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.769704 31408 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.775754 31408 raft_consensus.cc:515] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.777660 31408 leader_election.cc:290] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 election: Requested vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), cc81689ff422498292ab8adb7876289c (127.17.40.2:40441)
I20260709 12:28:57.778703 31208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
I20260709 12:28:57.778826 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc81689ff422498292ab8adb7876289c"
I20260709 12:28:57.779534 31284 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.779294 31208 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.785656 31208 raft_consensus.cc:2468] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 1.
I20260709 12:28:57.786429 31284 raft_consensus.cc:2468] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 1.
I20260709 12:28:57.786806 31322 leader_election.cc:304] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:57.787736 31408 raft_consensus.cc:2804] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.788367 31408 raft_consensus.cc:697] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Becoming Leader. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Running, Role: LEADER
I20260709 12:28:57.789300 31408 consensus_queue.cc:237] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:57.797912 31106 catalog_manager.cc:5697] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "4d6b297da72b4d37a0a816b92767e690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.836843 31403 consensus_queue.cc:1048] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.850484 31439 consensus_queue.cc:1048] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:57.906526 31283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6"
dest_uuid: "cc81689ff422498292ab8adb7876289c"
mode: GRACEFUL
new_leader_uuid: "4d6b297da72b4d37a0a816b92767e690"
 from {username='slave'} at 127.0.0.1:35170
I20260709 12:28:57.907243 31283 raft_consensus.cc:606] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 LEADER]: Received request to transfer leadership to TS 4d6b297da72b4d37a0a816b92767e690
I20260709 12:28:57.907943 31408 consensus_queue.cc:1048] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.922571 31429 consensus_queue.cc:1048] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:57.925125 31358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb"
dest_uuid: "4d6b297da72b4d37a0a816b92767e690"
mode: GRACEFUL
new_leader_uuid: "d007ae0880c945ecbd6c356d0e76a651"
 from {username='slave'} at 127.0.0.1:42552
I20260709 12:28:57.925776 31358 raft_consensus.cc:606] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Received request to transfer leadership to TS d007ae0880c945ecbd6c356d0e76a651
I20260709 12:28:57.936568 31358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41d7b83c9706415d8507fbe346b7dd33"
dest_uuid: "4d6b297da72b4d37a0a816b92767e690"
mode: GRACEFUL
new_leader_uuid: "d007ae0880c945ecbd6c356d0e76a651"
 from {username='slave'} at 127.0.0.1:42552
I20260709 12:28:57.937282 31358 raft_consensus.cc:606] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Received request to transfer leadership to TS d007ae0880c945ecbd6c356d0e76a651
I20260709 12:28:58.206092 31429 consensus_queue.cc:1048] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.217684 31447 consensus_queue.cc:1048] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.227046 31408 raft_consensus.cc:993] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690: : Instructing follower d007ae0880c945ecbd6c356d0e76a651 to start an election
I20260709 12:28:58.227883 31408 raft_consensus.cc:1081] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Signalling peer d007ae0880c945ecbd6c356d0e76a651 to start an election
I20260709 12:28:58.231698 31208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb"
dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
 from {username='slave'} at 127.0.0.1:33146
I20260709 12:28:58.232424 31208 raft_consensus.cc:493] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:58.233794 31208 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.242547 31208 raft_consensus.cc:515] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.245922 31208 leader_election.cc:290] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 2 election: Requested vote from peers cc81689ff422498292ab8adb7876289c (127.17.40.2:40441), 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871)
I20260709 12:28:58.246182 31358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb" candidate_uuid: "d007ae0880c945ecbd6c356d0e76a651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d6b297da72b4d37a0a816b92767e690"
I20260709 12:28:58.246901 31358 raft_consensus.cc:3055] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:58.247277 31358 raft_consensus.cc:740] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Running, Role: LEADER
I20260709 12:28:58.248273 31358 consensus_queue.cc:260] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.250726 31358 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.254166 31440 raft_consensus.cc:993] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c: : Instructing follower 4d6b297da72b4d37a0a816b92767e690 to start an election
I20260709 12:28:58.254776 31440 raft_consensus.cc:1081] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 LEADER]: Signalling peer 4d6b297da72b4d37a0a816b92767e690 to start an election
I20260709 12:28:58.256686 31357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6"
dest_uuid: "4d6b297da72b4d37a0a816b92767e690"
 from {username='slave'} at 127.0.0.1:35870
I20260709 12:28:58.257277 31357 raft_consensus.cc:493] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:58.248227 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb" candidate_uuid: "d007ae0880c945ecbd6c356d0e76a651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc81689ff422498292ab8adb7876289c"
I20260709 12:28:58.257704 31357 raft_consensus.cc:3060] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.262678 31283 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.262882 31358 raft_consensus.cc:2468] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d007ae0880c945ecbd6c356d0e76a651 in term 2.
I20260709 12:28:58.264328 31172 leader_election.cc:304] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:58.265290 31450 raft_consensus.cc:2804] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:58.266695 31450 raft_consensus.cc:697] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 2 LEADER]: Becoming Leader. State: Replica: d007ae0880c945ecbd6c356d0e76a651, State: Running, Role: LEADER
I20260709 12:28:58.267755 31450 consensus_queue.cc:237] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.270620 31357 raft_consensus.cc:515] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.277094 31208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
I20260709 12:28:58.276743 31107 catalog_manager.cc:5697] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 reported cstate change: term changed from 1 to 2, leader changed from 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3) to d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "d007ae0880c945ecbd6c356d0e76a651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:58.277674 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97591bed853f48aabac3b455d27e9fe6" candidate_uuid: "4d6b297da72b4d37a0a816b92767e690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc81689ff422498292ab8adb7876289c"
I20260709 12:28:58.277876 31208 raft_consensus.cc:3060] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.278374 31284 raft_consensus.cc:3055] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:58.278784 31284 raft_consensus.cc:740] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc81689ff422498292ab8adb7876289c, State: Running, Role: LEADER
I20260709 12:28:58.279528 31357 leader_election.cc:290] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 2 election: Requested vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), cc81689ff422498292ab8adb7876289c (127.17.40.2:40441)
I20260709 12:28:58.279659 31284 consensus_queue.cc:260] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.280936 31284 raft_consensus.cc:3060] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.292371 31283 raft_consensus.cc:2468] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d007ae0880c945ecbd6c356d0e76a651 in term 2.
I20260709 12:28:58.300825 31208 raft_consensus.cc:2468] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 2.
I20260709 12:28:58.302253 31322 leader_election.cc:304] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d6b297da72b4d37a0a816b92767e690, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:58.303153 31408 raft_consensus.cc:2804] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:58.303179 31284 raft_consensus.cc:2468] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d6b297da72b4d37a0a816b92767e690 in term 2.
I20260709 12:28:58.303792 31408 raft_consensus.cc:697] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 2 LEADER]: Becoming Leader. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Running, Role: LEADER
I20260709 12:28:58.304713 31408 consensus_queue.cc:237] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.311575 31107 catalog_manager.cc:5697] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 reported cstate change: term changed from 1 to 2, leader changed from cc81689ff422498292ab8adb7876289c (127.17.40.2) to 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "4d6b297da72b4d37a0a816b92767e690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:58.332231 31429 raft_consensus.cc:993] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690: : Instructing follower d007ae0880c945ecbd6c356d0e76a651 to start an election
I20260709 12:28:58.332828 31408 raft_consensus.cc:1081] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Signalling peer d007ae0880c945ecbd6c356d0e76a651 to start an election
I20260709 12:28:58.334438 31208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41d7b83c9706415d8507fbe346b7dd33"
dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
 from {username='slave'} at 127.0.0.1:33146
I20260709 12:28:58.334985 31208 raft_consensus.cc:493] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:58.335391 31208 raft_consensus.cc:3060] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.340905 31208 raft_consensus.cc:515] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.343050 31208 leader_election.cc:290] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 2 election: Requested vote from peers cc81689ff422498292ab8adb7876289c (127.17.40.2:40441), 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871)
I20260709 12:28:58.343914 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7b83c9706415d8507fbe346b7dd33" candidate_uuid: "d007ae0880c945ecbd6c356d0e76a651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc81689ff422498292ab8adb7876289c"
I20260709 12:28:58.344246 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7b83c9706415d8507fbe346b7dd33" candidate_uuid: "d007ae0880c945ecbd6c356d0e76a651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d6b297da72b4d37a0a816b92767e690"
I20260709 12:28:58.344597 31284 raft_consensus.cc:3060] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.344901 31357 raft_consensus.cc:3055] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:58.345225 31357 raft_consensus.cc:740] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d6b297da72b4d37a0a816b92767e690, State: Running, Role: LEADER
I20260709 12:28:58.346000 31357 consensus_queue.cc:260] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.347158 31357 raft_consensus.cc:3060] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:58.351620 31284 raft_consensus.cc:2468] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d007ae0880c945ecbd6c356d0e76a651 in term 2.
I20260709 12:28:58.352965 31175 leader_election.cc:304] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc81689ff422498292ab8adb7876289c, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:58.353770 31450 raft_consensus.cc:2804] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:58.353955 31357 raft_consensus.cc:2468] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d007ae0880c945ecbd6c356d0e76a651 in term 2.
I20260709 12:28:58.354197 31450 raft_consensus.cc:697] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 2 LEADER]: Becoming Leader. State: Replica: d007ae0880c945ecbd6c356d0e76a651, State: Running, Role: LEADER
I20260709 12:28:58.355322 31450 consensus_queue.cc:237] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.362139 31107 catalog_manager.cc:5697] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 reported cstate change: term changed from 1 to 2, leader changed from 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3) to d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "d007ae0880c945ecbd6c356d0e76a651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:58.414651 17568 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:28:58.416385 17568 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:28:58.416851 17568 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:28:58.430495 31208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb"
dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
mode: GRACEFUL
new_leader_uuid: "cc81689ff422498292ab8adb7876289c"
 from {username='slave'} at 127.0.0.1:44406
I20260709 12:28:58.431026 31208 raft_consensus.cc:606] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 2 LEADER]: Received request to transfer leadership to TS cc81689ff422498292ab8adb7876289c
I20260709 12:28:58.432304 17568 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:28:58.686435 31208 raft_consensus.cc:1275] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Refusing update from remote peer 4d6b297da72b4d37a0a816b92767e690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.687844 31408 consensus_queue.cc:1048] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:58.695897 31284 raft_consensus.cc:1275] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Refusing update from remote peer 4d6b297da72b4d37a0a816b92767e690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.697862 31429 consensus_queue.cc:1048] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:58.748731 31357 raft_consensus.cc:1275] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Refusing update from remote peer d007ae0880c945ecbd6c356d0e76a651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.750264 31450 consensus_queue.cc:1048] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:58.759071 31284 raft_consensus.cc:1275] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Refusing update from remote peer d007ae0880c945ecbd6c356d0e76a651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.760696 31450 consensus_queue.cc:1048] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:58.872205 31357 raft_consensus.cc:1275] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Refusing update from remote peer d007ae0880c945ecbd6c356d0e76a651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.873916 31450 consensus_queue.cc:1048] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:58.876356 31284 raft_consensus.cc:1275] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Refusing update from remote peer d007ae0880c945ecbd6c356d0e76a651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:58.877780 31453 consensus_queue.cc:1048] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:58.886566 31405 raft_consensus.cc:993] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651: : Instructing follower cc81689ff422498292ab8adb7876289c to start an election
I20260709 12:28:58.887137 31405 raft_consensus.cc:1081] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 2 LEADER]: Signalling peer cc81689ff422498292ab8adb7876289c to start an election
I20260709 12:28:58.888823 31283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb"
dest_uuid: "cc81689ff422498292ab8adb7876289c"
 from {username='slave'} at 127.0.0.1:56804
I20260709 12:28:58.889943 31283 raft_consensus.cc:493] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:58.890367 31283 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:58.898077 31283 raft_consensus.cc:515] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.901294 31208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb" candidate_uuid: "cc81689ff422498292ab8adb7876289c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d007ae0880c945ecbd6c356d0e76a651"
I20260709 12:28:58.901394 31283 leader_election.cc:290] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [CANDIDATE]: Term 3 election: Requested vote from peers d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1:39183), 4d6b297da72b4d37a0a816b92767e690 (127.17.40.3:42871)
I20260709 12:28:58.902046 31208 raft_consensus.cc:3055] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:58.902443 31208 raft_consensus.cc:740] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d007ae0880c945ecbd6c356d0e76a651, State: Running, Role: LEADER
I20260709 12:28:58.903290 31208 consensus_queue.cc:260] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.904266 31208 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:58.907382 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de72f20bc654cad8b2c4e4e40e2dffb" candidate_uuid: "cc81689ff422498292ab8adb7876289c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d6b297da72b4d37a0a816b92767e690"
I20260709 12:28:58.908066 31357 raft_consensus.cc:3060] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:58.910185 31208 raft_consensus.cc:2468] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc81689ff422498292ab8adb7876289c in term 3.
I20260709 12:28:58.911474 31248 leader_election.cc:304] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc81689ff422498292ab8adb7876289c, d007ae0880c945ecbd6c356d0e76a651; no voters: 
I20260709 12:28:58.912225 31439 raft_consensus.cc:2804] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:58.913246 31439 raft_consensus.cc:697] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 3 LEADER]: Becoming Leader. State: Replica: cc81689ff422498292ab8adb7876289c, State: Running, Role: LEADER
I20260709 12:28:58.914127 31439 consensus_queue.cc:237] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } }
I20260709 12:28:58.915764 31357 raft_consensus.cc:2468] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc81689ff422498292ab8adb7876289c in term 3.
I20260709 12:28:58.921074 31104 catalog_manager.cc:5697] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c reported cstate change: term changed from 2 to 3, leader changed from d007ae0880c945ecbd6c356d0e76a651 (127.17.40.1) to cc81689ff422498292ab8adb7876289c (127.17.40.2). New cstate: current_term: 3 leader_uuid: "cc81689ff422498292ab8adb7876289c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d007ae0880c945ecbd6c356d0e76a651" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 39183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc81689ff422498292ab8adb7876289c" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 40441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d6b297da72b4d37a0a816b92767e690" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 42871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.055292 17568 tablet_server.cc:179] TabletServer@127.17.40.1:0 shutting down...
I20260709 12:28:59.078212 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:59.078948 17568 tablet_replica.cc:333] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651: stopping tablet replica
I20260709 12:28:59.079524 17568 raft_consensus.cc:2243] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.080376 17568 raft_consensus.cc:2272] T 41d7b83c9706415d8507fbe346b7dd33 P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.083308 17568 tablet_replica.cc:333] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651: stopping tablet replica
I20260709 12:28:59.083846 17568 raft_consensus.cc:2243] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.084261 17568 raft_consensus.cc:2272] T 97591bed853f48aabac3b455d27e9fe6 P d007ae0880c945ecbd6c356d0e76a651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.086668 17568 tablet_replica.cc:333] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651: stopping tablet replica
I20260709 12:28:59.087174 17568 raft_consensus.cc:2243] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.087538 17568 raft_consensus.cc:2272] T 7de72f20bc654cad8b2c4e4e40e2dffb P d007ae0880c945ecbd6c356d0e76a651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.089845 17568 tablet_replica.cc:333] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651: stopping tablet replica
I20260709 12:28:59.090318 17568 raft_consensus.cc:2243] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.091161 17568 raft_consensus.cc:2272] T c1443d2fc085446bb378439f892903cf P d007ae0880c945ecbd6c356d0e76a651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.104984 17568 tablet_server.cc:196] TabletServer@127.17.40.1:0 shutdown complete.
I20260709 12:28:59.118813 17568 tablet_server.cc:179] TabletServer@127.17.40.2:0 shutting down...
I20260709 12:28:59.140501 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:59.141106 17568 tablet_replica.cc:333] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c: stopping tablet replica
I20260709 12:28:59.141652 17568 raft_consensus.cc:2243] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.142091 17568 raft_consensus.cc:2272] T 41d7b83c9706415d8507fbe346b7dd33 P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.144443 17568 tablet_replica.cc:333] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c: stopping tablet replica
I20260709 12:28:59.144977 17568 raft_consensus.cc:2243] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.145565 17568 pending_rounds.cc:70] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c: Trying to abort 1 pending ops.
I20260709 12:28:59.145727 17568 pending_rounds.cc:77] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305626169002356736 op_type: NO_OP noop_request { }
I20260709 12:28:59.145999 17568 raft_consensus.cc:2889] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:28:59.146354 17568 raft_consensus.cc:2272] T 7de72f20bc654cad8b2c4e4e40e2dffb P cc81689ff422498292ab8adb7876289c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.149210 17568 tablet_replica.cc:333] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c: stopping tablet replica
I20260709 12:28:59.149818 17568 raft_consensus.cc:2243] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.150312 17568 raft_consensus.cc:2272] T c1443d2fc085446bb378439f892903cf P cc81689ff422498292ab8adb7876289c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.152315 17568 tablet_replica.cc:333] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c: stopping tablet replica
I20260709 12:28:59.152838 17568 raft_consensus.cc:2243] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.153301 17568 raft_consensus.cc:2272] T 97591bed853f48aabac3b455d27e9fe6 P cc81689ff422498292ab8adb7876289c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.176345 17568 tablet_server.cc:196] TabletServer@127.17.40.2:0 shutdown complete.
I20260709 12:28:59.190204 17568 tablet_server.cc:179] TabletServer@127.17.40.3:0 shutting down...
I20260709 12:28:59.211431 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:59.212110 17568 tablet_replica.cc:333] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690: stopping tablet replica
I20260709 12:28:59.212719 17568 raft_consensus.cc:2243] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.213219 17568 raft_consensus.cc:2272] T 41d7b83c9706415d8507fbe346b7dd33 P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.215857 17568 tablet_replica.cc:333] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690: stopping tablet replica
I20260709 12:28:59.216455 17568 raft_consensus.cc:2243] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.216939 17568 raft_consensus.cc:2272] T 7de72f20bc654cad8b2c4e4e40e2dffb P 4d6b297da72b4d37a0a816b92767e690 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.219321 17568 tablet_replica.cc:333] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690: stopping tablet replica
I20260709 12:28:59.219892 17568 raft_consensus.cc:2243] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.220347 17568 raft_consensus.cc:2272] T c1443d2fc085446bb378439f892903cf P 4d6b297da72b4d37a0a816b92767e690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.222275 17568 tablet_replica.cc:333] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690: stopping tablet replica
I20260709 12:28:59.222836 17568 raft_consensus.cc:2243] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.223723 17568 raft_consensus.cc:2272] T 97591bed853f48aabac3b455d27e9fe6 P 4d6b297da72b4d37a0a816b92767e690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.246810 17568 tablet_server.cc:196] TabletServer@127.17.40.3:0 shutdown complete.
I20260709 12:28:59.260499 17568 master.cc:562] Master@127.17.40.62:34851 shutting down...
I20260709 12:28:59.277021 17568 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.277628 17568 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.277987 17568 tablet_replica.cc:333] T 00000000000000000000000000000000 P 344f5d624815498182b93967dc4c227d: stopping tablet replica
I20260709 12:28:59.296958 17568 master.cc:584] Master@127.17.40.62:34851 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2887 ms)
[----------] 6 tests from LeaderRebalancerTest (450643 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:28:59.326294 17568 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.40.62:43555
I20260709 12:28:59.327643 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:59.333103 31458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:59.335117 31461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:59.335243 31459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:59.335300 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:59.336589 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:59.336813 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:59.336980 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600139336963 us; error 0 us; skew 500 ppm
I20260709 12:28:59.337545 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:59.340205 17568 webserver.cc:533] Webserver started at http://127.17.40.62:33583/ using document root <none> and password file <none>
I20260709 12:28:59.340734 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:59.340946 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:59.341234 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:59.342379 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/master-0-root/instance:
uuid: "3a35a17ab0c74c40bc09680aac2e13dd"
format_stamp: "Formatted at 2026-07-09 12:28:59 on dist-test-slave-tjfs"
I20260709 12:28:59.347519 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:59.351578 31466 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.352530 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:28:59.352906 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/master-0-root
uuid: "3a35a17ab0c74c40bc09680aac2e13dd"
format_stamp: "Formatted at 2026-07-09 12:28:59 on dist-test-slave-tjfs"
I20260709 12:28:59.353281 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:59.369546 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:59.370772 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:59.408392 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.62:43555
I20260709 12:28:59.408495 31517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.62:43555 every 8 connection(s)
I20260709 12:28:59.412503 31518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:59.424921 31518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd: Bootstrap starting.
I20260709 12:28:59.429769 31518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.434271 31518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd: No bootstrap required, opened a new log
I20260709 12:28:59.436544 31518 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a35a17ab0c74c40bc09680aac2e13dd" member_type: VOTER }
I20260709 12:28:59.436960 31518 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.437136 31518 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a35a17ab0c74c40bc09680aac2e13dd, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.437668 31518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a35a17ab0c74c40bc09680aac2e13dd" member_type: VOTER }
I20260709 12:28:59.438095 31518 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:59.438292 31518 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:59.438606 31518 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.443770 31518 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a35a17ab0c74c40bc09680aac2e13dd" member_type: VOTER }
I20260709 12:28:59.444278 31518 leader_election.cc:304] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a35a17ab0c74c40bc09680aac2e13dd; no voters: 
I20260709 12:28:59.445415 31518 leader_election.cc:290] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:59.445811 31521 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.447328 31521 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 1 LEADER]: Becoming Leader. State: Replica: 3a35a17ab0c74c40bc09680aac2e13dd, State: Running, Role: LEADER
I20260709 12:28:59.448061 31521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a35a17ab0c74c40bc09680aac2e13dd" member_type: VOTER }
I20260709 12:28:59.448529 31518 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:59.452898 31522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a35a17ab0c74c40bc09680aac2e13dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a35a17ab0c74c40bc09680aac2e13dd" member_type: VOTER } }
I20260709 12:28:59.453583 31522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:59.454819 31523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a35a17ab0c74c40bc09680aac2e13dd. Latest consensus state: current_term: 1 leader_uuid: "3a35a17ab0c74c40bc09680aac2e13dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a35a17ab0c74c40bc09680aac2e13dd" member_type: VOTER } }
I20260709 12:28:59.455583 31523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:59.460636 31529 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:59.465672 31529 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:59.468320 17568 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:59.475091 31529 catalog_manager.cc:1383] Generated new cluster ID: 9de26c69e1444602b47d86877c772156
I20260709 12:28:59.475423 31529 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:59.513636 31529 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:59.515117 31529 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:59.529547 31529 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd: Generated new TSK 0
I20260709 12:28:59.530241 31529 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:59.535113 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:59.541635 31539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:59.542685 31540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:59.544495 31542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:59.544649 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:59.545804 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:59.546046 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:59.546231 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600139546210 us; error 0 us; skew 500 ppm
I20260709 12:28:59.546839 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:59.549701 17568 webserver.cc:533] Webserver started at http://127.17.40.1:39977/ using document root <none> and password file <none>
I20260709 12:28:59.550293 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:59.550546 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:59.550843 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:59.552023 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-0-root/instance:
uuid: "b36f77bba0f44e4e903422b337e9ba9b"
format_stamp: "Formatted at 2026-07-09 12:28:59 on dist-test-slave-tjfs"
I20260709 12:28:59.556984 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:59.560576 31547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.561393 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:28:59.561772 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "b36f77bba0f44e4e903422b337e9ba9b"
format_stamp: "Formatted at 2026-07-09 12:28:59 on dist-test-slave-tjfs"
I20260709 12:28:59.562091 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:59.582020 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:59.583338 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:59.584906 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:59.587409 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:59.587667 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.587934 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:59.588119 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.629330 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:36725
I20260709 12:28:59.629431 31609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:36725 every 8 connection(s)
I20260709 12:28:59.635011 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:59.642746 31614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:59.644423 31615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:59.647051 31617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:59.648964 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:59.650074 31610 heartbeater.cc:344] Connected to a master server at 127.17.40.62:43555
I20260709 12:28:59.650609 31610 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:59.650810 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:59.651127 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:59.651327 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600139651311 us; error 0 us; skew 500 ppm
I20260709 12:28:59.651731 31610 heartbeater.cc:507] Master 127.17.40.62:43555 requested a full tablet report, sending...
I20260709 12:28:59.652148 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:59.654484 31483 ts_manager.cc:194] Registered new tserver with Master: b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725)
I20260709 12:28:59.655418 17568 webserver.cc:533] Webserver started at http://127.17.40.2:43543/ using document root <none> and password file <none>
I20260709 12:28:59.656253 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:59.656534 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:59.656855 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:59.657210 31483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56192
I20260709 12:28:59.658756 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-1-root/instance:
uuid: "510046307b7e4418ad3a50b58f3ba982"
format_stamp: "Formatted at 2026-07-09 12:28:59 on dist-test-slave-tjfs"
I20260709 12:28:59.663977 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:59.667721 31622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.668622 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:59.668975 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-1-root
uuid: "510046307b7e4418ad3a50b58f3ba982"
format_stamp: "Formatted at 2026-07-09 12:28:59 on dist-test-slave-tjfs"
I20260709 12:28:59.669255 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:59.743606 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:59.744825 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:59.746358 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:59.748943 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:59.749219 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.749508 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:59.749718 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.791517 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.2:39131
I20260709 12:28:59.791625 31684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.2:39131 every 8 connection(s)
I20260709 12:28:59.796974 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:59.805197 31688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:59.805929 31689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:59.811349 31685 heartbeater.cc:344] Connected to a master server at 127.17.40.62:43555
W20260709 12:28:59.811779 31691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:59.812220 31685 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:59.813433 31685 heartbeater.cc:507] Master 127.17.40.62:43555 requested a full tablet report, sending...
I20260709 12:28:59.814199 17568 server_base.cc:1061] running on GCE node
I20260709 12:28:59.815485 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:59.815730 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:59.815932 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600139815910 us; error 0 us; skew 500 ppm
I20260709 12:28:59.816166 31483 ts_manager.cc:194] Registered new tserver with Master: 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:28:59.816545 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:59.818073 31483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56196
I20260709 12:28:59.819576 17568 webserver.cc:533] Webserver started at http://127.17.40.3:41933/ using document root <none> and password file <none>
I20260709 12:28:59.820360 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:59.820618 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:59.820962 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:59.822190 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-2-root/instance:
uuid: "de66417897734488be5261c5177f95dc"
format_stamp: "Formatted at 2026-07-09 12:28:59 on dist-test-slave-tjfs"
I20260709 12:28:59.827025 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:59.830540 31696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.831439 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:28:59.831796 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-2-root
uuid: "de66417897734488be5261c5177f95dc"
format_stamp: "Formatted at 2026-07-09 12:28:59 on dist-test-slave-tjfs"
I20260709 12:28:59.832175 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599688508335-17568-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:59.844585 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:59.845821 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:59.847450 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:59.849843 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:59.850097 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.850473 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:59.850737 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:59.892782 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.3:43611
I20260709 12:28:59.892892 31758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.3:43611 every 8 connection(s)
I20260709 12:28:59.908825 31759 heartbeater.cc:344] Connected to a master server at 127.17.40.62:43555
I20260709 12:28:59.909235 31759 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:59.909983 31759 heartbeater.cc:507] Master 127.17.40.62:43555 requested a full tablet report, sending...
I20260709 12:28:59.912263 31483 ts_manager.cc:194] Registered new tserver with Master: de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:28:59.912770 17568 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016485187s
I20260709 12:28:59.913851 31483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56212
I20260709 12:28:59.941563 31483 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56222:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:59.944217 31483 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:00.043710 31575 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0783b4df0849c9b30f993aa292e59b (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:00.044853 31573 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5706fbf1bb4c0d952b332e171bf929 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:00.043766 31574 tablet_service.cc:1511] Processing CreateTablet for tablet 70a7390f649b448f819227c2358af4f9 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:00.046154 31649 tablet_service.cc:1511] Processing CreateTablet for tablet 70a7390f649b448f819227c2358af4f9 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:00.043671 31650 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0783b4df0849c9b30f993aa292e59b (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:00.047600 31649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a7390f649b448f819227c2358af4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.049706 31572 tablet_service.cc:1511] Processing CreateTablet for tablet f5ab25c254fc4c61b6e53ead6c80df7f (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:00.050421 31648 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5706fbf1bb4c0d952b332e171bf929 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:00.051944 31648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5706fbf1bb4c0d952b332e171bf929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.051343 31647 tablet_service.cc:1511] Processing CreateTablet for tablet f5ab25c254fc4c61b6e53ead6c80df7f (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:00.052089 31570 tablet_service.cc:1511] Processing CreateTablet for tablet e5583615df9b4db682252b5f365e0857 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:00.053050 31647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ab25c254fc4c61b6e53ead6c80df7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.047077 31571 tablet_service.cc:1511] Processing CreateTablet for tablet 4f843a391eed40c0b7c66c649d549eb9 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:00.055866 31569 tablet_service.cc:1511] Processing CreateTablet for tablet 432e40d1cf054414b5428334e7d7ec0e (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:00.057716 31650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0783b4df0849c9b30f993aa292e59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.062201 31568 tablet_service.cc:1511] Processing CreateTablet for tablet 43befabd185e4bac8552e94d3ea7cf95 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:00.063750 31646 tablet_service.cc:1511] Processing CreateTablet for tablet 4f843a391eed40c0b7c66c649d549eb9 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:00.065214 31646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f843a391eed40c0b7c66c649d549eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.045341 31575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0783b4df0849c9b30f993aa292e59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.068265 31567 tablet_service.cc:1511] Processing CreateTablet for tablet e4184a4339224d88ae793b9927dc3e89 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:00.069824 31567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4184a4339224d88ae793b9927dc3e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.070883 31569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432e40d1cf054414b5428334e7d7ec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.072969 31568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43befabd185e4bac8552e94d3ea7cf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.076500 31572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ab25c254fc4c61b6e53ead6c80df7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.078874 31570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5583615df9b4db682252b5f365e0857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.082465 31571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f843a391eed40c0b7c66c649d549eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.082945 31645 tablet_service.cc:1511] Processing CreateTablet for tablet e5583615df9b4db682252b5f365e0857 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:00.084460 31645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5583615df9b4db682252b5f365e0857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.086421 31573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5706fbf1bb4c0d952b332e171bf929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.090894 31574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a7390f649b448f819227c2358af4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.096487 31644 tablet_service.cc:1511] Processing CreateTablet for tablet 432e40d1cf054414b5428334e7d7ec0e (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:00.098090 31644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432e40d1cf054414b5428334e7d7ec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.100121 31774 tablet_bootstrap.cc:492] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.108812 31648 tablet_service.cc:1511] Processing CreateTablet for tablet 43befabd185e4bac8552e94d3ea7cf95 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:00.110342 31648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43befabd185e4bac8552e94d3ea7cf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.111444 31649 tablet_service.cc:1511] Processing CreateTablet for tablet e4184a4339224d88ae793b9927dc3e89 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:00.116058 31649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4184a4339224d88ae793b9927dc3e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.120849 31774 tablet_bootstrap.cc:654] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.136127 31723 tablet_service.cc:1511] Processing CreateTablet for tablet 70a7390f649b448f819227c2358af4f9 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:00.136667 31724 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0783b4df0849c9b30f993aa292e59b (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:00.137880 31723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a7390f649b448f819227c2358af4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.139312 31722 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5706fbf1bb4c0d952b332e171bf929 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:00.141121 31720 tablet_service.cc:1511] Processing CreateTablet for tablet 4f843a391eed40c0b7c66c649d549eb9 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:00.142839 31719 tablet_service.cc:1511] Processing CreateTablet for tablet e5583615df9b4db682252b5f365e0857 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:00.144506 31718 tablet_service.cc:1511] Processing CreateTablet for tablet 432e40d1cf054414b5428334e7d7ec0e (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:00.146178 31717 tablet_service.cc:1511] Processing CreateTablet for tablet 43befabd185e4bac8552e94d3ea7cf95 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:00.147883 31716 tablet_service.cc:1511] Processing CreateTablet for tablet e4184a4339224d88ae793b9927dc3e89 (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:00.150038 31721 tablet_service.cc:1511] Processing CreateTablet for tablet f5ab25c254fc4c61b6e53ead6c80df7f (DEFAULT_TABLE table=test-workload [id=034382ef978941948448ce94368f9154]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:00.159042 31721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ab25c254fc4c61b6e53ead6c80df7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.162794 31717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43befabd185e4bac8552e94d3ea7cf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.165759 31718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432e40d1cf054414b5428334e7d7ec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.171936 31722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5706fbf1bb4c0d952b332e171bf929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.173175 31719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5583615df9b4db682252b5f365e0857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.178812 31716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4184a4339224d88ae793b9927dc3e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.179663 31724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0783b4df0849c9b30f993aa292e59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.180440 31720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f843a391eed40c0b7c66c649d549eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:00.211812 31775 tablet_bootstrap.cc:492] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:00.247648 31775 tablet_bootstrap.cc:654] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.266278 31774 tablet_bootstrap.cc:492] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.275234 31774 ts_tablet_manager.cc:1403] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.175s	user 0.025s	sys 0.016s
I20260709 12:29:00.286005 31774 raft_consensus.cc:359] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.286844 31774 raft_consensus.cc:385] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.287175 31774 raft_consensus.cc:740] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.287930 31774 consensus_queue.cc:260] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.292292 31775 tablet_bootstrap.cc:492] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.292913 31775 ts_tablet_manager.cc:1403] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.081s	user 0.028s	sys 0.004s
I20260709 12:29:00.294304 31777 tablet_bootstrap.cc:492] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.296042 31685 heartbeater.cc:499] Master 127.17.40.62:43555 was elected leader, sending a full tablet report...
I20260709 12:29:00.296564 31774 ts_tablet_manager.cc:1434] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 12:29:00.296042 31775 raft_consensus.cc:359] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.297144 31775 raft_consensus.cc:385] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.297459 31775 raft_consensus.cc:740] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.297730 31774 tablet_bootstrap.cc:492] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.298228 31775 consensus_queue.cc:260] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.303417 31777 tablet_bootstrap.cc:654] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.305640 31774 tablet_bootstrap.cc:654] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.327313 31775 ts_tablet_manager.cc:1434] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.034s	user 0.011s	sys 0.024s
I20260709 12:29:00.328418 31610 heartbeater.cc:499] Master 127.17.40.62:43555 was elected leader, sending a full tablet report...
I20260709 12:29:00.329089 31775 tablet_bootstrap.cc:492] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:00.330440 31777 tablet_bootstrap.cc:492] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.331077 31777 ts_tablet_manager.cc:1403] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.037s	user 0.024s	sys 0.009s
I20260709 12:29:00.333578 31774 tablet_bootstrap.cc:492] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.335196 31777 raft_consensus.cc:359] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.336280 31777 raft_consensus.cc:385] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.336331 31774 ts_tablet_manager.cc:1403] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.016s
I20260709 12:29:00.336576 31775 tablet_bootstrap.cc:654] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.336850 31777 raft_consensus.cc:740] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.338007 31777 consensus_queue.cc:260] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.340152 31774 raft_consensus.cc:359] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.341383 31774 raft_consensus.cc:385] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.341809 31774 raft_consensus.cc:740] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.342929 31774 consensus_queue.cc:260] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.346364 31774 ts_tablet_manager.cc:1434] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:29:00.348104 31774 tablet_bootstrap.cc:492] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.357497 31774 tablet_bootstrap.cc:654] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.358929 31775 tablet_bootstrap.cc:492] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.359408 31759 heartbeater.cc:499] Master 127.17.40.62:43555 was elected leader, sending a full tablet report...
I20260709 12:29:00.359683 31775 ts_tablet_manager.cc:1403] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.031s	user 0.029s	sys 0.000s
I20260709 12:29:00.359977 31777 ts_tablet_manager.cc:1434] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.007s
I20260709 12:29:00.361430 31777 tablet_bootstrap.cc:492] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.363530 31775 raft_consensus.cc:359] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:00.364524 31775 raft_consensus.cc:385] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.364894 31775 raft_consensus.cc:740] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.365782 31775 consensus_queue.cc:260] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:00.368536 31775 ts_tablet_manager.cc:1434] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:00.369680 31775 tablet_bootstrap.cc:492] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:00.370213 31777 tablet_bootstrap.cc:654] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.376405 31775 tablet_bootstrap.cc:654] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.402498 31774 tablet_bootstrap.cc:492] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.403309 31774 ts_tablet_manager.cc:1403] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.056s	user 0.027s	sys 0.020s
I20260709 12:29:00.407493 31774 raft_consensus.cc:359] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.408696 31774 raft_consensus.cc:385] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.409109 31774 raft_consensus.cc:740] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.410424 31774 consensus_queue.cc:260] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.418849 31774 ts_tablet_manager.cc:1434] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:29:00.419042 31775 tablet_bootstrap.cc:492] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.419708 31777 tablet_bootstrap.cc:492] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.419885 31775 ts_tablet_manager.cc:1403] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.018s
I20260709 12:29:00.420070 31774 tablet_bootstrap.cc:492] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.420292 31777 ts_tablet_manager.cc:1403] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.059s	user 0.032s	sys 0.024s
I20260709 12:29:00.423429 31777 raft_consensus.cc:359] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.423712 31775 raft_consensus.cc:359] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.424268 31777 raft_consensus.cc:385] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.424461 31775 raft_consensus.cc:385] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.424640 31777 raft_consensus.cc:740] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.424825 31775 raft_consensus.cc:740] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.425557 31777 consensus_queue.cc:260] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.426230 31774 tablet_bootstrap.cc:654] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.426783 31775 consensus_queue.cc:260] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.430940 31777 ts_tablet_manager.cc:1434] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:29:00.432147 31777 tablet_bootstrap.cc:492] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.433257 31775 ts_tablet_manager.cc:1434] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:29:00.435118 31775 tablet_bootstrap.cc:492] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:00.438448 31774 tablet_bootstrap.cc:492] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.438908 31777 tablet_bootstrap.cc:654] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.439062 31774 ts_tablet_manager.cc:1403] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 12:29:00.441819 31775 tablet_bootstrap.cc:654] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.442619 31774 raft_consensus.cc:359] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.443506 31774 raft_consensus.cc:385] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.443826 31774 raft_consensus.cc:740] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.444804 31774 consensus_queue.cc:260] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.448485 31774 ts_tablet_manager.cc:1434] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:29:00.449973 31774 tablet_bootstrap.cc:492] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.460642 31777 tablet_bootstrap.cc:492] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.461272 31777 ts_tablet_manager.cc:1403] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.017s
W20260709 12:29:00.462765 31531 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:00.462950 31774 tablet_bootstrap.cc:654] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.464459 31777 raft_consensus.cc:359] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.465287 31777 raft_consensus.cc:385] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.465595 31777 raft_consensus.cc:740] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.466483 31777 consensus_queue.cc:260] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.468686 31777 ts_tablet_manager.cc:1434] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:00.470136 31777 tablet_bootstrap.cc:492] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.465801 31775 tablet_bootstrap.cc:492] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.471259 31775 ts_tablet_manager.cc:1403] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.015s
I20260709 12:29:00.474917 31775 raft_consensus.cc:359] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.475423 31774 tablet_bootstrap.cc:492] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.475777 31775 raft_consensus.cc:385] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.476147 31774 ts_tablet_manager.cc:1403] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.007s
I20260709 12:29:00.476229 31775 raft_consensus.cc:740] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.477447 31777 tablet_bootstrap.cc:654] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.477355 31775 consensus_queue.cc:260] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.479995 31775 ts_tablet_manager.cc:1434] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:00.481529 31780 raft_consensus.cc:493] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.482234 31780 raft_consensus.cc:515] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.479590 31774 raft_consensus.cc:359] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.483450 31774 raft_consensus.cc:385] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.483867 31774 raft_consensus.cc:740] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.484892 31774 consensus_queue.cc:260] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.487640 31775 tablet_bootstrap.cc:492] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:00.496717 31780 leader_election.cc:290] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.488109 31774 ts_tablet_manager.cc:1434] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:29:00.497519 31775 tablet_bootstrap.cc:654] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.498778 31774 tablet_bootstrap.cc:492] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.505601 31784 raft_consensus.cc:493] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.506543 31784 raft_consensus.cc:515] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.514289 31784 leader_election.cc:290] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:00.515142 31780 raft_consensus.cc:493] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.515676 31780 raft_consensus.cc:515] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:00.518410 31779 raft_consensus.cc:493] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.519198 31779 raft_consensus.cc:515] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.520452 31780 leader_election.cc:290] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de66417897734488be5261c5177f95dc (127.17.40.3:43611), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:00.524223 31774 tablet_bootstrap.cc:654] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.530015 31779 leader_election.cc:290] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.553771 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:00.554733 31734 raft_consensus.cc:2468] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 0.
I20260709 12:29:00.557130 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:00.559705 31660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:00.560316 31774 tablet_bootstrap.cc:492] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.560597 31660 raft_consensus.cc:2468] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:00.560902 31774 ts_tablet_manager.cc:1403] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.002s
I20260709 12:29:00.562156 31697 leader_election.cc:304] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:00.563154 31784 raft_consensus.cc:2804] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.563532 31784 raft_consensus.cc:493] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.563866 31784 raft_consensus.cc:3060] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.564407 31774 raft_consensus.cc:359] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.565212 31774 raft_consensus.cc:385] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.565501 31774 raft_consensus.cc:740] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.566303 31774 consensus_queue.cc:260] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.568730 31774 ts_tablet_manager.cc:1434] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:00.575366 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432e40d1cf054414b5428334e7d7ec0e" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:00.576182 31733 raft_consensus.cc:2468] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:00.577729 31625 leader_election.cc:304] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:00.578745 31779 raft_consensus.cc:2804] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.579155 31779 raft_consensus.cc:493] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.579524 31779 raft_consensus.cc:3060] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.580116 31793 raft_consensus.cc:493] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.580940 31793 raft_consensus.cc:515] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.583042 31774 tablet_bootstrap.cc:492] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.583846 31793 leader_election.cc:290] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.586098 31777 tablet_bootstrap.cc:492] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.586712 31777 ts_tablet_manager.cc:1403] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.117s	user 0.023s	sys 0.027s
I20260709 12:29:00.588349 31779 raft_consensus.cc:515] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.589381 31774 tablet_bootstrap.cc:654] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.590361 31777 raft_consensus.cc:359] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.591202 31777 raft_consensus.cc:385] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.591511 31777 raft_consensus.cc:740] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.592007 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432e40d1cf054414b5428334e7d7ec0e" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:00.592667 31733 raft_consensus.cc:3060] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.592344 31777 consensus_queue.cc:260] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.571452 31550 leader_election.cc:304] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
W20260709 12:29:00.596730 31550 leader_election.cc:343] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.597636 31775 tablet_bootstrap.cc:492] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.598227 31775 ts_tablet_manager.cc:1403] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.111s	user 0.039s	sys 0.052s
I20260709 12:29:00.599614 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:00.600661 31734 raft_consensus.cc:2468] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 0.
I20260709 12:29:00.601557 31775 raft_consensus.cc:359] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.602362 31775 raft_consensus.cc:385] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.605340 31775 raft_consensus.cc:740] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.606492 31775 consensus_queue.cc:260] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.603528 31793 raft_consensus.cc:2804] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.608322 31793 raft_consensus.cc:493] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.608824 31793 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.609741 31775 ts_tablet_manager.cc:1434] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 12:29:00.604276 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:00.610895 31779 leader_election.cc:290] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.617141 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432e40d1cf054414b5428334e7d7ec0e" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:00.604790 31550 leader_election.cc:304] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:00.618696 31780 raft_consensus.cc:2804] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.618908 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432e40d1cf054414b5428334e7d7ec0e" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:00.619287 31780 raft_consensus.cc:493] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.619832 31780 raft_consensus.cc:3060] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.620712 31775 tablet_bootstrap.cc:492] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
W20260709 12:29:00.623504 31698 leader_election.cc:343] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.626812 31793 raft_consensus.cc:515] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
W20260709 12:29:00.627854 31624 leader_election.cc:343] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:00.628949 31624 leader_election.cc:343] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.642108 31780 raft_consensus.cc:515] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.604874 31784 raft_consensus.cc:515] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.645958 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:00.646346 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:00.645009 31780 leader_election.cc:290] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.647333 31734 raft_consensus.cc:3060] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.647406 31660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:00.648061 31659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:00.648924 31660 raft_consensus.cc:2468] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 0.
I20260709 12:29:00.650183 31656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
W20260709 12:29:00.650434 31548 leader_election.cc:343] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.650934 31548 leader_election.cc:304] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b; no voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc
I20260709 12:29:00.651783 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:00.653254 31657 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:00.653399 31548 leader_election.cc:343] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:00.654013 31698 leader_election.cc:343] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.654158 31779 raft_consensus.cc:493] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.652446 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:00.655123 31779 raft_consensus.cc:515] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.659153 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a7390f649b448f819227c2358af4f9" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:00.659998 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a7390f649b448f819227c2358af4f9" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:00.660789 31584 raft_consensus.cc:2468] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
W20260709 12:29:00.660849 31625 leader_election.cc:343] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:00.661849 31548 leader_election.cc:343] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.662531 31624 leader_election.cc:304] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: de66417897734488be5261c5177f95dc
I20260709 12:29:00.662911 31779 leader_election.cc:290] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.664041 31779 raft_consensus.cc:2804] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.664433 31779 raft_consensus.cc:493] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.664800 31779 raft_consensus.cc:3060] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.664927 31784 leader_election.cc:290] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:00.665194 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:00.665937 31658 raft_consensus.cc:3060] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.666585 31780 raft_consensus.cc:2749] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:00.668617 31775 tablet_bootstrap.cc:654] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.672497 31733 raft_consensus.cc:2468] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:00.673193 31777 ts_tablet_manager.cc:1434] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.086s	user 0.034s	sys 0.029s
I20260709 12:29:00.674046 31625 leader_election.cc:304] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:00.674472 31777 tablet_bootstrap.cc:492] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.671638 31780 raft_consensus.cc:493] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.678650 31793 leader_election.cc:290] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.677976 31780 raft_consensus.cc:515] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.678066 31774 tablet_bootstrap.cc:492] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.680027 31774 ts_tablet_manager.cc:1403] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.029s
I20260709 12:29:00.679867 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:00.680675 31733 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.680959 31780 leader_election.cc:290] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.682596 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:00.684805 31656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:00.685223 31734 raft_consensus.cc:2468] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 1.
W20260709 12:29:00.686597 31550 leader_election.cc:343] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.687597 31658 raft_consensus.cc:2468] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
W20260709 12:29:00.687798 31548 leader_election.cc:343] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.688292 31548 leader_election.cc:304] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b; no voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc
I20260709 12:29:00.689157 31657 raft_consensus.cc:2468] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 1.
I20260709 12:29:00.689692 31550 leader_election.cc:304] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 510046307b7e4418ad3a50b58f3ba982
I20260709 12:29:00.691633 31548 leader_election.cc:304] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:00.692123 31733 raft_consensus.cc:2468] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 1.
I20260709 12:29:00.695950 31774 raft_consensus.cc:359] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.697098 31780 raft_consensus.cc:2749] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:00.697944 31775 tablet_bootstrap.cc:492] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.699429 31774 raft_consensus.cc:385] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.699747 31775 ts_tablet_manager.cc:1403] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.007s
I20260709 12:29:00.700345 31774 raft_consensus.cc:740] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.702090 31793 raft_consensus.cc:2804] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.702028 31774 consensus_queue.cc:260] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.703951 31775 raft_consensus.cc:359] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.704325 31697 leader_election.cc:304] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:00.704957 31808 raft_consensus.cc:2804] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.705902 31775 raft_consensus.cc:385] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.706278 31775 raft_consensus.cc:740] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.705149 31780 raft_consensus.cc:2804] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.698312 31779 raft_consensus.cc:515] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.704751 31777 tablet_bootstrap.cc:654] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.707058 31805 raft_consensus.cc:2804] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.708781 31805 raft_consensus.cc:697] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:00.709082 31779 leader_election.cc:290] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.709877 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a7390f649b448f819227c2358af4f9" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:00.710160 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a7390f649b448f819227c2358af4f9" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:00.710587 31584 raft_consensus.cc:3060] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:00.711601 31625 leader_election.cc:343] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.712920 31805 consensus_queue.cc:237] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.717666 31780 raft_consensus.cc:697] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:00.719041 31780 consensus_queue.cc:237] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.722827 31793 raft_consensus.cc:697] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:00.723979 31793 consensus_queue.cc:237] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.720363 31775 consensus_queue.cc:260] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.720873 31584 raft_consensus.cc:2468] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:00.727739 31624 leader_election.cc:304] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: de66417897734488be5261c5177f95dc
I20260709 12:29:00.728932 31775 ts_tablet_manager.cc:1434] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 12:29:00.729094 31779 raft_consensus.cc:2804] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.729820 31779 raft_consensus.cc:697] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:00.730597 31775 tablet_bootstrap.cc:492] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:00.730729 31779 consensus_queue.cc:237] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.734001 31483 catalog_manager.cc:5697] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc reported cstate change: term changed from 0 to 1, leader changed from <none> to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 1 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:00.743692 31777 tablet_bootstrap.cc:492] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.748116 31777 ts_tablet_manager.cc:1403] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.011s
I20260709 12:29:00.751616 31777 raft_consensus.cc:359] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.752450 31777 raft_consensus.cc:385] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.752810 31777 raft_consensus.cc:740] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.753795 31777 consensus_queue.cc:260] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.752079 31775 tablet_bootstrap.cc:654] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.755964 31808 raft_consensus.cc:697] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:00.758875 31774 ts_tablet_manager.cc:1434] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.010s
I20260709 12:29:00.756520 31482 catalog_manager.cc:5697] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 0 to 1, leader changed from <none> to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 1 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.759531 31808 consensus_queue.cc:237] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.760959 31774 tablet_bootstrap.cc:492] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.760627 31482 catalog_manager.cc:5697] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 0 to 1, leader changed from <none> to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 1 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.769903 31811 raft_consensus.cc:493] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.771088 31811 raft_consensus.cc:515] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.775290 31811 leader_election.cc:290] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.775559 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5706fbf1bb4c0d952b332e171bf929" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:00.776569 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5706fbf1bb4c0d952b332e171bf929" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
W20260709 12:29:00.778054 31624 leader_election.cc:343] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.773999 31774 tablet_bootstrap.cc:654] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.763819 31777 ts_tablet_manager.cc:1434] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
W20260709 12:29:00.778834 31625 leader_election.cc:343] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.779774 31625 leader_election.cc:304] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982; no voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc
I20260709 12:29:00.784734 31777 tablet_bootstrap.cc:492] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.783394 31811 raft_consensus.cc:2749] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:00.789196 31775 tablet_bootstrap.cc:492] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.789784 31775 ts_tablet_manager.cc:1403] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.008s
I20260709 12:29:00.793066 31775 raft_consensus.cc:359] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.793944 31775 raft_consensus.cc:385] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.795680 31775 raft_consensus.cc:740] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.798775 31774 tablet_bootstrap.cc:492] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.799378 31774 ts_tablet_manager.cc:1403] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.010s
I20260709 12:29:00.800081 31481 catalog_manager.cc:5697] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.802974 31774 raft_consensus.cc:359] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:00.803783 31774 raft_consensus.cc:385] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.804047 31774 raft_consensus.cc:740] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.804883 31774 consensus_queue.cc:260] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:00.796659 31775 consensus_queue.cc:260] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.806599 31774 ts_tablet_manager.cc:1434] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:29:00.807552 31774 tablet_bootstrap.cc:492] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:00.808346 31775 ts_tablet_manager.cc:1434] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:29:00.809540 31775 tablet_bootstrap.cc:492] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:00.815059 31777 tablet_bootstrap.cc:654] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.815750 31774 tablet_bootstrap.cc:654] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.819571 31775 tablet_bootstrap.cc:654] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.824654 31774 tablet_bootstrap.cc:492] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:00.825172 31774 ts_tablet_manager.cc:1403] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 12:29:00.827946 31774 raft_consensus.cc:359] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.828433 31774 raft_consensus.cc:385] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.828655 31774 raft_consensus.cc:740] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.829409 31774 consensus_queue.cc:260] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.831535 31774 ts_tablet_manager.cc:1434] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:00.833166 31808 raft_consensus.cc:493] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.833781 31808 raft_consensus.cc:515] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.834529 31777 tablet_bootstrap.cc:492] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.835047 31775 tablet_bootstrap.cc:492] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.835646 31775 ts_tablet_manager.cc:1403] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 12:29:00.836129 31808 leader_election.cc:290] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.835104 31777 ts_tablet_manager.cc:1403] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.012s
I20260709 12:29:00.838263 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5583615df9b4db682252b5f365e0857" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:00.838682 31775 raft_consensus.cc:359] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.839555 31775 raft_consensus.cc:385] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.839871 31775 raft_consensus.cc:740] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.840193 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5583615df9b4db682252b5f365e0857" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:00.840705 31775 consensus_queue.cc:260] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.840915 31777 raft_consensus.cc:359] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.840372 31481 catalog_manager.cc:5697] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:00.841557 31625 leader_election.cc:343] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.841750 31777 raft_consensus.cc:385] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.842171 31777 raft_consensus.cc:740] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.842319 31584 raft_consensus.cc:2468] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:00.843466 31775 ts_tablet_manager.cc:1434] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:00.843127 31777 consensus_queue.cc:260] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.844681 31775 tablet_bootstrap.cc:492] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:00.845818 31777 ts_tablet_manager.cc:1434] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:00.847024 31777 tablet_bootstrap.cc:492] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.852101 31775 tablet_bootstrap.cc:654] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.854542 31777 tablet_bootstrap.cc:654] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.864008 31777 tablet_bootstrap.cc:492] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.864581 31777 ts_tablet_manager.cc:1403] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 12:29:00.864797 31624 leader_election.cc:304] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: de66417897734488be5261c5177f95dc
I20260709 12:29:00.867826 31777 raft_consensus.cc:359] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.868702 31777 raft_consensus.cc:385] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.869062 31777 raft_consensus.cc:740] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.870075 31808 raft_consensus.cc:2804] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.869922 31777 consensus_queue.cc:260] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.870601 31808 raft_consensus.cc:493] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.871546 31808 raft_consensus.cc:3060] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.871965 31775 tablet_bootstrap.cc:492] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:00.872537 31777 ts_tablet_manager.cc:1434] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:29:00.872611 31775 ts_tablet_manager.cc:1403] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 12:29:00.873862 31777 tablet_bootstrap.cc:492] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.876245 31775 raft_consensus.cc:359] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.877056 31775 raft_consensus.cc:385] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.877410 31775 raft_consensus.cc:740] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.878295 31775 consensus_queue.cc:260] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.880462 31808 raft_consensus.cc:515] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.880990 31775 ts_tablet_manager.cc:1434] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:00.881701 31777 tablet_bootstrap.cc:654] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.882787 31808 leader_election.cc:290] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.883903 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5583615df9b4db682252b5f365e0857" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:00.884574 31584 raft_consensus.cc:3060] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.886935 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5583615df9b4db682252b5f365e0857" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:00.887852 31733 raft_consensus.cc:3060] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.891896 31777 tablet_bootstrap.cc:492] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.892513 31777 ts_tablet_manager.cc:1403] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.019s	user 0.001s	sys 0.015s
I20260709 12:29:00.895596 31777 raft_consensus.cc:359] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.896330 31777 raft_consensus.cc:385] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.896306 31733 raft_consensus.cc:2468] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:00.896981 31777 raft_consensus.cc:740] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.897835 31625 leader_election.cc:304] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:00.897861 31777 consensus_queue.cc:260] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.898900 31808 raft_consensus.cc:2804] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.899441 31808 raft_consensus.cc:697] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:00.900295 31808 consensus_queue.cc:237] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.902771 31584 raft_consensus.cc:2468] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:00.900260 31777 ts_tablet_manager.cc:1434] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:29:00.905817 31777 tablet_bootstrap.cc:492] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:00.912081 31777 tablet_bootstrap.cc:654] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.917886 31777 tablet_bootstrap.cc:492] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:00.918442 31777 ts_tablet_manager.cc:1403] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 12:29:00.918581 31481 catalog_manager.cc:5697] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.920680 31777 raft_consensus.cc:359] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:00.921293 31777 raft_consensus.cc:385] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.921525 31777 raft_consensus.cc:740] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.922184 31777 consensus_queue.cc:260] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:00.924091 31777 ts_tablet_manager.cc:1434] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:00.990520 31793 raft_consensus.cc:493] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.991240 31793 raft_consensus.cc:515] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:00.993237 31793 leader_election.cc:290] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:00.994379 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:00.994560 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:00.995617 31658 raft_consensus.cc:2393] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b36f77bba0f44e4e903422b337e9ba9b in current term 1: Already voted for candidate de66417897734488be5261c5177f95dc in this term.
I20260709 12:29:00.996683 31548 leader_election.cc:304] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b; no voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc
I20260709 12:29:00.997359 31793 raft_consensus.cc:3060] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.003587 31793 raft_consensus.cc:2749] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:01.019932 31808 raft_consensus.cc:493] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.020102 31811 raft_consensus.cc:493] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.020635 31808 raft_consensus.cc:515] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.020725 31811 raft_consensus.cc:515] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:01.022707 31808 leader_election.cc:290] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.022723 31811 leader_election.cc:290] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.023708 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:01.024049 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:01.024498 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:01.024571 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:01.024873 31585 raft_consensus.cc:2468] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:01.025465 31734 raft_consensus.cc:2468] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:01.026060 31624 leader_election.cc:304] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:01.026567 31733 raft_consensus.cc:2393] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 510046307b7e4418ad3a50b58f3ba982 in current term 1: Already voted for candidate b36f77bba0f44e4e903422b337e9ba9b in this term.
I20260709 12:29:01.027034 31811 raft_consensus.cc:2804] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.027486 31811 raft_consensus.cc:493] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.027801 31811 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.027642 31625 leader_election.cc:304] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982; no voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc
I20260709 12:29:01.028568 31808 raft_consensus.cc:3060] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.034224 31808 raft_consensus.cc:2749] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:01.034145 31811 raft_consensus.cc:515] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:01.036303 31811 leader_election.cc:290] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.037232 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:01.037353 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:01.037856 31585 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.037987 31733 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.043931 31585 raft_consensus.cc:2468] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:01.043931 31733 raft_consensus.cc:2468] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:01.045194 31624 leader_election.cc:304] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:01.046012 31811 raft_consensus.cc:2804] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.046129 31808 raft_consensus.cc:493] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.046612 31811 raft_consensus.cc:697] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:01.046794 31808 raft_consensus.cc:515] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.047462 31811 consensus_queue.cc:237] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:01.049006 31808 leader_election.cc:290] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.050014 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:01.050781 31585 raft_consensus.cc:2468] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:01.052213 31624 leader_election.cc:304] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:01.053131 31811 raft_consensus.cc:2804] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.052927 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:01.053530 31811 raft_consensus.cc:493] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.053841 31733 raft_consensus.cc:2468] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:01.053936 31811 raft_consensus.cc:3060] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.057367 31483 catalog_manager.cc:5697] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:01.063004 31811 raft_consensus.cc:515] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.065446 31811 leader_election.cc:290] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.066316 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:01.067088 31585 raft_consensus.cc:3060] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.067407 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:01.068065 31733 raft_consensus.cc:3060] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.075259 31585 raft_consensus.cc:2468] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:01.075623 31733 raft_consensus.cc:2468] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:01.076711 31624 leader_election.cc:304] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:01.077489 31811 raft_consensus.cc:2804] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.077976 31811 raft_consensus.cc:697] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:01.078905 31811 consensus_queue.cc:237] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.087185 31483 catalog_manager.cc:5697] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.111720 31805 raft_consensus.cc:493] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.112272 31805 raft_consensus.cc:515] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.114070 31805 leader_election.cc:290] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:01.114946 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a7390f649b448f819227c2358af4f9" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:01.115226 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a7390f649b448f819227c2358af4f9" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:01.115890 31585 raft_consensus.cc:2393] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de66417897734488be5261c5177f95dc in current term 1: Already voted for candidate 510046307b7e4418ad3a50b58f3ba982 in this term.
I20260709 12:29:01.116844 31698 leader_election.cc:304] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de66417897734488be5261c5177f95dc; no voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:01.117993 31784 raft_consensus.cc:3060] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.121016 31805 consensus_queue.cc:1048] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.125497 31835 consensus_queue.cc:1048] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.125938 31784 raft_consensus.cc:2749] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:01.161116 31793 consensus_queue.cc:1048] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.171571 31793 consensus_queue.cc:1048] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.231443 31585 raft_consensus.cc:3060] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.238759 31811 consensus_queue.cc:1048] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.250134 31811 consensus_queue.cc:1048] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.282817 31793 raft_consensus.cc:493] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.283457 31793 raft_consensus.cc:515] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.285396 31793 leader_election.cc:290] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.286494 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5706fbf1bb4c0d952b332e171bf929" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:01.286538 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5706fbf1bb4c0d952b332e171bf929" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:01.287282 31658 raft_consensus.cc:2468] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 0.
I20260709 12:29:01.287369 31733 raft_consensus.cc:2468] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 0.
I20260709 12:29:01.288486 31548 leader_election.cc:304] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:01.289213 31793 raft_consensus.cc:2804] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.289587 31793 raft_consensus.cc:493] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.289819 31793 raft_consensus.cc:3060] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.295361 31793 raft_consensus.cc:515] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.297283 31793 leader_election.cc:290] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.298236 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5706fbf1bb4c0d952b332e171bf929" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:01.298668 31733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5706fbf1bb4c0d952b332e171bf929" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:01.299023 31658 raft_consensus.cc:3060] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.299353 31733 raft_consensus.cc:3060] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.302795 31811 consensus_queue.cc:1048] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.306595 31658 raft_consensus.cc:2468] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 1.
I20260709 12:29:01.306795 31733 raft_consensus.cc:2468] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 1.
I20260709 12:29:01.308115 31548 leader_election.cc:304] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:01.309095 31793 raft_consensus.cc:2804] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.309624 31793 raft_consensus.cc:697] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:01.311928 31812 consensus_queue.cc:1048] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.311657 31793 consensus_queue.cc:237] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.320188 31812 consensus_queue.cc:1048] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.324993 31810 consensus_queue.cc:1048] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.347872 31780 consensus_queue.cc:1048] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.358282 31811 consensus_queue.cc:1048] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.365847 31481 catalog_manager.cc:5697] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 0 to 1, leader changed from <none> to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 1 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.476438 31811 consensus_queue.cc:1048] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.489650 31812 consensus_queue.cc:1048] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.508958 31658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
mode: GRACEFUL
new_leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:44408
I20260709 12:29:01.509573 31658 raft_consensus.cc:606] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Received request to transfer leadership to TS b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:01.515475 31658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70a7390f649b448f819227c2358af4f9"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
mode: GRACEFUL
new_leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:44408
I20260709 12:29:01.516047 31658 raft_consensus.cc:606] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Received request to transfer leadership to TS b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:01.533463 31734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f"
dest_uuid: "de66417897734488be5261c5177f95dc"
mode: GRACEFUL
new_leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:51722
I20260709 12:29:01.534176 31734 raft_consensus.cc:606] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Received request to transfer leadership to TS b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:01.543542 31812 consensus_queue.cc:1048] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.551432 31585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
mode: GRACEFUL
new_leader_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:33380
I20260709 12:29:01.552132 31585 raft_consensus.cc:606] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Received request to transfer leadership to TS 510046307b7e4418ad3a50b58f3ba982
I20260709 12:29:01.559587 31808 consensus_queue.cc:1048] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.571472 31811 raft_consensus.cc:993] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982: : Instructing follower b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:01.571995 31811 raft_consensus.cc:1081] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Signalling peer b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:01.572288 31585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
mode: GRACEFUL
new_leader_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:33380
I20260709 12:29:01.573017 31585 raft_consensus.cc:606] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Received request to transfer leadership to TS 510046307b7e4418ad3a50b58f3ba982
I20260709 12:29:01.573956 31584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:33374
I20260709 12:29:01.574671 31584 raft_consensus.cc:493] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:01.574998 31584 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.581049 31584 raft_consensus.cc:515] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:01.583755 31584 leader_election.cc:290] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Requested vote from peers de66417897734488be5261c5177f95dc (127.17.40.3:43611), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:01.583933 31658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
mode: GRACEFUL
new_leader_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:44408
I20260709 12:29:01.584581 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:01.584726 31658 raft_consensus.cc:606] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Received request to transfer leadership to TS de66417897734488be5261c5177f95dc
I20260709 12:29:01.585215 31734 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.586813 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:01.587520 31658 raft_consensus.cc:3055] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:01.587896 31658 raft_consensus.cc:740] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:01.588784 31658 consensus_queue.cc:260] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:01.589911 31658 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.591812 31734 raft_consensus.cc:2468] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:01.593096 31550 leader_election.cc:304] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:01.593840 31780 raft_consensus.cc:2804] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:01.594283 31780 raft_consensus.cc:697] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:01.595064 31780 consensus_queue.cc:237] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:01.595975 31658 raft_consensus.cc:2468] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:01.601727 31481 catalog_manager.cc:5697] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 1 to 2, leader changed from 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2) to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 2 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.666680 31780 raft_consensus.cc:993] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b: : Instructing follower 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:01.667320 31810 raft_consensus.cc:1081] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Signalling peer 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:01.669035 31658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:44400
I20260709 12:29:01.669641 31658 raft_consensus.cc:493] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:01.670075 31658 raft_consensus.cc:3060] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.675851 31658 raft_consensus.cc:515] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.677618 31658 leader_election.cc:290] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.678742 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:01.678870 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43befabd185e4bac8552e94d3ea7cf95" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:01.679428 31584 raft_consensus.cc:3055] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:01.679569 31734 raft_consensus.cc:3060] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.679764 31584 raft_consensus.cc:740] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:01.680565 31584 consensus_queue.cc:260] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.681610 31584 raft_consensus.cc:3060] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.685803 31734 raft_consensus.cc:2468] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:01.687090 31625 leader_election.cc:304] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:01.687189 31584 raft_consensus.cc:2468] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:01.687914 31808 raft_consensus.cc:2804] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:01.688457 31808 raft_consensus.cc:697] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:01.689297 31808 consensus_queue.cc:237] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.695828 31483 catalog_manager.cc:5697] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 1 to 2, leader changed from b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1) to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.739763 31805 raft_consensus.cc:993] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc: : Instructing follower b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:01.740212 31860 raft_consensus.cc:1081] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Signalling peer b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:01.741904 31584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:33364
I20260709 12:29:01.742556 31584 raft_consensus.cc:493] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:01.742902 31584 raft_consensus.cc:3060] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.748974 31584 raft_consensus.cc:515] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.751195 31584 leader_election.cc:290] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.751379 31780 consensus_queue.cc:1048] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.751938 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:01.752635 31658 raft_consensus.cc:3060] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.752813 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ab25c254fc4c61b6e53ead6c80df7f" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:01.753450 31734 raft_consensus.cc:3055] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:01.753829 31734 raft_consensus.cc:740] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:01.754719 31734 consensus_queue.cc:260] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.756090 31734 raft_consensus.cc:3060] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.762805 31658 raft_consensus.cc:2468] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:01.764394 31548 leader_election.cc:304] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:01.764566 31734 raft_consensus.cc:2468] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:01.765440 31793 raft_consensus.cc:2804] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:01.765988 31793 raft_consensus.cc:697] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:01.766885 31793 consensus_queue.cc:237] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.776100 31780 consensus_queue.cc:1048] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.777491 31481 catalog_manager.cc:5697] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 1 to 2, leader changed from de66417897734488be5261c5177f95dc (127.17.40.3) to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 2 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.889596 31793 raft_consensus.cc:993] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b: : Instructing follower 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:01.890168 31780 raft_consensus.cc:1081] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Signalling peer 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:01.891721 31658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:44400
I20260709 12:29:01.892263 31658 raft_consensus.cc:493] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:01.892601 31658 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.898509 31658 raft_consensus.cc:515] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.900352 31658 leader_election.cc:290] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.901358 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:01.901432 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:01.902172 31584 raft_consensus.cc:3055] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:01.902221 31732 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.902582 31584 raft_consensus.cc:740] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:01.903416 31584 consensus_queue.cc:260] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.904465 31584 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.909346 31732 raft_consensus.cc:2468] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:01.910742 31584 raft_consensus.cc:2468] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:01.910893 31625 leader_election.cc:304] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:01.912147 31808 raft_consensus.cc:2804] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:01.912669 31808 raft_consensus.cc:697] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:01.913543 31808 consensus_queue.cc:237] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.920351 31481 catalog_manager.cc:5697] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 1 to 2, leader changed from b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1) to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.923233 31779 raft_consensus.cc:993] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982: : Instructing follower b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:01.923759 31808 raft_consensus.cc:1081] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Signalling peer b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:01.925544 31584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70a7390f649b448f819227c2358af4f9"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:33374
I20260709 12:29:01.926115 31584 raft_consensus.cc:493] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:01.926505 31584 raft_consensus.cc:3060] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.932790 31584 raft_consensus.cc:515] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.934798 31584 leader_election.cc:290] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:01.935765 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a7390f649b448f819227c2358af4f9" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:01.936019 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a7390f649b448f819227c2358af4f9" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:01.936520 31658 raft_consensus.cc:3055] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:01.936659 31732 raft_consensus.cc:3060] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.936848 31658 raft_consensus.cc:740] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:01.937675 31658 consensus_queue.cc:260] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.938786 31658 raft_consensus.cc:3060] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.942950 31732 raft_consensus.cc:2468] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:01.944206 31550 leader_election.cc:304] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:01.944882 31658 raft_consensus.cc:2468] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:01.945008 31780 raft_consensus.cc:2804] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:01.945648 31780 raft_consensus.cc:697] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:01.946584 31780 consensus_queue.cc:237] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:01.953315 31481 catalog_manager.cc:5697] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 1 to 2, leader changed from 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2) to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 2 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.990132 31808 raft_consensus.cc:993] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982: : Instructing follower de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:01.990686 31811 raft_consensus.cc:1081] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Signalling peer de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:01.992322 31732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89"
dest_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:51712
I20260709 12:29:01.992806 31732 raft_consensus.cc:493] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:01.993067 31732 raft_consensus.cc:3060] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:01.998612 31732 raft_consensus.cc:515] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:02.000487 31732 leader_election.cc:290] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 2 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:02.001503 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:02.001686 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4184a4339224d88ae793b9927dc3e89" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:02.002205 31584 raft_consensus.cc:3060] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:02.002360 31658 raft_consensus.cc:3055] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:02.002861 31658 raft_consensus.cc:740] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:02.003630 31658 consensus_queue.cc:260] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:02.004676 31658 raft_consensus.cc:3060] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:02.008360 31584 raft_consensus.cc:2468] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 2.
I20260709 12:29:02.009832 31698 leader_election.cc:304] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:02.010807 31860 raft_consensus.cc:2804] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:02.011296 31860 raft_consensus.cc:697] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 2 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:02.012079 31860 consensus_queue.cc:237] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:02.012367 31658 raft_consensus.cc:2468] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 2.
I20260709 12:29:02.019376 31481 catalog_manager.cc:5697] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc reported cstate change: term changed from 1 to 2, leader changed from 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2) to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 2 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:02.136722 31732 raft_consensus.cc:1275] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.138368 31780 consensus_queue.cc:1048] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:02.147785 31658 raft_consensus.cc:1275] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.149343 31793 consensus_queue.cc:1048] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:02.208070 31732 raft_consensus.cc:1275] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.209616 31811 consensus_queue.cc:1048] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:02.219571 31584 raft_consensus.cc:1275] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.221422 31779 consensus_queue.cc:1048] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:02.243301 31732 raft_consensus.cc:1275] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.244611 31863 consensus_queue.cc:1048] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:02.253670 31658 raft_consensus.cc:1275] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.255218 31780 consensus_queue.cc:1048] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:02.337076 31732 raft_consensus.cc:1275] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.338476 31780 consensus_queue.cc:1048] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:02.348407 31732 raft_consensus.cc:1275] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.349251 31658 raft_consensus.cc:1275] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.351078 31779 consensus_queue.cc:1048] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:02.354979 31780 consensus_queue.cc:1048] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:02.360785 31584 raft_consensus.cc:1275] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.362433 31811 consensus_queue.cc:1048] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:02.451848 31584 raft_consensus.cc:1275] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.453260 31860 consensus_queue.cc:1048] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:02.466145 31658 raft_consensus.cc:1275] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:02.467770 31870 consensus_queue.cc:1048] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:04.623044 31481 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56232:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:04.626075 31481 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:04.687969 31569 tablet_service.cc:1511] Processing CreateTablet for tablet 717d49f93ddd4476b03c76d7340bddbf (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:04.689566 31650 tablet_service.cc:1511] Processing CreateTablet for tablet 717d49f93ddd4476b03c76d7340bddbf (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:04.690122 31569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717d49f93ddd4476b03c76d7340bddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.691569 31650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717d49f93ddd4476b03c76d7340bddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.694051 31573 tablet_service.cc:1511] Processing CreateTablet for tablet cee34c38f7664cdcaead4b8d09fd5a9a (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:04.695600 31573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee34c38f7664cdcaead4b8d09fd5a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.695322 31649 tablet_service.cc:1511] Processing CreateTablet for tablet cee34c38f7664cdcaead4b8d09fd5a9a (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:04.696923 31649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee34c38f7664cdcaead4b8d09fd5a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.691135 31724 tablet_service.cc:1511] Processing CreateTablet for tablet 717d49f93ddd4476b03c76d7340bddbf (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:04.700251 31716 tablet_service.cc:1511] Processing CreateTablet for tablet cee34c38f7664cdcaead4b8d09fd5a9a (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:04.702545 31648 tablet_service.cc:1511] Processing CreateTablet for tablet e1b356218f8b435eb7ee7a57e13aede9 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:04.701064 31724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717d49f93ddd4476b03c76d7340bddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.705865 31645 tablet_service.cc:1511] Processing CreateTablet for tablet d665386737814fe683a902bfccdb1633 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:04.704107 31648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b356218f8b435eb7ee7a57e13aede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.702214 31722 tablet_service.cc:1511] Processing CreateTablet for tablet e1b356218f8b435eb7ee7a57e13aede9 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:04.708719 31570 tablet_service.cc:1511] Processing CreateTablet for tablet e1b356218f8b435eb7ee7a57e13aede9 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:04.710122 31722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b356218f8b435eb7ee7a57e13aede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.710870 31645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d665386737814fe683a902bfccdb1633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.714260 31719 tablet_service.cc:1511] Processing CreateTablet for tablet d665386737814fe683a902bfccdb1633 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:04.714706 31571 tablet_service.cc:1511] Processing CreateTablet for tablet d665386737814fe683a902bfccdb1633 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:04.711138 31570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b356218f8b435eb7ee7a57e13aede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.716682 31571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d665386737814fe683a902bfccdb1633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.720996 31721 tablet_service.cc:1511] Processing CreateTablet for tablet db67e90c69e245209ef7aa9651bfb757 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:04.717861 31646 tablet_service.cc:1511] Processing CreateTablet for tablet db67e90c69e245209ef7aa9651bfb757 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:04.722939 31646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db67e90c69e245209ef7aa9651bfb757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.722627 31644 tablet_service.cc:1511] Processing CreateTablet for tablet 7005f7d51f204cb4a0132e30896b206f (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:04.724123 31644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7005f7d51f204cb4a0132e30896b206f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.725569 31723 tablet_service.cc:1511] Processing CreateTablet for tablet 7005f7d51f204cb4a0132e30896b206f (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:04.711688 31716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee34c38f7664cdcaead4b8d09fd5a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.727818 31721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db67e90c69e245209ef7aa9651bfb757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.730382 31723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7005f7d51f204cb4a0132e30896b206f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.733412 31647 tablet_service.cc:1511] Processing CreateTablet for tablet 86275b8d3aab4998af2d57417ea3f6bf (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:04.734757 31720 tablet_service.cc:1511] Processing CreateTablet for tablet 86275b8d3aab4998af2d57417ea3f6bf (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:04.736246 31720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86275b8d3aab4998af2d57417ea3f6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.735782 31643 tablet_service.cc:1511] Processing CreateTablet for tablet b95cf809e17243c4bae29b2942c36ad4 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:04.737973 31642 tablet_service.cc:1511] Processing CreateTablet for tablet 872994a823eb4662b699606a33f0a9ad (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:04.738519 31643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95cf809e17243c4bae29b2942c36ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.741374 31719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d665386737814fe683a902bfccdb1633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.744077 31642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872994a823eb4662b699606a33f0a9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.745862 31647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86275b8d3aab4998af2d57417ea3f6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.741937 31717 tablet_service.cc:1511] Processing CreateTablet for tablet b95cf809e17243c4bae29b2942c36ad4 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:04.748363 31717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95cf809e17243c4bae29b2942c36ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.745682 31718 tablet_service.cc:1511] Processing CreateTablet for tablet 872994a823eb4662b699606a33f0a9ad (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:04.751557 31718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872994a823eb4662b699606a33f0a9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.768625 31572 tablet_service.cc:1511] Processing CreateTablet for tablet db67e90c69e245209ef7aa9651bfb757 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:04.770423 31572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db67e90c69e245209ef7aa9651bfb757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.793213 31574 tablet_service.cc:1511] Processing CreateTablet for tablet 7005f7d51f204cb4a0132e30896b206f (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:04.795096 31574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7005f7d51f204cb4a0132e30896b206f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.817449 31568 tablet_service.cc:1511] Processing CreateTablet for tablet 86275b8d3aab4998af2d57417ea3f6bf (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:04.819133 31568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86275b8d3aab4998af2d57417ea3f6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.823882 31567 tablet_service.cc:1511] Processing CreateTablet for tablet b95cf809e17243c4bae29b2942c36ad4 (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:04.825457 31567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95cf809e17243c4bae29b2942c36ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.827852 31575 tablet_service.cc:1511] Processing CreateTablet for tablet 872994a823eb4662b699606a33f0a9ad (DEFAULT_TABLE table=soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:04.829403 31575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872994a823eb4662b699606a33f0a9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.899328 31886 tablet_bootstrap.cc:492] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc: Bootstrap starting.
W20260709 12:29:04.899834 31625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:43611, user_credentials={real_user=slave}} blocked reactor thread for 80321.6us
I20260709 12:29:04.951407 31890 tablet_bootstrap.cc:492] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:04.956614 31889 tablet_bootstrap.cc:492] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:04.967098 31889 tablet_bootstrap.cc:654] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.971361 31890 tablet_bootstrap.cc:654] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.975704 31886 tablet_bootstrap.cc:654] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.997502 31889 tablet_bootstrap.cc:492] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:04.998152 31889 ts_tablet_manager.cc:1403] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.017s
I20260709 12:29:04.998827 31890 tablet_bootstrap.cc:492] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:04.999094 31886 tablet_bootstrap.cc:492] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:04.999475 31890 ts_tablet_manager.cc:1403] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.005s
I20260709 12:29:04.999714 31886 ts_tablet_manager.cc:1403] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.008s
I20260709 12:29:05.001798 31889 raft_consensus.cc:359] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.002910 31889 raft_consensus.cc:385] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.003324 31889 raft_consensus.cc:740] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.003057 31886 raft_consensus.cc:359] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.004036 31886 raft_consensus.cc:385] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.004382 31886 raft_consensus.cc:740] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.004278 31889 consensus_queue.cc:260] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.005271 31890 raft_consensus.cc:359] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.005473 31886 consensus_queue.cc:260] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.006126 31890 raft_consensus.cc:385] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.006503 31890 raft_consensus.cc:740] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.007758 31890 consensus_queue.cc:260] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.008944 31886 ts_tablet_manager.cc:1434] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:29:05.010267 31886 tablet_bootstrap.cc:492] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:05.011055 31890 ts_tablet_manager.cc:1434] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:29:05.011554 31889 ts_tablet_manager.cc:1434] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.007s
I20260709 12:29:05.012416 31890 tablet_bootstrap.cc:492] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:05.012764 31889 tablet_bootstrap.cc:492] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:05.014662 31888 raft_consensus.cc:493] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.015322 31888 raft_consensus.cc:515] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.020978 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:05.022276 31886 tablet_bootstrap.cc:654] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:05.023257 31550 leader_election.cc:343] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.023689 31890 tablet_bootstrap.cc:654] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.023988 31888 leader_election.cc:290] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.025846 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
W20260709 12:29:05.028646 31548 leader_election.cc:343] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.029332 31548 leader_election.cc:304] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b; no voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc
I20260709 12:29:05.031795 31889 tablet_bootstrap.cc:654] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.037271 31888 raft_consensus.cc:2749] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.045331 31889 tablet_bootstrap.cc:492] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:05.046015 31889 ts_tablet_manager.cc:1403] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.007s
I20260709 12:29:05.042330 31890 tablet_bootstrap.cc:492] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:05.049625 31890 ts_tablet_manager.cc:1403] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.004s
I20260709 12:29:05.049412 31889 raft_consensus.cc:359] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.050203 31889 raft_consensus.cc:385] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.050653 31889 raft_consensus.cc:740] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.051472 31889 consensus_queue.cc:260] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.053273 31890 raft_consensus.cc:359] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.054111 31889 ts_tablet_manager.cc:1434] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:05.054452 31890 raft_consensus.cc:385] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.054809 31890 raft_consensus.cc:740] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.055688 31889 tablet_bootstrap.cc:492] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:05.055600 31890 consensus_queue.cc:260] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.058583 31890 ts_tablet_manager.cc:1434] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:29:05.059829 31890 tablet_bootstrap.cc:492] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:05.064282 31889 tablet_bootstrap.cc:654] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.069779 31890 tablet_bootstrap.cc:654] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.076449 31886 tablet_bootstrap.cc:492] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:05.077028 31886 ts_tablet_manager.cc:1403] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.032s
I20260709 12:29:05.080312 31886 raft_consensus.cc:359] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.081116 31886 raft_consensus.cc:385] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.081413 31886 raft_consensus.cc:740] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.082201 31886 consensus_queue.cc:260] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.084233 31890 tablet_bootstrap.cc:492] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:05.084758 31886 ts_tablet_manager.cc:1434] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:05.085062 31890 ts_tablet_manager.cc:1403] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.005s
I20260709 12:29:05.085886 31886 tablet_bootstrap.cc:492] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:05.089473 31890 raft_consensus.cc:359] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.090359 31890 raft_consensus.cc:385] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.090731 31890 raft_consensus.cc:740] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.091681 31890 consensus_queue.cc:260] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.092262 31889 tablet_bootstrap.cc:492] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:05.092986 31889 ts_tablet_manager.cc:1403] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.016s
I20260709 12:29:05.094581 31890 ts_tablet_manager.cc:1434] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.007s
I20260709 12:29:05.095772 31890 tablet_bootstrap.cc:492] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:05.096729 31889 raft_consensus.cc:359] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.097635 31889 raft_consensus.cc:385] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.098011 31889 raft_consensus.cc:740] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.098855 31889 consensus_queue.cc:260] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.103283 31886 tablet_bootstrap.cc:654] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.103754 31890 tablet_bootstrap.cc:654] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.104270 31889 ts_tablet_manager.cc:1434] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:29:05.105569 31889 tablet_bootstrap.cc:492] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:05.118125 31889 tablet_bootstrap.cc:654] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.120950 31890 tablet_bootstrap.cc:492] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:05.121676 31890 ts_tablet_manager.cc:1403] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:29:05.124446 31890 raft_consensus.cc:359] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.124953 31886 tablet_bootstrap.cc:492] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:05.125105 31890 raft_consensus.cc:385] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.125772 31890 raft_consensus.cc:740] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.125900 31886 ts_tablet_manager.cc:1403] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.004s
I20260709 12:29:05.127039 31890 consensus_queue.cc:260] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.128084 31889 tablet_bootstrap.cc:492] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:05.128685 31889 ts_tablet_manager.cc:1403] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 12:29:05.129240 31890 ts_tablet_manager.cc:1434] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:05.130621 31890 tablet_bootstrap.cc:492] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:05.131361 31886 raft_consensus.cc:359] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.131771 31889 raft_consensus.cc:359] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.132512 31886 raft_consensus.cc:385] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.132607 31889 raft_consensus.cc:385] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.132895 31886 raft_consensus.cc:740] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.133100 31889 raft_consensus.cc:740] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.133908 31886 consensus_queue.cc:260] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.134142 31889 consensus_queue.cc:260] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.137097 31886 ts_tablet_manager.cc:1434] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:29:05.137189 31889 ts_tablet_manager.cc:1434] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:29:05.138296 31886 tablet_bootstrap.cc:492] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:05.140982 31889 tablet_bootstrap.cc:492] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:05.142604 31890 tablet_bootstrap.cc:654] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.154986 31886 tablet_bootstrap.cc:654] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.159722 31889 tablet_bootstrap.cc:654] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.167198 31890 tablet_bootstrap.cc:492] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:05.168381 31890 ts_tablet_manager.cc:1403] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.026s
I20260709 12:29:05.169368 31889 tablet_bootstrap.cc:492] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:05.170018 31889 ts_tablet_manager.cc:1403] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.002s
I20260709 12:29:05.171612 31886 tablet_bootstrap.cc:492] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:05.172276 31886 ts_tablet_manager.cc:1403] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.015s
I20260709 12:29:05.172243 31890 raft_consensus.cc:359] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.173331 31890 raft_consensus.cc:385] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.173015 31889 raft_consensus.cc:359] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.173730 31890 raft_consensus.cc:740] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.173945 31889 raft_consensus.cc:385] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.174317 31889 raft_consensus.cc:740] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.174830 31890 consensus_queue.cc:260] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.175222 31889 consensus_queue.cc:260] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.176097 31886 raft_consensus.cc:359] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.176934 31886 raft_consensus.cc:385] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.177244 31886 raft_consensus.cc:740] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.178131 31889 ts_tablet_manager.cc:1434] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:05.178202 31890 ts_tablet_manager.cc:1434] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:29:05.178282 31886 consensus_queue.cc:260] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.179441 31889 tablet_bootstrap.cc:492] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:05.180259 31890 tablet_bootstrap.cc:492] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:05.184523 31886 ts_tablet_manager.cc:1434] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:29:05.186020 31886 tablet_bootstrap.cc:492] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:05.187216 31889 tablet_bootstrap.cc:654] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.189363 31890 tablet_bootstrap.cc:654] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.201565 31887 raft_consensus.cc:493] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.202422 31886 tablet_bootstrap.cc:654] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.202191 31887 raft_consensus.cc:515] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.204053 31889 tablet_bootstrap.cc:492] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:05.204684 31889 ts_tablet_manager.cc:1403] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:29:05.206960 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.208009 31584 raft_consensus.cc:2468] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:05.208073 31889 raft_consensus.cc:359] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.209015 31889 raft_consensus.cc:385] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.209331 31889 raft_consensus.cc:740] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.210367 31889 consensus_queue.cc:260] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.210675 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:05.213282 31889 ts_tablet_manager.cc:1434] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.007s
I20260709 12:29:05.213480 31624 leader_election.cc:304] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:05.215164 31885 raft_consensus.cc:2804] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.215687 31885 raft_consensus.cc:493] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.216135 31885 raft_consensus.cc:3060] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:05.219410 31625 leader_election.cc:343] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.220078 31889 tablet_bootstrap.cc:492] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:05.220407 31887 leader_election.cc:290] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.224721 31886 tablet_bootstrap.cc:492] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:05.225381 31886 ts_tablet_manager.cc:1403] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.008s
I20260709 12:29:05.227200 31890 tablet_bootstrap.cc:492] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:05.227818 31890 ts_tablet_manager.cc:1403] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.008s
I20260709 12:29:05.228936 31886 raft_consensus.cc:359] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.229641 31889 tablet_bootstrap.cc:654] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.229807 31886 raft_consensus.cc:385] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.230208 31886 raft_consensus.cc:740] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.231227 31886 consensus_queue.cc:260] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.234205 31886 ts_tablet_manager.cc:1434] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.001s
I20260709 12:29:05.234475 31890 raft_consensus.cc:359] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.235282 31890 raft_consensus.cc:385] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.235409 31886 tablet_bootstrap.cc:492] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:05.235607 31890 raft_consensus.cc:740] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.234210 31885 raft_consensus.cc:515] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.239547 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.240281 31584 raft_consensus.cc:3060] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.241945 31889 tablet_bootstrap.cc:492] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:05.242594 31889 ts_tablet_manager.cc:1403] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.015s
I20260709 12:29:05.243463 31886 tablet_bootstrap.cc:654] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.245929 31889 raft_consensus.cc:359] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.246783 31889 raft_consensus.cc:385] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.247080 31889 raft_consensus.cc:740] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.248081 31889 consensus_queue.cc:260] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.251303 31889 ts_tablet_manager.cc:1434] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:29:05.250824 31890 consensus_queue.cc:260] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.252497 31889 tablet_bootstrap.cc:492] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:05.254421 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:05.256006 31886 tablet_bootstrap.cc:492] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
W20260709 12:29:05.256172 31625 leader_election.cc:343] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.256825 31885 leader_election.cc:290] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.259682 31890 ts_tablet_manager.cc:1434] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.005s
I20260709 12:29:05.259750 31889 tablet_bootstrap.cc:654] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.262432 31886 ts_tablet_manager.cc:1403] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.007s
I20260709 12:29:05.265547 31584 raft_consensus.cc:2468] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:05.266175 31886 raft_consensus.cc:359] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.267035 31886 raft_consensus.cc:385] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.267340 31886 raft_consensus.cc:740] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.268414 31886 consensus_queue.cc:260] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.270345 31624 leader_election.cc:304] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: de66417897734488be5261c5177f95dc
I20260709 12:29:05.271252 31886 ts_tablet_manager.cc:1434] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:29:05.271837 31885 raft_consensus.cc:2804] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.272734 31885 raft_consensus.cc:697] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:05.273610 31886 tablet_bootstrap.cc:492] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:05.274538 31890 tablet_bootstrap.cc:492] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:05.278975 31808 raft_consensus.cc:493] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.279561 31808 raft_consensus.cc:515] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.281469 31808 leader_election.cc:290] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.281574 31886 tablet_bootstrap.cc:654] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.273651 31885 consensus_queue.cc:237] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.283161 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cf809e17243c4bae29b2942c36ad4" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.283794 31808 raft_consensus.cc:493] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.283934 31585 raft_consensus.cc:2468] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:05.284466 31808 raft_consensus.cc:515] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.285377 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cf809e17243c4bae29b2942c36ad4" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:05.286330 31734 raft_consensus.cc:2468] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:05.287420 31624 leader_election.cc:304] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:05.289393 31808 leader_election.cc:290] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.290323 31808 raft_consensus.cc:2804] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.291469 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.291926 31889 tablet_bootstrap.cc:492] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:05.293555 31889 ts_tablet_manager.cc:1403] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.010s
W20260709 12:29:05.293728 31624 leader_election.cc:343] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.295089 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
W20260709 12:29:05.297235 31625 leader_election.cc:343] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de66417897734488be5261c5177f95dc (127.17.40.3:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.297876 31625 leader_election.cc:304] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982; no voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc
I20260709 12:29:05.298142 31889 raft_consensus.cc:359] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.299530 31887 raft_consensus.cc:2749] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.292328 31808 raft_consensus.cc:493] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.299360 31889 raft_consensus.cc:385] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.302584 31889 raft_consensus.cc:740] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.301764 31808 raft_consensus.cc:3060] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.303894 31889 consensus_queue.cc:260] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.310549 31890 tablet_bootstrap.cc:654] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.316586 31886 tablet_bootstrap.cc:492] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:05.317174 31886 ts_tablet_manager.cc:1403] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.025s
I20260709 12:29:05.319867 31889 ts_tablet_manager.cc:1434] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:29:05.320415 31886 raft_consensus.cc:359] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.321115 31889 tablet_bootstrap.cc:492] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b: Bootstrap starting.
I20260709 12:29:05.321249 31886 raft_consensus.cc:385] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.321767 31886 raft_consensus.cc:740] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.322456 31888 raft_consensus.cc:493] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.322718 31886 consensus_queue.cc:260] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.322995 31888 raft_consensus.cc:515] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.324446 31808 raft_consensus.cc:515] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.325269 31888 leader_election.cc:290] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.327047 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:05.327342 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cf809e17243c4bae29b2942c36ad4" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.327811 31734 raft_consensus.cc:2468] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 0.
I20260709 12:29:05.328029 31584 raft_consensus.cc:3060] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.328430 31886 ts_tablet_manager.cc:1434] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:29:05.329569 31886 tablet_bootstrap.cc:492] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:05.330003 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:05.331676 31550 leader_election.cc:304] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
W20260709 12:29:05.333220 31548 leader_election.cc:343] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.334537 31888 raft_consensus.cc:2804] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.335227 31888 raft_consensus.cc:493] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.335613 31888 raft_consensus.cc:3060] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.336308 31584 raft_consensus.cc:2468] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:05.337556 31624 leader_election.cc:304] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:05.338528 31887 raft_consensus.cc:2804] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.339072 31887 raft_consensus.cc:697] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:05.340094 31887 consensus_queue.cc:237] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.341075 31886 tablet_bootstrap.cc:654] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.342906 31808 leader_election.cc:290] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.345767 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cf809e17243c4bae29b2942c36ad4" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:05.346542 31734 raft_consensus.cc:3060] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.346956 31886 tablet_bootstrap.cc:492] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:05.346956 31890 tablet_bootstrap.cc:492] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:05.347754 31886 ts_tablet_manager.cc:1403] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:29:05.347783 31890 ts_tablet_manager.cc:1403] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.003s
I20260709 12:29:05.350991 31886 raft_consensus.cc:359] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.351240 31890 raft_consensus.cc:359] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.351799 31886 raft_consensus.cc:385] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.351987 31890 raft_consensus.cc:385] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.352140 31886 raft_consensus.cc:740] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.352329 31890 raft_consensus.cc:740] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.352981 31886 consensus_queue.cc:260] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.353408 31890 consensus_queue.cc:260] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.356343 31890 ts_tablet_manager.cc:1434] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:05.356222 31734 raft_consensus.cc:2468] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:05.357627 31890 tablet_bootstrap.cc:492] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:05.361905 31873 raft_consensus.cc:493] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.362627 31873 raft_consensus.cc:515] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.365725 31873 leader_election.cc:290] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.365908 31890 tablet_bootstrap.cc:654] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.366667 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.367628 31584 raft_consensus.cc:2468] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.368091 31808 raft_consensus.cc:493] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.368705 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:05.368647 31808 raft_consensus.cc:515] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.369370 31658 raft_consensus.cc:2468] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.369987 31886 ts_tablet_manager.cc:1434] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:29:05.371135 31808 leader_election.cc:290] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.372406 31697 leader_election.cc:304] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.373179 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:05.373869 31886 tablet_bootstrap.cc:492] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: Bootstrap starting.
I20260709 12:29:05.373932 31732 raft_consensus.cc:2468] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:05.374502 31873 raft_consensus.cc:2804] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.374918 31873 raft_consensus.cc:493] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.375290 31873 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.375741 31625 leader_election.cc:304] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.377910 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.378844 31584 raft_consensus.cc:2468] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 0.
I20260709 12:29:05.378859 31808 raft_consensus.cc:2804] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.381223 31808 raft_consensus.cc:493] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.381656 31808 raft_consensus.cc:3060] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.384341 31890 tablet_bootstrap.cc:492] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:05.384913 31890 ts_tablet_manager.cc:1403] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.003s
I20260709 12:29:05.385690 31888 raft_consensus.cc:515] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.388588 31888 leader_election.cc:290] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.389635 31886 tablet_bootstrap.cc:654] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.389781 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:05.390627 31734 raft_consensus.cc:3060] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.391456 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
W20260709 12:29:05.392942 31548 leader_election.cc:343] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.392885 31890 raft_consensus.cc:359] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.394125 31890 raft_consensus.cc:385] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.394515 31890 raft_consensus.cc:740] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.395447 31890 consensus_queue.cc:260] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.398866 31734 raft_consensus.cc:2468] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 1.
I20260709 12:29:05.394660 31481 catalog_manager.cc:5697] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.401450 31808 raft_consensus.cc:515] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.402774 31886 tablet_bootstrap.cc:492] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: No bootstrap required, opened a new log
I20260709 12:29:05.403319 31886 ts_tablet_manager.cc:1403] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.011s
I20260709 12:29:05.403785 31808 leader_election.cc:290] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.404601 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.404924 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:05.405153 31890 ts_tablet_manager.cc:1434] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:29:05.405249 31584 raft_consensus.cc:3060] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.406279 31890 tablet_bootstrap.cc:492] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982: Bootstrap starting.
I20260709 12:29:05.406322 31886 raft_consensus.cc:359] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.407150 31886 raft_consensus.cc:385] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.407411 31886 raft_consensus.cc:740] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.405535 31732 raft_consensus.cc:3060] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.408195 31886 consensus_queue.cc:260] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.410051 31550 leader_election.cc:304] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 510046307b7e4418ad3a50b58f3ba982
I20260709 12:29:05.411857 31888 raft_consensus.cc:2804] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.412358 31888 raft_consensus.cc:697] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:05.413194 31888 consensus_queue.cc:237] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.419394 31889 tablet_bootstrap.cc:654] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.423168 31584 raft_consensus.cc:2468] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:05.425580 31886 ts_tablet_manager.cc:1434] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.009s
I20260709 12:29:05.425449 31624 leader_election.cc:304] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:05.426913 31808 raft_consensus.cc:2804] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.427605 31808 raft_consensus.cc:697] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:05.431288 31873 raft_consensus.cc:515] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.431391 31808 consensus_queue.cc:237] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.433367 31890 tablet_bootstrap.cc:654] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.429754 31732 raft_consensus.cc:2468] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 1.
I20260709 12:29:05.436723 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.437314 31584 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.440876 31873 leader_election.cc:290] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.441162 31920 raft_consensus.cc:493] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.441922 31920 raft_consensus.cc:515] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.444823 31920 leader_election.cc:290] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.445395 31920 raft_consensus.cc:493] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.445634 31584 raft_consensus.cc:2468] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.445832 31920 raft_consensus.cc:515] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.447037 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.447383 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:05.447681 31584 raft_consensus.cc:2468] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.448012 31658 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.448364 31920 leader_election.cc:290] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.448760 31482 catalog_manager.cc:5697] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 0 to 1, leader changed from <none> to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 1 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.450102 31698 leader_election.cc:304] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.450452 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d665386737814fe683a902bfccdb1633" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.451164 31584 raft_consensus.cc:2468] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.451567 31920 raft_consensus.cc:2804] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.451467 31698 leader_election.cc:304] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.452160 31920 raft_consensus.cc:697] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:05.452682 31698 leader_election.cc:304] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.453019 31656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d665386737814fe683a902bfccdb1633" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:05.453620 31873 raft_consensus.cc:2804] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.453907 31656 raft_consensus.cc:2468] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.454073 31873 raft_consensus.cc:493] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.456086 31873 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.453145 31920 consensus_queue.cc:237] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.453006 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:05.468400 31657 raft_consensus.cc:2468] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.491467 31658 raft_consensus.cc:2468] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.496624 31889 tablet_bootstrap.cc:492] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b: No bootstrap required, opened a new log
I20260709 12:29:05.497293 31889 ts_tablet_manager.cc:1403] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b: Time spent bootstrapping tablet: real 0.176s	user 0.019s	sys 0.004s
I20260709 12:29:05.494338 31920 raft_consensus.cc:2804] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.496681 31925 raft_consensus.cc:493] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.499418 31920 raft_consensus.cc:493] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.502789 31920 raft_consensus.cc:3060] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.506440 31924 raft_consensus.cc:493] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.504666 31890 tablet_bootstrap.cc:492] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982: No bootstrap required, opened a new log
I20260709 12:29:05.507298 31890 ts_tablet_manager.cc:1403] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982: Time spent bootstrapping tablet: real 0.101s	user 0.018s	sys 0.019s
I20260709 12:29:05.507028 31924 raft_consensus.cc:515] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.509918 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67e90c69e245209ef7aa9651bfb757" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.510547 31584 raft_consensus.cc:2468] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.510486 31890 raft_consensus.cc:359] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.511354 31890 raft_consensus.cc:385] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.511656 31890 raft_consensus.cc:740] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.512044 31698 leader_election.cc:304] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.512420 31890 consensus_queue.cc:260] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.505959 31873 raft_consensus.cc:515] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.505283 31925 raft_consensus.cc:515] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.519287 31890 ts_tablet_manager.cc:1434] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:29:05.521797 31873 leader_election.cc:290] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.522583 31873 raft_consensus.cc:2804] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.523473 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67e90c69e245209ef7aa9651bfb757" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:05.522965 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:05.524009 31658 raft_consensus.cc:2468] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.524550 31657 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.524197 31920 raft_consensus.cc:515] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.525542 31924 leader_election.cc:290] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.527562 31920 leader_election.cc:290] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.528650 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d665386737814fe683a902bfccdb1633" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:05.528918 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.529332 31658 raft_consensus.cc:3060] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.529592 31584 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.523103 31889 raft_consensus.cc:359] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.530805 31889 raft_consensus.cc:385] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.531107 31889 raft_consensus.cc:740] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.531844 31889 consensus_queue.cc:260] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.533288 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d665386737814fe683a902bfccdb1633" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.522979 31873 raft_consensus.cc:493] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.534338 31585 raft_consensus.cc:3060] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.534991 31873 raft_consensus.cc:3060] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.541226 31658 raft_consensus.cc:2468] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.542619 31697 leader_election.cc:304] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.544238 31920 raft_consensus.cc:2804] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.544795 31920 raft_consensus.cc:697] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:05.545877 31925 leader_election.cc:290] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.545696 31920 consensus_queue.cc:237] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.543125 31889 ts_tablet_manager.cc:1434] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.006s
I20260709 12:29:05.549129 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:05.542241 31657 raft_consensus.cc:2468] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.552358 31584 raft_consensus.cc:2468] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.554687 31697 leader_election.cc:304] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
W20260709 12:29:05.556972 31531 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:05.557677 31924 raft_consensus.cc:493] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.558284 31924 raft_consensus.cc:515] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.561456 31924 leader_election.cc:290] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.563294 31583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.564441 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982" is_pre_election: true
I20260709 12:29:05.565199 31583 raft_consensus.cc:2468] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.565306 31657 raft_consensus.cc:2468] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 0.
I20260709 12:29:05.564265 31930 raft_consensus.cc:2804] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.566772 31697 leader_election.cc:304] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.567890 31924 raft_consensus.cc:2804] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.568281 31924 raft_consensus.cc:493] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.568058 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.568748 31924 raft_consensus.cc:3060] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.569290 31584 raft_consensus.cc:2393] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de66417897734488be5261c5177f95dc in current term 1: Already voted for candidate 510046307b7e4418ad3a50b58f3ba982 in this term.
I20260709 12:29:05.570883 31698 leader_election.cc:304] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de66417897734488be5261c5177f95dc; no voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:05.574136 31873 raft_consensus.cc:515] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.576058 31585 raft_consensus.cc:2468] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.577934 31930 raft_consensus.cc:697] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:05.579005 31930 consensus_queue.cc:237] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.581477 31924 raft_consensus.cc:515] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.577843 31932 raft_consensus.cc:3060] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.584779 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.585453 31585 raft_consensus.cc:3060] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.589956 31932 raft_consensus.cc:2749] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.591166 31924 leader_election.cc:290] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.592409 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:05.593056 31657 raft_consensus.cc:3060] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.594075 31585 raft_consensus.cc:2468] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.593864 31481 catalog_manager.cc:5697] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc reported cstate change: term changed from 0 to 1, leader changed from <none> to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 1 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:05.595332 31698 leader_election.cc:304] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.595698 31481 catalog_manager.cc:5697] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc reported cstate change: term changed from 0 to 1, leader changed from <none> to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 1 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:05.596396 31924 raft_consensus.cc:2804] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.596998 31924 raft_consensus.cc:697] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:05.597806 31924 consensus_queue.cc:237] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.599828 31657 raft_consensus.cc:2468] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.600409 31873 leader_election.cc:290] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.601689 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67e90c69e245209ef7aa9651bfb757" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:05.602015 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67e90c69e245209ef7aa9651bfb757" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.602238 31657 raft_consensus.cc:3060] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.602681 31585 raft_consensus.cc:3060] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.608978 31483 catalog_manager.cc:5697] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.611485 31585 raft_consensus.cc:2468] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.611167 31483 catalog_manager.cc:5697] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 0 to 1, leader changed from <none> to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.613037 31698 leader_election.cc:304] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.613282 31657 raft_consensus.cc:2468] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 1.
I20260709 12:29:05.614079 31873 raft_consensus.cc:2804] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.614657 31873 raft_consensus.cc:697] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:05.615629 31873 consensus_queue.cc:237] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.630697 31483 catalog_manager.cc:5697] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc reported cstate change: term changed from 0 to 1, leader changed from <none> to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 1 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:05.631878 31483 catalog_manager.cc:5697] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc reported cstate change: term changed from 0 to 1, leader changed from <none> to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 1 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:05.632906 31483 catalog_manager.cc:5697] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc reported cstate change: term changed from 0 to 1, leader changed from <none> to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 1 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:05.648141 31732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf"
dest_uuid: "de66417897734488be5261c5177f95dc"
mode: GRACEFUL
new_leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:51722
I20260709 12:29:05.648818 31732 raft_consensus.cc:606] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 1 LEADER]: Received request to transfer leadership to TS b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:05.654963 31657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
mode: GRACEFUL
new_leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:44408
I20260709 12:29:05.655668 31657 raft_consensus.cc:606] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Received request to transfer leadership to TS b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:05.661142 31732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9"
dest_uuid: "de66417897734488be5261c5177f95dc"
mode: GRACEFUL
new_leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:51722
I20260709 12:29:05.661700 31732 raft_consensus.cc:606] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Received request to transfer leadership to TS b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:05.667043 31732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d665386737814fe683a902bfccdb1633"
dest_uuid: "de66417897734488be5261c5177f95dc"
mode: GRACEFUL
new_leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:51722
I20260709 12:29:05.667598 31732 raft_consensus.cc:606] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Received request to transfer leadership to TS b36f77bba0f44e4e903422b337e9ba9b
I20260709 12:29:05.673853 31732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db67e90c69e245209ef7aa9651bfb757"
dest_uuid: "de66417897734488be5261c5177f95dc"
mode: GRACEFUL
new_leader_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:51722
I20260709 12:29:05.674481 31732 raft_consensus.cc:606] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Received request to transfer leadership to TS 510046307b7e4418ad3a50b58f3ba982
I20260709 12:29:05.679927 31732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f"
dest_uuid: "de66417897734488be5261c5177f95dc"
mode: GRACEFUL
new_leader_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:51722
I20260709 12:29:05.680526 31732 raft_consensus.cc:606] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Received request to transfer leadership to TS 510046307b7e4418ad3a50b58f3ba982
I20260709 12:29:05.685861 31585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
mode: GRACEFUL
new_leader_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:33380
I20260709 12:29:05.686492 31585 raft_consensus.cc:606] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Received request to transfer leadership to TS 510046307b7e4418ad3a50b58f3ba982
I20260709 12:29:05.695300 31657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
mode: GRACEFUL
new_leader_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:44408
I20260709 12:29:05.695899 31657 raft_consensus.cc:606] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Received request to transfer leadership to TS de66417897734488be5261c5177f95dc
I20260709 12:29:05.746836 31808 consensus_queue.cc:1048] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.754678 31887 raft_consensus.cc:993] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982: : Instructing follower de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:05.755198 31887 raft_consensus.cc:1081] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Signalling peer de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:05.757063 31734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad"
dest_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:51712
I20260709 12:29:05.761714 31734 raft_consensus.cc:493] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:05.762233 31734 raft_consensus.cc:3060] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.767676 31913 consensus_queue.cc:1048] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.772295 31734 raft_consensus.cc:515] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.778970 31734 leader_election.cc:290] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 2 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:05.779389 31585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:05.780179 31585 raft_consensus.cc:3060] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.780493 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872994a823eb4662b699606a33f0a9ad" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:05.781216 31657 raft_consensus.cc:3055] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:05.781546 31657 raft_consensus.cc:740] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:05.782423 31657 consensus_queue.cc:260] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.783874 31657 raft_consensus.cc:3060] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.787325 31585 raft_consensus.cc:2468] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 2.
I20260709 12:29:05.788625 31698 leader_election.cc:304] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:05.789530 31924 raft_consensus.cc:2804] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:05.790050 31924 raft_consensus.cc:697] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 2 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:05.790455 31657 raft_consensus.cc:2468] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 2.
I20260709 12:29:05.790983 31924 consensus_queue.cc:237] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.798231 31483 catalog_manager.cc:5697] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc reported cstate change: term changed from 1 to 2, leader changed from 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2) to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 2 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:05.837827 31913 consensus_queue.cc:1048] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.845741 31885 raft_consensus.cc:993] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982: : Instructing follower b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:05.846282 31808 raft_consensus.cc:1081] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Signalling peer b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:05.849324 31584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:33374
I20260709 12:29:05.849984 31584 raft_consensus.cc:493] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:05.850423 31584 raft_consensus.cc:3060] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.851900 31808 consensus_queue.cc:1048] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.856026 31808 raft_consensus.cc:493] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.856468 31808 raft_consensus.cc:515] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.857489 31584 raft_consensus.cc:515] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.858528 31585 raft_consensus.cc:1240] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Rejecting Update request from peer 510046307b7e4418ad3a50b58f3ba982 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:05.859144 31808 leader_election.cc:290] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.859655 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de66417897734488be5261c5177f95dc" is_pre_election: true
I20260709 12:29:05.860669 31732 raft_consensus.cc:2393] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 510046307b7e4418ad3a50b58f3ba982 in current term 1: Already voted for candidate b36f77bba0f44e4e903422b337e9ba9b in this term.
I20260709 12:29:05.859156 31583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b" is_pre_election: true
I20260709 12:29:05.862205 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:05.862939 31657 raft_consensus.cc:3055] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:05.863320 31657 raft_consensus.cc:740] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:05.864081 31808 consensus_queue.cc:1059] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.864650 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee34c38f7664cdcaead4b8d09fd5a9a" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:05.864982 31624 leader_election.cc:304] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982; no voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc
I20260709 12:29:05.866436 31657 consensus_queue.cc:260] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.867660 31657 raft_consensus.cc:3060] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.867797 31885 raft_consensus.cc:3060] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.863432 31584 leader_election.cc:290] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.877563 31885 raft_consensus.cc:2749] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.879335 31657 raft_consensus.cc:2468] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
W20260709 12:29:05.880043 31913 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:29:05.880766 31548 leader_election.cc:304] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: de66417897734488be5261c5177f95dc
I20260709 12:29:05.881922 31810 raft_consensus.cc:2804] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:05.882522 31810 raft_consensus.cc:697] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:05.883388 31810 consensus_queue.cc:237] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.891796 31483 catalog_manager.cc:5697] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 1 to 2, leader changed from 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2) to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 2 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.892277 31913 consensus_queue.cc:1048] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.907747 31913 consensus_queue.cc:1048] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.913008 31873 consensus_queue.cc:1048] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.922775 31920 raft_consensus.cc:993] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: : Instructing follower b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:05.923349 31920 raft_consensus.cc:1081] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 1 LEADER]: Signalling peer b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:05.929982 31584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:33364
I20260709 12:29:05.930666 31584 raft_consensus.cc:493] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:05.931332 31584 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.934577 31932 consensus_queue.cc:1048] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.941023 31584 raft_consensus.cc:515] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.943189 31584 leader_election.cc:290] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:05.945349 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:05.946187 31734 raft_consensus.cc:3055] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:05.945379 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:05.947444 31734 raft_consensus.cc:740] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:05.949925 31734 consensus_queue.cc:260] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.951152 31734 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.960208 31734 raft_consensus.cc:2468] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:05.961409 31550 leader_election.cc:304] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 510046307b7e4418ad3a50b58f3ba982
I20260709 12:29:05.962411 31888 raft_consensus.cc:2804] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:05.962965 31888 raft_consensus.cc:697] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:05.963894 31888 consensus_queue.cc:237] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:05.972048 31481 catalog_manager.cc:5697] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 1 to 2, leader changed from de66417897734488be5261c5177f95dc (127.17.40.3) to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 2 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.973557 31888 consensus_queue.cc:1048] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.982430 31810 raft_consensus.cc:993] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b: : Instructing follower 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:05.984050 31810 raft_consensus.cc:1081] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Signalling peer 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:05.985970 31658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:44400
I20260709 12:29:05.986765 31658 raft_consensus.cc:493] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:05.987174 31658 raft_consensus.cc:3060] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:05.989410 31949 consensus_queue.cc:1048] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.994725 31658 raft_consensus.cc:515] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.000204 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:06.000964 31584 raft_consensus.cc:3055] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:06.001423 31584 raft_consensus.cc:740] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:06.002709 31584 consensus_queue.cc:260] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.004412 31584 raft_consensus.cc:3060] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.004518 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86275b8d3aab4998af2d57417ea3f6bf" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:06.005251 31734 raft_consensus.cc:3060] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.006294 31658 leader_election.cc:290] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:06.012869 31584 raft_consensus.cc:2468] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:06.014354 31624 leader_election.cc:304] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:06.015854 31913 raft_consensus.cc:2804] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.016433 31913 raft_consensus.cc:697] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:06.017385 31913 consensus_queue.cc:237] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.021073 31734 raft_consensus.cc:2468] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:06.027473 31482 catalog_manager.cc:5697] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 1 to 2, leader changed from b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1) to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:06.035853 31932 consensus_queue.cc:1048] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:06.048350 31932 consensus_queue.cc:1048] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:06.057153 31920 raft_consensus.cc:993] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc: : Instructing follower 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:06.057710 31932 raft_consensus.cc:1081] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Signalling peer 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:06.059415 31658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db67e90c69e245209ef7aa9651bfb757"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:44392
I20260709 12:29:06.059953 31658 raft_consensus.cc:493] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:06.060264 31658 raft_consensus.cc:3060] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.066608 31658 raft_consensus.cc:515] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.068617 31658 leader_election.cc:290] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:06.069485 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67e90c69e245209ef7aa9651bfb757" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:06.069720 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67e90c69e245209ef7aa9651bfb757" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:06.070183 31584 raft_consensus.cc:3060] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.070474 31732 raft_consensus.cc:3055] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:06.070883 31732 raft_consensus.cc:740] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:06.071898 31732 consensus_queue.cc:260] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.073362 31732 raft_consensus.cc:3060] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.076156 31584 raft_consensus.cc:2468] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:06.077317 31624 leader_election.cc:304] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, b36f77bba0f44e4e903422b337e9ba9b; no voters: 
I20260709 12:29:06.078097 31913 raft_consensus.cc:2804] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.078557 31913 raft_consensus.cc:697] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:06.079349 31913 consensus_queue.cc:237] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.080852 31732 raft_consensus.cc:2468] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:06.086882 31932 consensus_queue.cc:1048] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:06.086467 31482 catalog_manager.cc:5697] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 1 to 2, leader changed from de66417897734488be5261c5177f95dc (127.17.40.3) to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:06.098711 31920 consensus_queue.cc:1048] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:06.105602 31930 consensus_queue.cc:1048] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:06.116559 31932 consensus_queue.cc:1048] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:06.118129 31920 raft_consensus.cc:993] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc: : Instructing follower 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:06.118767 31930 raft_consensus.cc:1081] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Signalling peer 510046307b7e4418ad3a50b58f3ba982 to start an election
I20260709 12:29:06.122073 31658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
 from {username='slave'} at 127.0.0.1:44392
I20260709 12:29:06.122661 31658 raft_consensus.cc:493] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:06.123046 31658 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.126255 31933 consensus_queue.cc:1048] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:06.130746 31658 raft_consensus.cc:515] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.138352 31658 leader_election.cc:290] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:06.138236 31732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:06.139392 31732 raft_consensus.cc:3055] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:06.139730 31732 raft_consensus.cc:740] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:06.141012 31932 raft_consensus.cc:993] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc: : Instructing follower b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:06.140695 31732 consensus_queue.cc:260] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.141573 31932 raft_consensus.cc:1081] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Signalling peer b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:06.138236 31583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f" candidate_uuid: "510046307b7e4418ad3a50b58f3ba982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:06.142321 31732 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.143628 31584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d665386737814fe683a902bfccdb1633"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:33364
I20260709 12:29:06.144317 31584 raft_consensus.cc:493] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:06.144728 31584 raft_consensus.cc:3060] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.142834 31583 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.153236 31932 consensus_queue.cc:1048] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:06.161298 31584 raft_consensus.cc:515] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.164788 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d665386737814fe683a902bfccdb1633" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:06.164968 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d665386737814fe683a902bfccdb1633" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:06.165501 31658 raft_consensus.cc:3060] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.165660 31734 raft_consensus.cc:3055] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:06.166122 31734 raft_consensus.cc:740] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:06.166620 31584 leader_election.cc:290] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:06.166924 31734 consensus_queue.cc:260] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.168056 31734 raft_consensus.cc:3060] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.173455 31732 raft_consensus.cc:2468] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:06.175362 31625 leader_election.cc:304] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:06.175436 31734 raft_consensus.cc:2468] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:06.175912 31583 raft_consensus.cc:2468] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 510046307b7e4418ad3a50b58f3ba982 in term 2.
I20260709 12:29:06.176396 31913 raft_consensus.cc:2804] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.176932 31913 raft_consensus.cc:697] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Becoming Leader. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:06.177608 31550 leader_election.cc:304] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:06.177812 31913 consensus_queue.cc:237] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.178658 31949 raft_consensus.cc:2804] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.179376 31949 raft_consensus.cc:697] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:06.180493 31949 consensus_queue.cc:237] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.181495 31932 raft_consensus.cc:993] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: : Instructing follower b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:06.181469 31658 raft_consensus.cc:2468] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:06.182179 31932 raft_consensus.cc:1081] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Signalling peer b36f77bba0f44e4e903422b337e9ba9b to start an election
I20260709 12:29:06.183972 31585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
 from {username='slave'} at 127.0.0.1:33364
I20260709 12:29:06.184634 31585 raft_consensus.cc:493] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:06.185091 31585 raft_consensus.cc:3060] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.190925 31481 catalog_manager.cc:5697] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 reported cstate change: term changed from 1 to 2, leader changed from de66417897734488be5261c5177f95dc (127.17.40.3) to 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "510046307b7e4418ad3a50b58f3ba982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:06.192032 31482 catalog_manager.cc:5697] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 1 to 2, leader changed from de66417897734488be5261c5177f95dc (127.17.40.3) to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 2 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:06.193135 31585 raft_consensus.cc:515] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.196041 31585 leader_election.cc:290] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Requested vote from peers 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131), de66417897734488be5261c5177f95dc (127.17.40.3:43611)
I20260709 12:29:06.196390 31658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:06.196832 31734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b356218f8b435eb7ee7a57e13aede9" candidate_uuid: "b36f77bba0f44e4e903422b337e9ba9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de66417897734488be5261c5177f95dc"
I20260709 12:29:06.197120 31658 raft_consensus.cc:3060] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.197465 31734 raft_consensus.cc:3055] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:06.197774 31734 raft_consensus.cc:740] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:06.198680 31734 consensus_queue.cc:260] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.200047 31734 raft_consensus.cc:3060] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.209153 31734 raft_consensus.cc:2468] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:06.210336 31658 raft_consensus.cc:2468] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36f77bba0f44e4e903422b337e9ba9b in term 2.
I20260709 12:29:06.211033 31550 leader_election.cc:304] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:06.212054 31949 raft_consensus.cc:2804] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.212821 31949 raft_consensus.cc:697] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Leader. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:06.213833 31949 consensus_queue.cc:237] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:06.221269 31482 catalog_manager.cc:5697] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b reported cstate change: term changed from 1 to 2, leader changed from de66417897734488be5261c5177f95dc (127.17.40.3) to b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1). New cstate: current_term: 2 leader_uuid: "b36f77bba0f44e4e903422b337e9ba9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:06.295152 31585 raft_consensus.cc:1275] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.296520 31920 consensus_queue.cc:1048] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.304488 31658 raft_consensus.cc:1275] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.306160 31920 consensus_queue.cc:1048] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.320518 31658 raft_consensus.cc:1275] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.321904 31949 consensus_queue.cc:1048] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.331696 31734 raft_consensus.cc:3060] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.338878 31734 raft_consensus.cc:1275] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.340248 31949 consensus_queue.cc:1048] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.405800 31734 raft_consensus.cc:1275] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.407424 31885 consensus_queue.cc:1048] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.409794 31734 raft_consensus.cc:1275] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.411244 31949 consensus_queue.cc:1048] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.415419 31585 raft_consensus.cc:1275] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.418238 31913 consensus_queue.cc:1048] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.422482 31658 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.433594 31658 raft_consensus.cc:1275] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.435065 31960 consensus_queue.cc:1048] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:06.554118 31585 raft_consensus.cc:1275] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.555814 31885 consensus_queue.cc:1048] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.564070 31732 raft_consensus.cc:1275] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.566037 31887 consensus_queue.cc:1048] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.584633 31732 raft_consensus.cc:1275] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.586762 31887 consensus_queue.cc:1048] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.595624 31583 raft_consensus.cc:1275] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Refusing update from remote peer 510046307b7e4418ad3a50b58f3ba982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.597385 31887 consensus_queue.cc:1048] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.599231 31658 raft_consensus.cc:1275] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.602298 31960 consensus_queue.cc:1048] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.614449 31732 raft_consensus.cc:1275] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.616353 31888 consensus_queue.cc:1048] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.711304 31732 raft_consensus.cc:1275] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.712792 31888 consensus_queue.cc:1048] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:06.721020 31658 raft_consensus.cc:1275] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Refusing update from remote peer b36f77bba0f44e4e903422b337e9ba9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:06.722747 31810 consensus_queue.cc:1048] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.699644 31482 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56232:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:29:08.721448 31482 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56232:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:29:08.796797 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:29:08.952520 31991 log.cc:927] Time spent T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
W20260709 12:29:08.954905 31992 log.cc:927] Time spent T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 12:29:08.955963 32005 tablet.cc:1724] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:08.992378 32000 tablet.cc:1724] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:09.008533 31997 log.cc:927] Time spent T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: Append to log took a long time: real 0.112s	user 0.004s	sys 0.000s
W20260709 12:29:09.027714 31686 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:717d49f93ddd4476b03c76d7340bddbf)
W20260709 12:29:09.039516 32004 log.cc:927] Time spent T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:29:09.041636 31998 log.cc:927] Time spent T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 12:29:09.046468 31686 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:717d49f93ddd4476b03c76d7340bddbf)
W20260709 12:29:09.033684 31550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.3:43611, user_credentials={real_user=slave}} blocked reactor thread for 78574.8us
W20260709 12:29:09.052538 31686 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:717d49f93ddd4476b03c76d7340bddbf)
I20260709 12:29:09.094857 31656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
mode: GRACEFUL
new_leader_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:40484
I20260709 12:29:09.060818 32013 tablet.cc:1724] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.095683 31656 raft_consensus.cc:606] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Received request to transfer leadership to TS de66417897734488be5261c5177f95dc
I20260709 12:29:09.081459 32018 tablet.cc:1724] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.121120 32024 tablet.cc:1724] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.123808 32019 tablet.cc:1724] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.124070 32021 tablet.cc:1724] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.129734 32000 tablet.cc:1724] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:09.079886 31548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:39131, user_credentials={real_user=slave}} blocked reactor thread for 122876us
I20260709 12:29:09.167886 32029 tablet.cc:1724] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.173785 32023 tablet.cc:1724] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.179591 32025 tablet.cc:1724] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.197474 32019 tablet.cc:1724] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.211241 32028 tablet.cc:1724] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.214605 32029 tablet.cc:1724] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.235306 32015 raft_consensus.cc:993] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982: : Instructing follower de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:09.236066 32015 raft_consensus.cc:1081] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Signalling peer de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:09.243669 31733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f"
dest_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:51712
I20260709 12:29:09.244282 31733 raft_consensus.cc:493] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:09.244123 32024 tablet.cc:1724] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.244840 31733 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.223824 32023 tablet.cc:1724] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.251998 32019 tablet.cc:1724] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.256955 32028 tablet.cc:1724] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.224334 32021 tablet.cc:1724] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:09.281234 31548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.40.2:39131, user_credentials={real_user=slave}} blocked reactor thread for 48898.8us
I20260709 12:29:09.284075 32031 tablet.cc:1724] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.282521 32013 tablet.cc:1724] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.290483 31733 raft_consensus.cc:515] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.292650 32005 tablet.cc:1724] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.293898 31582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:09.294651 31582 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.303510 31585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
mode: GRACEFUL
new_leader_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:29:09.304261 31585 raft_consensus.cc:606] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Received request to transfer leadership to TS de66417897734488be5261c5177f95dc
I20260709 12:29:09.309963 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:29:09.310159 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7005f7d51f204cb4a0132e30896b206f" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:09.310768 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:09.310905 31657 raft_consensus.cc:3055] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:09.311318 31657 raft_consensus.cc:740] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:09.312276 31657 consensus_queue.cc:260] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.319607 31733 leader_election.cc:290] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 3 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:09.326320 31585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b"
dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
mode: GRACEFUL
new_leader_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:29:09.327018 31585 raft_consensus.cc:606] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Received request to transfer leadership to TS de66417897734488be5261c5177f95dc
I20260709 12:29:09.313472 31657 raft_consensus.cc:3060] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.333382 31659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9"
dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
mode: GRACEFUL
new_leader_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:40484
I20260709 12:29:09.335501 31659 raft_consensus.cc:606] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Received request to transfer leadership to TS de66417897734488be5261c5177f95dc
I20260709 12:29:09.345510 32025 tablet.cc:1724] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.347877 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:09.348769 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:09.331403 32023 tablet.cc:1724] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.351753 31582 raft_consensus.cc:2468] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 3.
I20260709 12:29:09.354480 31698 leader_election.cc:304] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:09.355463 31930 raft_consensus.cc:2804] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:09.356012 31930 raft_consensus.cc:697] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 3 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:09.356918 31930 consensus_queue.cc:237] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.372259 31481 catalog_manager.cc:5697] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc reported cstate change: term changed from 2 to 3, leader changed from 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2) to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 3 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:09.386467 32000 tablet.cc:1724] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.381558 32019 tablet.cc:1724] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.380537 32025 tablet.cc:1724] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:09.403591 31657 raft_consensus.cc:2468] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 3.
I20260709 12:29:09.425765 31480 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd: soft_deleted_table [id=65b1f67792b747c5be8ccd5908e91c37] alter complete (version 1)
I20260709 12:29:09.509068 32016 raft_consensus.cc:993] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b: : Instructing follower de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:09.509645 32003 raft_consensus.cc:1081] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Signalling peer de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:09.511253 31734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b"
dest_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:51698
I20260709 12:29:09.511793 31734 raft_consensus.cc:493] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:09.512122 31734 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.517624 31734 raft_consensus.cc:515] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:09.519302 31734 leader_election.cc:290] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 3 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:09.520251 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:09.520529 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0783b4df0849c9b30f993aa292e59b" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:09.520984 31584 raft_consensus.cc:3055] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:09.521095 31657 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.521361 31584 raft_consensus.cc:740] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:09.522243 31584 consensus_queue.cc:260] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:09.523587 31584 raft_consensus.cc:3060] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.529110 31657 raft_consensus.cc:2468] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 3.
I20260709 12:29:09.530741 31697 leader_election.cc:304] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 510046307b7e4418ad3a50b58f3ba982, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:09.530997 31584 raft_consensus.cc:2468] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 3.
I20260709 12:29:09.531744 31930 raft_consensus.cc:2804] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:09.532270 31930 raft_consensus.cc:697] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 3 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:09.533130 31930 consensus_queue.cc:237] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } }
I20260709 12:29:09.538430 32016 raft_consensus.cc:993] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b: : Instructing follower de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:09.538901 32003 raft_consensus.cc:1081] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Signalling peer de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:09.540392 31734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf"
dest_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:51698
I20260709 12:29:09.540910 31734 raft_consensus.cc:493] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:09.541273 31734 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.542246 31483 catalog_manager.cc:5697] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc reported cstate change: term changed from 2 to 3, leader changed from b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1) to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 3 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:09.547482 31734 raft_consensus.cc:515] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.550263 31583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:09.550354 31734 leader_election.cc:290] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 3 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:09.550949 31583 raft_consensus.cc:3055] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:09.551314 31583 raft_consensus.cc:740] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b36f77bba0f44e4e903422b337e9ba9b, State: Running, Role: LEADER
I20260709 12:29:09.552155 31583 consensus_queue.cc:260] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.553267 31583 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.555680 31657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d49f93ddd4476b03c76d7340bddbf" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:09.556268 31657 raft_consensus.cc:3060] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.559924 31583 raft_consensus.cc:2468] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 3.
I20260709 12:29:09.561206 31698 leader_election.cc:304] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:09.562057 31930 raft_consensus.cc:2804] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:09.562427 31657 raft_consensus.cc:2468] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 3.
I20260709 12:29:09.562602 31930 raft_consensus.cc:697] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 3 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:09.563607 31930 consensus_queue.cc:237] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.571157 31483 catalog_manager.cc:5697] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc reported cstate change: term changed from 2 to 3, leader changed from b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1) to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 3 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:09.746644 31583 raft_consensus.cc:1275] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:29:09.747983 31930 consensus_queue.cc:1048] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:09.758378 31659 raft_consensus.cc:1275] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:29:09.760274 31930 consensus_queue.cc:1048] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:09.885360 31980 raft_consensus.cc:993] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982: : Instructing follower de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:09.885906 32015 raft_consensus.cc:1081] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Signalling peer de66417897734488be5261c5177f95dc to start an election
I20260709 12:29:09.887625 31733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9"
dest_uuid: "de66417897734488be5261c5177f95dc"
 from {username='slave'} at 127.0.0.1:51712
I20260709 12:29:09.888196 31733 raft_consensus.cc:493] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:09.888604 31733 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.896512 31733 raft_consensus.cc:515] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.899114 31733 leader_election.cc:290] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 3 election: Requested vote from peers b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725), 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131)
I20260709 12:29:09.899839 31659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "510046307b7e4418ad3a50b58f3ba982"
I20260709 12:29:09.900602 31584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f843a391eed40c0b7c66c649d549eb9" candidate_uuid: "de66417897734488be5261c5177f95dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b36f77bba0f44e4e903422b337e9ba9b"
I20260709 12:29:09.901347 31584 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.900688 31659 raft_consensus.cc:3055] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:09.902149 31659 raft_consensus.cc:740] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 510046307b7e4418ad3a50b58f3ba982, State: Running, Role: LEADER
I20260709 12:29:09.903267 31659 consensus_queue.cc:260] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.904791 31659 raft_consensus.cc:3060] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:09.911481 31584 raft_consensus.cc:2468] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 3.
I20260709 12:29:09.912815 31698 leader_election.cc:304] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36f77bba0f44e4e903422b337e9ba9b, de66417897734488be5261c5177f95dc; no voters: 
I20260709 12:29:09.913647 31930 raft_consensus.cc:2804] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:09.914268 31930 raft_consensus.cc:697] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 3 LEADER]: Becoming Leader. State: Replica: de66417897734488be5261c5177f95dc, State: Running, Role: LEADER
I20260709 12:29:09.915542 31659 raft_consensus.cc:2468] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de66417897734488be5261c5177f95dc in term 3.
I20260709 12:29:09.915239 31930 consensus_queue.cc:237] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } }
I20260709 12:29:09.924343 31480 catalog_manager.cc:5697] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc reported cstate change: term changed from 2 to 3, leader changed from 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2) to de66417897734488be5261c5177f95dc (127.17.40.3). New cstate: current_term: 3 leader_uuid: "de66417897734488be5261c5177f95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de66417897734488be5261c5177f95dc" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 43611 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:09.945655 31659 raft_consensus.cc:1275] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:29:09.947171 31930 consensus_queue.cc:1048] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:09.955672 31584 raft_consensus.cc:1275] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:29:09.958755 31930 consensus_queue.cc:1048] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:10.073556 31584 raft_consensus.cc:1275] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:10.075148 31930 consensus_queue.cc:1048] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:10.088385 31659 raft_consensus.cc:1275] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:10.089855 31996 consensus_queue.cc:1048] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:10.350152 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:10.355753 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:10.356266 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:10.361914 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:10.362493 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:10.383225 31584 raft_consensus.cc:1275] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:10.384881 31996 consensus_queue.cc:1048] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36f77bba0f44e4e903422b337e9ba9b" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:10.394143 31659 raft_consensus.cc:1275] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Refusing update from remote peer de66417897734488be5261c5177f95dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:10.397769 31996 consensus_queue.cc:1048] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "510046307b7e4418ad3a50b58f3ba982" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 39131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:11.363658 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:11.371182 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:11.371722 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:11.376969 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:11.377458 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:12.378580 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:12.384248 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:12.384883 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:12.391876 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:12.392443 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:13.393750 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:13.399501 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:13.400076 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:13.405537 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:13.406103 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:14.407836 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:14.415184 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:14.415629 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:14.422295 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:14.422935 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:15.424472 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:15.430037 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:15.430675 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:15.436903 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:15.437410 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:16.438450 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:16.443760 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:16.444283 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:16.451866 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:16.452404 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:17.453696 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:17.460155 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:17.460721 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:17.466226 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:17.466770 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:18.467917 17568 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:18.473362 17568 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:18.473887 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:18.479467 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:18.479915 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:19.543994 17568 tablet_server.cc:179] TabletServer@127.17.40.1:0 shutting down...
W20260709 12:29:19.558354 31698 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 12:29:19.563469 31698 consensus_peers.cc:597] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc -> Peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Couldn't send request to peer b36f77bba0f44e4e903422b337e9ba9b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.589334 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:19.590296 17568 tablet_replica.cc:333] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.591686 17568 raft_consensus.cc:2243] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.593199 17568 raft_consensus.cc:2272] T e1b356218f8b435eb7ee7a57e13aede9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.598040 17568 tablet_replica.cc:333] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.598917 17568 raft_consensus.cc:2243] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.600037 17568 raft_consensus.cc:2272] T d665386737814fe683a902bfccdb1633 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.602816 17568 tablet_replica.cc:333] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.603709 17568 raft_consensus.cc:2243] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.604457 17568 raft_consensus.cc:2272] T 7005f7d51f204cb4a0132e30896b206f P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.607962 17568 tablet_replica.cc:333] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.608708 17568 raft_consensus.cc:2243] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.609305 17568 raft_consensus.cc:2272] T 86275b8d3aab4998af2d57417ea3f6bf P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.612082 17568 tablet_replica.cc:333] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.612766 17568 raft_consensus.cc:2243] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.613343 17568 raft_consensus.cc:2272] T 872994a823eb4662b699606a33f0a9ad P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.616022 17568 tablet_replica.cc:333] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.616750 17568 raft_consensus.cc:2243] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.617439 17568 raft_consensus.cc:2272] T db67e90c69e245209ef7aa9651bfb757 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.620638 17568 tablet_replica.cc:333] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.621555 17568 raft_consensus.cc:2243] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.622321 17568 raft_consensus.cc:2272] T 717d49f93ddd4476b03c76d7340bddbf P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.625610 17568 tablet_replica.cc:333] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.626652 17568 raft_consensus.cc:2243] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.627542 17568 raft_consensus.cc:2272] T b95cf809e17243c4bae29b2942c36ad4 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.631208 17568 tablet_replica.cc:333] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.631974 17568 raft_consensus.cc:2243] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.633100 17568 raft_consensus.cc:2272] T 70a7390f649b448f819227c2358af4f9 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.636507 17568 tablet_replica.cc:333] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.637287 17568 raft_consensus.cc:2243] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.637845 17568 raft_consensus.cc:2272] T 432e40d1cf054414b5428334e7d7ec0e P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.640655 17568 tablet_replica.cc:333] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.641255 17568 raft_consensus.cc:2243] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.641796 17568 raft_consensus.cc:2272] T e5583615df9b4db682252b5f365e0857 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.644657 17568 tablet_replica.cc:333] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.645340 17568 raft_consensus.cc:2243] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.645910 17568 raft_consensus.cc:2272] T 43befabd185e4bac8552e94d3ea7cf95 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.649541 17568 tablet_replica.cc:333] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.650530 17568 raft_consensus.cc:2243] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.651299 17568 raft_consensus.cc:2272] T 4f843a391eed40c0b7c66c649d549eb9 P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:19.651922 31698 consensus_peers.cc:597] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc -> Peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Couldn't send request to peer b36f77bba0f44e4e903422b337e9ba9b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.654480 17568 tablet_replica.cc:333] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.655392 17568 raft_consensus.cc:2243] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.656064 17568 raft_consensus.cc:2272] T 2c0783b4df0849c9b30f993aa292e59b P b36f77bba0f44e4e903422b337e9ba9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.659121 17568 tablet_replica.cc:333] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.659848 17568 raft_consensus.cc:2243] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.660487 17568 raft_consensus.cc:2272] T e4184a4339224d88ae793b9927dc3e89 P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.663700 17568 tablet_replica.cc:333] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.664439 17568 raft_consensus.cc:2243] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.665604 17568 raft_consensus.cc:2272] T 8b5706fbf1bb4c0d952b332e171bf929 P b36f77bba0f44e4e903422b337e9ba9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.668841 17568 tablet_replica.cc:333] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.669590 17568 raft_consensus.cc:2243] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.671044 17568 raft_consensus.cc:2272] T f5ab25c254fc4c61b6e53ead6c80df7f P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.674630 17568 tablet_replica.cc:333] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b: stopping tablet replica
I20260709 12:29:19.675333 17568 raft_consensus.cc:2243] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.676708 17568 raft_consensus.cc:2272] T cee34c38f7664cdcaead4b8d09fd5a9a P b36f77bba0f44e4e903422b337e9ba9b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:19.695173 31698 consensus_peers.cc:597] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc -> Peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Couldn't send request to peer b36f77bba0f44e4e903422b337e9ba9b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.735526 17568 tablet_server.cc:196] TabletServer@127.17.40.1:0 shutdown complete.
W20260709 12:29:19.747618 31624 consensus_peers.cc:597] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 -> Peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Couldn't send request to peer b36f77bba0f44e4e903422b337e9ba9b. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:19.753671 31698 consensus_peers.cc:597] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc -> Peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Couldn't send request to peer b36f77bba0f44e4e903422b337e9ba9b. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.791960 17568 tablet_server.cc:179] TabletServer@127.17.40.2:0 shutting down...
W20260709 12:29:19.829457 31624 consensus_peers.cc:597] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 -> Peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Couldn't send request to peer b36f77bba0f44e4e903422b337e9ba9b. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.830713 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:19.831763 17568 tablet_replica.cc:333] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.833380 17568 raft_consensus.cc:2243] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.834906 17568 raft_consensus.cc:2272] T 86275b8d3aab4998af2d57417ea3f6bf P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:19.837972 31697 consensus_peers.cc:597] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc -> Peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Couldn't send request to peer 510046307b7e4418ad3a50b58f3ba982. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.838862 17568 tablet_replica.cc:333] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.840051 17568 raft_consensus.cc:2243] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.840788 17568 raft_consensus.cc:2272] T 7005f7d51f204cb4a0132e30896b206f P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.844614 17568 tablet_replica.cc:333] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.845405 17568 raft_consensus.cc:2243] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.845957 17568 raft_consensus.cc:2272] T 717d49f93ddd4476b03c76d7340bddbf P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.848492 17568 tablet_replica.cc:333] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.849102 17568 raft_consensus.cc:2243] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.849625 17568 raft_consensus.cc:2272] T cee34c38f7664cdcaead4b8d09fd5a9a P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.852502 17568 tablet_replica.cc:333] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.853193 17568 raft_consensus.cc:2243] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.854074 17568 raft_consensus.cc:2272] T db67e90c69e245209ef7aa9651bfb757 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.857332 17568 tablet_replica.cc:333] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.858199 17568 raft_consensus.cc:2243] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.859247 17568 raft_consensus.cc:2272] T 872994a823eb4662b699606a33f0a9ad P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:19.861732 31698 consensus_peers.cc:597] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc -> Peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Couldn't send request to peer b36f77bba0f44e4e903422b337e9ba9b. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.862746 17568 tablet_replica.cc:333] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.863595 17568 raft_consensus.cc:2243] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.864279 17568 raft_consensus.cc:2272] T d665386737814fe683a902bfccdb1633 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.867268 17568 tablet_replica.cc:333] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.868016 17568 raft_consensus.cc:2243] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.868798 17568 raft_consensus.cc:2272] T e1b356218f8b435eb7ee7a57e13aede9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.872891 17568 tablet_replica.cc:333] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.873871 17568 raft_consensus.cc:2243] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:29:19.874428 31697 consensus_peers.cc:597] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc -> Peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Couldn't send request to peer 510046307b7e4418ad3a50b58f3ba982. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.875168 17568 raft_consensus.cc:2272] T b95cf809e17243c4bae29b2942c36ad4 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.878160 17568 tablet_replica.cc:333] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.878862 17568 raft_consensus.cc:2243] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.879449 17568 raft_consensus.cc:2272] T 8b5706fbf1bb4c0d952b332e171bf929 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.882810 17568 tablet_replica.cc:333] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.883512 17568 raft_consensus.cc:2243] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.884254 17568 raft_consensus.cc:2272] T e4184a4339224d88ae793b9927dc3e89 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.886960 17568 tablet_replica.cc:333] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.887622 17568 raft_consensus.cc:2243] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.888175 17568 raft_consensus.cc:2272] T 2c0783b4df0849c9b30f993aa292e59b P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.890630 17568 tablet_replica.cc:333] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.891218 17568 raft_consensus.cc:2243] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.892287 17568 raft_consensus.cc:2272] T e5583615df9b4db682252b5f365e0857 P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.895375 17568 tablet_replica.cc:333] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.895946 17568 raft_consensus.cc:2243] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.896474 17568 raft_consensus.cc:2272] T 70a7390f649b448f819227c2358af4f9 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.899197 17568 tablet_replica.cc:333] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.899914 17568 raft_consensus.cc:2243] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.900945 17568 raft_consensus.cc:2272] T 432e40d1cf054414b5428334e7d7ec0e P 510046307b7e4418ad3a50b58f3ba982 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.903856 17568 tablet_replica.cc:333] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.904490 17568 raft_consensus.cc:2243] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:19.904582 31624 consensus_peers.cc:597] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 -> Peer b36f77bba0f44e4e903422b337e9ba9b (127.17.40.1:36725): Couldn't send request to peer b36f77bba0f44e4e903422b337e9ba9b. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:36725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.905130 17568 raft_consensus.cc:2272] T 4f843a391eed40c0b7c66c649d549eb9 P 510046307b7e4418ad3a50b58f3ba982 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.907759 17568 tablet_replica.cc:333] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.908340 17568 raft_consensus.cc:2243] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:19.909322 17568 raft_consensus.cc:2272] T 43befabd185e4bac8552e94d3ea7cf95 P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:19.911921 17568 tablet_replica.cc:333] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982: stopping tablet replica
I20260709 12:29:19.912529 17568 raft_consensus.cc:2243] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:19.913089 17568 raft_consensus.cc:2272] T f5ab25c254fc4c61b6e53ead6c80df7f P 510046307b7e4418ad3a50b58f3ba982 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:19.935578 31697 consensus_peers.cc:597] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc -> Peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Couldn't send request to peer 510046307b7e4418ad3a50b58f3ba982. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:19.954248 31697 consensus_peers.cc:597] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc -> Peer 510046307b7e4418ad3a50b58f3ba982 (127.17.40.2:39131): Couldn't send request to peer 510046307b7e4418ad3a50b58f3ba982. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.2:39131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:19.960623 17568 tablet_server.cc:196] TabletServer@127.17.40.2:0 shutdown complete.
I20260709 12:29:20.004573 17568 tablet_server.cc:179] TabletServer@127.17.40.3:0 shutting down...
I20260709 12:29:20.035328 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:20.036116 17568 tablet_replica.cc:333] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.036936 17568 raft_consensus.cc:2243] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.037676 17568 raft_consensus.cc:2272] T e1b356218f8b435eb7ee7a57e13aede9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.040184 17568 tablet_replica.cc:333] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.040923 17568 raft_consensus.cc:2243] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.041541 17568 raft_consensus.cc:2272] T 86275b8d3aab4998af2d57417ea3f6bf P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.044036 17568 tablet_replica.cc:333] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.044661 17568 raft_consensus.cc:2243] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.045608 17568 raft_consensus.cc:2272] T 7005f7d51f204cb4a0132e30896b206f P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.048022 17568 tablet_replica.cc:333] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.048691 17568 raft_consensus.cc:2243] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.049281 17568 raft_consensus.cc:2272] T b95cf809e17243c4bae29b2942c36ad4 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.051892 17568 tablet_replica.cc:333] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.052568 17568 raft_consensus.cc:2243] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.053542 17568 raft_consensus.cc:2272] T 717d49f93ddd4476b03c76d7340bddbf P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.056162 17568 tablet_replica.cc:333] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.056826 17568 raft_consensus.cc:2243] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.057463 17568 raft_consensus.cc:2272] T cee34c38f7664cdcaead4b8d09fd5a9a P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.059880 17568 tablet_replica.cc:333] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.060539 17568 raft_consensus.cc:2243] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.061514 17568 raft_consensus.cc:2272] T 872994a823eb4662b699606a33f0a9ad P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.063851 17568 tablet_replica.cc:333] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.064473 17568 raft_consensus.cc:2243] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.065073 17568 raft_consensus.cc:2272] T db67e90c69e245209ef7aa9651bfb757 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.067449 17568 tablet_replica.cc:333] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.068115 17568 raft_consensus.cc:2243] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.069024 17568 raft_consensus.cc:2272] T 2c0783b4df0849c9b30f993aa292e59b P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.071475 17568 tablet_replica.cc:333] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.072082 17568 raft_consensus.cc:2243] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.072582 17568 raft_consensus.cc:2272] T e5583615df9b4db682252b5f365e0857 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.074959 17568 tablet_replica.cc:333] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.075539 17568 raft_consensus.cc:2243] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.076507 17568 raft_consensus.cc:2272] T e4184a4339224d88ae793b9927dc3e89 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.078783 17568 tablet_replica.cc:333] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.079420 17568 raft_consensus.cc:2243] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.079973 17568 raft_consensus.cc:2272] T 8b5706fbf1bb4c0d952b332e171bf929 P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.082592 17568 tablet_replica.cc:333] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.083217 17568 raft_consensus.cc:2243] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.083721 17568 raft_consensus.cc:2272] T f5ab25c254fc4c61b6e53ead6c80df7f P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.086169 17568 tablet_replica.cc:333] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.086766 17568 raft_consensus.cc:2243] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.087723 17568 raft_consensus.cc:2272] T 4f843a391eed40c0b7c66c649d549eb9 P de66417897734488be5261c5177f95dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.089977 17568 tablet_replica.cc:333] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.090579 17568 raft_consensus.cc:2243] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.091095 17568 raft_consensus.cc:2272] T 43befabd185e4bac8552e94d3ea7cf95 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.093511 17568 tablet_replica.cc:333] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.094095 17568 raft_consensus.cc:2243] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.094605 17568 raft_consensus.cc:2272] T 432e40d1cf054414b5428334e7d7ec0e P de66417897734488be5261c5177f95dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.097386 17568 tablet_replica.cc:333] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.097957 17568 raft_consensus.cc:2243] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.098524 17568 raft_consensus.cc:2272] T 70a7390f649b448f819227c2358af4f9 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.100657 17568 tablet_replica.cc:333] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc: stopping tablet replica
I20260709 12:29:20.101203 17568 raft_consensus.cc:2243] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.101791 17568 raft_consensus.cc:2272] T d665386737814fe683a902bfccdb1633 P de66417897734488be5261c5177f95dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.149394 17568 tablet_server.cc:196] TabletServer@127.17.40.3:0 shutdown complete.
I20260709 12:29:20.189944 17568 master.cc:562] Master@127.17.40.62:43555 shutting down...
I20260709 12:29:20.220297 17568 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.220995 17568 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.221398 17568 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a35a17ab0c74c40bc09680aac2e13dd: stopping tablet replica
I20260709 12:29:20.243841 17568 master.cc:584] Master@127.17.40.62:43555 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20976 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:29:20.303236 17568 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.40.62:33669
I20260709 12:29:20.304466 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:20.311264 32076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:20.311528 32075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:20.312578 32078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:20.313514 17568 server_base.cc:1061] running on GCE node
I20260709 12:29:20.314689 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:20.314901 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:20.315074 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600160315040 us; error 0 us; skew 500 ppm
I20260709 12:29:20.315631 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:20.318213 17568 webserver.cc:533] Webserver started at http://127.17.40.62:35971/ using document root <none> and password file <none>
I20260709 12:29:20.318867 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:20.319164 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:20.319465 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:20.320703 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/master-0-root/instance:
uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c"
format_stamp: "Formatted at 2026-07-09 12:29:20 on dist-test-slave-tjfs"
I20260709 12:29:20.325590 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:29:20.329366 32083 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.330257 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:20.330654 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/master-0-root
uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c"
format_stamp: "Formatted at 2026-07-09 12:29:20 on dist-test-slave-tjfs"
I20260709 12:29:20.331005 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:20.352708 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:20.354070 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:20.395252 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.62:33669
I20260709 12:29:20.395433 32134 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.62:33669 every 8 connection(s)
I20260709 12:29:20.399609 32135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:20.412922 32135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c: Bootstrap starting.
I20260709 12:29:20.418319 32135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.423462 32135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c: No bootstrap required, opened a new log
I20260709 12:29:20.426000 32135 raft_consensus.cc:359] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c" member_type: VOTER }
I20260709 12:29:20.426554 32135 raft_consensus.cc:385] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.426812 32135 raft_consensus.cc:740] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6ef40822b2c4ddd8a0531e5ce2e279c, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.427532 32135 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c" member_type: VOTER }
I20260709 12:29:20.428057 32135 raft_consensus.cc:399] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:20.428273 32135 raft_consensus.cc:493] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:20.428602 32135 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.434633 32135 raft_consensus.cc:515] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c" member_type: VOTER }
I20260709 12:29:20.435240 32135 leader_election.cc:304] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6ef40822b2c4ddd8a0531e5ce2e279c; no voters: 
I20260709 12:29:20.436465 32135 leader_election.cc:290] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:20.436956 32138 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:20.438541 32138 raft_consensus.cc:697] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 1 LEADER]: Becoming Leader. State: Replica: a6ef40822b2c4ddd8a0531e5ce2e279c, State: Running, Role: LEADER
I20260709 12:29:20.439378 32138 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c" member_type: VOTER }
I20260709 12:29:20.439884 32135 sys_catalog.cc:565] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:20.444311 32140 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6ef40822b2c4ddd8a0531e5ce2e279c. Latest consensus state: current_term: 1 leader_uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c" member_type: VOTER } }
I20260709 12:29:20.446134 32140 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:20.445478 32139 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ef40822b2c4ddd8a0531e5ce2e279c" member_type: VOTER } }
I20260709 12:29:20.446686 32139 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:20.448298 32145 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:20.453657 32145 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:20.457604 17568 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:20.465610 32145 catalog_manager.cc:1383] Generated new cluster ID: f55ae8f049024172a16de7928e0364d4
I20260709 12:29:20.466104 32145 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:20.499194 32145 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:20.500664 32145 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:20.514019 32145 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c: Generated new TSK 0
I20260709 12:29:20.514740 32145 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:20.528903 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:20.535743 32156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:20.536872 32157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:20.538496 17568 server_base.cc:1061] running on GCE node
W20260709 12:29:20.538933 32159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:20.539974 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:20.540213 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:20.540382 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600160540360 us; error 0 us; skew 500 ppm
I20260709 12:29:20.540915 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:20.543466 17568 webserver.cc:533] Webserver started at http://127.17.40.1:46647/ using document root <none> and password file <none>
I20260709 12:29:20.543996 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:20.544199 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:20.544500 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:20.545688 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-0-root/instance:
uuid: "6df360bbccb74065bcf6874dfe187687"
format_stamp: "Formatted at 2026-07-09 12:29:20 on dist-test-slave-tjfs"
I20260709 12:29:20.550438 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:20.553987 32164 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.554893 17568 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:20.555219 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-0-root
uuid: "6df360bbccb74065bcf6874dfe187687"
format_stamp: "Formatted at 2026-07-09 12:29:20 on dist-test-slave-tjfs"
I20260709 12:29:20.555526 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:20.574064 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:20.575393 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:20.576987 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:20.579435 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:20.579697 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.579957 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:20.580152 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.623500 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.1:41573
I20260709 12:29:20.623642 32226 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.1:41573 every 8 connection(s)
I20260709 12:29:20.629122 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:20.636847 32231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:20.639324 32232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:20.640441 17568 server_base.cc:1061] running on GCE node
W20260709 12:29:20.640729 32234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:20.642691 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:20.642982 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:20.643190 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600160643152 us; error 0 us; skew 500 ppm
I20260709 12:29:20.643795 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:20.644172 32227 heartbeater.cc:344] Connected to a master server at 127.17.40.62:33669
I20260709 12:29:20.644711 32227 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:20.645684 32227 heartbeater.cc:507] Master 127.17.40.62:33669 requested a full tablet report, sending...
I20260709 12:29:20.646610 17568 webserver.cc:533] Webserver started at http://127.17.40.2:42187/ using document root <none> and password file <none>
I20260709 12:29:20.647274 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:20.647487 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:20.647815 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:20.648360 32100 ts_manager.cc:194] Registered new tserver with Master: 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573)
I20260709 12:29:20.649582 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-1-root/instance:
uuid: "4d19c5882d9940a38aeab897a4f65240"
format_stamp: "Formatted at 2026-07-09 12:29:20 on dist-test-slave-tjfs"
I20260709 12:29:20.651098 32100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45938
I20260709 12:29:20.655682 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.004s
I20260709 12:29:20.659845 32239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.660823 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:29:20.661206 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-1-root
uuid: "4d19c5882d9940a38aeab897a4f65240"
format_stamp: "Formatted at 2026-07-09 12:29:20 on dist-test-slave-tjfs"
I20260709 12:29:20.661510 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:20.672861 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:20.674222 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:20.675907 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:20.678335 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:20.678673 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:29:20.678946 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:20.679123 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.723114 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.2:43613
I20260709 12:29:20.723213 32301 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.2:43613 every 8 connection(s)
I20260709 12:29:20.728514 17568 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:20.738083 32306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:20.738108 32305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:20.743309 32308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:20.744227 32302 heartbeater.cc:344] Connected to a master server at 127.17.40.62:33669
I20260709 12:29:20.744886 32302 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:20.746255 32302 heartbeater.cc:507] Master 127.17.40.62:33669 requested a full tablet report, sending...
I20260709 12:29:20.748831 17568 server_base.cc:1061] running on GCE node
I20260709 12:29:20.749045 32100 ts_manager.cc:194] Registered new tserver with Master: 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:20.750087 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:20.750483 17568 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:20.750715 17568 hybrid_clock.cc:648] HybridClock initialized: now 1783600160750693 us; error 0 us; skew 500 ppm
I20260709 12:29:20.751243 32100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45952
I20260709 12:29:20.751549 17568 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:20.754578 17568 webserver.cc:533] Webserver started at http://127.17.40.3:34647/ using document root <none> and password file <none>
I20260709 12:29:20.755113 17568 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:20.755331 17568 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:20.755622 17568 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:20.756855 17568 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-2-root/instance:
uuid: "8150545344b54f839e178a18a8511058"
format_stamp: "Formatted at 2026-07-09 12:29:20 on dist-test-slave-tjfs"
I20260709 12:29:20.761868 17568 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:29:20.765890 32313 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.766997 17568 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:29:20.767310 17568 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-2-root
uuid: "8150545344b54f839e178a18a8511058"
format_stamp: "Formatted at 2026-07-09 12:29:20 on dist-test-slave-tjfs"
I20260709 12:29:20.767580 17568 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxF6r1y/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599688508335-17568-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:20.786278 17568 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:20.787645 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:20.789124 17568 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:20.791745 17568 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:20.791944 17568 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.792273 17568 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:20.792440 17568 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:20.836351 17568 rpc_server.cc:307] RPC server started. Bound to: 127.17.40.3:36157
I20260709 12:29:20.836467 32375 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.40.3:36157 every 8 connection(s)
I20260709 12:29:20.851110 32376 heartbeater.cc:344] Connected to a master server at 127.17.40.62:33669
I20260709 12:29:20.851691 32376 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:20.852499 32376 heartbeater.cc:507] Master 127.17.40.62:33669 requested a full tablet report, sending...
I20260709 12:29:20.854682 32100 ts_manager.cc:194] Registered new tserver with Master: 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:20.854866 17568 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01525617s
I20260709 12:29:20.856269 32100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45966
I20260709 12:29:20.882541 32100 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45972:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:20.885517 32100 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:20.963339 32267 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff28cd78a14a4ea7c5a3ee8c75b9a1 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:20.965032 32267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff28cd78a14a4ea7c5a3ee8c75b9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:20.967705 32265 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa0bb4c884b489596097064f0bf79f5 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:20.969509 32265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa0bb4c884b489596097064f0bf79f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:20.971613 32266 tablet_service.cc:1511] Processing CreateTablet for tablet 2e604421633a4d83a4f915b89dc8cb73 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:20.973220 32266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e604421633a4d83a4f915b89dc8cb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:20.988610 32264 tablet_service.cc:1511] Processing CreateTablet for tablet b2881224b4a9483784d2fc3506e15efb (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:20.989578 32262 tablet_service.cc:1511] Processing CreateTablet for tablet 77ad699d9aa749ca962699ee67454652 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:20.991727 32263 tablet_service.cc:1511] Processing CreateTablet for tablet a8b4429f78694eabba75c370968d892f (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:20.990289 32264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2881224b4a9483784d2fc3506e15efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:20.994068 32192 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff28cd78a14a4ea7c5a3ee8c75b9a1 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:20.995223 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b4429f78694eabba75c370968d892f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:20.995635 32192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff28cd78a14a4ea7c5a3ee8c75b9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.000023 32191 tablet_service.cc:1511] Processing CreateTablet for tablet 2e604421633a4d83a4f915b89dc8cb73 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:21.001742 32191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e604421633a4d83a4f915b89dc8cb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.003646 32188 tablet_service.cc:1511] Processing CreateTablet for tablet a8b4429f78694eabba75c370968d892f (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:21.005422 32188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b4429f78694eabba75c370968d892f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.003645 32190 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa0bb4c884b489596097064f0bf79f5 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:21.009086 32190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa0bb4c884b489596097064f0bf79f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.004973 32189 tablet_service.cc:1511] Processing CreateTablet for tablet b2881224b4a9483784d2fc3506e15efb (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:21.011343 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2881224b4a9483784d2fc3506e15efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.014829 32262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ad699d9aa749ca962699ee67454652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.016331 32187 tablet_service.cc:1511] Processing CreateTablet for tablet 77ad699d9aa749ca962699ee67454652 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:21.024115 32341 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff28cd78a14a4ea7c5a3ee8c75b9a1 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:21.025803 32186 tablet_service.cc:1511] Processing CreateTablet for tablet eaecbfb45f43413bab6668024b58b5ed (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:21.017992 32187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ad699d9aa749ca962699ee67454652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.027735 32261 tablet_service.cc:1511] Processing CreateTablet for tablet eaecbfb45f43413bab6668024b58b5ed (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:21.029330 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaecbfb45f43413bab6668024b58b5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.029902 32338 tablet_service.cc:1511] Processing CreateTablet for tablet b2881224b4a9483784d2fc3506e15efb (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:21.030812 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaecbfb45f43413bab6668024b58b5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.032594 32337 tablet_service.cc:1511] Processing CreateTablet for tablet a8b4429f78694eabba75c370968d892f (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:21.035351 32336 tablet_service.cc:1511] Processing CreateTablet for tablet 77ad699d9aa749ca962699ee67454652 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:21.038097 32340 tablet_service.cc:1511] Processing CreateTablet for tablet 2e604421633a4d83a4f915b89dc8cb73 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:21.027628 32339 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa0bb4c884b489596097064f0bf79f5 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:21.046636 32335 tablet_service.cc:1511] Processing CreateTablet for tablet eaecbfb45f43413bab6668024b58b5ed (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:21.049155 32185 tablet_service.cc:1511] Processing CreateTablet for tablet 5f81d8b0dff94305a099ce806b8d7020 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:21.050788 32185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f81d8b0dff94305a099ce806b8d7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.026261 32341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff28cd78a14a4ea7c5a3ee8c75b9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.052264 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 5f81d8b0dff94305a099ce806b8d7020 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:21.055076 32336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ad699d9aa749ca962699ee67454652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.055527 32334 tablet_service.cc:1511] Processing CreateTablet for tablet 5f81d8b0dff94305a099ce806b8d7020 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:21.057037 32334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f81d8b0dff94305a099ce806b8d7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.065753 32390 tablet_bootstrap.cc:492] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.070834 32259 tablet_service.cc:1511] Processing CreateTablet for tablet f6269385447741a78b60510b9318dee1 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:21.071061 32184 tablet_service.cc:1511] Processing CreateTablet for tablet f6269385447741a78b60510b9318dee1 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:21.072674 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6269385447741a78b60510b9318dee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.072762 32184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6269385447741a78b60510b9318dee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.078009 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f81d8b0dff94305a099ce806b8d7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.078583 32338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2881224b4a9483784d2fc3506e15efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.078743 32333 tablet_service.cc:1511] Processing CreateTablet for tablet f6269385447741a78b60510b9318dee1 (DEFAULT_TABLE table=test-workload [id=379103a70d9642a5976c5a18d704731a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:21.080485 32333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6269385447741a78b60510b9318dee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.081604 32340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e604421633a4d83a4f915b89dc8cb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.082741 32335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaecbfb45f43413bab6668024b58b5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.085332 32339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa0bb4c884b489596097064f0bf79f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.090036 32390 tablet_bootstrap.cc:654] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.098819 32337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b4429f78694eabba75c370968d892f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:21.127637 32391 tablet_bootstrap.cc:492] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:21.135732 32392 tablet_bootstrap.cc:492] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:21.140818 32390 tablet_bootstrap.cc:492] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:21.141525 32390 ts_tablet_manager.cc:1403] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.004s
I20260709 12:29:21.142237 32391 tablet_bootstrap.cc:654] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.148401 32390 raft_consensus.cc:359] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.149227 32390 raft_consensus.cc:385] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.149526 32390 raft_consensus.cc:740] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.146610 32392 tablet_bootstrap.cc:654] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.157953 32390 consensus_queue.cc:260] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.160239 32392 tablet_bootstrap.cc:492] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.166973 32392 ts_tablet_manager.cc:1403] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.008s
I20260709 12:29:21.174563 32390 ts_tablet_manager.cc:1434] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.008s
I20260709 12:29:21.175487 32302 heartbeater.cc:499] Master 127.17.40.62:33669 was elected leader, sending a full tablet report...
I20260709 12:29:21.180680 32390 tablet_bootstrap.cc:492] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.187938 32390 tablet_bootstrap.cc:654] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.196233 32392 raft_consensus.cc:359] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.197152 32392 raft_consensus.cc:385] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.197461 32392 raft_consensus.cc:740] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.200183 32391 tablet_bootstrap.cc:492] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.200845 32391 ts_tablet_manager.cc:1403] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.005s
I20260709 12:29:21.204034 32391 raft_consensus.cc:359] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.204900 32391 raft_consensus.cc:385] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.205214 32391 raft_consensus.cc:740] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.206101 32391 consensus_queue.cc:260] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.214494 32390 tablet_bootstrap.cc:492] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:21.215229 32390 ts_tablet_manager.cc:1403] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.005s
I20260709 12:29:21.218314 32390 raft_consensus.cc:359] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.219175 32390 raft_consensus.cc:385] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.218753 32392 consensus_queue.cc:260] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.219525 32390 raft_consensus.cc:740] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.220502 32390 consensus_queue.cc:260] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.221728 32376 heartbeater.cc:499] Master 127.17.40.62:33669 was elected leader, sending a full tablet report...
I20260709 12:29:21.223361 32392 ts_tablet_manager.cc:1434] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.004s
I20260709 12:29:21.223668 32227 heartbeater.cc:499] Master 127.17.40.62:33669 was elected leader, sending a full tablet report...
I20260709 12:29:21.224398 32391 ts_tablet_manager.cc:1434] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.003s
I20260709 12:29:21.224644 32392 tablet_bootstrap.cc:492] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
W20260709 12:29:21.227761 32303 tablet.cc:2406] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:29:21.231756 32391 tablet_bootstrap.cc:492] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:21.232332 32392 tablet_bootstrap.cc:654] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.236802 32390 ts_tablet_manager.cc:1434] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:29:21.241356 32390 tablet_bootstrap.cc:492] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.242420 32391 tablet_bootstrap.cc:654] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.246282 32392 tablet_bootstrap.cc:492] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.247069 32392 ts_tablet_manager.cc:1403] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 12:29:21.250783 32390 tablet_bootstrap.cc:654] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.251513 32392 raft_consensus.cc:359] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.252686 32392 raft_consensus.cc:385] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.253087 32392 raft_consensus.cc:740] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.254478 32392 consensus_queue.cc:260] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.258100 32392 ts_tablet_manager.cc:1434] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:29:21.260931 32392 tablet_bootstrap.cc:492] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:21.269640 32390 tablet_bootstrap.cc:492] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:21.269960 32392 tablet_bootstrap.cc:654] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.270349 32390 ts_tablet_manager.cc:1403] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.010s
I20260709 12:29:21.274230 32390 raft_consensus.cc:359] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.275123 32390 raft_consensus.cc:385] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.275455 32390 raft_consensus.cc:740] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.276258 32390 consensus_queue.cc:260] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.278751 32390 ts_tablet_manager.cc:1434] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:21.278985 32396 raft_consensus.cc:493] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.279918 32390 tablet_bootstrap.cc:492] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.279592 32396 raft_consensus.cc:515] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.281744 32391 tablet_bootstrap.cc:492] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.282948 32391 ts_tablet_manager.cc:1403] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.012s
I20260709 12:29:21.287029 32396 leader_election.cc:290] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.290901 32399 raft_consensus.cc:493] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.291543 32399 raft_consensus.cc:515] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.287381 32391 raft_consensus.cc:359] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.293066 32391 raft_consensus.cc:385] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.293459 32391 raft_consensus.cc:740] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.294515 32391 consensus_queue.cc:260] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.299155 32396 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.298697 32399 leader_election.cc:290] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:21.299862 32396 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.300879 32391 ts_tablet_manager.cc:1434] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:29:21.302064 32391 tablet_bootstrap.cc:492] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:21.304317 32396 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.308959 32391 tablet_bootstrap.cc:654] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.309617 32392 tablet_bootstrap.cc:492] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.309921 32390 tablet_bootstrap.cc:654] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.310245 32392 ts_tablet_manager.cc:1403] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.013s
I20260709 12:29:21.314152 32392 raft_consensus.cc:359] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.317655 32392 raft_consensus.cc:385] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.318027 32392 raft_consensus.cc:740] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.319123 32392 consensus_queue.cc:260] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.325233 32392 ts_tablet_manager.cc:1434] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:29:21.326570 32392 tablet_bootstrap.cc:492] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:21.331204 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:21.334353 32392 tablet_bootstrap.cc:654] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:21.337288 32317 leader_election.cc:343] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.348204 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
W20260709 12:29:21.350354 32316 leader_election.cc:343] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.351063 32316 leader_election.cc:304] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8150545344b54f839e178a18a8511058; no voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:21.352901 32399 raft_consensus.cc:2749] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:21.354866 32398 raft_consensus.cc:493] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.355674 32398 raft_consensus.cc:515] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.364069 32398 leader_election.cc:290] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.367069 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:21.367960 32202 raft_consensus.cc:2468] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 0.
I20260709 12:29:21.370626 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:21.372740 32242 leader_election.cc:304] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
W20260709 12:29:21.380227 32242 leader_election.cc:343] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.380800 32396 raft_consensus.cc:2804] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.381410 32396 raft_consensus.cc:493] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.381814 32396 raft_consensus.cc:3060] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.387379 32391 tablet_bootstrap.cc:492] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.387436 32392 tablet_bootstrap.cc:492] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.388105 32391 ts_tablet_manager.cc:1403] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.086s	user 0.026s	sys 0.034s
I20260709 12:29:21.388253 32392 ts_tablet_manager.cc:1403] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.026s
I20260709 12:29:21.391584 32391 raft_consensus.cc:359] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.392218 32391 raft_consensus.cc:385] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.392535 32391 raft_consensus.cc:740] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.392705 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.393435 32392 raft_consensus.cc:359] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.393463 32391 consensus_queue.cc:260] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.394517 32392 raft_consensus.cc:385] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:29:21.394843 32167 leader_election.cc:343] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.392652 32390 tablet_bootstrap.cc:492] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:21.396205 32390 ts_tablet_manager.cc:1403] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.008s
I20260709 12:29:21.394932 32392 raft_consensus.cc:740] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.396620 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:21.399266 32396 raft_consensus.cc:515] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.399647 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.400751 32277 raft_consensus.cc:2393] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6df360bbccb74065bcf6874dfe187687 in current term 1: Already voted for candidate 4d19c5882d9940a38aeab897a4f65240 in this term.
I20260709 12:29:21.400926 32391 ts_tablet_manager.cc:1434] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:29:21.401332 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.402506 32391 tablet_bootstrap.cc:492] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
W20260709 12:29:21.403322 32242 leader_election.cc:343] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.404659 32392 consensus_queue.cc:260] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.405064 32168 leader_election.cc:304] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687; no voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058
I20260709 12:29:21.405939 32350 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 0.
I20260709 12:29:21.406586 32399 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.407313 32398 raft_consensus.cc:3060] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.407147 32399 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.408720 32242 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:21.410954 32391 tablet_bootstrap.cc:654] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.413808 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
W20260709 12:29:21.415973 32316 leader_election.cc:343] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.416832 32399 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:21.418223 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:21.419312 32277 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:21.421056 32317 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:21.421662 32392 ts_tablet_manager.cc:1434] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:29:21.424130 32414 raft_consensus.cc:2804] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.424700 32414 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.425094 32414 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.425503 32398 raft_consensus.cc:2749] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:21.427731 32392 tablet_bootstrap.cc:492] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:21.428501 32390 raft_consensus.cc:359] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.429467 32390 raft_consensus.cc:385] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.429804 32390 raft_consensus.cc:740] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.433496 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:21.434719 32396 leader_election.cc:290] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.435983 32390 consensus_queue.cc:260] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.438208 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:21.439004 32390 ts_tablet_manager.cc:1434] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 12:29:21.440368 32390 tablet_bootstrap.cc:492] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.441432 32391 tablet_bootstrap.cc:492] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.442121 32391 ts_tablet_manager.cc:1403] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.023s
W20260709 12:29:21.445166 32242 leader_election.cc:343] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.447033 32399 raft_consensus.cc:2804] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.447582 32399 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.447971 32399 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.448567 32390 tablet_bootstrap.cc:654] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.449862 32391 raft_consensus.cc:359] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.450947 32391 raft_consensus.cc:385] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.451332 32391 raft_consensus.cc:740] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
W20260709 12:29:21.452096 32148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:21.452346 32391 consensus_queue.cc:260] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.457268 32391 ts_tablet_manager.cc:1434] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:29:21.458453 32391 tablet_bootstrap.cc:492] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:21.463593 32202 raft_consensus.cc:2468] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 1.
I20260709 12:29:21.465212 32242 leader_election.cc:304] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 8150545344b54f839e178a18a8511058
I20260709 12:29:21.465618 32391 tablet_bootstrap.cc:654] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.466212 32396 raft_consensus.cc:2804] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:21.446341 32392 tablet_bootstrap.cc:654] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.470827 32399 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.468112 32414 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.475193 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:21.476624 32414 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.478487 32201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:21.481148 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
W20260709 12:29:21.483299 32242 leader_election.cc:343] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.484162 32350 raft_consensus.cc:2393] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d19c5882d9940a38aeab897a4f65240 in current term 1: Already voted for candidate 8150545344b54f839e178a18a8511058 in this term.
I20260709 12:29:21.486439 32390 tablet_bootstrap.cc:492] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:21.486141 32242 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240; no voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058
I20260709 12:29:21.487272 32392 tablet_bootstrap.cc:492] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.487862 32390 ts_tablet_manager.cc:1403] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.017s
W20260709 12:29:21.487771 32316 leader_election.cc:343] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.492072 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:21.492267 32390 raft_consensus.cc:359] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.487862 32392 ts_tablet_manager.cc:1403] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.001s
I20260709 12:29:21.493268 32277 raft_consensus.cc:2393] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8150545344b54f839e178a18a8511058 in current term 1: Already voted for candidate 4d19c5882d9940a38aeab897a4f65240 in this term.
I20260709 12:29:21.493288 32396 raft_consensus.cc:697] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:21.496233 32396 consensus_queue.cc:237] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.496680 32317 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8150545344b54f839e178a18a8511058; no voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:21.497493 32399 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:21.497197 32392 raft_consensus.cc:359] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.498284 32392 raft_consensus.cc:385] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.498664 32392 raft_consensus.cc:740] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.499442 32416 raft_consensus.cc:2749] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:21.493288 32390 raft_consensus.cc:385] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.500206 32390 raft_consensus.cc:740] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.501399 32391 tablet_bootstrap.cc:492] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.501101 32390 consensus_queue.cc:260] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.499699 32392 consensus_queue.cc:260] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.503134 32391 ts_tablet_manager.cc:1403] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.019s
I20260709 12:29:21.503774 32390 ts_tablet_manager.cc:1434] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:29:21.497321 32418 raft_consensus.cc:2749] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:21.505007 32390 tablet_bootstrap.cc:492] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.506640 32391 raft_consensus.cc:359] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.507542 32391 raft_consensus.cc:385] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.505026 32392 ts_tablet_manager.cc:1434] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:29:21.507855 32391 raft_consensus.cc:740] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.509258 32392 tablet_bootstrap.cc:492] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:21.509181 32391 consensus_queue.cc:260] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.512955 32390 tablet_bootstrap.cc:654] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.518033 32392 tablet_bootstrap.cc:654] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.521371 32398 raft_consensus.cc:493] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.522214 32398 raft_consensus.cc:515] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.524230 32418 raft_consensus.cc:493] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.525233 32418 raft_consensus.cc:515] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.526731 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaecbfb45f43413bab6668024b58b5ed" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:21.527822 32277 raft_consensus.cc:2468] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:21.529749 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:21.530488 32168 leader_election.cc:304] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
W20260709 12:29:21.532065 32242 leader_election.cc:343] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.533004 32414 raft_consensus.cc:493] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.533645 32414 raft_consensus.cc:515] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.534533 32392 tablet_bootstrap.cc:492] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.534677 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaecbfb45f43413bab6668024b58b5ed" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.535178 32392 ts_tablet_manager.cc:1403] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 12:29:21.535739 32350 raft_consensus.cc:2468] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:21.536231 32414 leader_election.cc:290] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.538446 32398 leader_election.cc:290] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.538738 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ad699d9aa749ca962699ee67454652" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:21.539362 32398 raft_consensus.cc:2804] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.539482 32392 raft_consensus.cc:359] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.540527 32392 raft_consensus.cc:385] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.540391 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ad699d9aa749ca962699ee67454652" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.539561 32202 raft_consensus.cc:2468] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 0.
I20260709 12:29:21.539927 32398 raft_consensus.cc:493] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.541280 32350 raft_consensus.cc:2468] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 0.
I20260709 12:29:21.541587 32398 raft_consensus.cc:3060] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.542757 32242 leader_election.cc:304] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:21.542713 32392 raft_consensus.cc:740] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.544725 32414 raft_consensus.cc:2804] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.545300 32414 raft_consensus.cc:493] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.544842 32392 consensus_queue.cc:260] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.545840 32414 raft_consensus.cc:3060] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.546216 32391 ts_tablet_manager.cc:1434] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 12:29:21.548142 32392 ts_tablet_manager.cc:1434] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:29:21.549485 32392 tablet_bootstrap.cc:492] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:21.552850 32391 tablet_bootstrap.cc:492] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:21.557245 32392 tablet_bootstrap.cc:654] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.569744 32398 raft_consensus.cc:515] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.570690 32392 tablet_bootstrap.cc:492] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.571547 32392 ts_tablet_manager.cc:1403] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 12:29:21.572861 32391 tablet_bootstrap.cc:654] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.575212 32392 raft_consensus.cc:359] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.576171 32392 raft_consensus.cc:385] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.576517 32392 raft_consensus.cc:740] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.577677 32392 consensus_queue.cc:260] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.578977 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.580565 32099 catalog_manager.cc:5697] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:21.580971 32242 leader_election.cc:343] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.582777 32242 leader_election.cc:304] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240; no voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058
I20260709 12:29:21.583102 32392 ts_tablet_manager.cc:1434] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:29:21.584430 32392 tablet_bootstrap.cc:492] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:21.584901 32396 raft_consensus.cc:2749] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:21.592892 32392 tablet_bootstrap.cc:654] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.598977 32424 raft_consensus.cc:493] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.599701 32424 raft_consensus.cc:515] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.602432 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaecbfb45f43413bab6668024b58b5ed" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:21.603325 32418 leader_election.cc:290] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.603446 32277 raft_consensus.cc:3060] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.604014 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
W20260709 12:29:21.605938 32168 leader_election.cc:343] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.602293 32424 leader_election.cc:290] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.607785 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.608777 32350 raft_consensus.cc:2468] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:21.610760 32167 leader_election.cc:304] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 4d19c5882d9940a38aeab897a4f65240
I20260709 12:29:21.612161 32424 raft_consensus.cc:2804] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.612540 32424 raft_consensus.cc:493] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.612903 32424 raft_consensus.cc:3060] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.613634 32414 raft_consensus.cc:515] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.617520 32390 tablet_bootstrap.cc:492] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:21.618211 32390 ts_tablet_manager.cc:1403] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.113s	user 0.055s	sys 0.055s
I20260709 12:29:21.618625 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ad699d9aa749ca962699ee67454652" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:21.619355 32202 raft_consensus.cc:3060] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.619256 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ad699d9aa749ca962699ee67454652" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:21.620150 32351 raft_consensus.cc:3060] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.621599 32390 raft_consensus.cc:359] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.622433 32390 raft_consensus.cc:385] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.622745 32390 raft_consensus.cc:740] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.622640 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaecbfb45f43413bab6668024b58b5ed" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:21.623440 32350 raft_consensus.cc:3060] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.623870 32390 consensus_queue.cc:260] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.624329 32424 raft_consensus.cc:515] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.626591 32390 ts_tablet_manager.cc:1434] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:21.627810 32390 tablet_bootstrap.cc:492] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.627810 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
W20260709 12:29:21.629565 32168 leader_election.cc:343] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.630050 32414 leader_election.cc:290] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.633364 32424 leader_election.cc:290] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.629779 32351 raft_consensus.cc:2468] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 1.
I20260709 12:29:21.634191 32424 raft_consensus.cc:493] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.634701 32424 raft_consensus.cc:515] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.635277 32242 leader_election.cc:304] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:21.635845 32390 tablet_bootstrap.cc:654] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.636299 32414 raft_consensus.cc:2804] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:21.637164 32414 raft_consensus.cc:697] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:21.637797 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b4429f78694eabba75c370968d892f" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:21.638576 32276 raft_consensus.cc:2468] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:21.638145 32414 consensus_queue.cc:237] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.640125 32168 leader_election.cc:304] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:21.641716 32428 raft_consensus.cc:2804] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.642792 32392 tablet_bootstrap.cc:492] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.642200 32428 raft_consensus.cc:493] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.643379 32428 raft_consensus.cc:3060] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.643419 32392 ts_tablet_manager.cc:1403] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.059s	user 0.004s	sys 0.016s
I20260709 12:29:21.645929 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b4429f78694eabba75c370968d892f" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.646781 32349 raft_consensus.cc:2468] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:21.647604 32277 raft_consensus.cc:2468] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:21.644034 32398 leader_election.cc:290] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.644204 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:21.648487 32390 tablet_bootstrap.cc:492] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:21.648898 32351 raft_consensus.cc:3060] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.648597 32392 raft_consensus.cc:359] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.649078 32168 leader_election.cc:304] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:21.649133 32390 ts_tablet_manager.cc:1403] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:29:21.649796 32392 raft_consensus.cc:385] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.650247 32392 raft_consensus.cc:740] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.644904 32424 leader_election.cc:290] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.651444 32392 consensus_queue.cc:260] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.652945 32390 raft_consensus.cc:359] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.653813 32390 raft_consensus.cc:385] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.654099 32390 raft_consensus.cc:740] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.638083 32350 raft_consensus.cc:2468] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:21.655112 32390 consensus_queue.cc:260] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.657809 32390 ts_tablet_manager.cc:1434] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:21.651822 32424 raft_consensus.cc:2804] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:21.659854 32392 ts_tablet_manager.cc:1434] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:29:21.658638 32202 raft_consensus.cc:2468] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 1.
I20260709 12:29:21.661221 32392 tablet_bootstrap.cc:492] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:21.660163 32424 raft_consensus.cc:697] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:21.663309 32391 tablet_bootstrap.cc:492] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.662926 32424 consensus_queue.cc:237] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.663938 32391 ts_tablet_manager.cc:1403] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.010s
I20260709 12:29:21.665187 32428 raft_consensus.cc:515] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.660352 32390 tablet_bootstrap.cc:492] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.669509 32392 tablet_bootstrap.cc:654] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.669914 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b4429f78694eabba75c370968d892f" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:21.671092 32277 raft_consensus.cc:3060] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.676658 32391 raft_consensus.cc:359] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.681221 32390 tablet_bootstrap.cc:654] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.677923 32391 raft_consensus.cc:385] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.682976 32391 raft_consensus.cc:740] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.684754 32351 raft_consensus.cc:2468] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:21.684288 32391 consensus_queue.cc:260] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.688349 32167 leader_election.cc:304] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 4d19c5882d9940a38aeab897a4f65240
I20260709 12:29:21.684906 32399 raft_consensus.cc:493] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.679173 32428 leader_election.cc:290] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.685604 32277 raft_consensus.cc:2468] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:21.685961 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b4429f78694eabba75c370968d892f" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:21.690716 32350 raft_consensus.cc:3060] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.691730 32168 leader_election.cc:304] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:21.691511 32399 raft_consensus.cc:515] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.693805 32392 tablet_bootstrap.cc:492] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:21.694308 32399 leader_election.cc:290] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:21.694384 32392 ts_tablet_manager.cc:1403] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.003s
I20260709 12:29:21.695175 32391 ts_tablet_manager.cc:1434] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.003s
I20260709 12:29:21.694317 32098 catalog_manager.cc:5697] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:21.695551 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2881224b4a9483784d2fc3506e15efb" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:21.696329 32391 tablet_bootstrap.cc:492] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:21.696291 32202 raft_consensus.cc:2468] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:21.698089 32392 raft_consensus.cc:359] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.698899 32392 raft_consensus.cc:385] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.698529 32316 leader_election.cc:304] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:21.699225 32392 raft_consensus.cc:740] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.700501 32399 raft_consensus.cc:2804] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.700968 32399 raft_consensus.cc:493] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.701125 32398 raft_consensus.cc:2804] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:21.701340 32399 raft_consensus.cc:3060] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.701699 32398 raft_consensus.cc:697] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:21.702672 32398 consensus_queue.cc:237] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.703728 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2881224b4a9483784d2fc3506e15efb" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:21.704487 32277 raft_consensus.cc:2468] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:21.700372 32392 consensus_queue.cc:260] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.709038 32392 ts_tablet_manager.cc:1434] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:29:21.706267 32424 raft_consensus.cc:2804] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:21.715416 32416 raft_consensus.cc:493] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.715916 32424 raft_consensus.cc:697] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:21.716272 32416 raft_consensus.cc:515] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.717615 32424 consensus_queue.cc:237] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.720825 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:21.721482 32416 leader_election.cc:290] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573)
I20260709 12:29:21.721654 32277 raft_consensus.cc:2468] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:21.724273 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:21.727217 32317 leader_election.cc:304] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:21.730131 32416 raft_consensus.cc:2804] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.730582 32416 raft_consensus.cc:493] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.730926 32416 raft_consensus.cc:3060] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.731510 32391 tablet_bootstrap.cc:654] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:21.736722 32316 leader_election.cc:343] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.747077 32350 raft_consensus.cc:2468] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:21.748632 32390 tablet_bootstrap.cc:492] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
W20260709 12:29:21.747253 32167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.40.3:36157, user_credentials={real_user=slave}} blocked reactor thread for 59023.6us
I20260709 12:29:21.749380 32390 ts_tablet_manager.cc:1403] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.010s
I20260709 12:29:21.755831 32416 raft_consensus.cc:515] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.758167 32416 leader_election.cc:290] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573)
I20260709 12:29:21.759454 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
W20260709 12:29:21.760901 32316 leader_election.cc:343] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.763757 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:21.764503 32277 raft_consensus.cc:3060] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.766144 32390 raft_consensus.cc:359] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.769074 32390 raft_consensus.cc:385] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.769681 32390 raft_consensus.cc:740] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.747771 32399 raft_consensus.cc:515] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.772403 32399 leader_election.cc:290] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:21.773053 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2881224b4a9483784d2fc3506e15efb" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:21.773885 32202 raft_consensus.cc:3060] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.773203 32390 consensus_queue.cc:260] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.774000 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2881224b4a9483784d2fc3506e15efb" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:21.774782 32276 raft_consensus.cc:3060] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.776095 32390 ts_tablet_manager.cc:1434] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:29:21.777272 32390 tablet_bootstrap.cc:492] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:21.777709 32277 raft_consensus.cc:2468] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:21.783488 32390 tablet_bootstrap.cc:654] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.784624 32391 tablet_bootstrap.cc:492] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.785287 32391 ts_tablet_manager.cc:1403] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.010s
I20260709 12:29:21.786187 32202 raft_consensus.cc:2468] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:21.787194 32317 leader_election.cc:304] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:21.787482 32316 leader_election.cc:304] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:21.788591 32390 tablet_bootstrap.cc:492] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:21.788508 32399 raft_consensus.cc:2804] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:21.788998 32414 raft_consensus.cc:493] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.789423 32390 ts_tablet_manager.cc:1403] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:29:21.789004 32391 raft_consensus.cc:359] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.789752 32414 raft_consensus.cc:515] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.790221 32391 raft_consensus.cc:385] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.790671 32391 raft_consensus.cc:740] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.790309 32097 catalog_manager.cc:5697] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:21.791635 32391 consensus_queue.cc:260] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.792116 32414 leader_election.cc:290] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.793087 32390 raft_consensus.cc:359] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.793918 32390 raft_consensus.cc:385] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.794245 32390 raft_consensus.cc:740] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.794644 32391 ts_tablet_manager.cc:1434] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:29:21.795167 32390 consensus_queue.cc:260] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.796092 32391 tablet_bootstrap.cc:492] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:21.797441 32390 ts_tablet_manager.cc:1434] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:21.798697 32276 raft_consensus.cc:2468] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:21.788452 32416 raft_consensus.cc:2804] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:21.799510 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.800239 32350 raft_consensus.cc:2468] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 0.
I20260709 12:29:21.801725 32242 leader_election.cc:304] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:21.802003 32399 raft_consensus.cc:697] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:21.803023 32399 consensus_queue.cc:237] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.803486 32414 raft_consensus.cc:2804] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:21.804117 32414 raft_consensus.cc:493] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.804543 32414 raft_consensus.cc:3060] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.807137 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
W20260709 12:29:21.808715 32242 leader_election.cc:343] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.810783 32098 catalog_manager.cc:5697] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:21.812584 32098 catalog_manager.cc:5697] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:21.815070 32416 raft_consensus.cc:697] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:21.815440 32414 raft_consensus.cc:515] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.817873 32414 leader_election.cc:290] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.819515 32416 consensus_queue.cc:237] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.821092 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:21.821611 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:21.822300 32350 raft_consensus.cc:3060] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.822561 32391 tablet_bootstrap.cc:654] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:21.825820 32242 leader_election.cc:343] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:21.832448 32350 raft_consensus.cc:2468] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 1.
I20260709 12:29:21.834139 32242 leader_election.cc:304] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:21.835870 32414 raft_consensus.cc:2804] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:21.836570 32414 raft_consensus.cc:697] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:21.837723 32414 consensus_queue.cc:237] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.846566 32391 tablet_bootstrap.cc:492] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.847221 32391 ts_tablet_manager.cc:1403] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.002s
I20260709 12:29:21.850136 32391 raft_consensus.cc:359] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.850888 32391 raft_consensus.cc:385] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.851703 32391 raft_consensus.cc:740] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.852469 32391 consensus_queue.cc:260] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.852778 32098 catalog_manager.cc:5697] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:21.853042 32097 catalog_manager.cc:5697] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:21.854794 32391 ts_tablet_manager.cc:1434] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:21.855135 32097 catalog_manager.cc:5697] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:21.857487 32391 tablet_bootstrap.cc:492] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:21.865490 32391 tablet_bootstrap.cc:654] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:21.870807 32391 tablet_bootstrap.cc:492] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:21.871345 32391 ts_tablet_manager.cc:1403] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:29:21.874262 32391 raft_consensus.cc:359] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.875046 32391 raft_consensus.cc:385] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:21.875239 32391 raft_consensus.cc:740] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:21.875763 32391 consensus_queue.cc:260] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.877609 32391 ts_tablet_manager.cc:1434] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:21.909325 32414 raft_consensus.cc:493] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.909936 32414 raft_consensus.cc:515] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:21.911734 32414 leader_election.cc:290] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:21.912806 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:21.912985 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:21.913789 32350 raft_consensus.cc:2393] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d19c5882d9940a38aeab897a4f65240 in current term 1: Already voted for candidate 6df360bbccb74065bcf6874dfe187687 in this term.
I20260709 12:29:21.914812 32242 leader_election.cc:304] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240; no voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058
I20260709 12:29:21.915503 32414 raft_consensus.cc:3060] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.921128 32414 raft_consensus.cc:2749] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:21.953926 32350 raft_consensus.cc:3060] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:21.961520 32414 consensus_queue.cc:1048] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:21.974928 32414 consensus_queue.cc:1048] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.039377 32424 raft_consensus.cc:493] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.039875 32424 raft_consensus.cc:515] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:22.041712 32424 leader_election.cc:290] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:22.042563 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:22.042829 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:22.043505 32276 raft_consensus.cc:2393] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6df360bbccb74065bcf6874dfe187687 in current term 1: Already voted for candidate 8150545344b54f839e178a18a8511058 in this term.
I20260709 12:29:22.044514 32168 leader_election.cc:304] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687; no voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058
I20260709 12:29:22.045254 32424 raft_consensus.cc:3060] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:22.047931 32414 consensus_queue.cc:1048] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.051211 32424 raft_consensus.cc:2749] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:22.061138 32452 consensus_queue.cc:1048] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:22.148357 32424 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.148967 32424 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:22.151095 32424 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:22.152215 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:22.152074 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:22.153246 32350 raft_consensus.cc:2393] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6df360bbccb74065bcf6874dfe187687 in current term 1: Already voted for candidate 8150545344b54f839e178a18a8511058 in this term.
I20260709 12:29:22.153260 32276 raft_consensus.cc:2393] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6df360bbccb74065bcf6874dfe187687 in current term 1: Already voted for candidate 4d19c5882d9940a38aeab897a4f65240 in this term.
I20260709 12:29:22.154783 32168 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687; no voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058
I20260709 12:29:22.155578 32424 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:22.163095 32424 raft_consensus.cc:2749] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:22.163751 32436 consensus_queue.cc:1048] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:22.175478 32398 consensus_queue.cc:1048] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.198990 32398 consensus_queue.cc:1048] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.211738 32424 consensus_queue.cc:1048] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.228116 32416 consensus_queue.cc:1048] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.238216 32424 consensus_queue.cc:1048] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:22.240166 32443 consensus_queue.cc:1048] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:22.258623 32428 consensus_queue.cc:1048] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.288846 32443 consensus_queue.cc:1048] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.298141 32398 raft_consensus.cc:493] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.298843 32398 raft_consensus.cc:515] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:22.300200 32444 consensus_queue.cc:1048] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:22.303112 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:22.303941 32350 raft_consensus.cc:2393] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6df360bbccb74065bcf6874dfe187687 in current term 1: Already voted for candidate 4d19c5882d9940a38aeab897a4f65240 in this term.
I20260709 12:29:22.306177 32398 leader_election.cc:290] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:22.306504 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:22.308349 32168 leader_election.cc:304] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687; no voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058
I20260709 12:29:22.310892 32398 raft_consensus.cc:3060] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:22.317236 32398 raft_consensus.cc:2749] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:22.344584 32452 consensus_queue.cc:1048] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:22.355767 32452 consensus_queue.cc:1048] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:22.455368 32148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:23.416544 32444 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.417135 32444 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.418959 32444 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:23.419996 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:23.420199 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:23.420689 32202 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:23.420997 32276 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:23.422019 32316 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:23.422879 32444 raft_consensus.cc:2804] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:23.423246 32444 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.423529 32444 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.429335 32444 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.431380 32444 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 2 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:23.432108 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:23.432353 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:23.432873 32202 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.433072 32276 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.438737 32202 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 2.
I20260709 12:29:23.438905 32276 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 2.
I20260709 12:29:23.440109 32316 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:23.440877 32444 raft_consensus.cc:2804] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:23.441932 32444 raft_consensus.cc:697] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:23.442873 32444 consensus_queue.cc:237] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.450289 32097 catalog_manager.cc:5697] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 0 to 2, leader changed from <none> to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:23.461596 32148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:23.715296 32350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1"
dest_uuid: "8150545344b54f839e178a18a8511058"
mode: GRACEFUL
new_leader_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34750
I20260709 12:29:23.716049 32350 raft_consensus.cc:606] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Received request to transfer leadership to TS 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:23.733381 32276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73"
dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
mode: GRACEFUL
new_leader_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:46684
I20260709 12:29:23.733975 32276 raft_consensus.cc:606] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Received request to transfer leadership to TS 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:23.739600 32350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5"
dest_uuid: "8150545344b54f839e178a18a8511058"
mode: GRACEFUL
new_leader_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34750
I20260709 12:29:23.740206 32350 raft_consensus.cc:606] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Received request to transfer leadership to TS 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:23.746057 32350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2881224b4a9483784d2fc3506e15efb"
dest_uuid: "8150545344b54f839e178a18a8511058"
mode: GRACEFUL
new_leader_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34750
I20260709 12:29:23.746685 32350 raft_consensus.cc:606] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Received request to transfer leadership to TS 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:23.762001 32202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8b4429f78694eabba75c370968d892f"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
mode: GRACEFUL
new_leader_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:34334
I20260709 12:29:23.762624 32202 raft_consensus.cc:606] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Received request to transfer leadership to TS 4d19c5882d9940a38aeab897a4f65240
I20260709 12:29:23.772112 32202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaecbfb45f43413bab6668024b58b5ed"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
mode: GRACEFUL
new_leader_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:34334
I20260709 12:29:23.772753 32202 raft_consensus.cc:606] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Received request to transfer leadership to TS 4d19c5882d9940a38aeab897a4f65240
I20260709 12:29:23.781682 32202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6269385447741a78b60510b9318dee1"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
mode: GRACEFUL
new_leader_uuid: "8150545344b54f839e178a18a8511058"
 from {username='slave'} at 127.0.0.1:34334
I20260709 12:29:23.782306 32202 raft_consensus.cc:606] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Received request to transfer leadership to TS 8150545344b54f839e178a18a8511058
I20260709 12:29:23.821758 32470 raft_consensus.cc:993] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687: : Instructing follower 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:23.822314 32398 raft_consensus.cc:1081] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Signalling peer 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:23.824054 32276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8b4429f78694eabba75c370968d892f"
dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:29:23.824777 32276 raft_consensus.cc:493] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:23.825214 32276 raft_consensus.cc:3060] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.828229 32471 raft_consensus.cc:993] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058: : Instructing follower 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:23.828874 32444 raft_consensus.cc:1081] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Signalling peer 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:23.830806 32202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2881224b4a9483784d2fc3506e15efb"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34326
I20260709 12:29:23.831349 32202 raft_consensus.cc:493] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:23.831681 32202 raft_consensus.cc:3060] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.833443 32276 raft_consensus.cc:515] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.835806 32276 leader_election.cc:290] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:23.836652 32201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b4429f78694eabba75c370968d892f" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:23.837428 32201 raft_consensus.cc:3055] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:23.837814 32201 raft_consensus.cc:740] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:23.838995 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b4429f78694eabba75c370968d892f" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:23.838794 32201 consensus_queue.cc:260] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.839718 32350 raft_consensus.cc:3060] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.839884 32200 raft_consensus.cc:1275] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Refusing update from remote peer 8150545344b54f839e178a18a8511058: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:23.840440 32201 raft_consensus.cc:3060] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.840066 32202 raft_consensus.cc:515] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.842199 32471 consensus_queue.cc:1048] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:23.844555 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2881224b4a9483784d2fc3506e15efb" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:23.845328 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2881224b4a9483784d2fc3506e15efb" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:23.845403 32277 raft_consensus.cc:3060] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.846153 32351 raft_consensus.cc:3055] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:23.846632 32351 raft_consensus.cc:740] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:23.847550 32351 consensus_queue.cc:260] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.850174 32351 raft_consensus.cc:3060] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.850366 32350 raft_consensus.cc:2468] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:23.853957 32202 leader_election.cc:290] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:23.854990 32277 raft_consensus.cc:2468] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:23.855566 32242 leader_election.cc:304] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:23.856719 32414 raft_consensus.cc:2804] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:23.856774 32168 leader_election.cc:304] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:23.858013 32470 raft_consensus.cc:2804] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:23.858078 32351 raft_consensus.cc:2468] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:23.854583 32398 raft_consensus.cc:993] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687: : Instructing follower 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:23.860988 32484 raft_consensus.cc:1081] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Signalling peer 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:23.846153 32276 raft_consensus.cc:1275] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 8150545344b54f839e178a18a8511058: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:23.865000 32201 raft_consensus.cc:2468] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:23.865662 32471 consensus_queue.cc:1048] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:23.866515 32276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaecbfb45f43413bab6668024b58b5ed"
dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:29:23.867224 32276 raft_consensus.cc:493] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:23.867645 32276 raft_consensus.cc:3060] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.868896 32470 raft_consensus.cc:697] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:23.870008 32470 consensus_queue.cc:237] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.875178 32444 raft_consensus.cc:993] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058: : Instructing follower 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:23.880092 32471 raft_consensus.cc:1081] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Signalling peer 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:23.883474 32414 raft_consensus.cc:697] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:23.884732 32414 consensus_queue.cc:237] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.888424 32276 raft_consensus.cc:515] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.890378 32200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34326
I20260709 12:29:23.891248 32200 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:23.891727 32200 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:23.897342 32097 catalog_manager.cc:5697] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 1 to 2, leader changed from 8150545344b54f839e178a18a8511058 (127.17.40.3) to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.900413 32201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaecbfb45f43413bab6668024b58b5ed" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:23.901183 32201 raft_consensus.cc:3055] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:23.901535 32201 raft_consensus.cc:740] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:23.902472 32201 consensus_queue.cc:260] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.903750 32201 raft_consensus.cc:3060] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.903874 32099 catalog_manager.cc:5697] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 1 to 2, leader changed from 6df360bbccb74065bcf6874dfe187687 (127.17.40.1) to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.909209 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaecbfb45f43413bab6668024b58b5ed" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:23.910158 32351 raft_consensus.cc:3060] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.913905 32483 raft_consensus.cc:993] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687: : Instructing follower 8150545344b54f839e178a18a8511058 to start an election
I20260709 12:29:23.914716 32483 raft_consensus.cc:1081] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Signalling peer 8150545344b54f839e178a18a8511058 to start an election
I20260709 12:29:23.917339 32350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6269385447741a78b60510b9318dee1"
dest_uuid: "8150545344b54f839e178a18a8511058"
 from {username='slave'} at 127.0.0.1:34744
I20260709 12:29:23.918205 32350 raft_consensus.cc:493] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:23.918758 32350 raft_consensus.cc:3060] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.930047 32487 raft_consensus.cc:993] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058: : Instructing follower 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:23.903918 32276 leader_election.cc:290] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:23.930702 32487 raft_consensus.cc:1081] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Signalling peer 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:23.933425 32202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34326
I20260709 12:29:23.934098 32202 raft_consensus.cc:493] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:23.934518 32202 raft_consensus.cc:3060] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.936829 32350 raft_consensus.cc:515] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.941356 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:23.942314 32199 raft_consensus.cc:3055] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:23.942930 32199 raft_consensus.cc:740] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:23.944051 32199 consensus_queue.cc:260] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.945834 32199 raft_consensus.cc:3060] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.946646 32202 raft_consensus.cc:515] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.949410 32351 raft_consensus.cc:2468] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:23.950109 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:23.950853 32242 leader_election.cc:304] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:23.952088 32414 raft_consensus.cc:2804] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:23.952606 32414 raft_consensus.cc:697] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:23.953727 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff28cd78a14a4ea7c5a3ee8c75b9a1" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:23.953490 32414 consensus_queue.cc:237] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.954380 32349 raft_consensus.cc:3055] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:23.954778 32349 raft_consensus.cc:740] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:23.955770 32202 leader_election.cc:290] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:23.956161 32349 consensus_queue.cc:260] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.950884 32276 raft_consensus.cc:3060] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.958616 32349 raft_consensus.cc:3060] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.945680 32200 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.972679 32482 raft_consensus.cc:993] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240: : Instructing follower 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:23.973445 32482 raft_consensus.cc:1081] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Signalling peer 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:23.954749 32201 raft_consensus.cc:2468] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:23.976063 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:23.976805 32202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34314
I20260709 12:29:23.977487 32202 raft_consensus.cc:493] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:23.977928 32202 raft_consensus.cc:3060] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.983335 32350 leader_election.cc:290] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 2 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:23.984638 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6269385447741a78b60510b9318dee1" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:23.985410 32275 raft_consensus.cc:3060] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:23.988188 32199 raft_consensus.cc:2468] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 2.
I20260709 12:29:23.989728 32316 leader_election.cc:304] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:23.990787 32486 raft_consensus.cc:2804] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:23.991959 32200 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 3 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:23.993876 32486 raft_consensus.cc:697] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:23.984654 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:23.995831 32486 consensus_queue.cc:237] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:23.997229 32349 raft_consensus.cc:2468] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:23.998759 32167 leader_election.cc:304] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:24.000264 32276 raft_consensus.cc:2468] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:24.001109 32275 raft_consensus.cc:2468] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 2.
I20260709 12:29:24.001111 32484 raft_consensus.cc:2804] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:24.004944 32484 raft_consensus.cc:697] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:24.006183 32484 consensus_queue.cc:237] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:24.016985 32351 raft_consensus.cc:3055] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:24.017735 32351 raft_consensus.cc:740] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:24.019428 32351 consensus_queue.cc:260] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:24.021175 32351 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:24.029937 32097 catalog_manager.cc:5697] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 1 to 2, leader changed from 6df360bbccb74065bcf6874dfe187687 (127.17.40.1) to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:24.034938 32202 raft_consensus.cc:515] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:24.037002 32099 catalog_manager.cc:5697] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 1 to 2, leader changed from 8150545344b54f839e178a18a8511058 (127.17.40.3) to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.038219 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:24.038892 32276 raft_consensus.cc:3055] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:24.039248 32276 raft_consensus.cc:740] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:24.040093 32276 consensus_queue.cc:260] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:24.041162 32276 raft_consensus.cc:3060] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:24.043913 32351 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 3.
I20260709 12:29:24.047808 32167 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 4d19c5882d9940a38aeab897a4f65240
I20260709 12:29:24.048748 32484 raft_consensus.cc:2804] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:24.049777 32484 raft_consensus.cc:697] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 3 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:24.051002 32484 consensus_queue.cc:237] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:24.052035 32202 leader_election.cc:290] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:24.053205 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e604421633a4d83a4f915b89dc8cb73" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:24.053933 32349 raft_consensus.cc:3060] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:24.065405 32276 raft_consensus.cc:2468] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:24.067600 32168 leader_election.cc:304] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:24.068608 32484 raft_consensus.cc:2804] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:24.069154 32484 raft_consensus.cc:697] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:24.070519 32349 raft_consensus.cc:2468] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:24.070451 32484 consensus_queue.cc:237] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:24.072492 32098 catalog_manager.cc:5697] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 1 to 2, leader changed from 6df360bbccb74065bcf6874dfe187687 (127.17.40.1) to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.082252 32097 catalog_manager.cc:5697] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 2 to 3, leader changed from 8150545344b54f839e178a18a8511058 (127.17.40.3) to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 3 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.094985 32097 catalog_manager.cc:5697] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 1 to 2, leader changed from 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2) to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.268045 32202 raft_consensus.cc:1275] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.270677 32414 consensus_queue.cc:1048] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:24.284984 32276 raft_consensus.cc:1275] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.288626 32484 consensus_queue.cc:1048] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:24.299451 32349 raft_consensus.cc:1275] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.304251 32502 consensus_queue.cc:1048] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:24.327831 32349 raft_consensus.cc:1275] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.329591 32484 consensus_queue.cc:1048] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:24.357266 32202 raft_consensus.cc:1275] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.359109 32501 consensus_queue.cc:1048] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:24.374478 32349 raft_consensus.cc:1275] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.376111 32502 consensus_queue.cc:1048] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:24.445101 32276 raft_consensus.cc:1275] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.446534 32484 consensus_queue.cc:1048] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:24.458230 32349 raft_consensus.cc:1275] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.460124 32484 consensus_queue.cc:1048] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:24.481846 32276 raft_consensus.cc:1275] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 8150545344b54f839e178a18a8511058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.483577 32486 consensus_queue.cc:1048] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:24.496716 32200 raft_consensus.cc:1275] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Refusing update from remote peer 8150545344b54f839e178a18a8511058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.498153 32486 consensus_queue.cc:1048] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:24.501318 32276 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:24.506274 32349 raft_consensus.cc:1275] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 3 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:24.508335 32483 consensus_queue.cc:1048] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:24.518199 32276 raft_consensus.cc:1275] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 3 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:24.520526 32483 consensus_queue.cc:1048] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:24.695509 32276 raft_consensus.cc:1275] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.696753 32349 raft_consensus.cc:1275] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:24.697127 32483 consensus_queue.cc:1048] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:24.698282 32484 consensus_queue.cc:1048] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:26.815524 32098 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45986:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:26.818725 32098 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:26.879944 32192 tablet_service.cc:1511] Processing CreateTablet for tablet aabf1420b6004260b676898a60afd538 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:26.882009 32192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabf1420b6004260b676898a60afd538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.881793 32259 tablet_service.cc:1511] Processing CreateTablet for tablet aabf1420b6004260b676898a60afd538 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:26.883751 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabf1420b6004260b676898a60afd538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.883929 32341 tablet_service.cc:1511] Processing CreateTablet for tablet aabf1420b6004260b676898a60afd538 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:26.885895 32341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabf1420b6004260b676898a60afd538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.888732 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 9032a50663924a7287247dabc3005a8a (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:26.891700 32337 tablet_service.cc:1511] Processing CreateTablet for tablet 9032a50663924a7287247dabc3005a8a (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:26.893370 32337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9032a50663924a7287247dabc3005a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.893460 32334 tablet_service.cc:1511] Processing CreateTablet for tablet 4092cce7b4f94cd685c153e4eb146a90 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:26.895143 32334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4092cce7b4f94cd685c153e4eb146a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.898633 32190 tablet_service.cc:1511] Processing CreateTablet for tablet 9032a50663924a7287247dabc3005a8a (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:26.899061 32186 tablet_service.cc:1511] Processing CreateTablet for tablet f3260ed557264b14876daaa57a2cb2ea (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:26.900238 32190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9032a50663924a7287247dabc3005a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.901013 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3260ed557264b14876daaa57a2cb2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.902637 32185 tablet_service.cc:1511] Processing CreateTablet for tablet 4092cce7b4f94cd685c153e4eb146a90 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:26.904174 32185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4092cce7b4f94cd685c153e4eb146a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.903875 32184 tablet_service.cc:1511] Processing CreateTablet for tablet 27f1fc97e3ab45f999483cad10f00adb (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:26.905468 32184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f1fc97e3ab45f999483cad10f00adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.902427 32339 tablet_service.cc:1511] Processing CreateTablet for tablet f3260ed557264b14876daaa57a2cb2ea (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:26.907955 32339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3260ed557264b14876daaa57a2cb2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.908116 32189 tablet_service.cc:1511] Processing CreateTablet for tablet ab7cbe75a58645a6a826571706c9c7ce (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:26.910104 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7cbe75a58645a6a826571706c9c7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.909813 32188 tablet_service.cc:1511] Processing CreateTablet for tablet 99ead4b9dd744903ac17169ad0b0c02a (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:26.906452 32340 tablet_service.cc:1511] Processing CreateTablet for tablet ab7cbe75a58645a6a826571706c9c7ce (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:26.918358 32263 tablet_service.cc:1511] Processing CreateTablet for tablet f3260ed557264b14876daaa57a2cb2ea (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:26.931102 32188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ead4b9dd744903ac17169ad0b0c02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.918358 32265 tablet_service.cc:1511] Processing CreateTablet for tablet ab7cbe75a58645a6a826571706c9c7ce (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:26.919819 32264 tablet_service.cc:1511] Processing CreateTablet for tablet 4092cce7b4f94cd685c153e4eb146a90 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:26.920661 32335 tablet_service.cc:1511] Processing CreateTablet for tablet 99ead4b9dd744903ac17169ad0b0c02a (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:26.932534 32333 tablet_service.cc:1511] Processing CreateTablet for tablet f0b72663445443c1a410c11abb04b2c7 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:26.921808 32338 tablet_service.cc:1511] Processing CreateTablet for tablet 27f1fc97e3ab45f999483cad10f00adb (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:26.933384 32187 tablet_service.cc:1511] Processing CreateTablet for tablet a22546a5c10d49bda05422e90e837631 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:26.924340 32261 tablet_service.cc:1511] Processing CreateTablet for tablet 27f1fc97e3ab45f999483cad10f00adb (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:26.924458 32191 tablet_service.cc:1511] Processing CreateTablet for tablet f0b72663445443c1a410c11abb04b2c7 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:26.926977 32267 tablet_service.cc:1511] Processing CreateTablet for tablet 99ead4b9dd744903ac17169ad0b0c02a (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:26.927276 32266 tablet_service.cc:1511] Processing CreateTablet for tablet f0b72663445443c1a410c11abb04b2c7 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:26.935164 32336 tablet_service.cc:1511] Processing CreateTablet for tablet a22546a5c10d49bda05422e90e837631 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:26.928278 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9032a50663924a7287247dabc3005a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.936293 32187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22546a5c10d49bda05422e90e837631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.931105 32340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7cbe75a58645a6a826571706c9c7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.938267 32336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22546a5c10d49bda05422e90e837631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.938764 32264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4092cce7b4f94cd685c153e4eb146a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.939069 32191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b72663445443c1a410c11abb04b2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.941532 32266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b72663445443c1a410c11abb04b2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.942970 32333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b72663445443c1a410c11abb04b2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.943817 32265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7cbe75a58645a6a826571706c9c7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.944656 32267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ead4b9dd744903ac17169ad0b0c02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.946573 32338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f1fc97e3ab45f999483cad10f00adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.949157 32335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ead4b9dd744903ac17169ad0b0c02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.955689 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3260ed557264b14876daaa57a2cb2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:26.961385 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f1fc97e3ab45f999483cad10f00adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:27.007081 32262 tablet_service.cc:1511] Processing CreateTablet for tablet a22546a5c10d49bda05422e90e837631 (DEFAULT_TABLE table=soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:27.008641 32262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22546a5c10d49bda05422e90e837631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:27.085258 32528 tablet_bootstrap.cc:492] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:27.167245 32528 tablet_bootstrap.cc:654] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.168165 32529 tablet_bootstrap.cc:492] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.169031 32530 tablet_bootstrap.cc:492] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.173622 32528 tablet_bootstrap.cc:492] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.174384 32528 ts_tablet_manager.cc:1403] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.090s	user 0.003s	sys 0.012s
I20260709 12:29:27.176944 32529 tablet_bootstrap.cc:654] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.177292 32530 tablet_bootstrap.cc:654] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.177505 32528 raft_consensus.cc:359] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.178244 32528 raft_consensus.cc:385] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.178593 32528 raft_consensus.cc:740] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.179375 32528 consensus_queue.cc:260] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.182024 32528 ts_tablet_manager.cc:1434] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:29:27.183107 32528 tablet_bootstrap.cc:492] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:27.187659 32530 tablet_bootstrap.cc:492] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.188549 32530 ts_tablet_manager.cc:1403] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:29:27.190434 32528 tablet_bootstrap.cc:654] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.193081 32530 raft_consensus.cc:359] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.194257 32530 raft_consensus.cc:385] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.195981 32530 raft_consensus.cc:740] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.196913 32530 consensus_queue.cc:260] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.197510 32529 tablet_bootstrap.cc:492] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.198133 32529 ts_tablet_manager.cc:1403] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.012s
I20260709 12:29:27.201406 32529 raft_consensus.cc:359] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.202257 32529 raft_consensus.cc:385] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.202425 32530 ts_tablet_manager.cc:1434] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:29:27.202623 32529 raft_consensus.cc:740] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.203723 32530 tablet_bootstrap.cc:492] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.203480 32529 consensus_queue.cc:260] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.206251 32529 ts_tablet_manager.cc:1434] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:29:27.207901 32529 tablet_bootstrap.cc:492] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.215384 32529 tablet_bootstrap.cc:654] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.215916 32528 tablet_bootstrap.cc:492] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.216553 32528 ts_tablet_manager.cc:1403] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.018s
I20260709 12:29:27.220000 32528 raft_consensus.cc:359] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.220834 32528 raft_consensus.cc:385] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.221143 32528 raft_consensus.cc:740] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.221905 32528 consensus_queue.cc:260] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.224740 32528 ts_tablet_manager.cc:1434] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:29:27.225870 32528 tablet_bootstrap.cc:492] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:27.227702 32529 tablet_bootstrap.cc:492] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.228008 32530 tablet_bootstrap.cc:654] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.228315 32529 ts_tablet_manager.cc:1403] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 12:29:27.231986 32529 raft_consensus.cc:359] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.232779 32529 raft_consensus.cc:385] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.233232 32529 raft_consensus.cc:740] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.234074 32529 consensus_queue.cc:260] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.236747 32529 ts_tablet_manager.cc:1434] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:27.236907 32530 tablet_bootstrap.cc:492] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.237521 32530 ts_tablet_manager.cc:1403] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 12:29:27.237789 32529 tablet_bootstrap.cc:492] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.240890 32530 raft_consensus.cc:359] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.241736 32530 raft_consensus.cc:385] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.242180 32530 raft_consensus.cc:740] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.237793 32528 tablet_bootstrap.cc:654] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.243089 32530 consensus_queue.cc:260] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.244959 32529 tablet_bootstrap.cc:654] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.247794 32530 ts_tablet_manager.cc:1434] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:29:27.249290 32530 tablet_bootstrap.cc:492] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.255458 32529 tablet_bootstrap.cc:492] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.255481 32528 tablet_bootstrap.cc:492] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.256157 32529 ts_tablet_manager.cc:1403] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:29:27.256497 32528 ts_tablet_manager.cc:1403] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 12:29:27.257640 32530 tablet_bootstrap.cc:654] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.259559 32529 raft_consensus.cc:359] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.260382 32529 raft_consensus.cc:385] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.260754 32529 raft_consensus.cc:740] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.260452 32528 raft_consensus.cc:359] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.261747 32528 raft_consensus.cc:385] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.261658 32529 consensus_queue.cc:260] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.262456 32528 raft_consensus.cc:740] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.264235 32529 ts_tablet_manager.cc:1434] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:27.263898 32528 consensus_queue.cc:260] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.265439 32529 tablet_bootstrap.cc:492] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.269694 32528 ts_tablet_manager.cc:1434] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:29:27.271054 32528 tablet_bootstrap.cc:492] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:27.273185 32529 tablet_bootstrap.cc:654] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.277415 32530 tablet_bootstrap.cc:492] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.278122 32530 ts_tablet_manager.cc:1403] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.002s
I20260709 12:29:27.282045 32528 tablet_bootstrap.cc:654] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.282671 32530 raft_consensus.cc:359] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.283839 32530 raft_consensus.cc:385] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.284227 32530 raft_consensus.cc:740] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.285562 32530 consensus_queue.cc:260] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.293664 32530 ts_tablet_manager.cc:1434] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:29:27.295792 32530 tablet_bootstrap.cc:492] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.299854 32528 tablet_bootstrap.cc:492] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.300619 32528 ts_tablet_manager.cc:1403] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 12:29:27.304358 32528 raft_consensus.cc:359] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.305253 32528 raft_consensus.cc:385] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.305579 32530 tablet_bootstrap.cc:654] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.305632 32528 raft_consensus.cc:740] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.309057 32528 consensus_queue.cc:260] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.312716 32528 ts_tablet_manager.cc:1434] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:29:27.314265 32528 tablet_bootstrap.cc:492] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:27.315621 32470 raft_consensus.cc:493] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.316239 32470 raft_consensus.cc:515] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.320181 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf1420b6004260b676898a60afd538" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.320957 32276 raft_consensus.cc:2468] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:27.321587 32528 tablet_bootstrap.cc:654] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.322723 32168 leader_election.cc:304] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:27.324209 32530 tablet_bootstrap.cc:492] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.324882 32530 ts_tablet_manager.cc:1403] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.008s
I20260709 12:29:27.325505 32529 tablet_bootstrap.cc:492] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.326212 32529 ts_tablet_manager.cc:1403] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.061s	user 0.029s	sys 0.019s
I20260709 12:29:27.326848 32544 raft_consensus.cc:2804] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:27.327356 32544 raft_consensus.cc:493] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.327966 32544 raft_consensus.cc:3060] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.329576 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf1420b6004260b676898a60afd538" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
W20260709 12:29:27.332410 32167 leader_election.cc:343] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:27.335248 32543 raft_consensus.cc:493] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.336021 32543 raft_consensus.cc:515] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.337056 32530 raft_consensus.cc:359] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.338547 32530 raft_consensus.cc:385] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.339119 32530 raft_consensus.cc:740] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.338471 32529 raft_consensus.cc:359] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.339687 32529 raft_consensus.cc:385] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.340073 32529 raft_consensus.cc:740] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.340009 32530 consensus_queue.cc:260] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.341295 32529 consensus_queue.cc:260] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.343031 32530 ts_tablet_manager.cc:1434] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:29:27.344087 32529 ts_tablet_manager.cc:1434] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:29:27.345311 32530 tablet_bootstrap.cc:492] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.327235 32470 leader_election.cc:290] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.346841 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ead4b9dd744903ac17169ad0b0c02a" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.347582 32276 raft_consensus.cc:2468] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:27.347956 32470 raft_consensus.cc:493] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.348493 32470 raft_consensus.cc:515] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.345311 32529 tablet_bootstrap.cc:492] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.351954 32470 leader_election.cc:290] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.340245 32543 leader_election.cc:290] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.353102 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f1fc97e3ab45f999483cad10f00adb" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.353410 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f1fc97e3ab45f999483cad10f00adb" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:27.355235 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ead4b9dd744903ac17169ad0b0c02a" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:27.356019 32349 raft_consensus.cc:2468] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:27.357599 32529 tablet_bootstrap.cc:654] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:27.358742 32167 leader_election.cc:343] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:27.360241 32544 raft_consensus.cc:515] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.357621 32528 tablet_bootstrap.cc:492] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.360867 32167 leader_election.cc:304] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.361493 32528 ts_tablet_manager.cc:1403] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.004s
I20260709 12:29:27.363938 32544 leader_election.cc:290] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.364645 32544 raft_consensus.cc:2804] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:27.365013 32544 raft_consensus.cc:493] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.353536 32530 tablet_bootstrap.cc:654] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.365121 32528 raft_consensus.cc:359] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.366030 32528 raft_consensus.cc:385] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.366371 32528 raft_consensus.cc:740] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.366837 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf1420b6004260b676898a60afd538" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:27.366894 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf1420b6004260b676898a60afd538" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:27.367553 32276 raft_consensus.cc:3060] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.367278 32528 consensus_queue.cc:260] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
W20260709 12:29:27.368765 32167 leader_election.cc:343] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:27.370476 32528 ts_tablet_manager.cc:1434] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.007s
I20260709 12:29:27.365425 32544 raft_consensus.cc:3060] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.376679 32530 tablet_bootstrap.cc:492] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.377563 32530 ts_tablet_manager.cc:1403] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.005s
I20260709 12:29:27.378176 32528 tablet_bootstrap.cc:492] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
W20260709 12:29:27.365353 32168 leader_election.cc:343] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:27.379060 32168 leader_election.cc:304] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687; no voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058
I20260709 12:29:27.379914 32470 raft_consensus.cc:2749] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:27.381093 32530 raft_consensus.cc:359] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.382016 32530 raft_consensus.cc:385] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.382364 32530 raft_consensus.cc:740] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.383313 32530 consensus_queue.cc:260] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.385985 32530 ts_tablet_manager.cc:1434] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:27.386340 32516 raft_consensus.cc:493] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.386958 32516 raft_consensus.cc:515] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.387491 32530 tablet_bootstrap.cc:492] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.389377 32516 leader_election.cc:290] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:27.391390 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4092cce7b4f94cd685c153e4eb146a90" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:27.392210 32200 raft_consensus.cc:2468] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:27.386370 32528 tablet_bootstrap.cc:654] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.394876 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4092cce7b4f94cd685c153e4eb146a90" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.395776 32277 raft_consensus.cc:2468] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:27.396936 32530 tablet_bootstrap.cc:654] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.398344 32276 raft_consensus.cc:2468] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:27.400280 32316 leader_election.cc:304] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.401173 32516 raft_consensus.cc:2804] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:27.401618 32516 raft_consensus.cc:493] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.402052 32516 raft_consensus.cc:3060] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.402215 32529 tablet_bootstrap.cc:492] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.402995 32529 ts_tablet_manager.cc:1403] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.018s
I20260709 12:29:27.403831 32502 raft_consensus.cc:493] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.404382 32502 raft_consensus.cc:515] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.406068 32168 leader_election.cc:304] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 8150545344b54f839e178a18a8511058
I20260709 12:29:27.407087 32502 leader_election.cc:290] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.407810 32470 raft_consensus.cc:2804] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:27.409032 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:27.408215 32528 tablet_bootstrap.cc:492] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.409886 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
W20260709 12:29:27.413091 32242 leader_election.cc:343] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:27.413242 32529 raft_consensus.cc:359] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.414794 32200 raft_consensus.cc:2468] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 0.
I20260709 12:29:27.416045 32470 raft_consensus.cc:697] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:27.416656 32544 raft_consensus.cc:515] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.417037 32242 leader_election.cc:304] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 8150545344b54f839e178a18a8511058
I20260709 12:29:27.415655 32529 raft_consensus.cc:385] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.417948 32529 raft_consensus.cc:740] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.418612 32502 raft_consensus.cc:2804] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:27.419026 32544 leader_election.cc:290] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.419080 32502 raft_consensus.cc:493] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.419728 32502 raft_consensus.cc:3060] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.418815 32529 consensus_queue.cc:260] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.420279 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ead4b9dd744903ac17169ad0b0c02a" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:27.420997 32349 raft_consensus.cc:3060] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.417042 32470 consensus_queue.cc:237] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.414811 32528 ts_tablet_manager.cc:1403] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.002s
I20260709 12:29:27.428114 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ead4b9dd744903ac17169ad0b0c02a" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:27.428961 32276 raft_consensus.cc:3060] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.429708 32502 raft_consensus.cc:515] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.428025 32528 raft_consensus.cc:359] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.433099 32530 tablet_bootstrap.cc:492] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.433269 32516 raft_consensus.cc:515] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.433830 32528 raft_consensus.cc:385] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.434259 32530 ts_tablet_manager.cc:1403] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.010s
I20260709 12:29:27.437098 32349 raft_consensus.cc:2468] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:27.438651 32167 leader_election.cc:304] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.438752 32530 raft_consensus.cc:359] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.439690 32544 raft_consensus.cc:2804] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:27.439882 32530 raft_consensus.cc:385] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.440382 32530 raft_consensus.cc:740] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.440450 32544 raft_consensus.cc:697] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:27.441906 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4092cce7b4f94cd685c153e4eb146a90" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:27.441686 32544 consensus_queue.cc:237] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.442566 32200 raft_consensus.cc:3060] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.434289 32528 raft_consensus.cc:740] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.443882 32528 consensus_queue.cc:260] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.446382 32528 ts_tablet_manager.cc:1434] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:29:27.446873 32529 ts_tablet_manager.cc:1434] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.006s
I20260709 12:29:27.447598 32528 tablet_bootstrap.cc:492] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:27.448045 32529 tablet_bootstrap.cc:492] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.452327 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:27.452220 32530 consensus_queue.cc:260] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.453137 32202 raft_consensus.cc:3060] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.460049 32098 catalog_manager.cc:5697] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.461568 32502 leader_election.cc:290] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.466046 32529 tablet_bootstrap.cc:654] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.474102 32553 raft_consensus.cc:493] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.474782 32553 raft_consensus.cc:515] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.477119 32553 leader_election.cc:290] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.479835 32202 raft_consensus.cc:2468] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 1.
I20260709 12:29:27.482812 32200 raft_consensus.cc:2468] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:27.484437 32316 leader_election.cc:304] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.485064 32528 tablet_bootstrap.cc:654] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.485663 32550 raft_consensus.cc:2804] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:27.488303 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4092cce7b4f94cd685c153e4eb146a90" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:27.492151 32276 raft_consensus.cc:2468] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:27.496068 32530 ts_tablet_manager.cc:1434] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.061s	user 0.019s	sys 0.001s
I20260709 12:29:27.499591 32530 tablet_bootstrap.cc:492] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.492828 32277 raft_consensus.cc:3060] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.489235 32516 leader_election.cc:290] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
W20260709 12:29:27.509217 32148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:27.511929 32550 raft_consensus.cc:697] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:27.512975 32544 raft_consensus.cc:493] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.513729 32544 raft_consensus.cc:515] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.514678 32550 consensus_queue.cc:237] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.515924 32544 leader_election.cc:290] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.516546 32277 raft_consensus.cc:2468] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:27.517776 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3260ed557264b14876daaa57a2cb2ea" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:27.522814 32349 raft_consensus.cc:2468] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:27.518023 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3260ed557264b14876daaa57a2cb2ea" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.519181 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:27.520550 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22546a5c10d49bda05422e90e837631" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:27.524266 32167 leader_election.cc:304] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.525671 32544 raft_consensus.cc:2804] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:27.526070 32544 raft_consensus.cc:493] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.524511 32276 raft_consensus.cc:2468] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:27.526489 32544 raft_consensus.cc:3060] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.520951 32530 tablet_bootstrap.cc:654] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.528043 32529 tablet_bootstrap.cc:492] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.528663 32529 ts_tablet_manager.cc:1403] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.001s
I20260709 12:29:27.521342 32242 leader_election.cc:304] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
W20260709 12:29:27.531180 32242 leader_election.cc:343] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:27.533241 32242 leader_election.cc:343] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:27.521898 32528 tablet_bootstrap.cc:492] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.536087 32528 ts_tablet_manager.cc:1403] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.019s
I20260709 12:29:27.521643 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22546a5c10d49bda05422e90e837631" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:27.541148 32550 raft_consensus.cc:493] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:27.541597 32242 leader_election.cc:343] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8150545344b54f839e178a18a8511058 (127.17.40.3:36157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:27.542361 32242 leader_election.cc:304] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240; no voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058
I20260709 12:29:27.541807 32550 raft_consensus.cc:515] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.541205 32554 raft_consensus.cc:2804] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:27.543659 32544 raft_consensus.cc:515] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.545271 32550 leader_election.cc:290] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:27.540640 32529 raft_consensus.cc:359] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.546689 32529 raft_consensus.cc:385] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.546682 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf1420b6004260b676898a60afd538" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.547206 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabf1420b6004260b676898a60afd538" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:27.547338 32529 raft_consensus.cc:740] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.547725 32276 raft_consensus.cc:2393] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8150545344b54f839e178a18a8511058 in current term 1: Already voted for candidate 6df360bbccb74065bcf6874dfe187687 in this term.
I20260709 12:29:27.548214 32544 leader_election.cc:290] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.549455 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3260ed557264b14876daaa57a2cb2ea" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:27.549609 32317 leader_election.cc:304] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8150545344b54f839e178a18a8511058; no voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:27.550107 32350 raft_consensus.cc:3060] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.551312 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3260ed557264b14876daaa57a2cb2ea" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:27.551919 32276 raft_consensus.cc:3060] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.550618 32502 raft_consensus.cc:2749] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:27.551043 32554 raft_consensus.cc:697] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:27.556226 32554 consensus_queue.cc:237] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.556829 32550 raft_consensus.cc:3060] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.562162 32097 catalog_manager.cc:5697] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:27.564416 32276 raft_consensus.cc:2468] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:27.565886 32168 leader_election.cc:304] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:27.566661 32529 consensus_queue.cc:260] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.566118 32098 catalog_manager.cc:5697] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.570078 32544 raft_consensus.cc:2804] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:27.570962 32544 raft_consensus.cc:697] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:27.549823 32528 raft_consensus.cc:359] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.572867 32528 raft_consensus.cc:385] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.573323 32528 raft_consensus.cc:740] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.576444 32350 raft_consensus.cc:2468] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:27.579715 32528 consensus_queue.cc:260] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.581167 32529 ts_tablet_manager.cc:1434] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 12:29:27.584343 32529 tablet_bootstrap.cc:492] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.586882 32530 tablet_bootstrap.cc:492] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.587549 32530 ts_tablet_manager.cc:1403] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.017s
I20260709 12:29:27.588248 32550 raft_consensus.cc:2749] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:27.590946 32530 raft_consensus.cc:359] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.571907 32544 consensus_queue.cc:237] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.596076 32530 raft_consensus.cc:385] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.596558 32530 raft_consensus.cc:740] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.597910 32528 ts_tablet_manager.cc:1434] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 12:29:27.597530 32530 consensus_queue.cc:260] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.593827 32529 tablet_bootstrap.cc:654] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.599179 32528 tablet_bootstrap.cc:492] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:27.600598 32530 ts_tablet_manager.cc:1434] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:29:27.601876 32530 tablet_bootstrap.cc:492] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.609886 32530 tablet_bootstrap.cc:654] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.619293 32528 tablet_bootstrap.cc:654] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.622543 32099 catalog_manager.cc:5697] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.625032 32098 catalog_manager.cc:5697] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.626071 32550 raft_consensus.cc:493] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.626708 32550 raft_consensus.cc:515] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.626672 32529 tablet_bootstrap.cc:492] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.630446 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:27.631327 32529 ts_tablet_manager.cc:1403] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.008s
I20260709 12:29:27.631560 32200 raft_consensus.cc:2393] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8150545344b54f839e178a18a8511058 in current term 1: Already voted for candidate 4d19c5882d9940a38aeab897a4f65240 in this term.
I20260709 12:29:27.632691 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.635305 32528 tablet_bootstrap.cc:492] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.635545 32317 leader_election.cc:304] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8150545344b54f839e178a18a8511058; no voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:27.635916 32528 ts_tablet_manager.cc:1403] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 12:29:27.635757 32550 leader_election.cc:290] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:27.634887 32529 raft_consensus.cc:359] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.636624 32557 raft_consensus.cc:3060] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.636987 32529 raft_consensus.cc:385] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.637354 32529 raft_consensus.cc:740] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.638157 32529 consensus_queue.cc:260] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.639551 32528 raft_consensus.cc:359] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.640305 32528 raft_consensus.cc:385] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.640583 32528 raft_consensus.cc:740] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.641324 32528 consensus_queue.cc:260] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.644594 32528 ts_tablet_manager.cc:1434] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:27.645001 32529 ts_tablet_manager.cc:1434] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:29:27.645597 32528 tablet_bootstrap.cc:492] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: Bootstrap starting.
I20260709 12:29:27.646157 32529 tablet_bootstrap.cc:492] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.648300 32557 raft_consensus.cc:2749] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:27.653200 32528 tablet_bootstrap.cc:654] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.653654 32529 tablet_bootstrap.cc:654] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.654732 32530 tablet_bootstrap.cc:492] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.655295 32530 ts_tablet_manager.cc:1403] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.003s
I20260709 12:29:27.659076 32530 raft_consensus.cc:359] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.660008 32530 raft_consensus.cc:385] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.660352 32530 raft_consensus.cc:740] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.661275 32530 consensus_queue.cc:260] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.664372 32530 ts_tablet_manager.cc:1434] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:29:27.665730 32530 tablet_bootstrap.cc:492] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240: Bootstrap starting.
I20260709 12:29:27.665948 32529 tablet_bootstrap.cc:492] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.666594 32529 ts_tablet_manager.cc:1403] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:29:27.669698 32529 raft_consensus.cc:359] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.670439 32529 raft_consensus.cc:385] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.670714 32529 raft_consensus.cc:740] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.673059 32529 consensus_queue.cc:260] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.673801 32530 tablet_bootstrap.cc:654] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.675587 32529 ts_tablet_manager.cc:1434] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:29:27.677160 32529 tablet_bootstrap.cc:492] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058: Bootstrap starting.
I20260709 12:29:27.683561 32529 tablet_bootstrap.cc:654] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:27.683882 32528 tablet_bootstrap.cc:492] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: No bootstrap required, opened a new log
I20260709 12:29:27.684700 32528 ts_tablet_manager.cc:1403] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.003s
I20260709 12:29:27.688388 32528 raft_consensus.cc:359] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.689116 32528 raft_consensus.cc:385] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.689397 32528 raft_consensus.cc:740] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.689602 32530 tablet_bootstrap.cc:492] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240: No bootstrap required, opened a new log
I20260709 12:29:27.690171 32530 ts_tablet_manager.cc:1403] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.003s
I20260709 12:29:27.690207 32528 consensus_queue.cc:260] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.692713 32557 raft_consensus.cc:493] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.692916 32528 ts_tablet_manager.cc:1434] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:29:27.693136 32530 raft_consensus.cc:359] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.693303 32557 raft_consensus.cc:515] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.693850 32530 raft_consensus.cc:385] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.694196 32530 raft_consensus.cc:740] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.695535 32529 tablet_bootstrap.cc:492] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058: No bootstrap required, opened a new log
I20260709 12:29:27.695777 32557 leader_election.cc:290] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:27.696704 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9032a50663924a7287247dabc3005a8a" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:27.697419 32200 raft_consensus.cc:2468] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:27.699158 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9032a50663924a7287247dabc3005a8a" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.699787 32276 raft_consensus.cc:2468] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:27.700975 32316 leader_election.cc:304] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.703073 32550 raft_consensus.cc:493] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.703648 32550 raft_consensus.cc:515] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.706284 32550 leader_election.cc:290] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:27.709021 32550 raft_consensus.cc:2804] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:27.709450 32550 raft_consensus.cc:493] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.709846 32550 raft_consensus.cc:3060] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.711700 32529 ts_tablet_manager.cc:1403] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.013s
I20260709 12:29:27.712567 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22546a5c10d49bda05422e90e837631" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:27.712281 32530 consensus_queue.cc:260] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.713399 32200 raft_consensus.cc:2468] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:27.714885 32530 ts_tablet_manager.cc:1434] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:29:27.715344 32316 leader_election.cc:304] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.714887 32529 raft_consensus.cc:359] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.716305 32557 raft_consensus.cc:2804] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:27.716457 32529 raft_consensus.cc:385] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:27.716809 32557 raft_consensus.cc:493] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.716883 32529 raft_consensus.cc:740] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Initialized, Role: FOLLOWER
I20260709 12:29:27.716840 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22546a5c10d49bda05422e90e837631" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:27.718096 32276 raft_consensus.cc:2468] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 0.
I20260709 12:29:27.718101 32529 consensus_queue.cc:260] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.720489 32529 ts_tablet_manager.cc:1434] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:27.717368 32557 raft_consensus.cc:3060] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.729537 32550 raft_consensus.cc:515] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.730967 32557 raft_consensus.cc:515] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.733302 32557 leader_election.cc:290] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:27.737056 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22546a5c10d49bda05422e90e837631" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:27.737480 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9032a50663924a7287247dabc3005a8a" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:27.737919 32200 raft_consensus.cc:3060] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.738152 32202 raft_consensus.cc:3060] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.741197 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9032a50663924a7287247dabc3005a8a" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:27.741897 32277 raft_consensus.cc:3060] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.737053 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22546a5c10d49bda05422e90e837631" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:27.747325 32276 raft_consensus.cc:3060] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.747484 32202 raft_consensus.cc:2468] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:27.748812 32316 leader_election.cc:304] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.751593 32277 raft_consensus.cc:2468] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:27.752569 32557 raft_consensus.cc:2804] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:27.753187 32557 raft_consensus.cc:697] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:27.754050 32557 consensus_queue.cc:237] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.754223 32276 raft_consensus.cc:2468] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:27.746501 32550 leader_election.cc:290] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:27.746336 32200 raft_consensus.cc:2468] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 1.
I20260709 12:29:27.755800 32317 leader_election.cc:304] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.756721 32550 raft_consensus.cc:2804] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:27.757350 32550 raft_consensus.cc:697] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:27.758121 32550 consensus_queue.cc:237] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.767400 32097 catalog_manager.cc:5697] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:27.781379 32097 catalog_manager.cc:5697] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 1 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:27.868746 32470 consensus_queue.cc:1048] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:27.881337 32544 consensus_queue.cc:1048] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:27.909260 32554 raft_consensus.cc:493] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.909878 32554 raft_consensus.cc:515] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.912005 32554 leader_election.cc:290] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.912854 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f1fc97e3ab45f999483cad10f00adb" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687" is_pre_election: true
I20260709 12:29:27.913221 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f1fc97e3ab45f999483cad10f00adb" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:27.913811 32200 raft_consensus.cc:2468] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 0.
I20260709 12:29:27.914044 32350 raft_consensus.cc:2468] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 0.
I20260709 12:29:27.914985 32242 leader_election.cc:304] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:27.915764 32554 raft_consensus.cc:2804] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:27.916079 32554 raft_consensus.cc:493] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.916368 32554 raft_consensus.cc:3060] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.922735 32554 raft_consensus.cc:515] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.924507 32554 leader_election.cc:290] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:27.925525 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f1fc97e3ab45f999483cad10f00adb" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:27.925648 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f1fc97e3ab45f999483cad10f00adb" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:27.926247 32200 raft_consensus.cc:3060] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.926342 32350 raft_consensus.cc:3060] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:27.932739 32350 raft_consensus.cc:2468] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 1.
I20260709 12:29:27.933260 32200 raft_consensus.cc:2468] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 1.
I20260709 12:29:27.933916 32242 leader_election.cc:304] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:27.934885 32554 raft_consensus.cc:2804] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:27.935331 32554 raft_consensus.cc:697] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:27.936117 32554 consensus_queue.cc:237] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:27.943885 32557 consensus_queue.cc:1048] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:27.944604 32099 catalog_manager.cc:5697] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 1 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.956385 32516 consensus_queue.cc:1048] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:27.963527 32544 consensus_queue.cc:1048] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:27.981294 32543 consensus_queue.cc:1048] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.033061 32543 raft_consensus.cc:493] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.033664 32543 raft_consensus.cc:515] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.035905 32543 leader_election.cc:290] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:28.036401 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b72663445443c1a410c11abb04b2c7" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240" is_pre_election: true
I20260709 12:29:28.036726 32351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b72663445443c1a410c11abb04b2c7" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058" is_pre_election: true
I20260709 12:29:28.037195 32276 raft_consensus.cc:2468] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:28.037559 32351 raft_consensus.cc:2468] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 0.
I20260709 12:29:28.038324 32168 leader_election.cc:304] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:28.039239 32543 raft_consensus.cc:2804] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:28.039635 32543 raft_consensus.cc:493] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:28.039942 32543 raft_consensus.cc:3060] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:28.039734 32554 consensus_queue.cc:1048] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.047489 32543 raft_consensus.cc:515] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.051401 32564 consensus_queue.cc:1048] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:28.056556 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b72663445443c1a410c11abb04b2c7" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:28.057189 32276 raft_consensus.cc:3060] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:28.064718 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b72663445443c1a410c11abb04b2c7" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:28.065469 32350 raft_consensus.cc:3060] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:28.066505 32276 raft_consensus.cc:2468] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:28.067422 32543 leader_election.cc:290] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:28.067886 32168 leader_election.cc:304] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:28.069130 32543 raft_consensus.cc:2804] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:28.069808 32543 raft_consensus.cc:697] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:28.072144 32543 consensus_queue.cc:237] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.073246 32350 raft_consensus.cc:2468] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 1.
I20260709 12:29:28.081553 32099 catalog_manager.cc:5697] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 1 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.108199 32351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9032a50663924a7287247dabc3005a8a"
dest_uuid: "8150545344b54f839e178a18a8511058"
mode: GRACEFUL
new_leader_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34750
I20260709 12:29:28.108836 32351 raft_consensus.cc:606] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Received request to transfer leadership to TS 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:28.114220 32351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4092cce7b4f94cd685c153e4eb146a90"
dest_uuid: "8150545344b54f839e178a18a8511058"
mode: GRACEFUL
new_leader_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34750
I20260709 12:29:28.114796 32351 raft_consensus.cc:606] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Received request to transfer leadership to TS 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:28.120242 32276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce"
dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
mode: GRACEFUL
new_leader_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:46684
I20260709 12:29:28.120765 32276 raft_consensus.cc:606] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Received request to transfer leadership to TS 6df360bbccb74065bcf6874dfe187687
I20260709 12:29:28.125630 32543 consensus_queue.cc:1048] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.126533 32200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3260ed557264b14876daaa57a2cb2ea"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
mode: GRACEFUL
new_leader_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:34334
I20260709 12:29:28.127207 32200 raft_consensus.cc:606] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Received request to transfer leadership to TS 4d19c5882d9940a38aeab897a4f65240
I20260709 12:29:28.132958 32544 raft_consensus.cc:993] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687: : Instructing follower 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:28.133490 32470 raft_consensus.cc:1081] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Signalling peer 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:28.138993 32544 consensus_queue.cc:1048] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.140763 32200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ead4b9dd744903ac17169ad0b0c02a"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
mode: GRACEFUL
new_leader_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:34334
I20260709 12:29:28.140794 32277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3260ed557264b14876daaa57a2cb2ea"
dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:29:28.141757 32200 raft_consensus.cc:606] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Received request to transfer leadership to TS 4d19c5882d9940a38aeab897a4f65240
I20260709 12:29:28.142151 32277 raft_consensus.cc:493] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.142700 32277 raft_consensus.cc:3060] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.151918 32277 raft_consensus.cc:515] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.155253 32200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3260ed557264b14876daaa57a2cb2ea" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:28.155910 32200 raft_consensus.cc:3055] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:28.156241 32200 raft_consensus.cc:740] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:28.157051 32200 consensus_queue.cc:260] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.158296 32277 leader_election.cc:290] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:28.159574 32202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0b72663445443c1a410c11abb04b2c7"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
mode: GRACEFUL
new_leader_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:34334
I20260709 12:29:28.162271 32202 raft_consensus.cc:606] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Received request to transfer leadership to TS 4d19c5882d9940a38aeab897a4f65240
I20260709 12:29:28.158304 32200 raft_consensus.cc:3060] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.165297 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3260ed557264b14876daaa57a2cb2ea" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:28.165941 32350 raft_consensus.cc:3060] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.171623 32200 raft_consensus.cc:2468] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:28.171907 32350 raft_consensus.cc:2468] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:28.172986 32242 leader_election.cc:304] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:28.173708 32564 raft_consensus.cc:2804] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:28.174173 32564 raft_consensus.cc:697] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:28.175088 32564 consensus_queue.cc:237] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.182868 32099 catalog_manager.cc:5697] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 1 to 2, leader changed from 6df360bbccb74065bcf6874dfe187687 (127.17.40.1) to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.278246 32516 consensus_queue.cc:1048] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.285851 32550 raft_consensus.cc:993] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058: : Instructing follower 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:28.286542 32557 raft_consensus.cc:1081] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Signalling peer 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:28.289191 32202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9032a50663924a7287247dabc3005a8a"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34326
I20260709 12:29:28.291433 32202 raft_consensus.cc:493] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.291927 32202 raft_consensus.cc:3060] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.291688 32557 consensus_queue.cc:1048] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:28.300897 32202 raft_consensus.cc:515] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.307017 32202 leader_election.cc:290] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:28.309543 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9032a50663924a7287247dabc3005a8a" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:28.310218 32277 raft_consensus.cc:3060] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.310443 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9032a50663924a7287247dabc3005a8a" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:28.311153 32350 raft_consensus.cc:3055] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:28.311458 32350 raft_consensus.cc:740] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:28.312232 32350 consensus_queue.cc:260] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.313318 32350 raft_consensus.cc:3060] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.318849 32277 raft_consensus.cc:2468] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:28.320101 32168 leader_election.cc:304] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:28.320891 32543 raft_consensus.cc:2804] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:28.320999 32350 raft_consensus.cc:2468] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:28.321542 32543 raft_consensus.cc:697] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:28.322554 32543 consensus_queue.cc:237] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.330235 32098 catalog_manager.cc:5697] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 1 to 2, leader changed from 8150545344b54f839e178a18a8511058 (127.17.40.3) to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.359133 32557 consensus_queue.cc:1048] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.372601 32557 consensus_queue.cc:1048] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.372762 32564 consensus_queue.cc:1048] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.396436 32502 consensus_queue.cc:1048] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.411324 32470 raft_consensus.cc:993] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687: : Instructing follower 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:28.411900 32470 raft_consensus.cc:1081] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Signalling peer 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:28.414849 32277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99ead4b9dd744903ac17169ad0b0c02a"
dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:29:28.415813 32277 raft_consensus.cc:493] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.416350 32277 raft_consensus.cc:3060] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.429972 32277 raft_consensus.cc:515] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.433988 32277 leader_election.cc:290] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:28.435200 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ead4b9dd744903ac17169ad0b0c02a" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:28.435953 32202 raft_consensus.cc:3055] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:28.435751 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ead4b9dd744903ac17169ad0b0c02a" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:28.436323 32202 raft_consensus.cc:740] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:28.436542 32350 raft_consensus.cc:3060] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.437219 32202 consensus_queue.cc:260] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.438627 32202 raft_consensus.cc:3060] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.444829 32350 raft_consensus.cc:2468] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:28.446281 32242 leader_election.cc:304] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:28.446758 32202 raft_consensus.cc:2468] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:28.447345 32502 raft_consensus.cc:2804] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:28.447863 32502 raft_consensus.cc:697] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:28.448781 32502 consensus_queue.cc:237] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.457543 32098 catalog_manager.cc:5697] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 1 to 2, leader changed from 6df360bbccb74065bcf6874dfe187687 (127.17.40.1) to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.525099 32516 raft_consensus.cc:993] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058: : Instructing follower 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:28.525619 32516 raft_consensus.cc:1081] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Signalling peer 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:28.527453 32202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4092cce7b4f94cd685c153e4eb146a90"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34326
I20260709 12:29:28.528064 32202 raft_consensus.cc:493] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.528441 32202 raft_consensus.cc:3060] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.536545 32202 raft_consensus.cc:515] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.538172 32202 leader_election.cc:290] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:28.539083 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4092cce7b4f94cd685c153e4eb146a90" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:28.539264 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4092cce7b4f94cd685c153e4eb146a90" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:28.539914 32277 raft_consensus.cc:3060] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.539996 32350 raft_consensus.cc:3055] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:28.540449 32350 raft_consensus.cc:740] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:28.541213 32350 consensus_queue.cc:260] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.542325 32350 raft_consensus.cc:3060] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.545814 32277 raft_consensus.cc:2468] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:28.547252 32168 leader_election.cc:304] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 6df360bbccb74065bcf6874dfe187687; no voters: 
I20260709 12:29:28.547483 32350 raft_consensus.cc:2468] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:28.548031 32596 raft_consensus.cc:2804] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:28.548521 32596 raft_consensus.cc:697] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:28.549350 32596 consensus_queue.cc:237] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.556569 32098 catalog_manager.cc:5697] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 1 to 2, leader changed from 8150545344b54f839e178a18a8511058 (127.17.40.3) to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.567771 32554 raft_consensus.cc:993] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240: : Instructing follower 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:28.568298 32502 raft_consensus.cc:1081] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Signalling peer 6df360bbccb74065bcf6874dfe187687 to start an election
I20260709 12:29:28.569875 32202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
 from {username='slave'} at 127.0.0.1:34314
I20260709 12:29:28.570441 32202 raft_consensus.cc:493] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.570753 32202 raft_consensus.cc:3060] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.576010 32202 raft_consensus.cc:515] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.577802 32202 leader_election.cc:290] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Requested vote from peers 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:28.578771 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:28.579025 32350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7cbe75a58645a6a826571706c9c7ce" candidate_uuid: "6df360bbccb74065bcf6874dfe187687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:28.579613 32277 raft_consensus.cc:3055] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:28.579747 32350 raft_consensus.cc:3060] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.580055 32277 raft_consensus.cc:740] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:28.581072 32277 consensus_queue.cc:260] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.582661 32277 raft_consensus.cc:3060] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.584643 32351 raft_consensus.cc:1275] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.586472 32502 consensus_queue.cc:1048] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:28.587028 32350 raft_consensus.cc:2468] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:28.588317 32167 leader_election.cc:304] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:28.589113 32544 raft_consensus.cc:2804] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:28.589601 32544 raft_consensus.cc:697] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Becoming Leader. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:28.590497 32544 consensus_queue.cc:237] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.598922 32544 consensus_queue.cc:1048] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.602212 32098 catalog_manager.cc:5697] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 reported cstate change: term changed from 1 to 2, leader changed from 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2) to 6df360bbccb74065bcf6874dfe187687 (127.17.40.1). New cstate: current_term: 2 leader_uuid: "6df360bbccb74065bcf6874dfe187687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.607388 32202 raft_consensus.cc:1275] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.609907 32277 raft_consensus.cc:2468] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6df360bbccb74065bcf6874dfe187687 in term 2.
I20260709 12:29:28.609791 32554 consensus_queue.cc:1048] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:28.635421 32470 consensus_queue.cc:1048] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:28.644979 32544 raft_consensus.cc:993] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: : Instructing follower 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:28.645529 32470 raft_consensus.cc:1081] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Signalling peer 4d19c5882d9940a38aeab897a4f65240 to start an election
I20260709 12:29:28.647387 32277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0b72663445443c1a410c11abb04b2c7"
dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:29:28.647984 32277 raft_consensus.cc:493] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.648316 32277 raft_consensus.cc:3060] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.654251 32277 raft_consensus.cc:515] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.656085 32277 leader_election.cc:290] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 8150545344b54f839e178a18a8511058 (127.17.40.3:36157)
I20260709 12:29:28.657395 32349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b72663445443c1a410c11abb04b2c7" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8150545344b54f839e178a18a8511058"
I20260709 12:29:28.657395 32202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b72663445443c1a410c11abb04b2c7" candidate_uuid: "4d19c5882d9940a38aeab897a4f65240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:28.658185 32349 raft_consensus.cc:3060] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.658550 32202 raft_consensus.cc:3055] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:28.658864 32202 raft_consensus.cc:740] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:28.659703 32202 consensus_queue.cc:260] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.661013 32202 raft_consensus.cc:3060] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.666280 32349 raft_consensus.cc:2468] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:28.667562 32242 leader_election.cc:304] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d19c5882d9940a38aeab897a4f65240, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:28.668381 32564 raft_consensus.cc:2804] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:28.668695 32202 raft_consensus.cc:2468] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d19c5882d9940a38aeab897a4f65240 in term 2.
I20260709 12:29:28.668875 32564 raft_consensus.cc:697] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Becoming Leader. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:28.669909 32564 consensus_queue.cc:237] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:28.676782 32098 catalog_manager.cc:5697] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 reported cstate change: term changed from 1 to 2, leader changed from 6df360bbccb74065bcf6874dfe187687 (127.17.40.1) to 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2). New cstate: current_term: 2 leader_uuid: "4d19c5882d9940a38aeab897a4f65240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.738027 32277 raft_consensus.cc:1275] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.739414 32470 consensus_queue.cc:1048] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:28.747344 32349 raft_consensus.cc:1275] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.748883 32470 consensus_queue.cc:1048] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:28.886668 32202 raft_consensus.cc:1275] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.888015 32564 consensus_queue.cc:1048] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:28.897024 32349 raft_consensus.cc:1275] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.899438 32564 consensus_queue.cc:1048] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:28.976398 32277 raft_consensus.cc:1275] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.978065 32596 consensus_queue.cc:1048] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:28.978984 32349 raft_consensus.cc:1275] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.980459 32596 consensus_queue.cc:1048] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:28.987644 32351 raft_consensus.cc:1275] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:28.991950 32470 consensus_queue.cc:1048] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:29.006891 32276 raft_consensus.cc:1275] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 6df360bbccb74065bcf6874dfe187687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:29.008550 32596 consensus_queue.cc:1048] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:29.169365 32349 raft_consensus.cc:1275] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:29.170781 32554 consensus_queue.cc:1048] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:29.179930 32202 raft_consensus.cc:1275] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Refusing update from remote peer 4d19c5882d9940a38aeab897a4f65240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:29.181571 32554 consensus_queue.cc:1048] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:31.170100 32098 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45986:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:29:31.192849 32098 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45986:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:29:31.205142 32099 catalog_manager.cc:5789] TS 8150545344b54f839e178a18a8511058 (127.17.40.3:36157) does not have the latest schema for tablet a22546a5c10d49bda05422e90e837631 (table soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]). Expected version 1 got 0
I20260709 12:29:31.246291 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:31.396960 32625 log.cc:927] Time spent T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:29:31.399945 32629 log.cc:927] Time spent T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:29:31.510656 32657 tablet.cc:1724] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.526747 32276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020"
dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
mode: GRACEFUL
new_leader_uuid: "8150545344b54f839e178a18a8511058"
 from {username='slave'} at 127.0.0.1:35052
I20260709 12:29:31.527601 32276 raft_consensus.cc:606] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Received request to transfer leadership to TS 8150545344b54f839e178a18a8511058
I20260709 12:29:31.532965 32098 catalog_manager.cc:5789] TS 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573) does not have the latest schema for tablet 9032a50663924a7287247dabc3005a8a (table soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]). Expected version 1 got 0
I20260709 12:29:31.534090 32098 catalog_manager.cc:5789] TS 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573) does not have the latest schema for tablet ab7cbe75a58645a6a826571706c9c7ce (table soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]). Expected version 1 got 0
I20260709 12:29:31.535914 32098 catalog_manager.cc:5789] TS 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573) does not have the latest schema for tablet 4092cce7b4f94cd685c153e4eb146a90 (table soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]). Expected version 1 got 0
I20260709 12:29:31.540416 32098 catalog_manager.cc:5789] TS 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573) does not have the latest schema for tablet aabf1420b6004260b676898a60afd538 (table soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]). Expected version 1 got 0
I20260709 12:29:31.581957 32666 tablet.cc:1724] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.619551 32665 tablet.cc:1724] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.518640 32653 tablet.cc:1724] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:31.638163 32658 log.cc:927] Time spent T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 12:29:31.667094 32659 log.cc:927] Time spent T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:29:31.673391 32664 tablet.cc:1724] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.704903 32098 catalog_manager.cc:5789] TS 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613) does not have the latest schema for tablet f0b72663445443c1a410c11abb04b2c7 (table soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]). Expected version 1 got 0
I20260709 12:29:31.706125 32098 catalog_manager.cc:5789] TS 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613) does not have the latest schema for tablet 27f1fc97e3ab45f999483cad10f00adb (table soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]). Expected version 1 got 0
I20260709 12:29:31.706962 32098 catalog_manager.cc:5789] TS 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613) does not have the latest schema for tablet f3260ed557264b14876daaa57a2cb2ea (table soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0]). Expected version 1 got 0
I20260709 12:29:31.739866 32675 tablet.cc:1724] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.769901 32666 tablet.cc:1724] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.773139 32670 tablet.cc:1724] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.774710 32674 tablet.cc:1724] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.778949 32202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5"
dest_uuid: "6df360bbccb74065bcf6874dfe187687"
mode: GRACEFUL
new_leader_uuid: "8150545344b54f839e178a18a8511058"
 from {username='slave'} at 127.0.0.1:43940
I20260709 12:29:31.779706 32202 raft_consensus.cc:606] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 3 LEADER]: Received request to transfer leadership to TS 8150545344b54f839e178a18a8511058
I20260709 12:29:31.780812 32673 tablet.cc:1724] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.782366 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:31.783275 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:31.787572 32676 tablet.cc:1724] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.755782 32669 tablet.cc:1724] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.708822 32662 tablet.cc:1724] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.791535 32657 tablet.cc:1724] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:31.799993 32668 log.cc:927] Time spent T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:29:31.808722 32666 tablet.cc:1724] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.819391 32670 tablet.cc:1724] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.825135 32607 raft_consensus.cc:993] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240: : Instructing follower 8150545344b54f839e178a18a8511058 to start an election
I20260709 12:29:31.825928 32644 raft_consensus.cc:1081] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Signalling peer 8150545344b54f839e178a18a8511058 to start an election
I20260709 12:29:31.846489 32348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020"
dest_uuid: "8150545344b54f839e178a18a8511058"
 from {username='slave'} at 127.0.0.1:34734
I20260709 12:29:31.847504 32348 raft_consensus.cc:493] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:31.848071 32348 raft_consensus.cc:3060] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:31.857880 32653 tablet.cc:1724] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.864265 32666 tablet.cc:1724] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.866923 32670 tablet.cc:1724] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.873103 32664 tablet.cc:1724] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.885073 32675 tablet.cc:1724] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.903141 32657 tablet.cc:1719] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:29:31.905887 32666 tablet.cc:1724] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.896819 32348 raft_consensus.cc:515] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:31.916137 32348 leader_election.cc:290] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 2 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:31.899559 32670 tablet.cc:1719] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:29:31.920840 32670 tablet.cc:1724] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.917279 32201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:31.917488 32653 tablet.cc:1724] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.923205 32201 raft_consensus.cc:3060] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:31.854822 32665 tablet.cc:1724] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.939818 32201 raft_consensus.cc:2468] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 2.
I20260709 12:29:31.941264 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f81d8b0dff94305a099ce806b8d7020" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:31.941654 32316 leader_election.cc:304] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:31.943127 32516 raft_consensus.cc:2804] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:31.942819 32662 tablet.cc:1724] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.943724 32516 raft_consensus.cc:697] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:31.944767 32516 consensus_queue.cc:237] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:31.945993 32275 raft_consensus.cc:3055] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:31.946445 32275 raft_consensus.cc:740] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d19c5882d9940a38aeab897a4f65240, State: Running, Role: LEADER
I20260709 12:29:31.947316 32275 consensus_queue.cc:260] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:31.953907 32275 raft_consensus.cc:3060] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:31.953944 32664 tablet.cc:1719] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:29:31.961321 32635 raft_consensus.cc:993] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687: : Instructing follower 8150545344b54f839e178a18a8511058 to start an election
I20260709 12:29:31.961999 32639 raft_consensus.cc:1081] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 3 LEADER]: Signalling peer 8150545344b54f839e178a18a8511058 to start an election
I20260709 12:29:31.964250 32348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5"
dest_uuid: "8150545344b54f839e178a18a8511058"
 from {username='slave'} at 127.0.0.1:34744
I20260709 12:29:31.964936 32348 raft_consensus.cc:493] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:31.965348 32348 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:31.974699 32670 tablet.cc:1724] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:31.981824 32348 raft_consensus.cc:515] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:31.985109 32348 leader_election.cc:290] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 4 election: Requested vote from peers 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573), 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613)
I20260709 12:29:31.985836 32201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6df360bbccb74065bcf6874dfe187687"
I20260709 12:29:31.986478 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa0bb4c884b489596097064f0bf79f5" candidate_uuid: "8150545344b54f839e178a18a8511058" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4d19c5882d9940a38aeab897a4f65240"
I20260709 12:29:31.986656 32201 raft_consensus.cc:3055] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:31.987195 32277 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:31.987152 32201 raft_consensus.cc:740] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6df360bbccb74065bcf6874dfe187687, State: Running, Role: LEADER
I20260709 12:29:31.988272 32201 consensus_queue.cc:260] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:31.989675 32098 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c: soft_deleted_table [id=2bd6f822cb1540cf9137d99fdac595b0] alter complete (version 1)
I20260709 12:29:31.989754 32201 raft_consensus.cc:3060] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:32.001617 32201 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 4.
I20260709 12:29:32.002122 32275 raft_consensus.cc:2468] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 2.
I20260709 12:29:32.003966 32316 leader_election.cc:304] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6df360bbccb74065bcf6874dfe187687, 8150545344b54f839e178a18a8511058; no voters: 
I20260709 12:29:32.005151 32608 raft_consensus.cc:2804] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:32.005695 32608 raft_consensus.cc:697] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 4 LEADER]: Becoming Leader. State: Replica: 8150545344b54f839e178a18a8511058, State: Running, Role: LEADER
I20260709 12:29:32.006623 32608 consensus_queue.cc:237] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } }
I20260709 12:29:32.015084 32098 catalog_manager.cc:5697] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 1 to 2, leader changed from 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2) to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 2 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:32.015545 32277 raft_consensus.cc:2468] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150545344b54f839e178a18a8511058 in term 4.
I20260709 12:29:32.031422 32098 catalog_manager.cc:5697] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 reported cstate change: term changed from 3 to 4, leader changed from 6df360bbccb74065bcf6874dfe187687 (127.17.40.1) to 8150545344b54f839e178a18a8511058 (127.17.40.3). New cstate: current_term: 4 leader_uuid: "8150545344b54f839e178a18a8511058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8150545344b54f839e178a18a8511058" member_type: VOTER last_known_addr { host: "127.17.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:32.395450 32201 raft_consensus.cc:1275] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 4 FOLLOWER]: Refusing update from remote peer 8150545344b54f839e178a18a8511058: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:32.396771 32608 consensus_queue.cc:1048] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:32.411861 32275 raft_consensus.cc:1275] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 4 FOLLOWER]: Refusing update from remote peer 8150545344b54f839e178a18a8511058: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:32.413371 32660 consensus_queue.cc:1048] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:32.492486 32275 raft_consensus.cc:1275] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Refusing update from remote peer 8150545344b54f839e178a18a8511058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:32.493945 32660 consensus_queue.cc:1048] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d19c5882d9940a38aeab897a4f65240" member_type: VOTER last_known_addr { host: "127.17.40.2" port: 43613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:32.503748 32201 raft_consensus.cc:1275] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Refusing update from remote peer 8150545344b54f839e178a18a8511058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:32.508152 32608 consensus_queue.cc:1048] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df360bbccb74065bcf6874dfe187687" member_type: VOTER last_known_addr { host: "127.17.40.1" port: 41573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:32.785172 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:32.791383 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:32.791961 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:33.793045 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:33.798519 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:33.799072 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:34.800407 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:34.806564 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:34.807062 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:35.808336 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:35.815059 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:35.815572 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:36.816619 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:36.822696 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:36.823256 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:37.824333 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:37.831720 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:37.832350 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:38.833338 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:38.839411 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:38.840049 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:39.841136 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:39.846719 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:39.847349 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:40.848459 17568 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:40.854728 17568 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:40.855258 17568 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:41.920081 17568 tablet_server.cc:179] TabletServer@127.17.40.1:0 shutting down...
W20260709 12:29:41.961051 32242 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 12:29:41.964589 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:41.965735 17568 tablet_replica.cc:333] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
W20260709 12:29:41.966557 32242 consensus_peers.cc:597] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 -> Peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Couldn't send request to peer 6df360bbccb74065bcf6874dfe187687. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:41.967470 17568 raft_consensus.cc:2243] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.968353 17568 raft_consensus.cc:2272] T a22546a5c10d49bda05422e90e837631 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.971354 17568 tablet_replica.cc:333] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:41.972016 17568 raft_consensus.cc:2243] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.972929 17568 raft_consensus.cc:2272] T 9032a50663924a7287247dabc3005a8a P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.975554 17568 tablet_replica.cc:333] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:41.976317 17568 raft_consensus.cc:2243] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.976925 17568 raft_consensus.cc:2272] T f0b72663445443c1a410c11abb04b2c7 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.980579 17568 tablet_replica.cc:333] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:41.981304 17568 raft_consensus.cc:2243] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.982097 17568 raft_consensus.cc:2272] T f3260ed557264b14876daaa57a2cb2ea P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:41.982117 32242 consensus_peers.cc:597] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 -> Peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Couldn't send request to peer 6df360bbccb74065bcf6874dfe187687. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:41.985334 17568 tablet_replica.cc:333] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:41.986218 17568 raft_consensus.cc:2243] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:41.987502 17568 raft_consensus.cc:2272] T ab7cbe75a58645a6a826571706c9c7ce P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.991192 17568 tablet_replica.cc:333] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:41.991981 17568 raft_consensus.cc:2243] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.992692 17568 raft_consensus.cc:2272] T 99ead4b9dd744903ac17169ad0b0c02a P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:41.996034 17568 tablet_replica.cc:333] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:41.997267 17568 raft_consensus.cc:2243] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:41.998212 17568 raft_consensus.cc:2272] T 5f81d8b0dff94305a099ce806b8d7020 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.002983 17568 tablet_replica.cc:333] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.003768 17568 raft_consensus.cc:2243] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.004570 17568 raft_consensus.cc:2272] T 8aa0bb4c884b489596097064f0bf79f5 P 6df360bbccb74065bcf6874dfe187687 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.008306 17568 tablet_replica.cc:333] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.008975 17568 raft_consensus.cc:2243] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.009557 17568 raft_consensus.cc:2272] T eaecbfb45f43413bab6668024b58b5ed P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.012326 17568 tablet_replica.cc:333] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.013026 17568 raft_consensus.cc:2243] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.013650 17568 raft_consensus.cc:2272] T f6269385447741a78b60510b9318dee1 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.016398 17568 tablet_replica.cc:333] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.017057 17568 raft_consensus.cc:2243] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.017612 17568 raft_consensus.cc:2272] T 77ad699d9aa749ca962699ee67454652 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.020174 17568 tablet_replica.cc:333] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.020792 17568 raft_consensus.cc:2243] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.021404 17568 raft_consensus.cc:2272] T 27f1fc97e3ab45f999483cad10f00adb P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.024042 17568 tablet_replica.cc:333] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.024689 17568 raft_consensus.cc:2243] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.025712 17568 raft_consensus.cc:2272] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.029470 17568 tablet_replica.cc:333] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.030467 17568 raft_consensus.cc:2243] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.031841 17568 raft_consensus.cc:2272] T 4092cce7b4f94cd685c153e4eb146a90 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:42.033246 32316 consensus_peers.cc:597] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 -> Peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Couldn't send request to peer 6df360bbccb74065bcf6874dfe187687. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:42.035816 17568 tablet_replica.cc:333] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.036538 17568 raft_consensus.cc:2243] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.037510 17568 raft_consensus.cc:2272] T b2881224b4a9483784d2fc3506e15efb P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.040282 17568 tablet_replica.cc:333] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.040897 17568 raft_consensus.cc:2243] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.041993 17568 raft_consensus.cc:2272] T 2e604421633a4d83a4f915b89dc8cb73 P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.044641 17568 tablet_replica.cc:333] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.045272 17568 raft_consensus.cc:2243] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.046207 17568 raft_consensus.cc:2272] T aabf1420b6004260b676898a60afd538 P 6df360bbccb74065bcf6874dfe187687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.048797 17568 tablet_replica.cc:333] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687: stopping tablet replica
I20260709 12:29:42.049367 17568 raft_consensus.cc:2243] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.049943 17568 raft_consensus.cc:2272] T a8b4429f78694eabba75c370968d892f P 6df360bbccb74065bcf6874dfe187687 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:42.093377 32242 consensus_peers.cc:597] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 -> Peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Couldn't send request to peer 6df360bbccb74065bcf6874dfe187687. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:41573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:42.102006 17568 tablet_server.cc:196] TabletServer@127.17.40.1:0 shutdown complete.
W20260709 12:29:42.117057 32242 consensus_peers.cc:597] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 -> Peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Couldn't send request to peer 6df360bbccb74065bcf6874dfe187687. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:41573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:42.120620 32316 consensus_peers.cc:597] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 -> Peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Couldn't send request to peer 6df360bbccb74065bcf6874dfe187687. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:41573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:42.155443 17568 tablet_server.cc:179] TabletServer@127.17.40.2:0 shutting down...
W20260709 12:29:42.168915 32317 consensus_peers.cc:597] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 -> Peer 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613): Couldn't send request to peer 4d19c5882d9940a38aeab897a4f65240. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:42.187678 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:42.188771 17568 tablet_replica.cc:333] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.189782 17568 raft_consensus.cc:2243] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.190474 17568 raft_consensus.cc:2272] T 9032a50663924a7287247dabc3005a8a P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.193120 17568 tablet_replica.cc:333] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.193809 17568 raft_consensus.cc:2243] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.194622 17568 raft_consensus.cc:2272] T a22546a5c10d49bda05422e90e837631 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.197284 17568 tablet_replica.cc:333] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.197968 17568 raft_consensus.cc:2243] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.199018 17568 raft_consensus.cc:2272] T 99ead4b9dd744903ac17169ad0b0c02a P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.201483 17568 tablet_replica.cc:333] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.202173 17568 raft_consensus.cc:2243] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.203253 17568 raft_consensus.cc:2272] T f0b72663445443c1a410c11abb04b2c7 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.205788 17568 tablet_replica.cc:333] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.206516 17568 raft_consensus.cc:2243] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.207471 17568 raft_consensus.cc:2272] T f3260ed557264b14876daaa57a2cb2ea P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.209921 17568 tablet_replica.cc:333] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.210637 17568 raft_consensus.cc:2243] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.211244 17568 raft_consensus.cc:2272] T ab7cbe75a58645a6a826571706c9c7ce P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.213653 17568 tablet_replica.cc:333] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.214288 17568 raft_consensus.cc:2243] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.215372 17568 raft_consensus.cc:2272] T eaecbfb45f43413bab6668024b58b5ed P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.217979 17568 tablet_replica.cc:333] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.218677 17568 raft_consensus.cc:2243] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.219261 17568 raft_consensus.cc:2272] T f6269385447741a78b60510b9318dee1 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.221846 17568 tablet_replica.cc:333] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.222535 17568 raft_consensus.cc:2243] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.223042 17568 raft_consensus.cc:2272] T 5f81d8b0dff94305a099ce806b8d7020 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.225386 17568 tablet_replica.cc:333] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.226071 17568 raft_consensus.cc:2243] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.226639 17568 raft_consensus.cc:2272] T aabf1420b6004260b676898a60afd538 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.229077 17568 tablet_replica.cc:333] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.229703 17568 raft_consensus.cc:2243] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.230707 17568 raft_consensus.cc:2272] T a8b4429f78694eabba75c370968d892f P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.233392 17568 tablet_replica.cc:333] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.234071 17568 raft_consensus.cc:2243] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.234663 17568 raft_consensus.cc:2272] T 4092cce7b4f94cd685c153e4eb146a90 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.237049 17568 tablet_replica.cc:333] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.237627 17568 raft_consensus.cc:2243] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.238145 17568 raft_consensus.cc:2272] T b2881224b4a9483784d2fc3506e15efb P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.240716 17568 tablet_replica.cc:333] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.241343 17568 raft_consensus.cc:2243] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.241899 17568 raft_consensus.cc:2272] T 2e604421633a4d83a4f915b89dc8cb73 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.244191 17568 tablet_replica.cc:333] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.244781 17568 raft_consensus.cc:2243] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.245759 17568 raft_consensus.cc:2272] T 27f1fc97e3ab45f999483cad10f00adb P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.248075 17568 tablet_replica.cc:333] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.248575 17568 raft_consensus.cc:2243] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.249012 17568 raft_consensus.cc:2272] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 4d19c5882d9940a38aeab897a4f65240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.251434 17568 tablet_replica.cc:333] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.251965 17568 raft_consensus.cc:2243] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.252444 17568 raft_consensus.cc:2272] T 8aa0bb4c884b489596097064f0bf79f5 P 4d19c5882d9940a38aeab897a4f65240 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.254837 17568 tablet_replica.cc:333] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240: stopping tablet replica
I20260709 12:29:42.255353 17568 raft_consensus.cc:2243] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.256307 17568 raft_consensus.cc:2272] T 77ad699d9aa749ca962699ee67454652 P 4d19c5882d9940a38aeab897a4f65240 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:42.268460 32317 consensus_peers.cc:597] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 -> Peer 4d19c5882d9940a38aeab897a4f65240 (127.17.40.2:43613): Couldn't send request to peer 4d19c5882d9940a38aeab897a4f65240. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:42.304450 17568 tablet_server.cc:196] TabletServer@127.17.40.2:0 shutdown complete.
I20260709 12:29:42.347314 17568 tablet_server.cc:179] TabletServer@127.17.40.3:0 shutting down...
W20260709 12:29:42.375028 32316 consensus_peers.cc:597] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 -> Peer 6df360bbccb74065bcf6874dfe187687 (127.17.40.1:41573): Couldn't send request to peer 6df360bbccb74065bcf6874dfe187687. Status: Network error: Client connection negotiation failed: client connection to 127.17.40.1:41573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:42.380626 17568 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:42.381474 17568 tablet_replica.cc:333] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.382329 17568 raft_consensus.cc:2243] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.383426 17568 raft_consensus.cc:2272] T a22546a5c10d49bda05422e90e837631 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.385916 17568 tablet_replica.cc:333] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.386628 17568 raft_consensus.cc:2243] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.387279 17568 raft_consensus.cc:2272] T 99ead4b9dd744903ac17169ad0b0c02a P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.389750 17568 tablet_replica.cc:333] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.390477 17568 raft_consensus.cc:2243] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.391047 17568 raft_consensus.cc:2272] T f0b72663445443c1a410c11abb04b2c7 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.393406 17568 tablet_replica.cc:333] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.394048 17568 raft_consensus.cc:2243] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.394645 17568 raft_consensus.cc:2272] T ab7cbe75a58645a6a826571706c9c7ce P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.396888 17568 tablet_replica.cc:333] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.397472 17568 raft_consensus.cc:2243] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.397989 17568 raft_consensus.cc:2272] T f3260ed557264b14876daaa57a2cb2ea P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.400440 17568 tablet_replica.cc:333] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.401050 17568 raft_consensus.cc:2243] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.401589 17568 raft_consensus.cc:2272] T aabf1420b6004260b676898a60afd538 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.404034 17568 tablet_replica.cc:333] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.404680 17568 raft_consensus.cc:2243] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.405246 17568 raft_consensus.cc:2272] T a8b4429f78694eabba75c370968d892f P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.407685 17568 tablet_replica.cc:333] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.408361 17568 raft_consensus.cc:2243] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.409354 17568 raft_consensus.cc:2272] T 5f81d8b0dff94305a099ce806b8d7020 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.412070 17568 tablet_replica.cc:333] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.412729 17568 raft_consensus.cc:2243] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.413686 17568 raft_consensus.cc:2272] T 8aa0bb4c884b489596097064f0bf79f5 P 8150545344b54f839e178a18a8511058 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.416136 17568 tablet_replica.cc:333] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.416754 17568 raft_consensus.cc:2243] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.417649 17568 raft_consensus.cc:2272] T f6269385447741a78b60510b9318dee1 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.420058 17568 tablet_replica.cc:333] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.420674 17568 raft_consensus.cc:2243] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.421152 17568 raft_consensus.cc:2272] T eaecbfb45f43413bab6668024b58b5ed P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.423452 17568 tablet_replica.cc:333] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.424067 17568 raft_consensus.cc:2243] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.424573 17568 raft_consensus.cc:2272] T 9032a50663924a7287247dabc3005a8a P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.426878 17568 tablet_replica.cc:333] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.427460 17568 raft_consensus.cc:2243] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.427950 17568 raft_consensus.cc:2272] T 27f1fc97e3ab45f999483cad10f00adb P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.430197 17568 tablet_replica.cc:333] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.430814 17568 raft_consensus.cc:2243] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.431310 17568 raft_consensus.cc:2272] T a8ff28cd78a14a4ea7c5a3ee8c75b9a1 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.433729 17568 tablet_replica.cc:333] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.434303 17568 raft_consensus.cc:2243] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.434864 17568 raft_consensus.cc:2272] T 2e604421633a4d83a4f915b89dc8cb73 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.437105 17568 tablet_replica.cc:333] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.437686 17568 raft_consensus.cc:2243] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.438190 17568 raft_consensus.cc:2272] T b2881224b4a9483784d2fc3506e15efb P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.440467 17568 tablet_replica.cc:333] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.441071 17568 raft_consensus.cc:2243] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.441622 17568 raft_consensus.cc:2272] T 4092cce7b4f94cd685c153e4eb146a90 P 8150545344b54f839e178a18a8511058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.444092 17568 tablet_replica.cc:333] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058: stopping tablet replica
I20260709 12:29:42.444626 17568 raft_consensus.cc:2243] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:42.445147 17568 raft_consensus.cc:2272] T 77ad699d9aa749ca962699ee67454652 P 8150545344b54f839e178a18a8511058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.488708 17568 tablet_server.cc:196] TabletServer@127.17.40.3:0 shutdown complete.
I20260709 12:29:42.527527 17568 master.cc:562] Master@127.17.40.62:33669 shutting down...
I20260709 12:29:42.555543 17568 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:42.556303 17568 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:42.556665 17568 tablet_replica.cc:333] T 00000000000000000000000000000000 P a6ef40822b2c4ddd8a0531e5ce2e279c: stopping tablet replica
I20260709 12:29:42.578960 17568 master.cc:584] Master@127.17.40.62:33669 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (22334 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43311 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (493955 ms total)
[  PASSED  ] 8 tests.
I20260709 12:29:42.640419 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2212 messages since previous log ~33 seconds ago
I20260709 12:29:42.640690 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2212 messages since previous log ~33 seconds ago
I20260709 12:29:42.640897 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2210 messages since previous log ~33 seconds ago
I20260709 12:29:42.641110 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~52 seconds ago
I20260709 12:29:42.641317 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~52 seconds ago
I20260709 12:29:42.641525 17568 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~164 seconds ago
I20260709 12:29:42.641729 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~164 seconds ago
I20260709 12:29:42.641957 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~145 seconds ago
I20260709 12:29:42.642241 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 12:29:42.642696 17568 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
